00010000:00010000:0.0:1746147185.133151:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e3fc00/0x313993942505dc5f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c15a expref: 21 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.133172:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e3fc00/0x313993942505dc5f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c15a expref: 21 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.133196:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3fc00, rc 0) 00000100:00100000:0.0:1746147185.133250:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2002:x1830967309570048:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 12261us (13248us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147185.133259:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17760 00000100:00100000:0.0:1746147185.133334:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.133353:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309571072 00000100:00100000:0.0:1746147185.133359:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309571072 00000100:00100000:0.0:1746147185.133384:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17767 00000100:00100000:0.0:1746147185.133390:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:1940:x1830967309571072:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147185.133403:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.133418:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x313993942505dc74 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c184 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.133440:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009400b000/0x313993942505db78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c0f1 expref: 34 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.133447:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147185.133449:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147185.133452:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x313993942505dc74 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c184 expref: 41 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.133478:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009400b000/0x313993942505db78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c0f1 expref: 34 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.133493:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009400b000/0x313993942505db78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c0f1 expref: 34 pid: 12201 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746147185.133504:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311147648:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147185.133555:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.134442:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.135987:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.139531:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311147648:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147185.139554:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x313993942505dc74 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c184 expref: 41 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.139565:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56000, rc 0) 00000100:00100000:0.0:1746147185.139624:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:1940:x1830967309571072:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6233us (6289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.139631:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17767 00000100:00100000:0.0:1746147185.139719:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2002:x1830967309570944:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 10151us (10238us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147185.139727:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6404 00002000:00100000:0.0:1746147185.139734:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88012fffc380 x1830967309570944/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.139742:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fffc380 with x1830967309570944 ext(0->1048575) 00002000:00010000:0.0:1746147185.139746:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fffc380 00000100:00100000:0.0:1746147185.139759:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1465 00000100:00100000:0.0:1746147185.139765:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2000:x1830967309571456:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147185.139964:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.139985:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309571712 00000100:00100000:0.0:1746147185.139989:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309571712 00000100:00100000:0.0:1746147185.140018:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16021 00000100:00100000:0.0:1746147185.140023:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:1947:x1830967309571712:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147185.140033:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.140049:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3f600/0x313993942505dc7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c18b expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.140172:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57200/0x313993942505dc82 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.140184:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7000/0x313993942505db9b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c0ff expref: 35 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.140192:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x313993942505dbe8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c122 expref: 15 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.140198:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ec00/0x313993942505dc3c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c14c expref: 12 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.140205:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57200/0x313993942505dc82 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.140224:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ec00/0x313993942505dc3c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c14c expref: 12 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.140234:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ec00/0x313993942505dc3c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c14c expref: 12 pid: 7237 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746147185.140244:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311147904:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147185.140283:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x313993942505dbe8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c122 expref: 15 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.140291:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x313993942505dbe8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c122 expref: 15 pid: 9138 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746147185.140298:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098859500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311148032:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147185.140320:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7000/0x313993942505db9b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c0ff expref: 35 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.140327:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7000/0x313993942505db9b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c0ff expref: 35 pid: 9138 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746147185.140334:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098859f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311148160:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147185.140347:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.146064:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2000:x1830967309571456:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 6289us (8111us total) trans 21474842196 rc 0/0 00000100:00100000:0.0:1746147185.146077:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1465 00002000:00100000:0.0:1746147185.146118:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2445311) req@ffff88012fffdf80 x1830967309571456/t21474842196(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:561/0 lens 488/448 e 0 to 0 dl 1746147196 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.146128:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fffdf80 with x1830967309571456 ext(2097152->2445311) 00010000:00010000:0.0:1746147185.146150:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009400b000/0x313993942505db78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c0f1 expref: 34 pid: 12201 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.146418:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009400b000/0x313993942505db78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c0f1 expref: 34 pid: 12201 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746147185.146426:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fffdf80 00000100:00100000:0.0:1746147185.146765:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098859f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311148160:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147185.146787:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57200/0x313993942505dc82 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147185.149636:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309572480 00000100:00100000:0.0:1746147185.149642:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309572480 00000100:00100000:0.0:1746147185.149675:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17768 00000100:00100000:0.0:1746147185.149682:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:1946:x1830967309572480:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147185.149695:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.149710:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x313993942505dc90 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c192 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.149737:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0e00/0x313993942505dbbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->2088959) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c10d expref: 40 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.149744:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147185.149746:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147185.149749:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x313993942505dc90 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c192 expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.149774:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0e00/0x313993942505dbbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->2088959) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c10d expref: 40 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.149789:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0e00/0x313993942505dbbe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->2088959) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c10d expref: 40 pid: 12201 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746147185.149800:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098859f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311148288:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147185.149871:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.153413:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.154165:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.156257:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098859f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311148288:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147185.156280:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x313993942505dc90 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c192 expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.156291:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7e00, rc 0) 00000100:00100000:0.0:1746147185.156320:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:1946:x1830967309572480:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6638us (6905us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.156328:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17768 00000100:00100000:0.0:1746147185.156461:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.162830:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.167845:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.169963:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.170009:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.170670:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.170702:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.171359:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.171377:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309574272 00000100:00100000:0.0:1746147185.171381:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309574272 00010000:00010000:0.0:1746147185.171398:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0e00/0x313993942505dbbe lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1974272->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c10d expref: 43 pid: 12201 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746147185.171414:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7958 00000100:00100000:0.0:1746147185.171418:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967309574272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.171426:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.171443:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0e00/0x313993942505dbbe lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1974272->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c10d expref: 43 pid: 12201 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.171453:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0e00/0x313993942505dbbe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1974272->2088959) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c10d expref: 43 pid: 12201 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.171470:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.171471:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.171476:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x313993942505dc90 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c192 expref: 26 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.171483:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x313993942505dc90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c192 expref: 26 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.171502:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x313993942505dc90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c192 expref: 26 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.171511:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e6e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311148928:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147185.171535:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.177395:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e6e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311148928:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147185.177408:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.177429:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967309574272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6009us (6069us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.177437:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7958 00000100:00100000:0.0:1746147185.182066:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.182159:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.186755:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.187293:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309575040 00000100:00100000:0.0:1746147185.187297:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309575040 00002000:00100000:0.0:1746147185.187321:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880094e59880 x1830967309575040/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:561/0 lens 504/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.187330:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e59880 with x1830967309575040 ext(1048576->2097151) 00002000:00010000:0.0:1746147185.187335:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e59880 00000100:00100000:0.0:1746147185.187348:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6410 00000100:00100000:0.0:1746147185.187353:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2002:x1830967309575040:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147185.193056:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967309573504:12345-192.168.204.25@tcp:3:cat.0 Request processed in 24294us (25198us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746147185.193069:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6407 00002000:00100000:0.0:1746147185.193082:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880129f55c00 x1830967309573504/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.193107:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55c00 with x1830967309573504 ext(2097152->4194303) 00002000:00010000:0.0:1746147185.193112:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f55c00 00000100:00100000:0.0:1746147185.199963:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.199999:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.200023:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.200038:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.200063:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.200077:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309575680 00000100:00100000:0.0:1746147185.200079:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309575680 00000100:00100000:0.0:1746147185.200201:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309575552 00000100:00100000:0.0:1746147185.200204:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309575552 00000100:00100000:0.0:1746147185.200398:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17774 00000100:00100000:0.0:1746147185.200404:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+29:2000:x1830967309575936:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147185.200419:0:12201:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097cd3400/0x313993942505dcdd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.200427:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x313993942505dc74 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c184 expref: 39 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.200435:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009844ac00/0x313993942505dcb3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1ae expref: 29 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.200440:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.200441:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.200442:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cd3400/0x313993942505dcdd lrc: 5/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.200454:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009844ac00/0x313993942505dcb3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1ae expref: 29 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.200460:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009844ac00/0x313993942505dcb3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1ae expref: 29 pid: 9586 timeout: 823 lvb_type: 1 00000100:00100000:0.0:1746147185.200467:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a496e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311149312:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147185.200734:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x313993942505dc74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c184 expref: 39 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.200742:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a56000/0x313993942505dc74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c184 expref: 39 pid: 9585 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746147185.200749:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a496ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311149824:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147185.200762:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.200790:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.208738:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a496e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311149312:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147185.209416:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a496ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311149824:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147185.209439:0:12201:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097cd3400/0x313993942505dcdd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.211049:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.211118:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.211147:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.211316:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.211332:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.211343:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.211355:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.211754:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.211764:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309576192 00000100:00100000:0.0:1746147185.211766:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309576192 00010000:00010000:0.0:1746147185.211777:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f239e00/0x313993942505dc43 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c153 expref: 30 pid: 9584 timeout: 823 lvb_type: 1 00000100:00100000:0.0:1746147185.211793:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7962 00000100:00100000:0.0:1746147185.211797:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+30:2003:x1830967309576192:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.211802:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.211809:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f239e00/0x313993942505dc43 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c153 expref: 30 pid: 9584 timeout: 823 lvb_type: 1 00010000:00010000:0.0:1746147185.211816:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f239e00/0x313993942505dc43 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c153 expref: 30 pid: 9584 timeout: 823 lvb_type: 1 00010000:00010000:0.0:1746147185.211826:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f239e00/0x313993942505dc43 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c153 expref: 30 pid: 9584 timeout: 823 lvb_type: 1 00010000:00010000:0.0:1746147185.211838:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.211850:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+29:2003:x1830967309576192:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 52us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.211855:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7962 00000100:00100000:0.0:1746147185.211899:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.212252:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309577216 00000100:00100000:0.0:1746147185.212255:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309577216 00000100:00100000:0.0:1746147185.212264:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309577472 00000100:00100000:0.0:1746147185.212266:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309577472 00000100:00100000:0.0:1746147185.212275:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17778 00000100:00100000:0.0:1746147185.212280:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a496ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967309577088:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147185.212293:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.212302:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x313993942505dcf9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c1bc expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.212314:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.212320:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x313993942505dcf9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1bc expref: 42 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.212329:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x313993942505dcf9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1bc expref: 42 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.212335:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38ce00, rc 0) 00000100:00100000:0.0:1746147185.212351:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a496ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967309577088:12345-192.168.204.25@tcp:101:cat.0 Request processed in 71us (1035us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147185.212356:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17778 00000100:00100000:0.0:1746147185.212365:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17780 00000100:00100000:0.0:1746147185.212369:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a496d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967309577344:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147185.212374:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.212380:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x313993942505dd07 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c1ca expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.212389:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.212393:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x313993942505dd07 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1ca expref: 42 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.212399:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38cc00/0x313993942505dd07 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1ca expref: 42 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.212406:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38cc00, rc 0) 00000100:00100000:0.0:1746147185.212417:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a496d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967309577344:12345-192.168.204.25@tcp:101:cat.0 Request processed in 48us (1074us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147185.212422:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17780 00000100:00100000:0.0:1746147185.212430:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17782 00000100:00100000:0.0:1746147185.212433:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967309577600:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147185.212437:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.212443:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x313993942505dd15 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c1d8 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.212451:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.212455:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x313993942505dd15 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1d8 expref: 42 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.212462:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x313993942505dd15 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1d8 expref: 42 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.212469:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38d200, rc 0) 00000100:00100000:0.0:1746147185.212480:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967309577600:12345-192.168.204.25@tcp:101:cat.0 Request processed in 46us (582us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147185.212485:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17782 00000100:00100000:0.0:1746147185.212514:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.212536:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.212555:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.212614:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fffd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311150464:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147185.212632:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942505dcd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.212707:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.212720:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.212730:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309576320 00000100:00100000:0.0:1746147185.212732:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309576320 00010000:00010000:0.0:1746147185.212743:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009844ac00/0x313993942505dcb3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1ae expref: 29 pid: 9586 timeout: 823 lvb_type: 1 00000100:00100000:0.0:1746147185.212757:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309576832 00000100:00100000:0.0:1746147185.212759:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309576832 00010000:00010000:0.0:1746147185.212767:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x313993942505dc20 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c145 expref: 34 pid: 1136 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746147185.212777:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309577728 00000100:00100000:0.0:1746147185.212779:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309577728 00010000:00010000:0.0:1746147185.212787:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3f800/0x313993942505dad0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c081 expref: 27 pid: 9584 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746147185.212795:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309577856 00000100:00100000:0.0:1746147185.212797:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309577856 00010000:00010000:0.0:1746147185.212803:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38c800/0x313993942505dc66 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c176 expref: 22 pid: 13695 timeout: 823 lvb_type: 1 00000100:00100000:0.0:1746147185.212812:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7963 00000100:00100000:0.0:1746147185.212816:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+29:2003:x1830967309576320:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.212822:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.212828:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009844ac00/0x313993942505dcb3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1ae expref: 29 pid: 9586 timeout: 823 lvb_type: 1 00010000:00010000:0.0:1746147185.212840:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009844ac00/0x313993942505dcb3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1ae expref: 29 pid: 9586 timeout: 823 lvb_type: 1 00010000:00010000:0.0:1746147185.212852:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009844ac00/0x313993942505dcb3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1ae expref: 29 pid: 9586 timeout: 823 lvb_type: 1 00010000:00010000:0.0:1746147185.212860:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.212862:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.212866:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cd3400/0x313993942505dcdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.212874:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cd3400/0x313993942505dcdd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.212889:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.212907:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+28:2003:x1830967309576320:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 90us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.212912:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7963 00000100:00100000:0.0:1746147185.212921:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7964 00000100:00100000:0.0:1746147185.212926:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2003:x1830967309576832:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.212932:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.212939:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x313993942505dc20 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c145 expref: 34 pid: 1136 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.212946:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x313993942505dc20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c145 expref: 34 pid: 1136 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.212961:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x313993942505dc20 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c145 expref: 34 pid: 1136 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.212968:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.212969:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.212972:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x313993942505dccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.212977:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffaa00/0x313993942505dccf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.212989:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.213002:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2003:x1830967309576832:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 75us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.213007:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7964 00000100:00100000:0.0:1746147185.213017:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7965 00000100:00100000:0.0:1746147185.213021:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2003:x1830967309577728:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.213027:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.213036:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e3f800/0x313993942505dad0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c081 expref: 27 pid: 9584 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.213043:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e3f800/0x313993942505dad0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c081 expref: 27 pid: 9584 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.213053:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e3f800/0x313993942505dad0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c081 expref: 27 pid: 9584 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.213065:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.213074:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2003:x1830967309577728:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 53us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.213079:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7965 00010000:00010000:0.0:1746147185.213127:0:12201:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097cd3400/0x313993942505dcdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.213145:0:12201:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cd3400/0x313993942505dcdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.213163:0:12201:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097cd3400/0x313993942505dcdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.213171:0:12201:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097cd3400/0x313993942505dcdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.213178:0:12201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097cd3400/0x313993942505dcdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.213184:0:12201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097cd3400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147185.213188:0:12201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097cd3400/0x313993942505dcdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.213196:0:12201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097cd3400/0x313993942505dcdd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.213209:0:12201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097cd3400/0x313993942505dcdd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.213215:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cd3400/0x313993942505dcdd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.213245:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+27:2000:x1830967309575936:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 12841us (13221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.213250:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17774 00000100:00100000:0.0:1746147185.213276:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.213303:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.213661:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.213677:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.213872:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7968 00000100:00100000:0.0:1746147185.213878:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2003:x1830967309578112:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.213885:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.213894:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e3f000/0x313993942505dac9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c07a expref: 41 pid: 9586 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.213901:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e3f000/0x313993942505dac9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c07a expref: 41 pid: 9586 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.213914:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e3f000/0x313993942505dac9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c07a expref: 41 pid: 9586 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.213927:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.213928:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.213931:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1000/0x313993942505dcf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.213936:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1000/0x313993942505dcf2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.213950:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.216297:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967309578112:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2415us (2632us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.216305:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7968 00010000:00010000:0.0:1746147185.216333:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942505dcd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.216339:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942505dcd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.216352:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942505dcd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.216359:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942505dcd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.216363:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942505dcd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.216373:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096e05a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147185.216376:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942505dcd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.216381:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942505dcd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.216389:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.216391:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.216395:0:9585:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ffb600/0x313993942505dd1c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1df expref: 24 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.216401:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffb600/0x313993942505dd1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1df expref: 24 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.216426:0:9585:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097ffb600/0x313993942505dd1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1df expref: 24 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.216438:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a496ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311150720:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147185.216486:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.219487:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.221052:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.224831:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.226074:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.229940:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.237064:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.237122:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.237159:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309579648 00000100:00100000:0.0:1746147185.237166:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309579648 00010000:00010000:0.0:1746147185.237203:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6a00/0x313993942505dbb0 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c106 expref: 35 pid: 7237 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746147185.237238:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309579904 00000100:00100000:0.0:1746147185.237241:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309579904 00010000:00010000:0.0:1746147185.237252:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x313993942505d94f lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7bf5b expref: 16 pid: 7237 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746147185.237266:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7971 00000100:00100000:0.0:1746147185.237273:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967309579648:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.237286:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.237292:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6a00/0x313993942505dbb0 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c106 expref: 35 pid: 7237 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.237302:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6a00/0x313993942505dbb0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c106 expref: 35 pid: 7237 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.237326:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147185.237330:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098447000/0x313993942505dd2a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.237338:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.237377:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967309579648:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 104us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.237382:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7971 00000100:00100000:0.0:1746147185.237396:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7972 00000100:00100000:0.0:1746147185.237401:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967309579904:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.237408:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.237412:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x313993942505d94f lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7bf5b expref: 16 pid: 7237 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.237419:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x313993942505d94f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7bf5b expref: 16 pid: 7237 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.237428:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147185.237431:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098447000/0x313993942505dd2a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.237436:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.237448:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967309579904:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 46us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.237452:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7972 00000100:00100000:0.0:1746147185.237505:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.237518:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309579776 00000100:00100000:0.0:1746147185.237520:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309579776 00010000:00010000:0.0:1746147185.237530:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942505dbfd lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c129 expref: 16 pid: 9138 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746147185.237543:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7973 00000100:00100000:0.0:1746147185.237547:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967309579776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.237553:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.237556:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942505dbfd lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c129 expref: 16 pid: 9138 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.237568:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942505dbfd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c129 expref: 16 pid: 9138 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.237578:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147185.237581:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098447000/0x313993942505dd2a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.237585:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.237599:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967309579776:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 51us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.237605:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7973 00000100:00100000:0.0:1746147185.238632:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309580032 00000100:00100000:0.0:1746147185.238636:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309580032 00010000:00010000:0.0:1746147185.238652:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f600/0x313993942505d925 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7bf46 expref: 34 pid: 6215 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746147185.238677:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7974 00000100:00100000:0.0:1746147185.238682:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967309580032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.238690:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.238694:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f600/0x313993942505d925 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7bf46 expref: 34 pid: 6215 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.239105:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f600/0x313993942505d925 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7bf46 expref: 34 pid: 6215 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.239123:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f600/0x313993942505d925 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7bf46 expref: 34 pid: 6215 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.239151:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147185.239154:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098447000/0x313993942505dd2a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.239162:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098447000/0x313993942505dd2a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.239168:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098447000/0x313993942505dd2a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.239186:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.239214:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967309580032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 531us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.239219:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7974 00000100:00100000:0.0:1746147185.240803:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000001:00080000:0.0:1746147185.243551:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936815 is committed 00000004:00080000:0.0:1746147185.243563:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 990 committed 00000004:00080000:0.0:1746147185.243584:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 963 committed 00000004:00080000:0.0:1746147185.243602:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 962 committed 00000004:00080000:0.0:1746147185.243603:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 961 committed 00000004:00080000:0.0:1746147185.243605:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 960 committed 00000004:00080000:0.0:1746147185.243608:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 989 committed 00000004:00080000:0.0:1746147185.243610:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 959 committed 00000004:00080000:0.0:1746147185.243611:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 988 committed 00000004:00080000:0.0:1746147185.243612:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 958 committed 00000004:00080000:0.0:1746147185.243614:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 987 committed 00000004:00080000:0.0:1746147185.243615:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 986 committed 00000004:00080000:0.0:1746147185.243617:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 985 committed 00000004:00080000:0.0:1746147185.243618:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 957 committed 00000004:00080000:0.0:1746147185.243619:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 956 committed 00000004:00080000:0.0:1746147185.243622:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 984 committed 00000004:00080000:0.0:1746147185.243623:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 983 committed 00000004:00080000:0.0:1746147185.243625:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 955 committed 00000001:00080000:0.0:1746147185.243631:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936813 is committed 00000001:00080000:0.0:1746147185.243640:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936809 is committed 00000100:00100000:0.0:1746147185.244024:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311151360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147185.244341:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.244358:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311151872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147185.244374:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.244398:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311151872 00000100:00100000:0.0:1746147185.244401:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311151872 00000100:00100000:0.0:1746147185.244418:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17787 00000100:00100000:0.0:1746147185.244423:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+73:3767:x1830967311151488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147185.244509:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147185.244512:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147183 -> 1746147183 00002000:00010000:0.0:1746147185.244514:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147183 -> 1746147183 00002000:00010000:0.0:1746147185.244516:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147184 -> 1746147184 00002000:00010000:0.0:1746147185.244518:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746147185.244540:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+76:3767:x1830967311151488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (355us total) trans 17179874849 rc 0/0 00000100:00100000:0.0:1746147185.244546:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17787 00000100:00100000:0.0:1746147185.244559:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17789 00000100:00100000:0.0:1746147185.244563:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+75:3765:x1830967311151360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147185.244610:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+75:3765:x1830967311151360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (268us total) trans 17179874852 rc 0/0 00000100:00100000:0.0:1746147185.244615:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17789 00000004:00080000:0.0:1746147185.244643:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e5a680/2, rc 0, transno 17179874852 00000100:00100000:0.0:1746147185.244647:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311151360:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147185.248622:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e5b800/2, rc 0, transno 17179874853 00000100:00100000:0.0:1746147185.248627:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311151872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147185.252175:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.255324:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.261947:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309580928 00000100:00100000:0.0:1746147185.261951:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309580928 00000100:00100000:0.0:1746147185.261970:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309581184 00000100:00100000:0.0:1746147185.261971:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309581184 00000100:00100000:0.0:1746147185.261984:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17803 00000100:00100000:0.0:1746147185.261989:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2002:x1830967309580800:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147185.261998:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.262012:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505dd4d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c209 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147185.262031:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x93:0x0] initial LVB size: 1048576, mtime: 0x68141770, atime: 0x68141770, ctime: 0x68141770, blocks: 0x7c8 00010000:00010000:0.0:1746147185.262044:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.262046:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.262053:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505dd4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c209 expref: 42 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.262064:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x313993942505dd4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c209 expref: 42 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.262071:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05e00, rc 0) 00000100:00100000:0.0:1746147185.262106:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967309580800:12345-192.168.204.25@tcp:101:cat.0 Request processed in 116us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.262111:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17803 00000100:00100000:0.0:1746147185.262126:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17805 00000100:00100000:0.0:1746147185.262130:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967309581056:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147185.262145:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.262152:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942505dd5b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c217 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.262160:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.262162:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.262166:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942505dd5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c217 expref: 43 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.262174:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942505dd5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c217 expref: 43 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.262180:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05a00, rc 0) 00000100:00100000:0.0:1746147185.262192:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2002:x1830967309581056:12345-192.168.204.25@tcp:101:cat.0 Request processed in 62us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.262196:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17805 00000100:00100000:0.0:1746147185.262204:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17807 00000100:00100000:0.0:1746147185.262208:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967309581312:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147185.262213:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.262219:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e04c00/0x313993942505dd69 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c225 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147185.262228:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x98:0x0] initial LVB size: 4194304, mtime: 0x68141770, atime: 0x68141770, ctime: 0x68141770, blocks: 0x1008 00010000:00010000:0.0:1746147185.262234:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.262235:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.262239:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e04c00/0x313993942505dd69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c225 expref: 43 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.262246:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e04c00/0x313993942505dd69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c225 expref: 43 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.263951:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e04c00, rc 0) 00000100:00100000:0.0:1746147185.263998:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2002:x1830967309581312:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1786us (2136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.264005:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17807 00000100:00100000:0.0:1746147185.267907:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.277054:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.277321:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.278819:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.278856:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.282939:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.282961:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.282990:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.283001:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.283062:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.290126:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309583616 00000100:00100000:0.0:1746147185.290151:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309583616 00000100:00100000:0.0:1746147185.290210:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16030 00000100:00100000:0.0:1746147185.290219:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:1950:x1830967309583616:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147185.290245:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.290251:0:7237:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746147185.290279:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33a00/0x313993942505dd3f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1fb expref: 29 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.290300:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147185.290303:0:7237:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147185.290315:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x313993942505ddcb lrc: 2/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c264 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.290361:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05000/0x313993942505ddd2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.290373:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e80c00/0x313993942505dd77 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c22c expref: 7 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.290380:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9ae00/0x313993942505dd38 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1f4 expref: 7 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.290385:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x313993942505dd46 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c202 expref: 7 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.290391:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05000/0x313993942505ddd2 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.290422:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x313993942505dd46 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c202 expref: 7 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.290433:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1000/0x313993942505dd46 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c202 expref: 7 pid: 9138 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746147185.290444:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a496f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311153920:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147185.293185:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9ae00/0x313993942505dd38 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1f4 expref: 7 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.293199:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9ae00/0x313993942505dd38 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1f4 expref: 7 pid: 7237 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746147185.293213:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a496d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311154048:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147185.293269:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e80c00/0x313993942505dd77 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c22c expref: 7 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.293277:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e80c00/0x313993942505dd77 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c22c expref: 7 pid: 7237 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746147185.293289:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a496e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311154176:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147185.293308:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941540c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.294277:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.294318:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.296389:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a496f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311153920:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147185.296400:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a496d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311154048:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147185.296407:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a496e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311154176:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147185.296433:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05000/0x313993942505ddd2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147185.297474:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17821 00000100:00100000:0.0:1746147185.297481:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2001:x1830967309585024:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147185.297490:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.297502:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x313993942505dde0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c272 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.297514:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.297516:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.297521:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x313993942505dde0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c272 expref: 26 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.297530:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x313993942505dde0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c272 expref: 26 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.297537:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a30a00, rc 0) 00000100:00100000:0.0:1746147185.297857:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2001:x1830967309585024:12345-192.168.204.25@tcp:101:cat.0 Request processed in 375us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.297897:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17821 00000100:00100000:0.0:1746147185.297950:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309585280 00000100:00100000:0.0:1746147185.297953:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309585280 00000100:00100000:0.0:1746147185.297971:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17823 00000100:00100000:0.0:1746147185.297976:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2001:x1830967309585280:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147185.297982:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.297990:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a30400/0x313993942505ddee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c280 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.298002:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.298003:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.298008:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a30400/0x313993942505ddee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c280 expref: 27 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.298018:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a30400/0x313993942505ddee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c280 expref: 27 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.298025:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a30400, rc 0) 00000100:00100000:0.0:1746147185.298043:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2001:x1830967309585280:12345-192.168.204.25@tcp:101:cat.0 Request processed in 66us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.298048:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17823 00000001:00080000:0.0:1746147185.305389:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936818 is committed 00000004:00080000:0.0:1746147185.305398:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 998 committed 00000004:00080000:0.0:1746147185.305555:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 972 committed 00000004:00080000:0.0:1746147185.305575:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 971 committed 00000004:00080000:0.0:1746147185.305577:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 970 committed 00000004:00080000:0.0:1746147185.305578:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 969 committed 00000004:00080000:0.0:1746147185.305580:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 997 committed 00000004:00080000:0.0:1746147185.305582:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 968 committed 00000004:00080000:0.0:1746147185.305583:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 996 committed 00000004:00080000:0.0:1746147185.305584:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 967 committed 00000004:00080000:0.0:1746147185.305586:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 995 committed 00000004:00080000:0.0:1746147185.305587:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 994 committed 00000004:00080000:0.0:1746147185.305588:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 993 committed 00000004:00080000:0.0:1746147185.305589:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 966 committed 00000004:00080000:0.0:1746147185.305591:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 965 committed 00000004:00080000:0.0:1746147185.305592:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 992 committed 00000004:00080000:0.0:1746147185.305593:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 991 committed 00000004:00080000:0.0:1746147185.305595:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 964 committed 00000100:00100000:0.0:1746147185.306589:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311154304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.306616:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.306747:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311155072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.306768:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.306780:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311155584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.306795:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.306807:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746147185.306811:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311154432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147185.306827:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.306838:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311155200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.306851:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.306873:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311154816 00000100:00100000:0.0:1746147185.306876:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311154816 00000100:00100000:0.0:1746147185.306897:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311155328 00000100:00100000:0.0:1746147185.306899:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311155328 00000100:00100000:0.0:1746147185.306908:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17824 00000100:00100000:0.0:1746147185.306913:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+114:3764:x1830967311154816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147185.307024:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147185.307027:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147185 -> 1746147185 00002000:00010000:0.0:1746147185.307029:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147184 -> 1746147184 00002000:00010000:0.0:1746147185.307031:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147185 -> 1746147185 00002000:00010000:0.0:1746147185.307033:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147185.307060:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+115:3764:x1830967311154816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 146us (1028us total) trans 21474842207 rc 0/0 00000100:00100000:0.0:1746147185.307066:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17824 00000100:00100000:0.0:1746147185.307077:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311154944 00000100:00100000:0.0:1746147185.307080:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311154944 00000100:00100000:0.0:1746147185.307107:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311155456 00000100:00100000:0.0:1746147185.307110:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311155456 00000100:00100000:0.0:1746147185.307117:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311154304 00000100:00100000:0.0:1746147185.307119:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311154304 00000100:00100000:0.0:1746147185.307124:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311155072 00000100:00100000:0.0:1746147185.307126:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311155072 00000100:00100000:0.0:1746147185.307143:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311155584 00000100:00100000:0.0:1746147185.307146:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311155584 00000100:00100000:0.0:1746147185.307153:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311154432 00000100:00100000:0.0:1746147185.307154:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311154432 00000100:00100000:0.0:1746147185.307161:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311155200 00000100:00100000:0.0:1746147185.307162:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311155200 00000100:00100000:0.0:1746147185.307169:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17825 00000100:00100000:0.0:1746147185.307173:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+120:3764:x1830967311155328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.307228:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+121:3764:x1830967311155328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (1166us total) trans 21474842208 rc 0/0 00000100:00100000:0.0:1746147185.307232:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17825 00000100:00100000:0.0:1746147185.307240:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17826 00000100:00100000:0.0:1746147185.307244:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+120:3764:x1830967311154944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147185.307280:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:0.0:1746147185.307282:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147184 -> 1746147184 00002000:00010000:0.0:1746147185.307284:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147183 -> 1746147183 00002000:00010000:0.0:1746147185.307286:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147184 -> 1746147184 00002000:00010000:0.0:1746147185.307287:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:0.0:1746147185.307305:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+121:3764:x1830967311154944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (1192us total) trans 21474842209 rc 0/0 00000100:00100000:0.0:1746147185.307310:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17826 00000100:00100000:0.0:1746147185.307319:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17828 00000100:00100000:0.0:1746147185.307322:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a496e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+121:3766:x1830967311154304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147185.307362:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147185.307364:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147184 -> 1746147184 00002000:00010000:0.0:1746147185.307366:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147184 -> 1746147184 00002000:00010000:0.0:1746147185.307368:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147184 -> 1746147184 00002000:00010000:0.0:1746147185.307370:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 1992 -> 1992 00000100:00100000:0.0:1746147185.307392:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a496e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+122:3766:x1830967311154304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (774us total) trans 21474842211 rc 0/0 00000100:00100000:0.0:1746147185.307397:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17828 00000100:00100000:0.0:1746147185.307406:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17830 00000100:00100000:0.0:1746147185.307409:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a496d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+121:3766:x1830967311155584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147185.307452:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:0.0:1746147185.307454:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147185.307456:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147185.307458:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147185.307460:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:0.0:1746147185.307478:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a496d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+121:3766:x1830967311155584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (682us total) trans 21474842213 rc 0/0 00000100:00100000:0.0:1746147185.307483:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17830 00000100:00100000:0.0:1746147185.307491:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17831 00000100:00100000:0.0:1746147185.307495:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a496f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+77:3766:x1830967311154432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147185.307546:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147185.307548:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147184 -> 1746147184 00002000:00010000:0.0:1746147185.307550:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147184 -> 1746147184 00002000:00010000:0.0:1746147185.307551:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147184 -> 1746147184 00002000:00010000:0.0:1746147185.307553:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147185.307570:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a496f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+78:3766:x1830967311154432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (742us total) trans 17179874857 rc 0/0 00000100:00100000:0.0:1746147185.307575:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17831 00000004:00080000:0.0:1746147185.307733:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096cf9880/2, rc 0, transno 17179874857 00000100:00100000:0.0:1746147185.307738:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311154432:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147185.307746:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099156a00/2, rc 0, transno 21474842214 00000100:00100000:0.0:1746147185.307749:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311155200:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147185.307754:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c72a00/2, rc 0, transno 21474842211 00000100:00100000:0.0:1746147185.307757:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311154304:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147185.307762:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099154e00/2, rc 0, transno 21474842212 00000100:00100000:0.0:1746147185.307765:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311155072:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147185.307771:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5575500/2, rc 0, transno 21474842213 00000100:00100000:0.0:1746147185.307773:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311155584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.307780:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746147185.307784:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311155712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147185.307802:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.315020:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311154560:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147185.315034:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311154688:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147185.315081:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x313993942505ddcb lrc: 0/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c264 expref: 28 pid: 7237 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746147185.315163:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05000/0x313993942505ddd2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c264 expref: 27 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.315196:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05000, rc 0) 00000100:00100000:0.0:1746147185.315265:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:1950:x1830967309583616:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 25045us (27378us total) trans 8589936818 rc 0/0 00000100:00100000:0.0:1746147185.315274:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16030 00000100:00100000:0.0:1746147185.318422:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.318458:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.318490:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.318517:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309586176 00000100:00100000:0.0:1746147185.318526:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309586176 00000100:00100000:0.0:1746147185.318562:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309586304 00000100:00100000:0.0:1746147185.318564:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309586304 00000100:00100000:0.0:1746147185.319010:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309586432 00000100:00100000:0.0:1746147185.319014:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309586432 00000100:00100000:0.0:1746147185.319406:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.319421:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309586560 00000100:00100000:0.0:1746147185.319424:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309586560 00000100:00100000:0.0:1746147185.319440:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17844 00000100:00100000:0.0:1746147185.319445:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309586560:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147185.319482:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309586560:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 36us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.319487:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17844 00000100:00100000:0.0:1746147185.319539:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.319549:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309586688 00000100:00100000:0.0:1746147185.319552:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309586688 00000100:00100000:0.0:1746147185.319566:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17845 00000100:00100000:0.0:1746147185.319571:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309586688:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147185.319603:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309586688:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 32us (64us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.319608:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17845 00000100:00100000:0.0:1746147185.321396:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309586816 00000100:00100000:0.0:1746147185.321402:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309586816 00000100:00100000:0.0:1746147185.321430:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309586944 00000100:00100000:0.0:1746147185.321432:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309586944 00000100:00100000:0.0:1746147185.321448:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17846 00000100:00100000:0.0:1746147185.321454:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967309586816:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147185.321526:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967309586816:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 71us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.321532:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17846 00000100:00100000:0.0:1746147185.321544:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17847 00000100:00100000:0.0:1746147185.321549:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:1950:x1830967309586944:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147185.321558:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.321577:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a31000/0x313993942505de26 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c29c expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.321604:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ffac00/0x313993942505dd31 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1ed expref: 7 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.321613:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d90000/0x313993942505dda8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c24f expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.321620:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0400/0x313993942505dd62 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c21e expref: 23 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.321626:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.321627:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.321630:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a31000/0x313993942505de26 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1507328->1597439] (req 1507328->1597439) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c29c expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.321662:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0400/0x313993942505dd62 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c21e expref: 23 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.321679:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0400/0x313993942505dd62 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c21e expref: 23 pid: 1853 timeout: 823 lvb_type: 1 00000100:00100000:0.0:1746147185.321691:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311156736:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147185.321743:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d90000/0x313993942505dda8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c24f expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147185.321751:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d90000/0x313993942505dda8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c24f expref: 10 pid: 9586 timeout: 823 lvb_type: 1 00000100:00100000:0.0:1746147185.321759:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311156864:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147185.321787:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ffac00/0x313993942505dd31 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1ed expref: 7 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.321795:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ffac00/0x313993942505dd31 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c1ed expref: 7 pid: 17600 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746147185.321803:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311156992:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147185.321821:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941540c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.327675:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.327710:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.329350:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.329915:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.333128:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.336582:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.337491:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.337523:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.337539:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309588224 00000100:00100000:0.0:1746147185.337542:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309588224 00002000:00100000:0.0:1746147185.337561:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff880095234e00 x1830967309588224/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.337569:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095234e00 with x1830967309588224 ext(2097152->4194303) 00002000:00010000:0.0:1746147185.337573:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095234e00 00000100:00100000:0.0:1746147185.337582:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309588352 00000100:00100000:0.0:1746147185.337584:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309588352 00002000:00100000:0.0:1746147185.337595:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1593344->1597439) req@ffff880095237800 x1830967309588352/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.337602:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095237800 with x1830967309588352 ext(1593344->1597439) 00002000:00010000:0.0:1746147185.337605:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095237800 00000100:00100000:0.0:1746147185.337614:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6416 00000100:00100000:0.0:1746147185.337619:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2003:x1830967309588224:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147185.355888:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.360478:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.360511:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.363212:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.363561:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.365566:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.367889:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.373533:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.373570:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.373612:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.373639:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309590400 00000100:00100000:0.0:1746147185.373648:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309590400 00000100:00100000:0.0:1746147185.373713:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309590272 00000100:00100000:0.0:1746147185.373715:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309590272 00000100:00100000:0.0:1746147185.373730:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309590784 00000100:00100000:0.0:1746147185.373732:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309590784 00002000:00100000:0.0:1746147185.373747:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x98:0x0] (2482176->2486271) req@ffff880094185c00 x1830967309590784/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.373757:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094185c00 with x1830967309590784 ext(2482176->2486271) 00010000:00010000:0.0:1746147185.373766:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x313993942505de49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2486271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c2b8 expref: 28 pid: 12201 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.373780:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x313993942505de49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2486271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c2b8 expref: 28 pid: 12201 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746147185.373787:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094185c00 00000100:00100000:0.0:1746147185.373802:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1469 00000100:00100000:0.0:1746147185.373809:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2000:x1830967309590784:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147185.373958:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2000:x1830967309590784:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 149us (344us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147185.373965:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1469 00002000:00100000:0.0:1746147185.373970:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x98:0x0] (2482176->2486271) req@ffff880094185c00 x1830967309590784/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746147196 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.373977:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094185c00 with x1830967309590784 ext(2482176->2486271) 00010000:00010000:0.0:1746147185.373982:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x313993942505de49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2486271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c2b8 expref: 28 pid: 12201 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.373989:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x313993942505de49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2486271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c2b8 expref: 28 pid: 12201 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746147185.373995:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094185c00 00000100:00100000:0.0:1746147185.374009:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6419 00000100:00100000:0.0:1746147185.374013:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2000:x1830967309590400:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147185.374034:0:29478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x313993942505de65 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.374047:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.374049:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.374054:0:29478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x313993942505de65 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.374066:0:29478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x313993942505de65 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.388172:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.388212:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.388238:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.388265:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.399613:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.399657:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.399689:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.419425:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311158400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746147185.419501:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147185.420341:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311158400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746147185.426705:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.428828:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.443349:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.447291:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.459478:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.466948:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.466988:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.467968:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.479331:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.479547:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.485934:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.494632:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309595136 00000100:00100000:0.0:1746147185.494643:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309595136 00010000:00010000:0.0:1746147185.494683:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d91400/0x313993942505dd9a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c23a expref: 11 pid: 9584 timeout: 823 lvb_type: 1 00000100:00100000:0.0:1746147185.494722:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7988 00000100:00100000:0.0:1746147185.494729:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967309595136:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.494743:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.494763:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d91400/0x313993942505dd9a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c23a expref: 11 pid: 9584 timeout: 823 lvb_type: 1 00010000:00010000:0.0:1746147185.494774:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d91400/0x313993942505dd9a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c23a expref: 11 pid: 9584 timeout: 823 lvb_type: 1 00010000:00010000:0.0:1746147185.494797:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d91400/0x313993942505dd9a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c23a expref: 11 pid: 9584 timeout: 823 lvb_type: 1 00010000:00010000:0.0:1746147185.494819:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.494861:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967309595136:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 132us (3535us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.494867:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7988 00000100:00100000:0.0:1746147185.527898:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967309595776:12345-192.168.204.25@tcp:3:cat.0 Request processed in 24291us (24368us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147185.527910:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6429 00002000:00100000:0.0:1746147185.527923:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88012f3cdf80 x1830967309595776/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:561/0 lens 488/440 e 0 to 0 dl 1746147196 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.527933:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cdf80 with x1830967309595776 ext(1048576->2097151) 00002000:00010000:0.0:1746147185.527939:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cdf80 00000100:00100000:0.0:1746147185.532584:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.532691:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.544450:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.544474:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.547226:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.549632:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.549678:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.551685:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.556234:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.557568:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.559180:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.562670:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.562706:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.563182:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.569851:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.570615:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.588843:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309598976 00000100:00100000:0.0:1746147185.588850:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309598976 00000100:00100000:0.0:1746147185.588882:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16038 00000100:00100000:0.0:1746147185.588888:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:1960:x1830967309598976:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147185.588903:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.588917:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7a00/0x313993942505df14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c321 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.588969:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7200/0x313993942505df1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.588979:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7200/0x313993942505df1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.588986:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7200/0x313993942505df1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.588995:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6e00/0x313993942505df22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589000:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6e00/0x313993942505df22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589004:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6e00/0x313993942505df22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589077:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7000/0x313993942505df29 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589082:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7000/0x313993942505df29 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589104:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7000/0x313993942505df29 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:0.0:1746147185.589111:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147185.589169:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7000/0x313993942505df29 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589174:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7000/0x313993942505df29 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589179:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7000/0x313993942505df29 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589183:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e7000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147185.589186:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7000/0x313993942505df29 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589191:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7000/0x313993942505df29 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589200:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147185.589202:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147185.589205:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7000/0x313993942505df29 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589209:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7000/0x313993942505df29 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589223:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7200/0x313993942505df1b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589227:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7200/0x313993942505df1b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589234:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7200/0x313993942505df1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589238:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7200/0x313993942505df1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589241:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958e7200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147185.589243:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7200/0x313993942505df1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589247:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7200/0x313993942505df1b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589251:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147185.589252:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147185.589254:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7200/0x313993942505df1b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589257:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7200/0x313993942505df1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589262:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6e00/0x313993942505df22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589265:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6e00/0x313993942505df22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589268:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6e00/0x313993942505df22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589271:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958e6e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147185.589273:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6e00/0x313993942505df22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589280:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6e00/0x313993942505df22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589284:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096bb1f00) 00010000:00010000:0.0:1746147185.589286:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147185.589287:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6e00/0x313993942505df22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589290:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e6e00/0x313993942505df22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147185.589314:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7a00/0x313993942505df14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c321 expref: 31 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.589320:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e7a00/0x313993942505df14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c321 expref: 31 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.589325:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e7a00, rc 0) 00000100:00100000:0.0:1746147185.589356:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:1960:x1830967309598976:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 469us (631us total) trans 8589936825 rc 301/301 00000100:00100000:0.0:1746147185.589362:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16038 00000100:00100000:0.0:1746147185.595332:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.602448:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.603514:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.603794:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.607836:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.614820:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.616069:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.616106:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309600000 00000100:00100000:0.0:1746147185.616110:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309600000 00010000:00010000:0.0:1746147185.616136:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009844a600/0x313993942505ded5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c2e2 expref: 41 pid: 12201 timeout: 823 lvb_type: 1 00000100:00100000:0.0:1746147185.616154:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8003 00000100:00100000:0.0:1746147185.616159:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967309600000:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.616166:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.616178:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009844a600/0x313993942505ded5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c2e2 expref: 41 pid: 12201 timeout: 823 lvb_type: 1 00010000:00010000:0.0:1746147185.616186:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009844a600/0x313993942505ded5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c2e2 expref: 41 pid: 12201 timeout: 823 lvb_type: 1 00010000:00010000:0.0:1746147185.616197:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009844a600/0x313993942505ded5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c2e2 expref: 41 pid: 12201 timeout: 823 lvb_type: 1 00010000:00010000:0.0:1746147185.616219:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.616220:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.616226:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098227800/0x313993942505df45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c336 expref: 20 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.616232:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098227800/0x313993942505df45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c336 expref: 20 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.616257:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098227800/0x313993942505df45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c336 expref: 20 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147185.616268:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311161984:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147185.616318:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941540c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.618416:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.619661:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.619704:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.620780:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.620837:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.628830:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.628907:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.632726:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.636593:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.650233:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309601920 00000100:00100000:0.0:1746147185.650245:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309601920 00000100:00100000:0.0:1746147185.650298:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16039 00000100:00100000:0.0:1746147185.650305:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:1964:x1830967309601920:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147185.650323:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147185.650337:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7e00/0x313993942505df4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c33d expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.650392:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942505df53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650402:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942505df53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650410:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942505df53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650419:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6c00/0x313993942505df5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650426:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6c00/0x313993942505df5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650431:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6c00/0x313993942505df5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650494:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6800/0x313993942505df61 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650501:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6800/0x313993942505df61 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650505:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6800/0x313993942505df61 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:0.0:1746147185.650511:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147185.650559:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942505df53 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650563:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942505df53 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650567:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942505df53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650572:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942505df53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650576:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e7600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147185.650578:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942505df53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650583:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942505df53 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650594:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147185.650596:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147185.650599:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942505df53 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650603:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942505df53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650617:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6c00/0x313993942505df5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650621:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6c00/0x313993942505df5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650625:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6c00/0x313993942505df5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650628:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e6c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147185.650629:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6c00/0x313993942505df5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650633:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6c00/0x313993942505df5a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650637:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096bb1e00) 00010000:00010000:0.0:1746147185.650638:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147185.650640:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6c00/0x313993942505df5a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650643:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6c00/0x313993942505df5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147185.650669:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7e00/0x313993942505df4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c33d expref: 14 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.650678:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6800/0x313993942505df61 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c33d expref: 13 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.650683:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147185.650684:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147185.650686:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e6800, rc 0) 00000100:00100000:0.0:1746147185.650727:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:1964:x1830967309601920:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 423us (992us total) trans 8589936828 rc 0/0 00000100:00100000:0.0:1746147185.650733:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16039 00000100:00100000:0.0:1746147185.656571:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.663342:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.670017:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.681982:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.686431:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.693610:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.693642:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.693676:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.693690:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.695236:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.700587:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.708287:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.723760:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.732338:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.736239:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147185.741357:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147185.743336:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.743394:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.745148:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.746356:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.747469:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.752579:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.752622:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.752660:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.764951:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.765009:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.768480:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.783664:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.792215:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.796250:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.819776:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.827934:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.827971:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.827995:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.828006:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.828033:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.828046:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309607936 00000100:00100000:0.0:1746147185.828049:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309607936 00000100:00100000:0.0:1746147185.839967:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.842948:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.848350:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.867704:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.876552:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.877027:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.877051:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309609728 00000100:00100000:0.0:1746147185.877057:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309609728 00010000:00010000:0.0:1746147185.877086:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009844aa00/0x313993942505def1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c2fe expref: 22 pid: 1854 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746147185.877142:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8013 00000100:00100000:0.0:1746147185.877149:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2001:x1830967309609728:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147185.877159:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147185.877181:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009844aa00/0x313993942505def1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c2fe expref: 22 pid: 1854 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.877196:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009844aa00/0x313993942505def1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c2fe expref: 22 pid: 1854 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.877217:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009844aa00/0x313993942505def1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c2fe expref: 22 pid: 1854 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.877247:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.877249:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147185.877256:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984ef400/0x313993942505e041 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1617919) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c3fa expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.877264:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ef400/0x313993942505e041 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1617919) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c3fa expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.877289:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800984ef400/0x313993942505e041 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1617919) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c3fa expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147185.877301:0:7227:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984ef400/0x313993942505e041 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1351680->1617919) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c3fa expref: 28 pid: 12225 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746147185.877313:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311166336:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147185.877386:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147185.882065:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311166336:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147185.882173:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147185.883836:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967309609728:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6674us (6796us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147185.883850:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8013 00000100:00100000:0.0:1746147185.888962:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.889252:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.893263:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.893298:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.893328:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.903914:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.903958:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.916865:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.931425:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.937914:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.941874:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.941931:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.941955:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.944002:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6443 00000100:00100000:0.0:1746147185.944010:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a496ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967309612288:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147185.944720:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6444 00000100:00100000:0.0:1746147185.944726:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a496e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967309612800:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147185.961793:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.966697:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.967980:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309613440 00000100:00100000:0.0:1746147185.967985:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309613440 00002000:00100000:0.0:1746147185.968017:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88012ca12a00 x1830967309613440/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:561/0 lens 488/0 e 0 to 0 dl 1746147196 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.968026:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca12a00 with x1830967309613440 ext(1048576->2097151) 00002000:00010000:0.0:1746147185.968030:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca12a00 00000100:00100000:0.0:1746147185.968731:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6445 00000100:00100000:0.0:1746147185.968741:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967309613440:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147185.972532:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.983633:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.987385:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.988841:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.991137:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967309613952:12345-192.168.204.25@tcp:4:cat.0 Request processed in 3125us (3750us total) trans 21474842222 rc 0/0 00000100:00100000:0.0:1746147185.991148:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1480 00002000:00100000:0.0:1746147185.991158:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1241087) req@ffff880095061c00 x1830967309613952/t21474842222(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:561/0 lens 488/448 e 0 to 0 dl 1746147196 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147185.991168:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095061c00 with x1830967309613952 ext(1048576->1241087) 00010000:00010000:0.0:1746147185.991177:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d9aa00/0x313993942505dfdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c3b4 expref: 27 pid: 1398 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746147185.991191:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d9aa00/0x313993942505dfdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c3b4 expref: 27 pid: 1398 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746147185.991199:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095061c00 00000100:00100000:0.0:1746147185.995068:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147185.998857:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.001554:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.024997:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.025706:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.026022:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.026535:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.030615:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.071407:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.071519:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.105519:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746147186.105540:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311169280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147186.124237:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.129751:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.146267:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.159635:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.160340:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.167482:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.167589:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.167631:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309617920 00000100:00100000:0.0:1746147186.167639:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309617920 00002000:00100000:0.0:1746147186.167688:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x98:0x0] (3416064->3420159) req@ffff88011e485f80 x1830967309617920/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147186.167698:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e485f80 with x1830967309617920 ext(3416064->3420159) 00002000:00010000:0.0:1746147186.167706:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e485f80 00000100:00100000:0.0:1746147186.167728:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6454 00000100:00100000:0.0:1746147186.167736:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967309617920:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147186.172751:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.172828:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.175763:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.175906:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.176779:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.176849:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.176962:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.177275:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.177310:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.193974:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309619584 00000100:00100000:0.0:1746147186.193989:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309619584 00000100:00100000:0.0:1746147186.194076:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16046 00000100:00100000:0.0:1746147186.194142:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:1984:x1830967309619584:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147186.194170:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147186.194195:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x313993942505e136 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c486 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.194330:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee200/0x313993942505e13d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.194349:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x313993942505e105 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c455 expref: 13 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.194359:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee200/0x313993942505e13d lrc: 4/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.194403:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x313993942505e105 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c455 expref: 13 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.194417:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x313993942505e105 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c455 expref: 13 pid: 7239 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746147186.194431:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311170176:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147186.194543:0:7239:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.198596:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.205891:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309619840 00000100:00100000:0.0:1746147186.205902:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309619840 00000100:00100000:0.0:1746147186.206061:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16047 00000100:00100000:0.0:1746147186.206072:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:1984:x1830967309619840:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147186.206915:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147186.206943:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef400/0x313993942505e14b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c48d expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.207055:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x313993942505e152 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.207073:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee200/0x313993942505e13d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c486 expref: 14 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.207081:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984efc00/0x313993942505e152 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.207154:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee200/0x313993942505e13d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c486 expref: 14 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.207171:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee200/0x313993942505e13d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c486 expref: 14 pid: 7239 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746147186.207184:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311170304:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147186.207682:0:7239:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.210572:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.213664:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.219592:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.219725:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.232638:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.235797:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.241194:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309621376 00000100:00100000:0.0:1746147186.241203:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309621376 00002000:00100000:0.0:1746147186.241248:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff8800984d4e00 x1830967309621376/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:562/0 lens 504/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147186.241258:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d4e00 with x1830967309621376 ext(2097152->4194303) 00002000:00010000:0.0:1746147186.241264:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d4e00 00000100:00100000:0.0:1746147186.242455:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6456 00000100:00100000:0.0:1746147186.242467:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2003:x1830967309621376:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147186.248719:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.258809:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.262067:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.263351:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.266235:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.273872:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.274976:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.280773:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.284572:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.288537:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.293029:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:0.0:1746147186.293881:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880099156a00 x1830967309623296/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147186.293891:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099156a00 with x1830967309623296 ext(3145728->4194303) 00002000:00010000:0.0:1746147186.293896:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099156a00 00000100:00100000:0.0:1746147186.293927:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6457 00000100:00100000:0.0:1746147186.293933:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2002:x1830967309623296:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147186.304992:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.312405:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2002:x1830967309623296:12345-192.168.204.25@tcp:3:cat.0 Request processed in 18462us (19375us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147186.312417:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6457 00002000:00100000:0.0:1746147186.312426:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880099156a00 x1830967309623296/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:562/0 lens 488/440 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147186.312435:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099156a00 with x1830967309623296 ext(3145728->4194303) 00002000:00010000:0.0:1746147186.312440:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099156a00 00000100:00100000:0.0:1746147186.315451:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.322362:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.322423:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.323670:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.324682:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.329859:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.329899:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.329925:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.329950:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309625088 00000100:00100000:0.0:1746147186.329956:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309625088 00000100:00100000:0.0:1746147186.330001:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17917 00000100:00100000:0.0:1746147186.330006:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967309625088:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147186.330022:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147186.330038:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x313993942505e1e5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c4d3 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.330055:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147186.330057:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147186.330065:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x313993942505e1e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c4d3 expref: 28 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.330077:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x313993942505e1e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c4d3 expref: 28 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.330084:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1600, rc 0) 00000100:00100000:0.0:1746147186.330135:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967309625088:12345-192.168.204.25@tcp:101:cat.0 Request processed in 128us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147186.330141:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17917 00000100:00100000:0.0:1746147186.330782:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309625216 00000100:00100000:0.0:1746147186.330785:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309625216 00000100:00100000:0.0:1746147186.331261:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17918 00000100:00100000:0.0:1746147186.331267:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967309625216:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147186.331274:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147186.331284:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b0800/0x313993942505e1ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c4da expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147186.331318:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311171968:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147186.331374:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.345078:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.346955:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.351387:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.352645:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.355194:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.358548:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.358564:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309626624 00000100:00100000:0.0:1746147186.358567:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309626624 00002000:00100000:0.0:1746147186.358590:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x97:0x0] (1110016->1114111) req@ffff880134868e00 x1830967309626624/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147186.358599:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134868e00 with x1830967309626624 ext(1110016->1114111) 00002000:00010000:0.0:1746147186.358603:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134868e00 00000100:00100000:0.0:1746147186.358617:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6461 00000100:00100000:0.0:1746147186.358623:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967309626624:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147186.358710:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967309626624:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 86us (163us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147186.358716:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6461 00002000:00100000:0.0:1746147186.358722:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x97:0x0] (1110016->1114111) req@ffff880134868e00 x1830967309626624/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147186.358728:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134868e00 with x1830967309626624 ext(1110016->1114111) 00002000:00010000:0.0:1746147186.358731:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134868e00 00000100:00100000:0.0:1746147186.375548:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.380484:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.394019:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.394078:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.418639:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.426194:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.471336:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.543660:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.554692:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.559575:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.570824:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.570874:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.577923:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.590365:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.601796:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.601956:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.611759:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.614038:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.636724:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.636778:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.641268:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.649817:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.650971:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.658659:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311174144:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147186.658689:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a57200/0x313993942505e278 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c52e expref: 29 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.658708:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a57200/0x313993942505e278 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c52e expref: 29 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.658784:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57200, rc 0) 00000100:00100000:0.0:1746147186.658844:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967309631232:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7682us (7872us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147186.658852:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17928 00000100:00100000:0.0:1746147186.660833:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.664203:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309631744 00000100:00100000:0.0:1746147186.664211:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309631744 00000100:00100000:0.0:1746147186.664261:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17929 00000100:00100000:0.0:1746147186.664267:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2026:x1830967309631744:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147186.664280:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147186.664296:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b537ac00/0x313993942505e27f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c535 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.664321:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984ef400/0x313993942505e1f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1306623) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c4e1 expref: 10 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.664327:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147186.664328:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147186.664331:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b537ac00/0x313993942505e27f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c535 expref: 29 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.664358:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984ef400/0x313993942505e1f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1306623) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c4e1 expref: 10 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.664373:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984ef400/0x313993942505e1f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1306623) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c4e1 expref: 10 pid: 9586 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746147186.664383:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311174272:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147186.664452:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.670453:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.676710:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.676907:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.677038:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.679508:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.687561:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.695220:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.698775:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.700532:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1486 00000100:00100000:0.0:1746147186.700542:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967309632896:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147186.729491:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.755818:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309634304 00000100:00100000:0.0:1746147186.755832:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309634304 00000100:00100000:0.0:1746147186.755891:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16054 00000100:00100000:0.0:1746147186.755902:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2030:x1830967309634304:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147186.755927:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147186.755949:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b417d400/0x313993942505e2a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c55f expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.756030:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4200/0x313993942505e2b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756045:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4200/0x313993942505e2b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756054:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4200/0x313993942505e2b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756066:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a5400/0x313993942505e2b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756071:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a5400/0x313993942505e2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756075:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a5400/0x313993942505e2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756206:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a5800/0x313993942505e2be lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756216:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a5800/0x313993942505e2be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756222:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a5800/0x313993942505e2be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:0.0:1746147186.756230:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147186.756313:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4200/0x313993942505e2b0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756319:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4200/0x313993942505e2b0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756324:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4200/0x313993942505e2b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756329:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4200/0x313993942505e2b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756335:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a9a4200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147186.756338:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4200/0x313993942505e2b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756345:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4200/0x313993942505e2b0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756355:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147186.756358:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147186.756361:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4200/0x313993942505e2b0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756366:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4200/0x313993942505e2b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756391:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a5400/0x313993942505e2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756396:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a5400/0x313993942505e2b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756400:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a5400/0x313993942505e2b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756404:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a9a5400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147186.756406:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a5400/0x313993942505e2b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756410:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a5400/0x313993942505e2b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756416:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096bb1d00) 00010000:00010000:0.0:1746147186.756418:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147186.756420:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a5400/0x313993942505e2b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756424:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a5400/0x313993942505e2b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147186.756459:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b417d400/0x313993942505e2a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c55f expref: 45 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.756470:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a5800/0x313993942505e2be lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c55f expref: 44 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.756476:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147186.756478:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147186.756480:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a5800, rc 0) 00000100:00100000:0.0:1746147186.756521:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2030:x1830967309634304:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 624us (754us total) trans 8589936851 rc 0/0 00000100:00100000:0.0:1746147186.756529:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16054 00000100:00100000:0.0:1746147186.768624:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.768651:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.768988:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.769505:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8040 00000100:00100000:0.0:1746147186.769516:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967309634816:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147186.769524:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147186.769537:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800932d7e00/0x313993942505e09c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c439 expref: 32 pid: 9584 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746147186.769545:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800932d7e00/0x313993942505e09c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c439 expref: 32 pid: 9584 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746147186.769566:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7e00/0x313993942505e09c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c439 expref: 32 pid: 9584 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746147186.769578:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147186.769615:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967309634816:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 103us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147186.769919:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8040 00000100:00100000:0.0:1746147186.779030:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.781868:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.781902:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.781935:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.791851:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.793590:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.793991:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.794419:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.803623:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.806373:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.806423:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.807158:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.816432:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.816508:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.839497:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.839940:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.840497:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013232ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967309637632:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 217us (1005us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147186.840503:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6478 00002000:00100000:0.0:1746147186.840509:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1609728->1613823) req@ffff88013232ce00 x1830967309637632/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746147197 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147186.840516:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013232ce00 with x1830967309637632 ext(1609728->1613823) 00002000:00010000:0.0:1746147186.840519:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013232ce00 00000100:00100000:0.0:1746147186.844899:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.844956:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.853227:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.853709:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309638528 00000100:00100000:0.0:1746147186.853715:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309638528 00002000:00100000:0.0:1746147186.853758:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800947e5f80 x1830967309638528/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:562/0 lens 488/0 e 0 to 0 dl 1746147197 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147186.853766:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e5f80 with x1830967309638528 ext(3145728->4194303) 00002000:00010000:0.0:1746147186.853770:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947e5f80 00000100:00100000:0.0:1746147186.854303:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6479 00000100:00100000:0.0:1746147186.854309:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967309638528:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147186.857167:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.863856:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.870798:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.874293:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309639296 00000100:00100000:0.0:1746147186.874300:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309639296 00000100:00100000:0.0:1746147186.874523:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17942 00000100:00100000:0.0:1746147186.874531:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967309639296:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147186.874549:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147186.874567:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009504e600/0x313993942505e319 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c59e expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.874601:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009504e600/0x313993942505e319 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c59e expref: 31 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.874611:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009504e600/0x313993942505e319 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c59e expref: 31 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.875289:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504e600, rc 0) 00000100:00100000:0.0:1746147186.878391:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.879612:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.889601:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.904512:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.904536:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.904546:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.904565:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309640064 00000100:00100000:0.0:1746147186.904573:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309640064 00000100:00100000:0.0:1746147186.904611:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309640320 00000100:00100000:0.0:1746147186.904612:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309640320 00000100:00100000:0.0:1746147186.904622:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309640192 00000100:00100000:0.0:1746147186.904623:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309640192 00000100:00100000:0.0:1746147186.904630:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309640448 00000100:00100000:0.0:1746147186.904632:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309640448 00000100:00100000:0.0:1746147186.904644:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17943 00000100:00100000:0.0:1746147186.904650:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013232e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2003:x1830967309640064:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147186.904666:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147186.904685:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x313993942505e320 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c5a5 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.904711:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147186.904713:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147186.904722:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x313993942505e320 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c5a5 expref: 10 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.904736:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x313993942505e320 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c5a5 expref: 10 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.904745:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504f000, rc 0) 00000100:00100000:0.0:1746147186.904793:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013232e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2003:x1830967309640064:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 144us (15480us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147186.904799:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17943 00000100:00100000:0.0:1746147186.904812:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17944 00000100:00100000:0.0:1746147186.904816:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013232df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2003:x1830967309640320:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147186.904821:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147186.904830:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009504f200/0x313993942505e327 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c5b3 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.904845:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009504f200/0x313993942505e327 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c5b3 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.904853:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009504f200/0x313993942505e327 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c5b3 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.904865:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504f200, rc 0) 00000100:00100000:0.0:1746147186.904875:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013232df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2003:x1830967309640320:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 59us (374us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147186.904880:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17944 00000100:00100000:0.0:1746147186.904888:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17945 00000100:00100000:0.0:1746147186.904892:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013232dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967309640192:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147186.904897:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147186.904903:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x313993942505e32e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c5ac expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147186.904938:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013232d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311176832:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147186.905166:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.905223:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.905266:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.905965:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309640832 00000100:00100000:0.0:1746147186.905973:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309640832 00000100:00100000:0.0:1746147186.906007:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17949 00000100:00100000:0.0:1746147186.906015:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967309640832:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147186.906029:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147186.906045:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1aeea00/0x313993942505e34a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c5cf expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.906070:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1aeea00/0x313993942505e34a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c5cf expref: 17 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.906080:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1aeea00/0x313993942505e34a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c5cf expref: 17 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.906144:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1aeea00, rc 0) 00000100:00100000:0.0:1746147186.906176:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967309640832:12345-192.168.204.25@tcp:101:cat.0 Request processed in 163us (909us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147186.906182:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17949 00000100:00100000:0.0:1746147186.912954:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.915231:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013232d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311176832:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147186.915269:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x313993942505e32e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c5ac expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.915281:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x313993942505e32e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c5ac expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.915292:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504e000, rc 0) 00000100:00100000:0.0:1746147186.915318:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013232dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967309640192:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 10424us (10780us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147186.915324:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17945 00000100:00100000:0.0:1746147186.915396:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.915420:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309640960 00000100:00100000:0.0:1746147186.915427:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309640960 00000100:00100000:0.0:1746147186.915455:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17950 00000100:00100000:0.0:1746147186.915460:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967309640960:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147186.915474:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147186.915488:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x313993942505e351 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c5d6 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.915514:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x313993942505e351 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c5d6 expref: 31 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.915526:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x313993942505e351 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c5d6 expref: 31 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.915532:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504f400, rc 0) 00000100:00100000:0.0:1746147186.915546:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967309640960:12345-192.168.204.25@tcp:101:cat.0 Request processed in 87us (151us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147186.915551:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17950 00000100:00100000:0.0:1746147186.920275:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.927689:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309641088 00000100:00100000:0.0:1746147186.927698:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309641088 00000100:00100000:0.0:1746147186.927740:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17951 00000100:00100000:0.0:1746147186.927747:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967309641088:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147186.927765:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147186.927783:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x313993942505e366 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c5dd expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.927811:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x313993942505e366 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c5dd expref: 31 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.927821:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x313993942505e366 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c5dd expref: 31 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.927835:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504fa00, rc 0) 00000100:00100000:0.0:1746147186.927876:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967309641088:12345-192.168.204.25@tcp:101:cat.0 Request processed in 129us (477us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147186.927882:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17951 00000100:00100000:0.0:1746147186.937733:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.939139:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.939161:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309641984 00000100:00100000:0.0:1746147186.939164:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309641984 00010000:00010000:0.0:1746147186.939187:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ac00/0x313993942505e312 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c597 expref: 16 pid: 7237 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746147186.939236:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8047 00000100:00100000:0.0:1746147186.939241:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967309641984:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147186.939250:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147186.939254:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ac00/0x313993942505e312 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c597 expref: 16 pid: 7237 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746147186.939264:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ac00/0x313993942505e312 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c597 expref: 16 pid: 7237 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746147186.939284:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ac00/0x313993942505e312 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c597 expref: 16 pid: 7237 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746147186.939295:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147186.939299:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b600/0x313993942505e35f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147186.939313:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b600/0x313993942505e35f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147186.939318:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b600/0x313993942505e35f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147186.939334:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147186.939351:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967309641984:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 110us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147186.939356:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8047 00000100:00100000:0.0:1746147186.942782:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.942832:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.943604:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.947672:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.948651:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.948671:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.951043:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.951075:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.951368:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17957 00000100:00100000:0.0:1746147186.951375:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967309643008:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147186.951382:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147186.951388:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x313993942505e3a5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c615 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.951404:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x313993942505e3a5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c615 expref: 15 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.951417:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x313993942505e3a5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c615 expref: 15 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.951428:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984eee00, rc 0) 00000100:00100000:0.0:1746147186.951565:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967309643008:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 191us (489us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147186.951570:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17957 00000100:00100000:0.0:1746147186.957384:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.960209:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.960605:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.960651:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.961045:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.961068:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309643520 00000100:00100000:0.0:1746147186.961070:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309643520 00000100:00100000:0.0:1746147186.961086:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17961 00000100:00100000:0.0:1746147186.961122:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967309643520:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147186.961137:0:9584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800984ef400/0x313993942505e3d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.961146:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f380800/0x313993942505e048 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c401 expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.961153:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f239e00/0x313993942505e113 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c463 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.961164:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x313993942505e080 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c41d expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.961169:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147186.961171:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147186.961173:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ef400/0x313993942505e3d6 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.961187:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x313993942505e080 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c41d expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.961194:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984eea00/0x313993942505e080 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c41d expref: 30 pid: 12225 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746147186.961202:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311178368:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147186.961223:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f239e00/0x313993942505e113 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c463 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147186.961230:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f239e00/0x313993942505e113 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c463 expref: 11 pid: 1853 timeout: 824 lvb_type: 1 00000100:00100000:0.0:1746147186.961237:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311178496:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147186.961256:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f380800/0x313993942505e048 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c401 expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.961268:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f380800/0x313993942505e048 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c401 expref: 11 pid: 1854 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746147186.961276:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311178624:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147186.961289:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147186.977052:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.977251:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.979427:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.979445:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.979457:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.979509:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.979524:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.979542:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309644800 00000100:00100000:0.0:1746147186.979546:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309644800 00010000:00010000:0.0:1746147186.979566:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f380800/0x313993942505e048 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c401 expref: 12 pid: 1854 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746147186.980440:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8054 00000100:00100000:0.0:1746147186.980445:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967309645056:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147186.980453:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147186.980463:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a2be00/0x313993942505e335 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c5ba expref: 14 pid: 12201 timeout: 824 lvb_type: 1 00010000:00010000:0.0:1746147186.980471:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a2be00/0x313993942505e335 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c5ba expref: 14 pid: 12201 timeout: 824 lvb_type: 1 00010000:00010000:0.0:1746147186.980488:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147186.980502:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967309645056:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 57us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147186.980507:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8054 00000100:00100000:0.0:1746147186.980515:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8055 00000100:00100000:0.0:1746147186.980519:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2003:x1830967309644800:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147186.980524:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147186.980529:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f380800/0x313993942505e048 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c401 expref: 12 pid: 1854 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746147186.980537:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f380800/0x313993942505e048 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c401 expref: 12 pid: 1854 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746147186.980547:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f380800/0x313993942505e048 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c401 expref: 12 pid: 1854 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746147186.980558:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147186.980567:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2003:x1830967309644800:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 48us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147186.980572:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8055 00000100:00100000:0.0:1746147186.981273:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.986251:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.986702:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.986723:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.986729:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309645312 00000100:00100000:0.0:1746147186.986732:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309645312 00010000:00010000:0.0:1746147186.986743:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x313993942505e2e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c57b expref: 31 pid: 9586 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746147186.986753:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8059 00000100:00100000:0.0:1746147186.986757:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967309645312:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147186.986763:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147186.986769:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x313993942505e2e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c57b expref: 31 pid: 9586 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746147186.986776:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x313993942505e2e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c57b expref: 31 pid: 9586 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746147186.986785:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x313993942505e2e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c57b expref: 30 pid: 9586 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746147186.986793:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147186.986795:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147186.986799:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db80400/0x313993942505e3e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.986806:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80400/0x313993942505e3e4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.986824:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147186.986836:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967309645312:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 78us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147186.986841:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8059 00000100:00100000:0.0:1746147186.986862:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.986869:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309645568 00000100:00100000:0.0:1746147186.986871:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309645568 00010000:00010000:0.0:1746147186.986879:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505e33c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c5c1 expref: 10 pid: 1136 timeout: 824 lvb_type: 1 00000100:00100000:0.0:1746147186.986890:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8060 00000100:00100000:0.0:1746147186.986894:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2002:x1830967309645568:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147186.986900:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147186.986905:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505e33c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c5c1 expref: 10 pid: 1136 timeout: 824 lvb_type: 1 00010000:00010000:0.0:1746147186.986911:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505e33c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c5c1 expref: 10 pid: 1136 timeout: 824 lvb_type: 1 00010000:00010000:0.0:1746147186.986920:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2ae00/0x313993942505e33c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c5c1 expref: 10 pid: 1136 timeout: 824 lvb_type: 1 00010000:00010000:0.0:1746147186.986927:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147186.986928:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147186.986931:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092562600/0x313993942505e3c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.986937:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092562600/0x313993942505e3c8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147186.986957:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147186.986968:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2002:x1830967309645568:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 74us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147186.986973:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8060 00000100:00100000:0.0:1746147186.987011:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.987017:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309645824 00000100:00100000:0.0:1746147186.987019:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309645824 00010000:00010000:0.0:1746147186.987028:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1a00/0x313993942505e2f6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c590 expref: 13 pid: 9586 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746147186.987040:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8061 00000100:00100000:0.0:1746147186.987044:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967309645824:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147186.987051:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147186.987062:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1a00/0x313993942505e2f6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c590 expref: 13 pid: 9586 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746147186.987069:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1a00/0x313993942505e2f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c590 expref: 13 pid: 9586 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746147186.987080:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147186.987115:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967309645824:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 70us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147186.987120:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8061 00000100:00100000:0.0:1746147186.987143:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.987177:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147186.987186:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309645952 00000100:00100000:0.0:1746147186.987188:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309645952 00010000:00010000:0.0:1746147186.987196:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0600/0x313993942505e2ef lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c589 expref: 30 pid: 9586 timeout: 824 lvb_type: 0 00000100:00100000:0.0:1746147186.987218:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8062 00000100:00100000:0.0:1746147186.987222:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967309645952:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147186.987227:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147186.987233:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0600/0x313993942505e2ef lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c589 expref: 30 pid: 9586 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746147186.987241:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0600/0x313993942505e2ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c589 expref: 30 pid: 9586 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746147186.987252:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147186.987261:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967309645952:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 39us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147186.987265:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8062 00000100:00100000:0.0:1746147187.004933:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.005526:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.007323:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.009308:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.009489:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.011392:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.013362:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.104296:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.112174:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.112204:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.112230:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.112243:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.112258:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.112283:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.112303:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309647616 00000100:00100000:0.0:1746147187.112310:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309647616 00000100:00100000:0.0:1746147187.112342:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309647744 00000100:00100000:0.0:1746147187.112344:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309647744 00000100:00100000:0.0:1746147187.112362:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309647872 00000100:00100000:0.0:1746147187.112364:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309647872 00000100:00100000:0.0:1746147187.112373:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309648000 00000100:00100000:0.0:1746147187.112374:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309648000 00000100:00100000:0.0:1746147187.112383:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309648128 00000100:00100000:0.0:1746147187.112384:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309648128 00000100:00100000:0.0:1746147187.112400:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309648256 00000100:00100000:0.0:1746147187.112402:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309648256 00000100:00100000:0.0:1746147187.112414:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17964 00000100:00100000:0.0:1746147187.112421:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2001:x1830967309647616:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147187.112436:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.112453:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x313993942505e423 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c62a expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147187.112475:0:1398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x93:0x0] initial LVB size: 1048576, mtime: 0x68141770, atime: 0x68141771, ctime: 0x68141771, blocks: 0x7c8 00010000:00010000:0.0:1746147187.112492:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.112495:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.112503:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x313993942505e423 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c62a expref: 16 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.112519:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x313993942505e423 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c62a expref: 16 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.112528:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff5c00, rc 0) 00000100:00100000:0.0:1746147187.112560:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967309647616:12345-192.168.204.25@tcp:101:cat.0 Request processed in 140us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147187.112565:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17964 00000100:00100000:0.0:1746147187.112578:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17965 00000100:00100000:0.0:1746147187.112582:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967309647744:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147187.112588:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.112599:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ff5800/0x313993942505e42a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c631 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147187.112612:0:1398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x96:0x0] initial LVB size: 2097152, mtime: 0x68141771, atime: 0x68141771, ctime: 0x68141771, blocks: 0x808 00010000:00010000:0.0:1746147187.112620:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.112622:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.112625:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff5800/0x313993942505e42a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c631 expref: 12 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.112636:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ff5800/0x313993942505e42a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c631 expref: 12 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.112642:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff5800, rc 0) 00000100:00100000:0.0:1746147187.112655:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967309647744:12345-192.168.204.25@tcp:101:cat.0 Request processed in 73us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147187.112660:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17965 00000100:00100000:0.0:1746147187.112668:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17966 00000100:00100000:0.0:1746147187.112672:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967309647872:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147187.112677:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.112684:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x313993942505e431 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c638 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147187.112693:0:1398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x97:0x0] initial LVB size: 2097152, mtime: 0x68141772, atime: 0x68141771, ctime: 0x68141772, blocks: 0x800 00010000:00010000:0.0:1746147187.112699:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.112701:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.112704:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x313993942505e431 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c638 expref: 12 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.112712:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x313993942505e431 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c638 expref: 12 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.112718:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4600, rc 0) 00000100:00100000:0.0:1746147187.112731:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967309647872:12345-192.168.204.25@tcp:101:cat.0 Request processed in 59us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147187.112736:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17966 00000100:00100000:0.0:1746147187.112744:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17967 00000100:00100000:0.0:1746147187.112748:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2001:x1830967309648000:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147187.112752:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.112760:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ff5000/0x313993942505e438 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c63f expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147187.112769:0:1398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x68141772, atime: 0x68141771, ctime: 0x68141772, blocks: 0x808 00010000:00010000:0.0:1746147187.112776:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.112777:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.112781:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff5000/0x313993942505e438 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c63f expref: 16 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.112788:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ff5000/0x313993942505e438 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c63f expref: 16 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.112796:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff5000, rc 0) 00000100:00100000:0.0:1746147187.112810:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967309648000:12345-192.168.204.25@tcp:101:cat.0 Request processed in 62us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147187.112815:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17967 00000100:00100000:0.0:1746147187.112828:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17968 00000100:00100000:0.0:1746147187.112833:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2001:x1830967309648128:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147187.112837:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.112844:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ff4000/0x313993942505e43f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c646 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147187.112854:0:1398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4886560, mtime: 0x68141772, atime: 0x68141772, ctime: 0x68141772, blocks: 0x1558 00010000:00010000:0.0:1746147187.112861:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.112862:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.112865:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff4000/0x313993942505e43f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c646 expref: 16 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.112872:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ff4000/0x313993942505e43f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c646 expref: 16 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.112878:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4000, rc 0) 00000100:00100000:0.0:1746147187.112890:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967309648128:12345-192.168.204.25@tcp:101:cat.0 Request processed in 58us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147187.112895:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17968 00000100:00100000:0.0:1746147187.112903:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17969 00000100:00100000:0.0:1746147187.112908:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967309648256:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147187.112914:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.112920:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ff4a00/0x313993942505e446 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c64d expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147187.112929:0:1398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x98:0x0] initial LVB size: 4194304, mtime: 0x68141772, atime: 0x68141772, ctime: 0x68141772, blocks: 0x1008 00010000:00010000:0.0:1746147187.112934:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.112936:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.112939:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff4a00/0x313993942505e446 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c64d expref: 12 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.112947:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ff4a00/0x313993942505e446 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c64d expref: 12 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.112953:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4a00, rc 0) 00000100:00100000:0.0:1746147187.112965:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967309648256:12345-192.168.204.25@tcp:101:cat.0 Request processed in 58us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147187.112970:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17969 00000100:00080000:0.0:1746147187.113126:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147187.150315:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967309649024:12345-192.168.204.25@tcp:3:cat.0 Request processed in 23582us (24791us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147187.150329:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6484 00002000:00100000:0.0:1746147187.150341:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880099151f80 x1830967309649024/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.150350:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151f80 with x1830967309649024 ext(1048576->2097151) 00002000:00010000:0.0:1746147187.150356:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099151f80 00000100:00100000:0.0:1746147187.167497:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967309648896:12345-192.168.204.25@tcp:3:cat.0 Request processed in 40035us (40965us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147187.167514:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6485 00002000:00100000:0.0:1746147187.167528:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8800947e6680 x1830967309648896/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.167538:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e6680 with x1830967309648896 ext(1048576->2097151) 00002000:00010000:0.0:1746147187.167544:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947e6680 00000100:00100000:0.0:1746147187.178295:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.178326:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.178349:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309650944 00000100:00100000:0.0:1746147187.178357:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309650944 00002000:00100000:0.0:1746147187.178401:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88012f3cdf80 x1830967309650944/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.178411:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cdf80 with x1830967309650944 ext(0->1048575) 00002000:00010000:0.0:1746147187.178417:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3cdf80 00000100:00100000:0.0:1746147187.178432:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309651200 00000100:00100000:0.0:1746147187.178434:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309651200 00002000:00100000:0.0:1746147187.178447:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88012f3cdc00 x1830967309651200/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.178454:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cdc00 with x1830967309651200 ext(1048576->2097151) 00002000:00010000:0.0:1746147187.178456:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cdc00 00000100:00100000:0.0:1746147187.178467:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6488 00000100:00100000:0.0:1746147187.178474:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967309650944:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147187.179244:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6489 00000100:00100000:0.0:1746147187.179251:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967309651200:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147187.192772:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.194496:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.199237:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.199261:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.199795:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.200117:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967309650944:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21643us (21834us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147187.200126:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6488 00002000:00100000:0.0:1746147187.200140:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88012f3cdf80 x1830967309650944/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.200149:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cdf80 with x1830967309650944 ext(0->1048575) 00002000:00010000:0.0:1746147187.200155:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3cdf80 00000100:00100000:0.0:1746147187.208844:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.212492:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.212535:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.220633:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967309651456:12345-192.168.204.25@tcp:3:cat.0 Request processed in 39453us (39565us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147187.220646:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6490 00002000:00100000:0.0:1746147187.220659:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88011db15f80 x1830967309651456/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.220668:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db15f80 with x1830967309651456 ext(1048576->2097151) 00010000:00010000:0.0:1746147187.220680:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098c11400/0x313993942505e45b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c669 expref: 34 pid: 9585 timeout: 825 lvb_type: 1 00010000:00010000:0.0:1746147187.220695:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098c11400/0x313993942505e45b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c669 expref: 34 pid: 9585 timeout: 825 lvb_type: 1 00002000:00010000:0.0:1746147187.220703:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011db15f80 00000100:00100000:0.0:1746147187.234999:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.239981:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.245383:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309653504 00000100:00100000:0.0:1746147187.245392:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309653504 00000100:00100000:0.0:1746147187.245439:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17978 00000100:00100000:0.0:1746147187.245447:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2047:x1830967309653504:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147187.245465:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.245483:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x313993942505e4a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c69a expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.245513:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505e49a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1069056->1110015) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c68c expref: 33 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.245520:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147187.245522:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147187.245525:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x313993942505e4a8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c69a expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.245555:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505e49a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1069056->1110015) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c68c expref: 33 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.245565:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db81600/0x313993942505e49a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1069056->1110015) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c68c expref: 33 pid: 17600 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746147187.245577:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311180672:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147187.247079:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.248308:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.248336:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.251721:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.253391:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.263699:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.264714:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.264802:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.273315:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.273361:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.282809:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.285354:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.298669:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.300650:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.351240:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.368033:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.368079:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.370302:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.407815:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.407873:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.416835:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.436887:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.437411:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309658112 00000100:00100000:0.0:1746147187.437420:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309658112 00000100:00100000:0.0:1746147187.437469:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309657984 00000100:00100000:0.0:1746147187.437472:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309657984 00000100:00100000:0.0:1746147187.437776:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17985 00000100:00100000:0.0:1746147187.437784:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967309658112:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147187.437804:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.437827:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092543200/0x313993942505e4d9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c6d2 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147187.437876:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311181696:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147187.437958:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.449971:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.450025:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.465024:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.480499:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.482712:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.514175:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.527440:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.534603:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.541407:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.545183:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.547839:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.548896:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.550989:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.551056:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.551430:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.552420:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.552856:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.553595:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.553630:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.555595:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.559295:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311182976:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147187.559329:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f380800/0x313993942505e549 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c70a expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.559343:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f380800/0x313993942505e549 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c70a expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.559358:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f380800, rc 0) 00000100:00100000:0.0:1746147187.559395:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967309660800:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 6239us (6975us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147187.559402:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17992 00000100:00100000:0.0:1746147187.563941:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.567848:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.571402:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309662208 00000100:00100000:0.0:1746147187.571409:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309662208 00002000:00100000:0.0:1746147187.571454:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->1052671) req@ffff880099152680 x1830967309662208/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.571463:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152680 with x1830967309662208 ext(1048576->1052671) 00002000:00010000:0.0:1746147187.571468:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099152680 00000100:00100000:0.0:1746147187.572379:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6504 00000100:00100000:0.0:1746147187.572389:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967309662208:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147187.572528:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967309662208:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 140us (1254us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147187.572534:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6504 00002000:00100000:0.0:1746147187.572540:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->1052671) req@ffff880099152680 x1830967309662208/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.572553:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152680 with x1830967309662208 ext(1048576->1052671) 00002000:00010000:0.0:1746147187.572558:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099152680 00000100:00100000:0.0:1746147187.577428:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309662592 00000100:00100000:0.0:1746147187.577438:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309662592 00000100:00100000:0.0:1746147187.577541:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5906 00000100:00100000:0.0:1746147187.577549:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2056:x1830967309662592:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147187.577855:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2056:x1830967309662592:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 306us (829us total) trans 8589936867 rc 0/0 00000100:00100000:0.0:1746147187.577861:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5906 00000100:00100000:0.0:1746147187.582048:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.586185:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309662976 00000100:00100000:0.0:1746147187.586192:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309662976 00000100:00100000:0.0:1746147187.586224:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309663104 00000100:00100000:0.0:1746147187.586226:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309663104 00000100:00100000:0.0:1746147187.586241:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 17997 00000100:00100000:0.0:1746147187.586247:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2003:x1830967309662976:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147187.586261:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.586275:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092542000/0x313993942505e58f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c73b expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147187.586315:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311183616:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147187.586390:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.591276:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311183616:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147187.591291:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092542000/0x313993942505e58f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c73b expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.591304:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092542000/0x313993942505e58f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c73b expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.591324:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542000, rc 0) 00000100:00100000:0.0:1746147187.591343:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2003:x1830967309662976:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5096us (5315us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147187.591734:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 17997 00000100:00100000:0.0:1746147187.596468:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.625993:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.630417:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309664384 00000100:00100000:0.0:1746147187.630424:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309664384 00002000:00100000:0.0:1746147187.630453:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x93:0x0] (806912->1048575) req@ffff88013232c700 x1830967309664384/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.630462:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013232c700 with x1830967309664384 ext(806912->1048575) 00010000:00010000:0.0:1746147187.630469:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a1f800/0x313993942505e534 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 806912->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c6f5 expref: 30 pid: 10340 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746147187.630478:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a1f800/0x313993942505e534 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 806912->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c6f5 expref: 30 pid: 10340 timeout: 825 lvb_type: 0 00002000:00010000:0.0:1746147187.630484:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013232c700 00000100:00100000:0.0:1746147187.630498:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309664512 00000100:00100000:0.0:1746147187.630500:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309664512 00002000:00100000:0.0:1746147187.630512:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1925119) req@ffff88013232f480 x1830967309664512/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.630524:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013232f480 with x1830967309664512 ext(1048576->1925119) 00010000:00010000:0.0:1746147187.630528:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e260a00/0x313993942505e4b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c6a8 expref: 13 pid: 10340 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746147187.630534:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e260a00/0x313993942505e4b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c6a8 expref: 13 pid: 10340 timeout: 825 lvb_type: 0 00002000:00010000:0.0:1746147187.630539:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013232f480 00000100:00100000:0.0:1746147187.630548:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1497 00000100:00100000:0.0:1746147187.630553:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013232c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967309664384:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147187.632123:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1498 00000100:00100000:0.0:1746147187.632135:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013232f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967309664512:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147187.632342:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.632381:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.640443:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.643687:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.654984:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.657500:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309666560 00000100:00100000:0.0:1746147187.657506:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309666560 00000100:00100000:0.0:1746147187.657544:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18007 00000100:00100000:0.0:1746147187.657551:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967309666560:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147187.657565:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.657582:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x313993942505e5ea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c76c expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147187.657607:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x68141772, atime: 0x68141771, ctime: 0x68141772, blocks: 0x808 00010000:00010000:0.0:1746147187.657622:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.657624:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.657630:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x313993942505e5ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c76c expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.657643:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x313993942505e5ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c76c expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.657652:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092543a00, rc 0) 00000100:00100000:0.0:1746147187.657695:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967309666560:12345-192.168.204.25@tcp:101:cat.0 Request processed in 144us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147187.657701:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18007 00000100:00100000:0.0:1746147187.661144:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.661195:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309667072 00000100:00100000:0.0:1746147187.661198:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309667072 00000100:00100000:0.0:1746147187.661234:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16068 00000100:00100000:0.0:1746147187.661239:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2062:x1830967309667072:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147187.661255:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.661269:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x313993942505e60d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c781 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.661352:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092543400/0x313993942505e614 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147187.661365:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aee00/0x313993942505e588 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c734 expref: 19 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.661374:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae800/0x313993942505e5ab lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c750 expref: 19 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.661379:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092543400/0x313993942505e614 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147187.661404:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae800/0x313993942505e5ab lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c750 expref: 19 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.661415:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae800/0x313993942505e5ab lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c750 expref: 19 pid: 7237 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746147187.661427:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095060700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311185664:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147187.661497:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aee00/0x313993942505e588 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c734 expref: 19 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.661505:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aee00/0x313993942505e588 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c734 expref: 19 pid: 7237 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746147187.661512:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095063480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311185792:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147187.661530:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941540c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.663847:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.663881:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.669710:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.674558:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.688485:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309668480 00000100:00100000:0.0:1746147187.688500:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309668480 00000100:00100000:0.0:1746147187.688566:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5907 00000100:00100000:0.0:1746147187.688574:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2058:x1830967309668480:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:0.0:1746147187.688794:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2058:x1830967309668480:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 220us (3856us total) trans 8589936870 rc 0/0 00000100:00100000:0.0:1746147187.688801:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5907 00000100:00100000:0.0:1746147187.698490:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967309667968:12345-192.168.204.25@tcp:3:cat.0 Request processed in 27620us (27848us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147187.698503:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6505 00002000:00100000:0.0:1746147187.698515:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88011db14a80 x1830967309667968/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:563/0 lens 488/440 e 0 to 0 dl 1746147198 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.698525:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14a80 with x1830967309667968 ext(0->1048575) 00002000:00010000:0.0:1746147187.698531:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db14a80 00000100:00100000:0.0:1746147187.716142:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.716211:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.716240:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309668736 00000100:00100000:0.0:1746147187.716243:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309668736 00000100:00100000:0.0:1746147187.716271:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5908 00000100:00100000:0.0:1746147187.716277:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cc22c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2058:x1830967309668736:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:0.0:1746147187.716456:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cc22c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2058:x1830967309668736:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 178us (244us total) trans 8589936871 rc 0/0 00000100:00100000:0.0:1746147187.716462:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5908 00000100:00100000:0.0:1746147187.723405:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.726219:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.727742:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.731957:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.733928:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.733974:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.735944:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.735996:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.736829:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.736850:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309670144 00000100:00100000:0.0:1746147187.736854:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309670144 00000100:00100000:0.0:1746147187.736874:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309670272 00000100:00100000:0.0:1746147187.736876:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309670272 00000100:00100000:0.0:1746147187.736886:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309670528 00000100:00100000:0.0:1746147187.736888:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309670528 00000100:00100000:0.0:1746147187.736915:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18015 00000100:00100000:0.0:1746147187.736921:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967309670144:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147187.736930:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.736942:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b81a00/0x313993942505e67d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c7ab expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.736954:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.736956:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.736961:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b81a00/0x313993942505e67d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c7ab expref: 35 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.736971:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b81a00/0x313993942505e67d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c7ab expref: 35 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.736980:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81a00, rc 0) 00000100:00100000:0.0:1746147187.737000:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967309670144:12345-192.168.204.25@tcp:101:cat.0 Request processed in 79us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147187.737004:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18015 00000100:00100000:0.0:1746147187.737016:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18016 00000100:00100000:0.0:1746147187.737021:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967309670272:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147187.737026:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.737032:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b81600/0x313993942505e684 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c7b2 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.737041:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.737042:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.737046:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b81600/0x313993942505e684 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c7b2 expref: 35 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.737054:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b81600/0x313993942505e684 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c7b2 expref: 35 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.737060:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81600, rc 0) 00000100:00100000:0.0:1746147187.737075:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967309670272:12345-192.168.204.25@tcp:101:cat.0 Request processed in 54us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147187.737080:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18016 00000100:00100000:0.0:1746147187.737114:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18017 00000100:00100000:0.0:1746147187.737120:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967309670528:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147187.737126:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.737134:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b80200/0x313993942505e68b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c7b9 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147187.737144:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.737145:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147187.737149:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b80200/0x313993942505e68b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c7b9 expref: 33 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.737160:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b80200/0x313993942505e68b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c7b9 expref: 33 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147187.737166:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80200, rc 0) 00000100:00100000:0.0:1746147187.737181:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2002:x1830967309670528:12345-192.168.204.25@tcp:101:cat.0 Request processed in 62us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147187.737186:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18017 00000100:00100000:0.0:1746147187.744227:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.750189:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.750231:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.750274:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.750303:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309671808 00000100:00100000:0.0:1746147187.750311:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309671808 00000100:00100000:0.0:1746147187.750369:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5909 00000100:00100000:0.0:1746147187.750377:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+53:2068:x1830967309671808:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147187.750581:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+54:2068:x1830967309671808:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 205us (305us total) trans 8589936874 rc 0/0 00000100:00100000:0.0:1746147187.750587:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5909 00000100:00100000:0.0:1746147187.756416:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309672320 00000100:00100000:0.0:1746147187.756421:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309672320 00002000:00100000:0.0:1746147187.756443:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88011db17800 x1830967309672320/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.756451:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db17800 with x1830967309672320 ext(1048576->2097151) 00002000:00010000:0.0:1746147187.756454:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db17800 00000100:00100000:0.0:1746147187.756466:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309672832 00000100:00100000:0.0:1746147187.756468:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309672832 00002000:00100000:0.0:1746147187.756478:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88011db14700 x1830967309672832/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:563/0 lens 488/0 e 0 to 0 dl 1746147198 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147187.756484:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14700 with x1830967309672832 ext(1048576->2097151) 00002000:00010000:0.0:1746147187.756487:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db14700 00000100:00100000:0.0:1746147187.756498:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6512 00000100:00100000:0.0:1746147187.756503:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967309672320:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147187.787825:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.804893:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.805505:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.808116:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.810076:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.810718:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.814884:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.819605:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.832968:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.835575:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.844145:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.851537:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.856677:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.871349:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.871393:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.871441:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.872508:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6521 00000100:00100000:0.0:1746147187.872516:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967309675648:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147187.918895:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.922214:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.929884:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.947663:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.958710:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.958877:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.960866:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18026 00000100:00100000:0.0:1746147187.960874:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967309677184:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147187.960882:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147187.960893:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e260800/0x313993942505e6ca lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c7f8 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147187.960921:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e486a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311187712:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147187.960947:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147187.968275:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.968323:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.978712:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147187.980513:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309677952 00000100:00100000:0.0:1746147187.980517:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309677952 00000100:00100000:0.0:1746147187.980551:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5910 00000100:00100000:0.0:1746147187.980556:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+56:2069:x1830967309677952:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:0.0:1746147187.980662:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+57:2069:x1830967309677952:12345-192.168.204.25@tcp:35:cat.0 Request processed in 105us (315us total) trans 8589936876 rc 0/0 00000100:00100000:0.0:1746147187.980667:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5910 00000100:00100000:0.0:1746147187.981337:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.003066:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.005703:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.011549:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.021039:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.057675:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.103427:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.112864:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.124958:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.124977:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309680768 00000100:00100000:0.0:1746147188.124981:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309680768 00000100:00100000:0.0:1746147188.125014:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 932 00000100:00100000:0.0:1746147188.125018:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+59:2001:x1830967309680768:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147188.125027:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147188.125042:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0e0600/0x313993942505e72c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c829 expref: 59 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.125059:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147188.125061:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147188.125107:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+58:2001:x1830967309680768:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 88us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.125112:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 932 00000100:00100000:0.0:1746147188.127245:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.133447:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.148585:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.168574:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.168667:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.180358:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.189964:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.190050:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.198540:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.213176:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.214761:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.224730:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.229260:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.229304:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.235709:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.237272:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.237301:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.237337:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.237559:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18040 00000100:00100000:0.0:1746147188.237566:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2001:x1830967309683712:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147188.237574:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.237584:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312e7a00/0x313993942505e795 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c86f expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147188.237619:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009885a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311190144:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147188.237674:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.242399:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309683968 00000100:00100000:0.0:1746147188.242408:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309683968 00000100:00100000:0.0:1746147188.242590:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18041 00000100:00100000:0.0:1746147188.242599:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2077:x1830967309683968:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147188.242621:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.242640:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801312e6600/0x313993942505e79c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c876 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.242670:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x313993942505e710 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c822 expref: 19 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.242678:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.242680:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.242684:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e6600/0x313993942505e79c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2818048->3145727] (req 2818048->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c876 expref: 19 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.242713:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x313993942505e710 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c822 expref: 19 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.242723:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x313993942505e710 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c822 expref: 19 pid: 10340 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746147188.242734:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009885b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311190272:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147188.242793:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.244439:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.244502:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.244808:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009885b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311190272:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147188.244834:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801312e6600/0x313993942505e79c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2818048->3145727] (req 2818048->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c876 expref: 19 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.244848:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e6600, rc 0) 00000100:00100000:0.0:1746147188.245018:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2077:x1830967309683968:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2420us (3727us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.245028:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18041 00000100:00100000:0.0:1746147188.245246:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967309683840:12345-192.168.204.25@tcp:4:cat.0 Request processed in 7377us (7907us total) trans 17179874880 rc 0/0 00000100:00100000:0.0:1746147188.245254:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1503 00002000:00100000:0.0:1746147188.245262:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->1388543) req@ffff88009885aa00 x1830967309683840/t17179874880(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:564/0 lens 488/448 e 0 to 0 dl 1746147199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.245271:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885aa00 with x1830967309683840 ext(1048576->1388543) 00010000:00010000:0.0:1746147188.245277:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x313993942505e6a7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c7d5 expref: 21 pid: 10340 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746147188.245287:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x313993942505e6a7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c7d5 expref: 21 pid: 10340 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746147188.245293:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009885aa00 00000100:00100000:0.0:1746147188.248075:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.248158:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.254773:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.255809:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.255832:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309685248 00000100:00100000:0.0:1746147188.255835:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309685248 00002000:00100000:0.0:1746147188.255867:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880098858a80 x1830967309685248/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.255877:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098858a80 with x1830967309685248 ext(1048576->2097151) 00002000:00010000:0.0:1746147188.255882:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098858a80 00000100:00100000:0.0:1746147188.255896:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6533 00000100:00100000:0.0:1746147188.255902:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967309685248:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147188.260367:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.267439:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.267540:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.270256:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.270307:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.276265:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967309685888:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5588us (5998us total) trans 17179874881 rc 0/0 00000100:00100000:0.0:1746147188.276276:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1504 00002000:00100000:0.0:1746147188.276287:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2605056->2932735) req@ffff880098859880 x1830967309685888/t17179874881(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:564/0 lens 488/448 e 0 to 0 dl 1746147199 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.276294:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098859880 with x1830967309685888 ext(2605056->2932735) 00010000:00010000:0.0:1746147188.276304:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091f28800/0x313993942505e780 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c85a expref: 39 pid: 10340 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746147188.276315:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091f28800/0x313993942505e780 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c85a expref: 39 pid: 10340 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746147188.276320:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098859880 00000100:00100000:0.0:1746147188.277757:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.278225:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309686272 00000100:00100000:0.0:1746147188.278228:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309686272 00010000:00010000:0.0:1746147188.278243:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e6600/0x313993942505e79c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c876 expref: 20 pid: 1136 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746147188.278260:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8107 00000100:00100000:0.0:1746147188.278266:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013232e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967309686272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147188.278274:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147188.278284:0:7226:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147187 -> 1746147188 00002000:00010000:0.0:1746147188.278287:0:7226:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147187 -> 1746147188 00010000:00010000:0.0:1746147188.278290:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801312e6600/0x313993942505e79c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c876 expref: 20 pid: 1136 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746147188.278299:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801312e6600/0x313993942505e79c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c876 expref: 20 pid: 1136 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746147188.278311:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801312e6600/0x313993942505e79c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2818048->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c876 expref: 20 pid: 1136 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746147188.278324:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.278325:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.278329:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x313993942505e7b8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c892 expref: 35 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.278335:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x313993942505e7b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c892 expref: 35 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.278353:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x313993942505e7b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c892 expref: 35 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147188.278361:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009885b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311191296:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147188.278380:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.283636:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.285012:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309686784 00000100:00100000:0.0:1746147188.285017:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309686784 00002000:00100000:0.0:1746147188.285041:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2781184->2785279) req@ffff88013232df80 x1830967309686784/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.285048:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013232df80 with x1830967309686784 ext(2781184->2785279) 00002000:00010000:0.0:1746147188.285052:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013232df80 00000100:00100000:0.0:1746147188.285073:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6536 00000100:00100000:0.0:1746147188.285104:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013232df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967309686784:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147188.285274:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013232df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967309686784:12345-192.168.204.25@tcp:3:cat.0 Request processed in 183us (504us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147188.285281:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6536 00002000:00100000:0.0:1746147188.285287:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2781184->2785279) req@ffff88013232df80 x1830967309686784/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746147199 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.285294:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013232df80 with x1830967309686784 ext(2781184->2785279) 00002000:00010000:0.0:1746147188.285296:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013232df80 00000100:00100000:0.0:1746147188.294861:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.297910:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.305569:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.314637:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.315133:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.342460:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.362474:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.377768:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.377805:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.377840:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.377878:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309688320 00000100:00100000:0.0:1746147188.377887:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309688320 00000100:00100000:0.0:1746147188.377923:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309688448 00000100:00100000:0.0:1746147188.377925:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309688448 00000100:00100000:0.0:1746147188.377947:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309688576 00000100:00100000:0.0:1746147188.377949:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309688576 00000100:00100000:0.0:1746147188.377962:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18047 00000100:00100000:0.0:1746147188.377969:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2003:x1830967309688320:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147188.377988:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.378006:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b0800/0x313993942505e7c6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c8a0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.378029:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.378031:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.378039:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b0800/0x313993942505e7c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8a0 expref: 20 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.378054:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b0800/0x313993942505e7c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8a0 expref: 20 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.378065:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b0800, rc 0) 00000100:00100000:0.0:1746147188.378145:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2003:x1830967309688320:12345-192.168.204.25@tcp:101:cat.0 Request processed in 175us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.378151:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18047 00000100:00100000:0.0:1746147188.378165:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18048 00000100:00100000:0.0:1746147188.378169:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2002:x1830967309688448:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147188.378175:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.378184:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x313993942505e7cd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c8a7 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.378200:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.378201:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.378204:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x313993942505e7cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8a7 expref: 20 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.378213:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x313993942505e7cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8a7 expref: 20 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.378219:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b0a00, rc 0) 00000100:00100000:0.0:1746147188.378231:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2002:x1830967309688448:12345-192.168.204.25@tcp:101:cat.0 Request processed in 62us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.378237:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18048 00000100:00100000:0.0:1746147188.378245:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18049 00000100:00100000:0.0:1746147188.378249:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2003:x1830967309688576:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147188.378254:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.378259:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x313993942505e7d4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c8ae expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.378268:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.378269:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.378272:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x313993942505e7d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8ae expref: 20 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.378279:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x313993942505e7d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8ae expref: 20 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.378290:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1e00, rc 0) 00000100:00100000:0.0:1746147188.378300:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2003:x1830967309688576:12345-192.168.204.25@tcp:101:cat.0 Request processed in 51us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.378305:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18049 00000100:00100000:0.0:1746147188.379708:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.388763:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.388794:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.388843:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.389372:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6540 00000100:00100000:0.0:1746147188.389379:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967309689472:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147188.436719:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.436767:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.448994:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.449035:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.449111:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309690240 00000100:00100000:0.0:1746147188.449118:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309690240 00010000:00010000:0.0:1746147188.449151:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096b80200/0x313993942505e68b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c7b9 expref: 38 pid: 1853 timeout: 826 lvb_type: 1 00000100:00100000:0.0:1746147188.449183:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309690368 00000100:00100000:0.0:1746147188.449186:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309690368 00010000:00010000:0.0:1746147188.449196:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x313993942505e5ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c76c expref: 22 pid: 1853 timeout: 826 lvb_type: 1 00000100:00100000:0.0:1746147188.449217:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8110 00000100:00100000:0.0:1746147188.449223:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967309690368:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147188.449230:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147188.449244:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x313993942505e5ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c76c expref: 22 pid: 1853 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746147188.449253:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x313993942505e5ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c76c expref: 22 pid: 1853 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746147188.449603:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x313993942505e5ea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c76c expref: 22 pid: 1853 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746147188.449617:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.449618:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.449625:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093708c00/0x313993942505e7fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8bc expref: 36 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.449632:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093708c00/0x313993942505e7fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8bc expref: 36 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.449663:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093708c00/0x313993942505e7fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8bc expref: 36 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147188.449675:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311191936:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147188.450024:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.464814:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c3c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311191936:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147188.464840:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147188.465572:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967309690368:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 16344us (16532us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.465585:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8110 00000100:00100000:0.0:1746147188.486001:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.490890:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.501213:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.501256:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.502214:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.507726:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.511423:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.511446:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.511667:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.518682:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.524390:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.524431:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.524483:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.528020:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.534834:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.536684:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.536738:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.547744:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309693696 00000100:00100000:0.0:1746147188.547748:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309693696 00010000:00010000:0.0:1746147188.547764:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a1f800/0x313993942505e66f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c79d expref: 22 pid: 12201 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746147188.548193:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096b81600/0x313993942505e684 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c7b2 expref: 38 pid: 1853 timeout: 826 lvb_type: 1 00000100:00100000:0.0:1746147188.548211:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e501500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311192704:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147188.550141:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a1f800/0x313993942505e66f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c79d expref: 22 pid: 12201 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746147188.550159:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e503800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311192832:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147188.550185:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ffb600/0x313993942505e852 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1241087) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8f4 expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.550197:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffb600, rc 0) 00000100:00100000:0.0:1746147188.550231:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2103:x1830967309693184:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 15236us (15398us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.550239:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18057 00000100:00100000:0.0:1746147188.550262:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309693824 00000100:00100000:0.0:1746147188.550267:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309693824 00000100:00100000:0.0:1746147188.550302:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18060 00000100:00100000:0.0:1746147188.550308:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2102:x1830967309693824:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147188.550321:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.550335:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x313993942505e867 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c909 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.550357:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x313993942505e80c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2121727] (req 2097152->2117631) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8ca expref: 37 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.550364:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147188.550367:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147188.550370:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x313993942505e867 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2117632->3145727] (req 2117632->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c909 expref: 37 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.550396:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x313993942505e80c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2121727] (req 2097152->2117631) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8ca expref: 37 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.550408:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ffa800/0x313993942505e80c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2121727] (req 2097152->2117631) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8ca expref: 37 pid: 12225 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746147188.550419:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311193216:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147188.550482:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.556669:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.556748:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.566860:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.568991:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.583337:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.608812:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.619836:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.638331:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.652250:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.668496:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147188.669421:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147188.673556:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.679932:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.680063:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.680337:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.680352:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309696768 00000100:00100000:0.0:1746147188.680355:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309696768 00000100:00100000:0.0:1746147188.680601:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309697024 00000100:00100000:0.0:1746147188.680604:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309697024 00000100:00100000:0.0:1746147188.680894:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.680928:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.681150:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18068 00000100:00100000:0.0:1746147188.681156:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2003:x1830967309696640:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147188.681161:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.681166:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091f28800/0x313993942505e8bb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c93a expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147188.681191:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311194112:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147188.681216:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.681241:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309696896 00000100:00100000:0.0:1746147188.681244:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309696896 00000100:00100000:0.0:1746147188.681260:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18069 00000100:00100000:0.0:1746147188.681265:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967309696896:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147188.681270:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.681277:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38e800/0x313993942505e8c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c948 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.681287:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.681288:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.681292:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38e800/0x313993942505e8c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c948 expref: 15 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.681301:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38e800/0x313993942505e8c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c948 expref: 15 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.681313:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38e800, rc 0) 00000100:00100000:0.0:1746147188.681327:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967309696896:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 63us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.681332:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18069 00000100:00100000:0.0:1746147188.684658:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311194112:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147188.684692:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091f28800/0x313993942505e8bb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c93a expref: 10 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.684705:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091f28800/0x313993942505e8bb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c93a expref: 10 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.684720:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f28800, rc 0) 00000100:00100000:0.0:1746147188.684854:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2003:x1830967309696640:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 3698us (3924us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147188.686006:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18068 00000100:00100000:0.0:1746147188.688413:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.691794:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.703627:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16079 00000100:00100000:0.0:1746147188.703646:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2107:x1830967309697664:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147188.703675:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.703680:0:7237:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746147188.703712:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093708600/0x313993942505e8d0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c956 expref: 22 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.704622:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147188.704652:0:7237:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147188.704671:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f200/0x313993942505e8de lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c95d expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.704778:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e200/0x313993942505e8e5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147188.704791:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e200/0x313993942505e8e5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147188.704801:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e200/0x313993942505e8e5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:0.0:1746147188.704812:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147188.704916:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f200/0x313993942505e8de lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c95d expref: 24 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.704928:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e200/0x313993942505e8e5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c95d expref: 23 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.704934:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147188.704937:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147188.704939:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38e200, rc 0) 00000100:00100000:0.0:1746147188.706860:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2107:x1830967309697664:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 3211us (5800us total) trans 8589936888 rc 0/0 00000100:00100000:0.0:1746147188.706871:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16079 00000100:00100000:0.0:1746147188.717868:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.717970:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.718003:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.718030:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.718844:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18072 00000100:00100000:0.0:1746147188.718851:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2003:x1830967309698176:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147188.718869:0:12201:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f38f200/0x313993942505e908 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.718879:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ffb600/0x313993942505e852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1241087) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8f4 expref: 19 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.718884:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147188.718885:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147188.718887:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38f200/0x313993942505e908 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.718903:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097ffb600/0x313993942505e852 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1241087) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8f4 expref: 19 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.718912:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097ffb600/0x313993942505e852 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1241087) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8f4 expref: 19 pid: 12201 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746147188.718921:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311194752:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147188.718943:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.721258:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18075 00000100:00100000:0.0:1746147188.721265:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2003:x1830967309698560:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147188.721288:0:1136:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f38f400/0x313993942505e91d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.721304:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d9bc00/0x313993942505e7bf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c899 expref: 37 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.721310:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ffac00/0x313993942505e8a6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c94f expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.721317:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x313993942505e7d4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8ae expref: 19 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.721323:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.721325:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.721327:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38f400/0x313993942505e91d lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.721352:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x313993942505e7d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8ae expref: 19 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.721363:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x313993942505e7d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8ae expref: 19 pid: 10340 timeout: 826 lvb_type: 1 00000100:00100000:0.0:1746147188.721375:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5577480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311195392:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147188.721441:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097ffac00/0x313993942505e8a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c94f expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147188.721450:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097ffac00/0x313993942505e8a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c94f expref: 11 pid: 1853 timeout: 826 lvb_type: 1 00000100:00100000:0.0:1746147188.721463:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311195648:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147188.721490:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d9bc00/0x313993942505e7bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c899 expref: 37 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.721498:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d9bc00/0x313993942505e7bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c899 expref: 37 pid: 9585 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746147188.721505:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311195904:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147188.721520:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147188.730777:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.730893:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5577480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311195392:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147188.730939:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311194752:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147188.730959:0:12201:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f38f200/0x313993942505e908 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147188.730991:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.731012:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311195648:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147188.731031:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311195904:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147188.731049:0:1136:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f38f400/0x313993942505e91d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147188.734186:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.734640:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.735545:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309699328 00000100:00100000:0.0:1746147188.735549:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309699328 00010000:00010000:0.0:1746147188.735563:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d9b800/0x313993942505e787 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c861 expref: 38 pid: 10340 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746147188.736047:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8121 00000100:00100000:0.0:1746147188.736056:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967309699328:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147188.736064:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147188.736084:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d9b800/0x313993942505e787 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c861 expref: 38 pid: 10340 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746147188.736121:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d9b800/0x313993942505e787 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c861 expref: 38 pid: 10340 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746147188.736135:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d9b800/0x313993942505e787 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c861 expref: 38 pid: 10340 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746147188.736149:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147188.736169:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967309699328:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 115us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.736175:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8121 00000100:00100000:0.0:1746147188.736224:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309699584 00000100:00100000:0.0:1746147188.736227:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309699584 00002000:00100000:0.0:1746147188.736253:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x97:0x0] (1060864->1241087) req@ffff88013232e680 x1830967309699584/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:564/0 lens 488/0 e 0 to 0 dl 1746147199 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147188.736262:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013232e680 with x1830967309699584 ext(1060864->1241087) 00010000:00010000:0.0:1746147188.736270:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097ffb600/0x313993942505e852 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1241087) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8f4 expref: 20 pid: 12201 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746147188.736279:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097ffb600/0x313993942505e852 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1241087) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8f4 expref: 20 pid: 12201 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746147188.736285:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013232e680 00000100:00100000:0.0:1746147188.736298:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1509 00000100:00100000:0.0:1746147188.736302:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013232e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2002:x1830967309699584:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147188.736390:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8122 00000100:00100000:0.0:1746147188.736395:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013232ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2002:x1830967309699840:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147188.736401:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147188.736409:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ffac00/0x313993942505e8a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c94f expref: 11 pid: 1853 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746147188.736415:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ffac00/0x313993942505e8a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c94f expref: 11 pid: 1853 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746147188.736426:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ffac00/0x313993942505e8a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c94f expref: 11 pid: 1853 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746147188.736434:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147188.736447:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013232ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2002:x1830967309699840:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 52us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.736451:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8122 00000100:00100000:0.0:1746147188.736462:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8124 00000100:00100000:0.0:1746147188.736467:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2002:x1830967309699200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147188.736471:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147188.736476:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800993b0800/0x313993942505e7c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8a0 expref: 23 pid: 10340 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746147188.736484:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800993b0800/0x313993942505e7c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8a0 expref: 23 pid: 10340 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746147188.736493:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b0800/0x313993942505e7c6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8a0 expref: 23 pid: 10340 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746147188.736500:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.736501:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.736504:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093708600/0x313993942505e8fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.736509:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093708600/0x313993942505e8fa lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.736522:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147188.736535:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2002:x1830967309699200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 68us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.736539:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8124 00000100:00100000:0.0:1746147188.746287:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309700352 00000100:00100000:0.0:1746147188.746296:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309700352 00010000:00010000:0.0:1746147188.746333:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097cd3800/0x313993942505e813 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2121728->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8d1 expref: 18 pid: 12225 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746147188.746380:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8129 00000100:00100000:0.0:1746147188.746388:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967309700352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147188.746401:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147188.746417:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097cd3800/0x313993942505e813 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2121728->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8d1 expref: 18 pid: 12225 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746147188.746428:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097cd3800/0x313993942505e813 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2121728->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8d1 expref: 18 pid: 12225 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746147188.746449:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cd3800/0x313993942505e813 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2121728->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c8d1 expref: 18 pid: 12225 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746147188.746462:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.746463:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147188.746468:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932d6400/0x313993942505e916 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.746476:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d6400/0x313993942505e916 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.746513:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147188.747146:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2003:x1830967309700352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 757us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.747154:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8129 00010000:00010000:0.0:1746147188.747704:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147188.754894:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.754990:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147188.756275:0:12201:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f38f200/0x313993942505e908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.756285:0:12201:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f38f200/0x313993942505e908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.756304:0:12201:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f38f200/0x313993942505e908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.756312:0:12201:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38f200/0x313993942505e908 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.756319:0:12201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f38f200/0x313993942505e908 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.756325:0:12201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38f200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147188.756329:0:12201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f38f200/0x313993942505e908 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.756336:0:12201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f38f200/0x313993942505e908 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.756346:0:12201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f38f200/0x313993942505e908 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.756352:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38f200/0x313993942505e908 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147188.756399:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2003:x1830967309698176:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 37549us (38395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.756407:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18072 00000100:00100000:0.0:1746147188.758357:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.765250:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.765297:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.765317:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309701248 00000100:00100000:0.0:1746147188.765321:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309701248 00010000:00010000:0.0:1746147188.765351:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x313993942505ddfc lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c28e expref: 29 pid: 9138 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746147188.765373:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8132 00000100:00100000:0.0:1746147188.765378:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2000:x1830967309701248:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147188.765392:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147188.765398:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x313993942505ddfc lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c28e expref: 29 pid: 9138 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746147188.765409:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90200/0x313993942505ddfc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c28e expref: 29 pid: 9138 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746147188.765429:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147188.765433:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x313993942505e924 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147188.765443:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147188.765478:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2000:x1830967309701248:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 100us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.765488:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8132 00000100:00100000:0.0:1746147188.765553:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.765609:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.765691:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.765710:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309701632 00000100:00100000:0.0:1746147188.765713:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309701632 00010000:00010000:0.0:1746147188.765725:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091eba800/0x313993942505e064 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c408 expref: 66 pid: 7237 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746147188.765739:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8135 00000100:00100000:0.0:1746147188.765744:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+66:2000:x1830967309701632:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147188.765750:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147188.765754:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091eba800/0x313993942505e064 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c408 expref: 66 pid: 7237 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746147188.766676:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091eba800/0x313993942505e064 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c408 expref: 64 pid: 7237 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746147188.766691:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091eba800/0x313993942505e064 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c408 expref: 64 pid: 7237 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746147188.766703:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147188.766706:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ba00/0x313993942505e924 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147188.766711:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147188.766749:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+63:2000:x1830967309701632:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1004us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.766759:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8135 00000100:00100000:0.0:1746147188.769689:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147188.786366:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x313993942505dec7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147188.786372:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x313993942505dec7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147188.786377:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x313993942505dec7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147188.786381:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d94800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147188.786384:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x313993942505dec7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147188.786389:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x313993942505dec7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147188.786397:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147188.786399:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147188.786401:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x313993942505dec7 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147188.786405:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x313993942505dec7 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147188.786426:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311197056 00000100:00100000:0.0:1746147188.786432:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311197056 00000100:00100000:0.0:1746147188.786467:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311197184 00000100:00100000:0.0:1746147188.786469:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311197184 00000100:00100000:0.0:1746147188.786482:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18076 00000100:00100000:0.0:1746147188.786487:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3767:x1830967311197056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147188.786622:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3767:x1830967311197056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 135us (813us total) trans 21474842234 rc 0/0 00000100:00100000:0.0:1746147188.786628:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18076 00000100:00100000:0.0:1746147188.786638:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18077 00000100:00100000:0.0:1746147188.786642:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3764:x1830967311197184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147188.786681:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147188.786684:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147188.786686:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147188.786688:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147188.786690:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:0.0:1746147188.786707:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3764:x1830967311197184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (806us total) trans 21474842235 rc 0/0 00000100:00100000:0.0:1746147188.786712:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18077 00000100:00080000:0.0:1746147188.786724:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147188.806144:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147188.806171:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309701888 00000100:00100000:0.0:1746147188.806175:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309701888 00000100:00100000:0.0:1746147188.806210:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16082 00000100:00100000:0.0:1746147188.806216:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2107:x1830967309701888:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147188.806238:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147188.806259:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffd800/0x313993942505e92b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c96b expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.806322:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffd800/0x313993942505e92b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c96b expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.806335:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffd800/0x313993942505e92b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c96b expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147188.806352:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147188.806355:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147188.806358:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ffd800, rc 0) 00000100:00100000:0.0:1746147188.806395:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2107:x1830967309701888:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 179us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147188.806400:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16082 00000100:00080000:0.0:1746147188.808152:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147188.813554:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147188.969753:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746147189.751148:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147189.831747:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.831799:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.833293:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.833321:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.833346:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.833367:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.834870:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309703552 00000100:00100000:0.0:1746147189.834873:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309703552 00000100:00100000:0.0:1746147189.834896:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18101 00000100:00100000:0.0:1746147189.834902:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967309703424:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:0.0:1746147189.834965:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967309703424:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 63us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.834970:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18101 00000100:00100000:0.0:1746147189.834982:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18102 00000100:00100000:0.0:1746147189.834986:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309703168:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:0.0:1746147189.835012:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309703168:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 26us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.835017:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18102 00000100:00100000:0.0:1746147189.835024:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18103 00000100:00100000:0.0:1746147189.835028:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967309703296:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:0.0:1746147189.835056:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967309703296:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 18us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.835061:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18103 00000100:00100000:0.0:1746147189.835068:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18104 00000100:00100000:0.0:1746147189.835072:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967309703552:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:0.0:1746147189.835107:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967309703552:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 34us (1739us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.835112:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18104 00000100:00100000:0.0:1746147189.840383:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.841059:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.841086:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.841150:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.841163:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.841187:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.841206:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309703808 00000100:00100000:0.0:1746147189.841213:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309703808 00000100:00100000:0.0:1746147189.841464:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309704064 00000100:00100000:0.0:1746147189.841467:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309704064 00000100:00100000:0.0:1746147189.848608:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.853844:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.865867:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.866492:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.866529:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.866544:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.866586:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.866623:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309704832 00000100:00100000:0.0:1746147189.866631:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309704832 00000100:00100000:0.0:1746147189.867884:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309705088 00000100:00100000:0.0:1746147189.867889:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309705088 00000100:00100000:0.0:1746147189.874545:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.874564:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309706624 00000100:00100000:0.0:1746147189.874569:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309706624 00000100:00100000:0.0:1746147189.874601:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6559 00000100:00100000:0.0:1746147189.874607:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2002:x1830967309706624:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:0.0:1746147189.874620:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800932d6c00/0x313993942505e99b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.874627:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147189.874629:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147189.874632:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d6c00/0x313993942505e99b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.874640:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d6c00/0x313993942505e99b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147189.934814:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.940447:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.945246:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.968757:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.971503:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309707776 00000100:00100000:0.0:1746147189.971509:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309707776 00000100:00100000:0.0:1746147189.971544:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16085 00000100:00100000:0.0:1746147189.971550:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2120:x1830967309707776:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147189.971560:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147189.971568:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x313993942505e9c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7c9aa expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.971601:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x313993942505e9cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.971608:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x313993942505e9cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.971615:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x313993942505e9cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.971622:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x313993942505e9d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.971627:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x313993942505e9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.971633:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x313993942505e9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.971675:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x313993942505e9da lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.971682:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x313993942505e9da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.971688:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x313993942505e9da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:0.0:1746147189.971697:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147189.971730:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x313993942505e9cc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.971735:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x313993942505e9cc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.971739:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x313993942505e9cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.971743:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x313993942505e9cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.971747:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f12cc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147189.971749:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x313993942505e9cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.971754:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x313993942505e9cc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.971760:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147189.971763:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147189.971765:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x313993942505e9cc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.971769:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x313993942505e9cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.972376:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x313993942505e9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.972387:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x313993942505e9d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.972397:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x313993942505e9d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.972402:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f12da00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147189.972404:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x313993942505e9d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.972411:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x313993942505e9d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.972417:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f027b00) 00010000:00010000:0.0:1746147189.972419:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147189.972421:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x313993942505e9d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.972425:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x313993942505e9d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147189.972449:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x313993942505e9c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c9aa expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.972455:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x313993942505e9da lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c9aa expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147189.972468:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147189.972470:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147189.972471:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12d800, rc 0) 00000100:00100000:0.0:1746147189.972528:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2120:x1830967309707776:12345-192.168.204.25@tcp:101:cat.0 Request processed in 977us (1076us total) trans 8589936894 rc 0/0 00000100:00100000:0.0:1746147189.972535:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16085 00000100:00100000:0.0:1746147189.982716:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.983534:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.988368:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.989495:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.991473:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147189.997677:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309710080 00000100:00100000:0.0:1746147189.997680:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309710080 00010000:00010000:0.0:1746147189.997697:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x313993942505ea2e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c9e2 expref: 11 pid: 9138 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746147189.997714:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8140 00000100:00100000:0.0:1746147189.997718:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2003:x1830967309710080:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147189.997725:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147189.997729:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x313993942505ea2e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c9e2 expref: 11 pid: 9138 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746147189.997739:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x313993942505ea2e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c9e2 expref: 11 pid: 9138 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746147189.997800:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a2e00/0x313993942505ea2e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c9e2 expref: 11 pid: 9138 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746147189.997818:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147189.997821:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e800/0x313993942505ea43 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147189.997827:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e800/0x313993942505ea43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147189.997832:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0e800/0x313993942505ea43 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147189.997838:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091f28600/0x313993942505ea58 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147189.997843:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091f28600/0x313993942505ea58 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147189.999114:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147189.999144:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2003:x1830967309710080:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1424us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147189.999152:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8140 00000100:00100000:0.0:1746147190.004182:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.004203:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309710464 00000100:00100000:0.0:1746147190.004210:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309710464 00010000:00010000:0.0:1746147190.004247:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffd800/0x313993942505e92b lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c96b expref: 9 pid: 7237 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746147190.004279:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8141 00000100:00100000:0.0:1746147190.004286:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2003:x1830967309710464:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147190.004298:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147190.004542:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffd800/0x313993942505e92b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c96b expref: 9 pid: 7237 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746147190.004550:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffd800/0x313993942505e92b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c96b expref: 9 pid: 7237 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746147190.004568:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffd800/0x313993942505e92b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c96b expref: 9 pid: 7237 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746147190.004593:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147190.004598:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091f28600/0x313993942505ea58 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147190.004605:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091f28600/0x313993942505ea58 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147190.004610:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147190.004653:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2003:x1830967309710464:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 367us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147190.004660:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8141 00000100:00100000:0.0:1746147190.004714:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309710208 00000100:00100000:0.0:1746147190.004717:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309710208 00010000:00010000:0.0:1746147190.004735:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x313993942505ea3c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c9f0 expref: 10 pid: 7239 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746147190.004747:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8142 00000100:00100000:0.0:1746147190.004752:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2002:x1830967309710208:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147190.004758:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147190.004761:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x313993942505ea3c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c9f0 expref: 10 pid: 7239 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746147190.004770:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x313993942505ea3c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c9f0 expref: 10 pid: 7239 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746147190.004780:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x313993942505ea3c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c9f0 expref: 10 pid: 7239 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746147190.004788:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147190.004791:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091f28600/0x313993942505ea58 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147190.004796:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091f28600/0x313993942505ea58 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147190.004800:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147190.004816:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2002:x1830967309710208:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 63us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147190.004821:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8142 00000100:00100000:0.0:1746147190.005476:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.005494:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.005921:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.012752:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.012797:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.012829:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.029819:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746147190.029827:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311201920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147190.029851:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147190.030261:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca11880/2, rc 0, transno 21474842252 00000100:00100000:0.0:1746147190.030265:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311201920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147190.034611:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.045920:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.045962:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.045997:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.046012:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.046036:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.046062:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.046086:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309712128 00000100:00100000:0.0:1746147190.046117:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309712128 00000100:00100000:0.0:1746147190.046158:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309712256 00000100:00100000:0.0:1746147190.046161:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309712256 00000100:00100000:0.0:1746147190.046174:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309712384 00000100:00100000:0.0:1746147190.046176:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309712384 00000100:00100000:0.0:1746147190.046184:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309712512 00000100:00100000:0.0:1746147190.046186:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309712512 00000100:00100000:0.0:1746147190.046932:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18141 00000100:00100000:0.0:1746147190.046936:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2002:x1830967309712512:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147190.046941:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147190.046947:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f12d000/0x313993942505ea90 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ca21 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.046956:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147190.046957:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147190.046961:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12d000/0x313993942505ea90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca21 expref: 40 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147190.046973:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f12d000/0x313993942505ea90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca21 expref: 40 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147190.046979:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12d000, rc 0) 00000100:00100000:0.0:1746147190.047005:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2002:x1830967309712512:12345-192.168.204.25@tcp:101:cat.0 Request processed in 68us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147190.047009:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18141 00000100:00100000:0.0:1746147190.056376:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.065039:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.065165:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.065211:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.065249:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.065304:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.065334:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309714048 00000100:00100000:0.0:1746147190.065342:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309714048 00010000:00010000:0.0:1746147190.065378:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097cd3000/0x313993942505ea19 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c9d4 expref: 20 pid: 9585 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746147190.065415:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8144 00000100:00100000:0.0:1746147190.065426:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967309714048:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147190.065444:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147190.065470:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097cd3000/0x313993942505ea19 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c9d4 expref: 20 pid: 9585 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746147190.065482:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097cd3000/0x313993942505ea19 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c9d4 expref: 20 pid: 9585 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746147190.065516:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147190.065572:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967309714048:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 147us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147190.065579:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8144 00000100:00100000:0.0:1746147190.065739:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.065756:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309714176 00000100:00100000:0.0:1746147190.065761:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309714176 00010000:00010000:0.0:1746147190.065775:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0d000/0x313993942505ea82 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca28 expref: 45 pid: 13695 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746147190.065807:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8145 00000100:00100000:0.0:1746147190.065813:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f78050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2002:x1830967309714176:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147190.065824:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147190.065834:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0d000/0x313993942505ea82 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca28 expref: 45 pid: 13695 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746147190.065842:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0d000/0x313993942505ea82 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca28 expref: 45 pid: 13695 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746147190.065856:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147190.065884:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f78050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2002:x1830967309714176:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 70us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147190.065890:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8145 00000100:00100000:0.0:1746147190.066024:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.066056:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309714304 00000100:00100000:0.0:1746147190.066060:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309714304 00010000:00010000:0.0:1746147190.066086:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800982a2200/0x313993942505e963 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c995 expref: 15 pid: 13695 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746147190.066140:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8146 00000100:00100000:0.0:1746147190.066146:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967309714304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147190.066155:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147190.066165:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800982a2200/0x313993942505e963 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c995 expref: 15 pid: 13695 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746147190.066175:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800982a2200/0x313993942505e963 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c995 expref: 15 pid: 13695 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746147190.066188:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147190.066191:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147190.066199:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x313993942505ea97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2588672->2977791) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca36 expref: 44 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.066208:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x313993942505ea97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2588672->2977791) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca36 expref: 44 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.066243:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x313993942505ea97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2588672->2977791) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca36 expref: 44 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147190.066257:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094185180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311202432:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147190.066331:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147190.074436:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094185180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311202432:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147190.074456:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147190.074521:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967309714304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8374us (8497us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147190.074530:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8146 00000100:00100000:0.0:1746147190.085061:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309715328 00000100:00100000:0.0:1746147190.085068:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309715328 00002000:00100000:0.0:1746147190.085137:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2588672->2592767) req@ffff88012ca12a00 x1830967309715328/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:566/0 lens 488/0 e 0 to 0 dl 1746147201 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147190.085144:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca12a00 with x1830967309715328 ext(2588672->2592767) 00002000:00010000:0.0:1746147190.085147:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ca12a00 00000100:00100000:0.0:1746147190.086676:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6571 00000100:00100000:0.0:1746147190.087258:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967309715328:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147190.087358:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967309715328:12345-192.168.204.25@tcp:3:cat.0 Request processed in 104us (3123us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147190.087365:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6571 00002000:00100000:0.0:1746147190.087373:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (2588672->2592767) req@ffff88012ca12a00 x1830967309715328/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:566/0 lens 488/4536 e 0 to 0 dl 1746147201 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147190.087382:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca12a00 with x1830967309715328 ext(2588672->2592767) 00002000:00010000:0.0:1746147190.087387:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ca12a00 00000100:00100000:0.0:1746147190.095845:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.101950:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.101978:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.101998:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.110805:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.118442:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.125976:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.132460:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.134768:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.134781:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309717120 00000100:00100000:0.0:1746147190.134783:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309717120 00000100:00100000:0.0:1746147190.135782:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.140774:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.150750:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.151444:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.151930:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8151 00000100:00100000:0.0:1746147190.151937:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967309717632:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147190.151945:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147190.151956:0:7225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147188 -> 1746147190 00002000:00010000:0.0:1746147190.151958:0:7225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147187 -> 1746147190 00002000:00010000:0.0:1746147190.151960:0:7225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147188 -> 1746147190 00010000:00010000:0.0:1746147190.151964:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x313993942505ea97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2588672->2977791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca36 expref: 42 pid: 13695 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746147190.152102:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x313993942505ea97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2588672->2977791) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca36 expref: 42 pid: 13695 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746147190.152116:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x313993942505ea97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2588672->2977791) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca36 expref: 42 pid: 13695 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746147190.152128:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147190.152130:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147190.152134:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f588e00/0x313993942505eaa5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca44 expref: 20 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.152140:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f588e00/0x313993942505eaa5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca44 expref: 20 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.152146:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147190.152147:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147190.152150:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094182c00/0x313993942505eaac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca4b expref: 20 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.152157:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094182c00/0x313993942505eaac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca4b expref: 20 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.152174:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094182c00/0x313993942505eaac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4513791) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca4b expref: 20 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147190.152187:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311203456:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147190.152222:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f588e00/0x313993942505eaa5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca44 expref: 20 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147190.152230:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311203584:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147190.152246:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147190.159039:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.159082:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.164844:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.165340:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6576 00000100:00100000:0.0:1746147190.165349:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967309718400:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147190.176708:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.177114:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.182653:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.182699:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.182744:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.203676:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.203738:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.222614:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.229811:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.234642:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.245683:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.249462:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.250620:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.266453:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.269188:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.278820:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.284296:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.286254:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.290790:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.293708:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.297509:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.300769:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.306062:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.306133:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.306160:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.306180:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.306203:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309723136 00000100:00100000:0.0:1746147190.306213:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309723136 00000100:00100000:0.0:1746147190.306253:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309723392 00000100:00100000:0.0:1746147190.306255:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309723392 00000100:00100000:0.0:1746147190.306266:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309723648 00000100:00100000:0.0:1746147190.306268:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309723648 00000100:00100000:0.0:1746147190.306282:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18155 00000100:00100000:0.0:1746147190.306290:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967309723136:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147190.306334:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009400ba00/0x313993942505eb3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.306350:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x313993942505e940 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c980 expref: 12 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147190.306359:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c11200/0x313993942505ea6d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca13 expref: 38 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147190.306370:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cd3600/0x313993942505ea0b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c9bf expref: 23 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147190.306376:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147190.306377:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147190.306379:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009400ba00/0x313993942505eb3f lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.306404:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097cd3600/0x313993942505ea0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c9bf expref: 23 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147190.306509:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097cd3600/0x313993942505ea0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c9bf expref: 23 pid: 9585 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746147190.306526:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311204480:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147190.306558:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098c11200/0x313993942505ea6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca13 expref: 38 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147190.306566:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098c11200/0x313993942505ea6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca13 expref: 38 pid: 1398 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746147190.306574:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311204864:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147190.306598:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x313993942505e940 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c980 expref: 12 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147190.306609:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800982a3600/0x313993942505e940 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c980 expref: 12 pid: 13695 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746147190.306616:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311205120:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147190.306633:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147190.306662:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.306677:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309723264 00000100:00100000:0.0:1746147190.306680:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309723264 00000100:00100000:0.0:1746147190.306705:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18159 00000100:00100000:0.0:1746147190.306710:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967309723264:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147190.306726:0:1398:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x313993942505eb5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.306736:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff400/0x313993942505e95c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c987 expref: 13 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147190.306743:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x313993942505ea74 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca1a expref: 38 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147190.306749:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db32a00/0x313993942505ea04 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c9c6 expref: 23 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147190.306754:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147190.306755:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147190.306757:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x313993942505eb5b lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.306774:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db32a00/0x313993942505ea04 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c9c6 expref: 23 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147190.306782:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db32a00/0x313993942505ea04 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c9c6 expref: 23 pid: 9586 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746147190.306790:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311205376:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147190.306818:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x313993942505ea74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca1a expref: 38 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147190.306826:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x313993942505ea74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ca1a expref: 38 pid: 13695 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746147190.306834:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311205632:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147190.306856:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff400/0x313993942505e95c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c987 expref: 13 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147190.306864:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff400/0x313993942505e95c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7c987 expref: 13 pid: 1136 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746147190.306872:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311205888:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147190.306883:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941540c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147190.306950:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.318425:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.318443:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.318469:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.318481:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.318511:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.318525:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.318580:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311205376:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147190.318624:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311205632:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147190.318651:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311205888:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147190.318677:0:1398:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x313993942505eb5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147190.318747:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.318756:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.318766:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.318776:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.318804:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.322767:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.322801:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.322817:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.322829:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.322852:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.322864:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.322916:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311206144:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147190.322946:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311206400:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147190.322973:0:1853:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942505eb62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147190.323141:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.323213:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147190.323571:0:1398:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x313993942505eb5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.323579:0:1398:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x313993942505eb5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.323601:0:1398:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x313993942505eb5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.323608:0:1398:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x313993942505eb5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.323615:0:1398:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x313993942505eb5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.323626:0:1398:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094182c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147190.323629:0:1398:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x313993942505eb5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.323635:0:1398:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x313993942505eb5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.323650:0:1398:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x313993942505eb5b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.323661:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x313993942505eb5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147190.323850:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967309723264:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 17137us (17185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147190.323859:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18159 00010000:00010000:0.0:1746147190.323889:0:12201:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505eb54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.323896:0:12201:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505eb54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.323906:0:12201:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505eb54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.323911:0:12201:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505eb54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.323917:0:12201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505eb54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.323921:0:12201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0c200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147190.323924:0:12201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505eb54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.323928:0:12201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505eb54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.323937:0:12201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505eb54 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.323942:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x313993942505eb54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147190.323966:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2001:x1830967309723648:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 17365us (17804us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147190.323971:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18157 00010000:00010000:0.0:1746147190.329358:0:1853:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942505eb62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.329367:0:1853:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942505eb62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.329566:0:1853:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942505eb62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.329574:0:1853:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942505eb62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.329579:0:1853:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942505eb62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.329584:0:1853:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093731e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147190.329587:0:1853:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942505eb62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.329593:0:1853:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942505eb62 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.329602:0:1853:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942505eb62 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147190.329606:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942505eb62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147190.329647:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967309723520:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 22291us (22696us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147190.331318:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18160 00000100:00100000:0.0:1746147190.337453:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.337482:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.337516:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147190.338772:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x313993942505eb69 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147190.338778:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x313993942505eb69 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000040:00080000:0.0:1746147190.339293:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1008, 88 off96536 00000004:00080000:0.0:1746147190.339298:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728329208329ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147190.339553:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1036, 88 off99008 00000004:00080000:0.0:1746147190.339557:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728329467624ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147190.339890:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1037, 88 off99096 00000004:00080000:0.0:1746147190.339895:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728329805721ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147190.339908:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1009, 88 off96624 00000004:00080000:0.0:1746147190.339910:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728329820639ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147190.339929:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1010, 88 off96712 00000004:00080000:0.0:1746147190.339932:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728329842637ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147190.340234:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1038, 88 off99184 00000004:00080000:0.0:1746147190.340239:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728330149266ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147190.340262:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1039, 88 off99272 00000004:00080000:0.0:1746147190.340265:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728330175524ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147190.340272:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1040, 88 off99360 00000004:00080000:0.0:1746147190.340274:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728330184906ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147190.340282:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1011, 88 off96800 00000004:00080000:0.0:1746147190.340285:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728330195196ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147190.340293:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1041, 88 off99448 00000004:00080000:0.0:1746147190.340295:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728330205744ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147190.340302:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1012, 88 off96888 00000004:00080000:0.0:1746147190.340305:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728330215294ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147190.340311:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1042, 88 off99536 00000004:00080000:0.0:1746147190.340314:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728330224359ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147190.340630:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1013, 88 off96976 00000004:00080000:0.0:1746147190.340634:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728330544682ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147190.340706:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1014, 88 off97064 00000004:00080000:0.0:1746147190.340709:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728330620032ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147190.340809:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1015, 88 off97152 00000004:00080000:0.0:1746147190.340813:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728330723292ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147190.340823:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1016, 88 off97240 00000004:00080000:0.0:1746147190.340826:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728330736594ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147190.340835:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1043, 88 off99624 00000004:00080000:0.0:1746147190.340838:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728330749034ns, next at 694367916532ns, rc = 0 00000100:00100000:0.0:1746147190.346071:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311207424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147190.346174:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147190.346218:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311207936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147190.346238:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147190.346250:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311208576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147190.346261:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147190.346272:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1746147190.346277:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311207552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147190.346288:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147190.346298:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311208064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147190.346309:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147190.346318:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311208448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147190.346330:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147190.346344:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311208960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147190.346357:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147190.346371:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147190.346375:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311209088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147190.346388:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147190.346608:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311207680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147190.346626:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147190.346639:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311208192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147190.346652:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147190.346659:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311208704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147190.346683:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147190.346692:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311209216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147190.346707:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147190.346718:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746147190.346723:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311208832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147190.346738:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147190.346745:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311209344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147190.346755:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147190.346773:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311209344 00000100:00100000:0.0:1746147190.346778:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311209344 00000100:00100000:0.0:1746147190.346801:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18163 00000100:00100000:0.0:1746147190.346807:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3764:x1830967311208576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147190.346919:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3764:x1830967311208576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (656us total) trans 17179874903 rc 0/0 00000100:00100000:0.0:1746147190.346925:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18163 00000100:00100000:0.0:1746147190.346937:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18166 00000100:00100000:0.0:1746147190.346941:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3764:x1830967311208448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147190.346996:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3764:x1830967311208448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (664us total) trans 21474842256 rc 0/0 00000100:00100000:0.0:1746147190.347001:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18166 00000100:00100000:0.0:1746147190.347011:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18169 00000100:00100000:0.0:1746147190.347015:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3766:x1830967311207680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147190.347074:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3766:x1830967311207680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (446us total) trans 17179874906 rc 0/0 00000100:00100000:0.0:1746147190.347079:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18169 00000100:00100000:0.0:1746147190.347108:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18172 00000100:00100000:0.0:1746147190.347113:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3767:x1830967311207808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147190.347153:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147190.347155:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147190.347157:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147190.347159:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147190.347161:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746147190.347181:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3767:x1830967311207808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (493us total) trans 17179874908 rc 0/0 00000100:00100000:0.0:1746147190.347185:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18172 00000004:00080000:0.0:1746147190.347325:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f087b80/2, rc 0, transno 21474842261 00000100:00100000:0.0:1746147190.347342:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311208832:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147190.347351:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f084380/2, rc 0, transno 21474842262 00000100:00100000:0.0:1746147190.347354:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311209344:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147190.347361:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d6680/2, rc 0, transno 17179874906 00000100:00100000:0.0:1746147190.347364:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311207680:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147190.347370:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d4e00/2, rc 0, transno 17179874907 00000100:00100000:0.0:1746147190.347372:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311208192:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147190.347379:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f085c00/2, rc 0, transno 21474842259 00000100:00100000:0.0:1746147190.347382:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311208704:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147190.347389:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f087480/2, rc 0, transno 21474842260 00000100:00100000:0.0:1746147190.347391:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311209216:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147190.347411:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f084e00/2, rc 0, transno 21474842258 00000100:00100000:0.0:1746147190.347413:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311209088:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147190.347422:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f086680/2, rc 0, transno 21474842257 00000100:00100000:0.0:1746147190.347424:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311208960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147190.347431:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d7b80/2, rc 0, transno 17179874904 00000100:00100000:0.0:1746147190.347433:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311207552:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147190.347438:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d7100/2, rc 0, transno 17179874905 00000100:00100000:0.0:1746147190.347440:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311208064:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147190.347445:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f085f80/2, rc 0, transno 21474842256 00000100:00100000:0.0:1746147190.347447:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311208448:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147190.347465:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f084a80/2, rc 0, transno 21474842255 00000100:00100000:0.0:1746147190.347468:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311207936:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147190.347473:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d6300/2, rc 0, transno 17179874903 00000100:00100000:0.0:1746147190.347475:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311208576:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147190.347481:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d6a00/2, rc 0, transno 17179874902 00000100:00100000:0.0:1746147190.347484:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311207424:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746147190.348971:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x313993942505eb69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147190.348983:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x313993942505eb69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147190.348990:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x313993942505eb69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147190.348995:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092563600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147190.349000:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x313993942505eb69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147190.349010:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x313993942505eb69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147190.349025:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147190.349027:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147190.349030:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x313993942505eb69 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147190.349035:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x313993942505eb69 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00000004:00080000:0.0:1746147190.351855:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f085500/2, rc 0, transno 21474842263 00000100:00100000:0.0:1746147190.351866:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311209472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147190.360290:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.369608:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.370509:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.371402:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.371437:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.371452:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.371546:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147190.428142:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967311209600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746147191.017984:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3766:1830967311209728:0@lo:400:kworker.0 00000100:00100000:0.0:1746147191.018087:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147191.018161:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967311210240:0@lo:400:kworker.0 00000100:00100000:0.0:1746147191.018184:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147191.018198:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3766:1830967311210752:0@lo:400:kworker.0 00000100:00100000:0.0:1746147191.018217:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147191.018230:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1746147191.018234:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967311209856:0@lo:400:kworker.0 00000100:00100000:0.0:1746147191.018255:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147191.018266:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3766:1830967311210368:0@lo:400:kworker.0 00000100:00100000:0.0:1746147191.018280:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147191.018290:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311210880:0@lo:400:kworker.0 00000100:00100000:0.0:1746147191.018305:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147191.018333:0:8098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311209728 00000100:00100000:0.0:1746147191.018340:0:8098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311209728 00000100:00100000:0.0:1746147191.018373:0:8098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1746147191.018379:0:8098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e20d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3766:x1830967311209728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147191.018414:0:8098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e20d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3766:x1830967311209728:12345-0@lo:400:kworker.0 Request processed in 35us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.018420:0:8098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1746147191.018447:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311210752 00000100:00100000:0.0:1746147191.018448:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311210752 00000100:00100000:0.0:1746147191.018473:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:0.0:1746147191.018476:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3766:x1830967311210752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147191.018494:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3766:x1830967311210752:12345-0@lo:400:kworker.0 Request processed in 18us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.018499:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00100000:0.0:1746147191.018505:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311210368 00000100:00100000:0.0:1746147191.018507:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311210368 00000100:00100000:0.0:1746147191.018522:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 946 00000100:00100000:0.0:1746147191.018525:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3766:x1830967311210368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147191.018545:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3766:x1830967311210368:12345-0@lo:400:kworker.0 Request processed in 20us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.018550:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 946 00000100:00100000:0.0:1746147191.018565:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3766:1830967311211264:0@lo:400:kworker.0 00000100:00100000:0.0:1746147191.018581:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147191.018606:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967311209856:0@lo:400:kworker.0 00000100:00100000:0.0:1746147191.018614:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3766:1830967311210368:0@lo:400:kworker.0 00000100:00100000:0.0:1746147191.018620:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311210880:0@lo:400:kworker.0 00000100:00100000:0.0:1746147191.018626:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099012680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967311210240:0@lo:400:kworker.0 00000100:00100000:0.0:1746147191.018633:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3766:1830967311210752:0@lo:400:kworker.0 00000100:00100000:0.0:1746147191.018639:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3766:1830967311209728:0@lo:400:kworker.0 00000100:00100000:0.0:1746147191.018663:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311211264 00000100:00100000:0.0:1746147191.018665:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311211264 00000100:00100000:0.0:1746147191.018679:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311210624 00000100:00100000:0.0:1746147191.018681:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311210624 00000100:00100000:0.0:1746147191.018692:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311209984 00000100:00100000:0.0:1746147191.018694:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311209984 00000100:00100000:0.0:1746147191.018701:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311210496 00000100:00100000:0.0:1746147191.018702:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311210496 00000100:00100000:0.0:1746147191.018713:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:0.0:1746147191.018716:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3766:x1830967311211264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147191.018739:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3766:x1830967311211264:12345-0@lo:400:kworker.0 Request processed in 22us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.018743:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00100000:0.0:1746147191.033671:0:9510:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311211392 00000100:00100000:0.0:1746147191.033683:0:9510:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311211392 00000100:00100000:0.0:1746147191.033735:0:9510:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:0.0:1746147191.033743:0:9510:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3767:x1830967311211392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746147191.033839:0:9510:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445597184 avail 1316134912 00000100:00100000:0.0:1746147191.034168:0:9510:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3767:x1830967311211392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 425us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.034174:0:9510:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:0.0:1746147191.050276:0:9510:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311211520 00000100:00100000:0.0:1746147191.050284:0:9510:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311211520 00000100:00100000:0.0:1746147191.050326:0:9510:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:0.0:1746147191.050334:0:9510:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3764:x1830967311211520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1746147191.050439:0:9510:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445572608 avail 1316110336 00000100:00100000:0.0:1746147191.051115:0:9510:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3764:x1830967311211520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 780us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.051122:0:9510:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:0.0:1746147191.113559:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311211648 00000100:00100000:0.0:1746147191.113567:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311211648 00000100:00100000:0.0:1746147191.113607:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1746147191.113614:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3764:x1830967311211648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746147191.113636:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1092056128 pending 5124096 free 3911233536 avail 3679711232 00000100:00100000:0.0:1746147191.113685:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3764:x1830967311211648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.113692:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1746147191.114073:0:12153:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311211776 00000100:00100000:0.0:1746147191.114077:0:12153:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311211776 00000100:00100000:0.0:1746147191.114129:0:12153:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1746147191.114134:0:12153:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3767:x1830967311211776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746147191.114146:0:12153:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1311630400 pending 0 free 3905294336 avail 3668680704 00000100:00100000:0.0:1746147191.114189:0:12153:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3767:x1830967311211776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.114194:0:12153:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1746147191.382043:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.382173:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.382206:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.382225:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.382252:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.382327:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.382359:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309728128 00000100:00100000:0.0:1746147191.382368:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309728128 00000100:00100000:0.0:1746147191.382699:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309728512 00000100:00100000:0.0:1746147191.382702:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309728512 00000100:00100000:0.0:1746147191.383458:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18189 00000100:00100000:0.0:1746147191.383465:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309728512:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:0.0:1746147191.383509:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309728512:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 45us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.383515:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18189 00000100:00100000:0.0:1746147191.388636:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.388676:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.388699:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.388726:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309728896 00000100:00100000:0.0:1746147191.388736:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309728896 00000100:00100000:0.0:1746147191.388800:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309729408 00000100:00100000:0.0:1746147191.388803:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309729408 00000100:00100000:0.0:1746147191.388823:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18191 00000100:00100000:0.0:1746147191.388830:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309729152:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:0.0:1746147191.389589:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309729152:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 757us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.389597:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18191 00000100:00100000:0.0:1746147191.391205:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309729024 00000100:00100000:0.0:1746147191.391211:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309729024 00000100:00100000:0.0:1746147191.391252:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18194 00000100:00100000:0.0:1746147191.391454:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309729024:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:0.0:1746147191.391775:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309729024:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 515us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.391781:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18194 00000100:00100000:0.0:1746147191.394360:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.400645:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.409738:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.409782:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.409810:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.409835:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309730176 00000100:00100000:0.0:1746147191.409844:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309730176 00000100:00100000:0.0:1746147191.409900:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309730560 00000100:00100000:0.0:1746147191.409903:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309730560 00000100:00100000:0.0:1746147191.409932:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309730048 00000100:00100000:0.0:1746147191.409935:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309730048 00000100:00100000:0.0:1746147191.409952:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6583 00000100:00100000:0.0:1746147191.409960:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967309730176:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:0.0:1746147191.409997:0:13302:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1400/0x313993942505ebaf lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.410012:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.410015:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.410032:0:13302:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1400/0x313993942505ebaf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.410048:0:13302:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1400/0x313993942505ebaf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147191.415638:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147191.432646:0:9589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098c10e00/0x313993942505ebbd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [32768->1048575] (req 32768->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.432665:0:9589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098c10e00/0x313993942505ebbd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [32768->1048575] (req 32768->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.432674:0:9589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098c10e00/0x313993942505ebbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [32768->1048575] (req 32768->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.432681:0:9589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c10e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147191.432685:0:9589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098c10e00/0x313993942505ebbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [32768->1048575] (req 32768->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.432692:0:9589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098c10e00/0x313993942505ebbd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [32768->1048575] (req 32768->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.432711:0:9589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098c10e00/0x313993942505ebbd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [32768->1048575] (req 32768->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.432717:0:9589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c10e00/0x313993942505ebbd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [32768->1048575] (req 32768->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147191.432816:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967309730048:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 20571us (23000us total) trans 0 rc 1015808/1015808 00000100:00100000:0.0:1746147191.432827:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6585 00000100:00100000:0.0:1746147191.467795:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.470733:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.474861:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.487838:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.488406:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.488423:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309732096 00000100:00100000:0.0:1746147191.488426:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309732096 00000100:00100000:0.0:1746147191.488479:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16100 00000100:00100000:0.0:1746147191.488486:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2134:x1830967309732096:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147191.488515:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.488535:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1a00/0x313993942505ebd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7caec expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.488615:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0e00/0x313993942505ebe0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.488628:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0e00/0x313993942505ebe0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.488638:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0e00/0x313993942505ebe0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489361:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x313993942505ec0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489367:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x313993942505ec0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489374:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x313993942505ec0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489410:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1000/0x313993942505ec11 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489417:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1000/0x313993942505ec11 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489422:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1000/0x313993942505ec11 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:0.0:1746147191.489428:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147191.489456:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0e00/0x313993942505ebe0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489462:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0e00/0x313993942505ebe0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489466:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0e00/0x313993942505ebe0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489470:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0e00/0x313993942505ebe0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489474:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbe0e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147191.489476:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0e00/0x313993942505ebe0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489480:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0e00/0x313993942505ebe0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489487:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147191.489489:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147191.489492:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0e00/0x313993942505ebe0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489496:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0e00/0x313993942505ebe0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489512:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x313993942505ec0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489518:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x313993942505ec0a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489562:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x313993942505ec0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489566:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbe1600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147191.489569:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x313993942505ec0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489574:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x313993942505ec0a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489580:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096bb1400) 00010000:00010000:0.0:1746147191.489582:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147191.489584:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x313993942505ec0a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489589:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x313993942505ec0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147191.489612:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1a00/0x313993942505ebd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7caec expref: 10 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.489621:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1000/0x313993942505ec11 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7caec expref: 9 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.489627:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147191.489629:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147191.489631:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe1000, rc 0) 00000100:00100000:0.0:1746147191.490544:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2134:x1830967309732096:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2055us (2134us total) trans 8589936908 rc 0/0 00000100:00100000:0.0:1746147191.490630:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16100 00000100:00100000:0.0:1746147191.491401:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.493669:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.495240:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.495457:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.496057:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.497588:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.497848:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.497877:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.497901:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.497921:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.497934:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.497949:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.497970:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.498271:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18203 00000100:00100000:0.0:1746147191.498278:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2000:x1830967309733376:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147191.498285:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.498292:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0400/0x313993942505ec6c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7cb24 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.498307:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.498308:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.498313:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0400/0x313993942505ec6c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb24 expref: 22 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.498322:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0400/0x313993942505ec6c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb24 expref: 22 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.498328:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0400, rc 0) 00000100:00100000:0.0:1746147191.498357:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2000:x1830967309733376:12345-192.168.204.25@tcp:101:cat.0 Request processed in 80us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.498362:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18203 00000100:00100000:0.0:1746147191.498372:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18205 00000100:00100000:0.0:1746147191.498377:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967309733632:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147191.498382:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.498387:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0a00/0x313993942505ec7a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7cb32 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.498396:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.498397:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.498400:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0a00/0x313993942505ec7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb32 expref: 26 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.498409:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0a00/0x313993942505ec7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb32 expref: 26 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.498419:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0a00, rc 0) 00000100:00100000:0.0:1746147191.498431:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967309733632:12345-192.168.204.25@tcp:101:cat.0 Request processed in 55us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.498436:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18205 00000100:00100000:0.0:1746147191.498443:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18207 00000100:00100000:0.0:1746147191.498447:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2000:x1830967309733888:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147191.498451:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.498455:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0c00/0x313993942505ec88 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7cb40 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.498462:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.498463:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.498467:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0c00/0x313993942505ec88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb40 expref: 23 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.498474:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0c00/0x313993942505ec88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb40 expref: 23 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.498479:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0c00, rc 0) 00000100:00100000:0.0:1746147191.498489:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2000:x1830967309733888:12345-192.168.204.25@tcp:101:cat.0 Request processed in 42us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.498497:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18207 00000100:00100000:0.0:1746147191.498534:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.498544:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309734144 00000100:00100000:0.0:1746147191.498547:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309734144 00000100:00100000:0.0:1746147191.498563:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18209 00000100:00100000:0.0:1746147191.498567:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2003:x1830967309734144:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147191.498572:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.498577:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0e00/0x313993942505ec96 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7cb4e expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.498585:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.498586:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.498590:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0e00/0x313993942505ec96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb4e expref: 8 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.498597:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0e00/0x313993942505ec96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb4e expref: 8 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.498603:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0e00, rc 0) 00000100:00100000:0.0:1746147191.498612:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2003:x1830967309734144:12345-192.168.204.25@tcp:101:cat.0 Request processed in 45us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.498616:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18209 00000100:00100000:0.0:1746147191.520072:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.520154:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.520181:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.520210:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.520235:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309734912 00000100:00100000:0.0:1746147191.520238:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309734912 00002000:00100000:0.0:1746147191.520263:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880097d75180 x1830967309734912/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.520272:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d75180 with x1830967309734912 ext(1048576->2097151) 00002000:00010000:0.0:1746147191.520277:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d75180 00000100:00100000:0.0:1746147191.521613:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6589 00000100:00100000:0.0:1746147191.521622:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967309734656:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147191.525135:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.546532:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.548057:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2003:x1830967309735168:12345-192.168.204.25@tcp:3:cat.0 Request processed in 26025us (27844us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147191.548066:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6591 00002000:00100000:0.0:1746147191.548077:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880097d76d80 x1830967309735168/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.548086:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d76d80 with x1830967309735168 ext(1048576->2097151) 00002000:00010000:0.0:1746147191.548124:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d76d80 00000100:00100000:0.0:1746147191.558861:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.558925:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.563758:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.563800:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.563831:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.568543:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311212544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147191.570185:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147191.570205:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311213056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147191.570222:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147191.570231:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311213824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147191.570245:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147191.571577:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311214336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147191.571599:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147191.571631:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311214336 00000100:00100000:0.0:1746147191.571635:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311214336 00000100:00100000:0.0:1746147191.571658:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18223 00000100:00100000:0.0:1746147191.571663:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3764:x1830967311213056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147191.571718:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:0.0:1746147191.571721:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:0.0:1746147191.571723:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147191.571724:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:0.0:1746147191.571726:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:0.0:1746147191.571746:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3764:x1830967311213056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (1523us total) trans 17179874918 rc 0/0 00000100:00100000:0.0:1746147191.571752:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18223 00000004:00080000:0.0:1746147191.571779:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5574a80/2, rc 0, transno 17179874917 00000100:00100000:0.0:1746147191.571783:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311212544:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147191.571788:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e59880/2, rc 0, transno 17179874918 00000100:00100000:0.0:1746147191.571789:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311213056:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147191.571814:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f087b80/2, rc 0, transno 21474842271 00000100:00100000:0.0:1746147191.571816:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311213824:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147191.571820:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f085180/2, rc 0, transno 21474842272 00000100:00100000:0.0:1746147191.571821:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311214336:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147191.573126:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f084e00/2, rc 0, transno 21474842273 00000100:00100000:0.0:1746147191.573133:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311214720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147191.573267:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309737344 00000100:00100000:0.0:1746147191.573271:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309737344 00000100:00100000:0.0:1746147191.573296:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309737472 00000100:00100000:0.0:1746147191.573298:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309737472 00000100:00100000:0.0:1746147191.573309:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5928 00000100:00100000:0.0:1746147191.573314:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2139:x1830967309737344:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:0.0:1746147191.573910:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2139:x1830967309737344:12345-192.168.204.25@tcp:49:cat.0 Request processed in 594us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.573917:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5928 00000100:00100000:0.0:1746147191.580569:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.581878:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.584408:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.584455:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.586445:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.591133:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.592685:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.592711:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.592741:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.599624:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.600667:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.602675:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309739776 00000100:00100000:0.0:1746147191.602689:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309739776 00002000:00100000:0.0:1746147191.602739:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880091d96d80 x1830967309739776/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.602750:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d96d80 with x1830967309739776 ext(2097152->4194303) 00002000:00010000:0.0:1746147191.602755:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d96d80 00000100:00100000:0.0:1746147191.602780:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309739904 00000100:00100000:0.0:1746147191.602782:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309739904 00002000:00100000:0.0:1746147191.602796:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff880091d97100 x1830967309739904/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.602802:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97100 with x1830967309739904 ext(2097152->4194303) 00002000:00010000:0.0:1746147191.602805:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d97100 00000100:00100000:0.0:1746147191.602822:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6600 00000100:00100000:0.0:1746147191.602829:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2001:x1830967309739776:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147191.619305:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.619346:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.619400:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.625171:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2001:x1830967309739776:12345-192.168.204.25@tcp:3:cat.0 Request processed in 22328us (25544us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746147191.625186:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6600 00002000:00100000:0.0:1746147191.625199:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880091d96d80 x1830967309739776/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:567/0 lens 488/440 e 0 to 0 dl 1746147202 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.625207:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d96d80 with x1830967309739776 ext(2097152->4194303) 00002000:00010000:0.0:1746147191.625214:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d96d80 00000100:00100000:0.0:1746147191.631127:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311216256:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147191.631137:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147191.631165:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967309740288:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 10635us (11765us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.631171:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8186 00000100:00100000:0.0:1746147191.631190:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309741056 00000100:00100000:0.0:1746147191.631192:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309741056 00002000:00100000:0.0:1746147191.631218:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1744896->1748991) req@ffff8800909f8380 x1830967309741056/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.631233:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8380 with x1830967309741056 ext(1744896->1748991) 00010000:00010000:0.0:1746147191.631238:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc800/0x313993942505ecc7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb78 expref: 9 pid: 1398 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746147191.631255:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc800/0x313993942505ecc7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb78 expref: 9 pid: 1398 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746147191.631260:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800909f8380 00000100:00100000:0.0:1746147191.631274:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1514 00000100:00100000:0.0:1746147191.631278:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2002:x1830967309741056:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147191.633465:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2002:x1830967309741056:12345-192.168.204.25@tcp:3:cat.0 Request processed in 2177us (3031us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147191.633476:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1514 00002000:00100000:0.0:1746147191.633484:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1744896->1748991) req@ffff8800909f8380 x1830967309741056/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746147202 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.633493:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8380 with x1830967309741056 ext(1744896->1748991) 00010000:00010000:0.0:1746147191.633500:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc800/0x313993942505ecc7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb78 expref: 9 pid: 1398 timeout: 829 lvb_type: 0 00010000:00010000:0.0:1746147191.633514:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fc800/0x313993942505ecc7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1744896->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb78 expref: 9 pid: 1398 timeout: 829 lvb_type: 0 00002000:00010000:0.0:1746147191.633521:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800909f8380 00000100:00100000:0.0:1746147191.640813:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.640853:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.640906:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.648416:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.648433:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.648449:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.648472:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309742208 00000100:00100000:0.0:1746147191.648479:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309742208 00000100:00100000:0.0:1746147191.648520:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18232 00000100:00100000:0.0:1746147191.648528:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967309742208:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147191.648544:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.648562:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a1fa00/0x313993942505ece3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7cb94 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147191.648615:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311216896:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147191.648685:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.648715:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.648734:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309742592 00000100:00100000:0.0:1746147191.648737:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309742592 00000100:00100000:0.0:1746147191.648761:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5930 00000100:00100000:0.0:1746147191.648766:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2135:x1830967309742592:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147191.648928:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2135:x1830967309742592:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 160us (211us total) trans 8589936912 rc 0/0 00000100:00100000:0.0:1746147191.648935:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5930 00000100:00100000:0.0:1746147191.648996:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.649024:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309742720 00000100:00100000:0.0:1746147191.649027:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309742720 00010000:00010000:0.0:1746147191.649041:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a30800/0x313993942505ec81 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb39 expref: 22 pid: 9586 timeout: 829 lvb_type: 1 00000100:00100000:0.0:1746147191.649060:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8192 00000100:00100000:0.0:1746147191.649065:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2002:x1830967309742720:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147191.649073:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147191.649081:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a30800/0x313993942505ec81 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb39 expref: 22 pid: 9586 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746147191.649110:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a30800/0x313993942505ec81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb39 expref: 22 pid: 9586 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746147191.649123:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.649125:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.649132:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093715800/0x313993942505ecdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1400831) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb8d expref: 9 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.649140:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093715800/0x313993942505ecdc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1400831) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb8d expref: 9 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.652406:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093715800/0x313993942505ecdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1400831) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb8d expref: 8 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147191.652416:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009689ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311217280:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147191.652447:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.655857:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009689ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311217280:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147191.655874:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147191.655905:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2002:x1830967309742720:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6840us (6908us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.655915:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8192 00000100:00100000:0.0:1746147191.656886:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.659311:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.661434:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.665983:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.667774:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.674367:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.674405:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.674655:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.678150:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.678195:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.678600:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18240 00000100:00100000:0.0:1746147191.678608:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2003:x1830967309744640:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147191.678616:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.678626:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e6c00/0x313993942505ed1b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7cbc5 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147191.678651:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009689b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311218048:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147191.678672:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147191.679969:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.682832:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.683154:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.689206:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.693374:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.717131:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.717183:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.741909:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.753076:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.779615:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.795290:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.799261:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.802633:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.808248:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.810982:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.895843:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.900635:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.905189:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.905223:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.906452:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.911536:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.915657:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.915690:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.915710:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.915739:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.924118:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.928027:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.934417:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.939953:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.971863:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.976987:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.980812:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.980838:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.980870:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.981197:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18249 00000100:00100000:0.0:1746147191.981204:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967309751424:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147191.981222:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.981239:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x313993942505edca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7cc27 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.981260:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.981262:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.981272:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x313993942505edca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cc27 expref: 24 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.981284:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x313993942505edca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cc27 expref: 24 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.981293:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c11400, rc 0) 00000100:00100000:0.0:1746147191.981329:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967309751424:12345-192.168.204.25@tcp:101:cat.0 Request processed in 126us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.981335:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18249 00000100:00100000:0.0:1746147191.981529:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18250 00000100:00100000:0.0:1746147191.981535:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967309751552:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147191.981543:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147191.981551:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c11800/0x313993942505edd1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7cc2e expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147191.981560:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.981562:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147191.981565:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c11800/0x313993942505edd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cc2e expref: 28 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.981574:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c11800/0x313993942505edd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cc2e expref: 28 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147191.981580:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c11800, rc 0) 00000100:00100000:0.0:1746147191.981594:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967309751552:12345-192.168.204.25@tcp:101:cat.0 Request processed in 60us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147191.981598:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18250 00000100:00100000:0.0:1746147191.982121:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.982719:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309751936 00000100:00100000:0.0:1746147191.982723:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309751936 00002000:00100000:0.0:1746147191.982737:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88011e501500 x1830967309751936/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:567/0 lens 488/0 e 0 to 0 dl 1746147202 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147191.982743:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e501500 with x1830967309751936 ext(1048576->2097151) 00002000:00010000:0.0:1746147191.982746:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e501500 00000100:00100000:0.0:1746147191.982768:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6616 00000100:00100000:0.0:1746147191.982773:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967309751936:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147191.996432:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147191.998587:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.013133:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.017358:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.024196:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967309752960:12345-192.168.204.25@tcp:4:cat.0 Request processed in 6147us (6828us total) trans 21474842276 rc 0/0 00000100:00100000:0.0:1746147192.024206:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1519 00002000:00100000:0.0:1746147192.024215:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1695744->1937407) req@ffff88009258f100 x1830967309752960/t21474842276(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:568/0 lens 488/448 e 0 to 0 dl 1746147203 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.024224:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258f100 with x1830967309752960 ext(1695744->1937407) 00010000:00010000:0.0:1746147192.024233:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800990cc000/0x313993942505ed4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cbe1 expref: 26 pid: 13695 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.024247:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800990cc000/0x313993942505ed4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cbe1 expref: 26 pid: 13695 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746147192.024253:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258f100 00000100:00100000:0.0:1746147192.027036:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.027086:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.031274:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309753344 00000100:00100000:0.0:1746147192.031284:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309753344 00002000:00100000:0.0:1746147192.031319:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (2023424->2097151) req@ffff8800984d4e00 x1830967309753344/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.031328:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d4e00 with x1830967309753344 ext(2023424->2097151) 00010000:00010000:0.0:1746147192.031335:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096b81000/0x313993942505ed76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cbef expref: 10 pid: 13695 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.031346:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096b81000/0x313993942505ed76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cbef expref: 10 pid: 13695 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746147192.031352:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800984d4e00 00000100:00100000:0.0:1746147192.031368:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1520 00000100:00100000:0.0:1746147192.031374:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2002:x1830967309753344:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147192.032113:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309753600 00000100:00100000:0.0:1746147192.032117:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309753600 00002000:00100000:0.0:1746147192.032133:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800984d6d80 x1830967309753600/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.032141:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d6d80 with x1830967309753600 ext(1048576->2097151) 00002000:00010000:0.0:1746147192.032144:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d6d80 00000100:00100000:0.0:1746147192.032164:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6619 00000100:00100000:0.0:1746147192.032169:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967309753600:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147192.039653:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.040346:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967309753600:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8174us (8270us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147192.040354:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6619 00002000:00100000:0.0:1746147192.040362:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800984d6d80 x1830967309753600/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:568/0 lens 488/440 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.040370:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d6d80 with x1830967309753600 ext(1048576->2097151) 00002000:00010000:0.0:1746147192.040373:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d6d80 00000100:00100000:0.0:1746147192.043288:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.045333:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.050027:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.050489:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.052987:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.054861:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.068478:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.073260:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.078138:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.081864:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.086254:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967309755776:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 2912us (4390us total) trans 21474842277 rc 0/0 00000100:00100000:0.0:1746147192.086264:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1523 00002000:00100000:0.0:1746147192.086273:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1937408->2056191) req@ffff88012ca13b80 x1830967309755776/t21474842277(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:568/0 lens 488/448 e 0 to 0 dl 1746147203 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.086281:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca13b80 with x1830967309755776 ext(1937408->2056191) 00010000:00010000:0.0:1746147192.086289:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096e3ec00/0x313993942505ee09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2056191) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cc58 expref: 29 pid: 13695 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.086302:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096e3ec00/0x313993942505ee09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2056191) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cc58 expref: 29 pid: 13695 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746147192.086309:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ca13b80 00000100:00100000:0.0:1746147192.091293:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.101172:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.141708:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.202155:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.202196:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.202232:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.202262:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.202304:0:8099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309756544 00000100:00100000:0.0:1746147192.202313:0:8099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309756544 00000100:00100000:0.0:1746147192.202350:0:8099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 229 00000100:00100000:0.0:1746147192.202357:0:8099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e20d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2002:x1830967309756544:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1746147192.202407:0:8099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e20d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2002:x1830967309756544:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 50us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.202416:0:8099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 229 00000100:00100000:0.0:1746147192.262549:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.281506:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.296992:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.315368:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.318510:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.318618:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.318661:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309758464 00000100:00100000:0.0:1746147192.318666:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309758464 00000100:00100000:0.0:1746147192.318692:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18258 00000100:00100000:0.0:1746147192.318697:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2164:x1830967309758464:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147192.318707:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147192.318719:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e7200/0x313993942505ee87 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7cc82 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.318741:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x313993942505eb8c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cad7 expref: 9 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.318750:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0c00/0x313993942505ec88 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb40 expref: 26 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.318757:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a31e00/0x313993942505ec65 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb1d expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.318762:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147192.318764:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147192.318768:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e7200/0x313993942505ee87 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->2256895] (req 2097152->2256895) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cc82 expref: 11 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.318792:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a31e00/0x313993942505ec65 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb1d expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.318803:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a31e00/0x313993942505ec65 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb1d expref: 11 pid: 9586 timeout: 830 lvb_type: 1 00000100:00100000:0.0:1746147192.318814:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311221632:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147192.318881:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0c00/0x313993942505ec88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb40 expref: 26 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.318889:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0c00/0x313993942505ec88 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb40 expref: 26 pid: 12225 timeout: 830 lvb_type: 1 00000100:00100000:0.0:1746147192.318896:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311221760:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147192.318920:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x313993942505eb8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cad7 expref: 9 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.318927:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x313993942505eb8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cad7 expref: 9 pid: 9584 timeout: 830 lvb_type: 1 00000100:00100000:0.0:1746147192.318934:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311221888:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147192.318948:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.324220:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.324247:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.324294:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.327281:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.333359:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.333428:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.339634:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.340503:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309759872 00000100:00100000:0.0:1746147192.340507:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309759872 00000100:00100000:0.0:1746147192.340534:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309760000 00000100:00100000:0.0:1746147192.340536:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309760000 00000100:00100000:0.0:1746147192.341401:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18261 00000100:00100000:0.0:1746147192.341407:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967309760000:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147192.341415:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147192.341424:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e3e600/0x313993942505eeb8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7cc9e expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.341435:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147192.341436:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147192.341440:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3e600/0x313993942505eeb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cc9e expref: 9 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.341449:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e3e600/0x313993942505eeb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cc9e expref: 9 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.341455:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3e600, rc 0) 00000100:00100000:0.0:1746147192.341474:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967309760000:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 68us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.341479:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18261 00000100:00100000:0.0:1746147192.342053:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.342126:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.342146:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.349071:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.366228:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.369646:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.370324:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309761664 00000100:00100000:0.0:1746147192.370331:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309761664 00002000:00100000:0.0:1746147192.370361:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1409023) req@ffff880091c3ce00 x1830967309761664/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.370369:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3ce00 with x1830967309761664 ext(1048576->1409023) 00002000:00010000:0.0:1746147192.370373:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c3ce00 00000100:00100000:0.0:1746147192.370387:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6625 00000100:00100000:0.0:1746147192.370393:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2002:x1830967309761664:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147192.375633:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.376792:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.380050:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.385297:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.388325:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147192.388627:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e80c00/0x313993942505ef21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147192.388633:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e80c00/0x313993942505ef21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:0.0:1746147192.388672:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:0.0:1746147192.388675:0:16099:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746147192.388689:0:16099:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e80c00/0x313993942505ef21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147192.388711:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e80200/0x313993942505ef1a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ccd6 expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.388865:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e80c00/0x313993942505ef21 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ccd6 expref: 8 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.388874:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147192.388876:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147192.388879:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e80c00, rc 0) 00000100:00100000:0.0:1746147192.388927:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2168:x1830967309762560:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3404us (3633us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.388933:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16119 00000100:00100000:0.0:1746147192.396684:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309762944 00000100:00100000:0.0:1746147192.396692:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309762944 00000100:00100000:0.0:1746147192.396736:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309762816 00000100:00100000:0.0:1746147192.396739:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309762816 00000100:00100000:0.0:1746147192.396768:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18267 00000100:00100000:0.0:1746147192.396775:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967309762944:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147192.396788:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147192.396802:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e3ec00/0x313993942505ef28 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7cce4 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.396844:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311223296:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147192.396908:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941540c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.397764:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.397799:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.406877:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.425323:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013232e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967309763456:12345-192.168.204.25@tcp:4:cat.0 Request processed in 18136us (18445us total) trans 21474842278 rc 0/0 00000100:00100000:0.0:1746147192.425335:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1524 00002000:00100000:0.0:1746147192.425345:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1409024->2097151) req@ffff88013232e300 x1830967309763456/t21474842278(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:568/0 lens 488/448 e 0 to 0 dl 1746147203 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.425353:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013232e300 with x1830967309763456 ext(1409024->2097151) 00010000:00010000:0.0:1746147192.425361:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942505ee3a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cc6d expref: 12 pid: 13695 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.425375:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942505ee3a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cc6d expref: 12 pid: 13695 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746147192.425380:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013232e300 00000100:00100000:0.0:1746147192.436079:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.442041:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.445744:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.447484:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309764736 00000100:00100000:0.0:1746147192.447488:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309764736 00002000:00100000:0.0:1746147192.447503:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880096899c00 x1830967309764736/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.447510:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096899c00 with x1830967309764736 ext(1048576->2097151) 00002000:00010000:0.0:1746147192.447513:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096899c00 00000100:00100000:0.0:1746147192.447555:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6628 00000100:00100000:0.0:1746147192.447560:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967309764736:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147192.465336:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.471884:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.488136:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.501387:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.518067:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.521023:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.531213:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.534406:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.536485:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.539412:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.542522:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.542569:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.550526:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.554292:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.556515:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.561882:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309767680 00000100:00100000:0.0:1746147192.561888:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309767680 00002000:00100000:0.0:1746147192.561923:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (2289664->2293759) req@ffff8800984d6680 x1830967309767680/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.561931:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d6680 with x1830967309767680 ext(2289664->2293759) 00002000:00010000:0.0:1746147192.561935:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d6680 00000100:00100000:0.0:1746147192.561963:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6632 00000100:00100000:0.0:1746147192.561970:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967309767680:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147192.562113:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967309767680:12345-192.168.204.25@tcp:3:cat.0 Request processed in 143us (300us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147192.562118:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6632 00002000:00100000:0.0:1746147192.562124:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (2289664->2293759) req@ffff8800984d6680 x1830967309767680/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746147203 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.562131:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d6680 with x1830967309767680 ext(2289664->2293759) 00002000:00010000:0.0:1746147192.562133:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d6680 00000100:00100000:0.0:1746147192.564277:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.573274:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.597969:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.602741:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.610467:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.614991:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.620307:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.623018:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.659319:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.659376:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.673692:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.679320:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.686587:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309770112 00000100:00100000:0.0:1746147192.686596:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309770112 00000100:00100000:0.0:1746147192.686639:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16122 00000100:00100000:0.0:1746147192.686646:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2186:x1830967309770112:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147192.686671:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147192.686689:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f400/0x313993942505efc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7cd54 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.686791:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f200/0x313993942505efc9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147192.686807:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e80c00/0x313993942505ef21 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ccd6 expref: 8 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.686817:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b403a000/0x313993942505ef98 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd31 expref: 21 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.686823:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f200/0x313993942505efc9 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147192.686851:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b403a000/0x313993942505ef98 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd31 expref: 21 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.686860:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b403a000/0x313993942505ef98 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd31 expref: 21 pid: 16099 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746147192.686872:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e6e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311225472:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147192.686955:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e80c00/0x313993942505ef21 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ccd6 expref: 8 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.686963:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e80c00/0x313993942505ef21 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ccd6 expref: 8 pid: 16099 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746147192.686970:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e6e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311225600:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147192.686989:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.689371:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.689398:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.689419:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309770240 00000100:00100000:0.0:1746147192.689425:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309770240 00010000:00010000:0.0:1746147192.689452:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e80c00/0x313993942505ef21 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ccd6 expref: 9 pid: 16099 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746147192.689488:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309770368 00000100:00100000:0.0:1746147192.689491:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309770368 00010000:00010000:0.0:1746147192.689500:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b403a000/0x313993942505ef98 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd31 expref: 22 pid: 16099 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746147192.689515:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8221 00000100:00100000:0.0:1746147192.689522:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967309770240:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147192.689539:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147192.689544:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e80c00/0x313993942505ef21 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ccd6 expref: 9 pid: 16099 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.689554:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e80c00/0x313993942505ef21 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ccd6 expref: 9 pid: 16099 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.689575:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147192.689579:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f200/0x313993942505efc9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147192.689588:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f200/0x313993942505efc9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147192.689594:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147192.689616:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967309770240:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 95us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.689623:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8221 00000100:00100000:0.0:1746147192.692726:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.699580:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.707064:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.714525:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.720865:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.720905:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.731957:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2003:x1830967309771392:12345-192.168.204.25@tcp:4:cat.0 Request processed in 10614us (11039us total) trans 17179874923 rc 0/0 00000100:00100000:0.0:1746147192.731971:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1529 00002000:00100000:0.0:1746147192.731983:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (3465216->3903487) req@ffff88011da9f100 x1830967309771392/t17179874923(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:568/0 lens 488/448 e 0 to 0 dl 1746147203 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.732002:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9f100 with x1830967309771392 ext(3465216->3903487) 00010000:00010000:0.0:1746147192.732012:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f600/0x313993942505efa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd38 expref: 14 pid: 9584 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.732027:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f600/0x313993942505efa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd38 expref: 14 pid: 9584 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746147192.732033:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011da9f100 00000100:00100000:0.0:1746147192.735880:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.740629:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.744971:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.745023:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.745057:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.745233:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6638 00000100:00100000:0.0:1746147192.745247:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967309772160:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147192.750210:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147192.757195:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147192.760963:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.765467:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.767453:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.767492:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.769323:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309773824 00000100:00100000:0.0:1746147192.769330:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309773824 00002000:00100000:0.0:1746147192.769364:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x98:0x0] (3522560->4009983) req@ffff88009689bb80 x1830967309773824/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:568/0 lens 488/0 e 0 to 0 dl 1746147203 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147192.769373:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689bb80 with x1830967309773824 ext(3522560->4009983) 00010000:00010000:0.0:1746147192.769385:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f400/0x313993942505efe5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3522560->18446744073709551615] (req 3522560->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd69 expref: 32 pid: 9584 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.769481:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f400/0x313993942505efe5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3522560->18446744073709551615] (req 3522560->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd69 expref: 31 pid: 9584 timeout: 830 lvb_type: 0 00002000:00010000:0.0:1746147192.769489:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009689bb80 00000100:00100000:0.0:1746147192.769507:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1530 00000100:00100000:0.0:1746147192.769514:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967309773824:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147192.792609:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.793482:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.798400:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.807589:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.813597:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.837481:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.840130:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.843003:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.849321:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.849360:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.849398:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.852868:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.860600:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.866373:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309776640 00000100:00100000:0.0:1746147192.866379:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309776640 00010000:00010000:0.0:1746147192.866405:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x313993942505f039 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cda1 expref: 12 pid: 16099 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746147192.866439:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8228 00000100:00100000:0.0:1746147192.866446:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967309776640:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147192.866458:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147192.866463:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x313993942505f039 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cda1 expref: 12 pid: 16099 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.866472:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x313993942505f039 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cda1 expref: 12 pid: 16099 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.866489:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x313993942505f039 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cda1 expref: 12 pid: 16099 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.866511:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147192.866515:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094008a00/0x313993942505f04e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147192.866523:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094008a00/0x313993942505f04e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147192.866530:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094008a00/0x313993942505f04e lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147192.866557:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147192.866911:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967309776640:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 466us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.866918:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8228 00000100:00100000:0.0:1746147192.872218:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.872247:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.872294:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.872323:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.872453:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.873280:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.873294:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309777664 00000100:00100000:0.0:1746147192.873297:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309777664 00000100:00100000:0.0:1746147192.873327:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18296 00000100:00100000:0.0:1746147192.873333:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967309777664:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147192.873348:0:12225:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x313993942505f08d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.873357:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x313993942505efde lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd62 expref: 31 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.873364:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x313993942505eff3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd77 expref: 31 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.873377:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f600/0x313993942505f02b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd9a expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.873393:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x313993942505effa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd7e expref: 14 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.873403:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a1e400/0x313993942505efec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd70 expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.873409:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746147192.873415:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746147192.873417:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x313993942505f08d lrc: 8/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.873432:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a1e400/0x313993942505efec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd70 expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.873440:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a1e400/0x313993942505efec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd70 expref: 14 pid: 1398 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746147192.873447:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311228928:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147192.873467:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x313993942505effa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd7e expref: 14 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.873474:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x313993942505effa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd7e expref: 14 pid: 9584 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746147192.873480:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093147480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311229056:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147192.873495:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f600/0x313993942505f02b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd9a expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.873502:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f600/0x313993942505f02b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd9a expref: 12 pid: 12201 timeout: 830 lvb_type: 1 00000100:00100000:0.0:1746147192.873508:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311229184:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147192.873521:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x313993942505eff3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd77 expref: 31 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.873528:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x313993942505eff3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd77 expref: 31 pid: 9584 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746147192.873534:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311229312:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147192.873546:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x313993942505efde lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd62 expref: 31 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.873552:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x313993942505efde lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd62 expref: 31 pid: 9584 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746147192.873558:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311229440:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147192.873566:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147192.883212:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.883897:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311228928:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147192.883933:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.883947:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.883963:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309778176 00000100:00100000:0.0:1746147192.883965:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309778176 00010000:00010000:0.0:1746147192.883975:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x313993942505edca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cc27 expref: 32 pid: 13695 timeout: 830 lvb_type: 1 00000100:00100000:0.0:1746147192.884005:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8230 00000100:00100000:0.0:1746147192.884010:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967309777920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147192.884017:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147192.884026:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800993b1e00/0x313993942505ef6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 4886528->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd1c expref: 32 pid: 9584 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.884034:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800993b1e00/0x313993942505ef6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 4886528->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd1c expref: 32 pid: 9584 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.884047:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1e00/0x313993942505ef6e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 4886528->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cd1c expref: 32 pid: 9584 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.884060:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147192.884840:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967309777920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 829us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.884846:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8230 00000100:00100000:0.0:1746147192.884882:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.884911:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.884964:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.884976:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.885007:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.885019:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.885039:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.885050:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.885062:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.885078:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.885126:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.886176:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.886201:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.886216:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.886230:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.886245:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.886910:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.889579:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.891773:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.891803:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.891855:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.892205:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309781248 00000100:00100000:0.0:1746147192.892209:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309781248 00010000:00010000:0.0:1746147192.892232:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x313993942505ecb2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb63 expref: 44 pid: 9138 timeout: 830 lvb_type: 0 00000100:00100000:0.0:1746147192.892257:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8250 00000100:00100000:0.0:1746147192.892263:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967309781248:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147192.892276:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147192.892281:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x313993942505ecb2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb63 expref: 44 pid: 9138 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.892290:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x313993942505ecb2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb63 expref: 44 pid: 9138 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.892417:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x313993942505ecb2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cb63 expref: 44 pid: 9138 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.892430:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147192.892434:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x313993942505f094 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147192.892444:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147192.892484:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967309781248:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 222us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.892490:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8250 00000100:00100000:0.0:1746147192.893033:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.893054:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.893753:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.893933:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.894167:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8254 00000100:00100000:0.0:1746147192.894209:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967309781632:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147192.894215:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147192.894219:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ba00/0x313993942505ee79 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cc7b expref: 44 pid: 7239 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.894226:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ba00/0x313993942505ee79 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 17 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cc7b expref: 44 pid: 7239 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.894235:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ba00/0x313993942505ee79 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cc7b expref: 44 pid: 7239 timeout: 830 lvb_type: 0 00010000:00010000:0.0:1746147192.894248:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147192.894251:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x313993942505f094 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147192.894256:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147192.894372:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967309781632:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 185us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.894379:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8254 00000100:00100000:0.0:1746147192.896169:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.896208:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.900723:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311230464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147192.900790:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147192.900823:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147192.900828:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311230592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147192.900846:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147192.901762:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311230976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147192.901782:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147192.901793:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311231488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147192.901808:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147192.901816:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311232000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147192.901828:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147192.901847:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094524a80/2, rc 0, transno 21474842281 00000100:00100000:0.0:1746147192.901854:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311230592:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147192.901862:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e502300/2, rc 0, transno 17179874925 00000100:00100000:0.0:1746147192.901865:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311230464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147192.901872:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1746147192.901875:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311231104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147192.901887:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147192.901897:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311231616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147192.901907:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147192.901913:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311232128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147192.901922:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147192.901934:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311230976 00000100:00100000:0.0:1746147192.901937:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311230976 00000100:00100000:0.0:1746147192.901947:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311231488 00000100:00100000:0.0:1746147192.901949:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311231488 00000100:00100000:0.0:1746147192.901954:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311232000 00000100:00100000:0.0:1746147192.901956:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311232000 00000100:00100000:0.0:1746147192.901960:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311231104 00000100:00100000:0.0:1746147192.901962:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311231104 00000100:00100000:0.0:1746147192.901967:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311231616 00000100:00100000:0.0:1746147192.901968:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311231616 00000100:00100000:0.0:1746147192.901973:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311232128 00000100:00100000:0.0:1746147192.901975:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311232128 00000100:00100000:0.0:1746147192.901981:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18307 00000100:00100000:0.0:1746147192.901985:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3764:x1830967311230976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147192.902051:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3764:x1830967311230976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (269us total) trans 17179874929 rc 0/0 00000100:00100000:0.0:1746147192.902056:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18307 00000100:00100000:0.0:1746147192.902064:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18308 00000100:00100000:0.0:1746147192.902068:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3764:x1830967311231488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147192.902120:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147192.902122:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147192.902124:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147192.902125:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147192.902127:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:0.0:1746147192.902141:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:3764:x1830967311231488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (332us total) trans 21474842287 rc 0/0 00000100:00100000:0.0:1746147192.902145:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18308 00000100:00100000:0.0:1746147192.902153:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18309 00000100:00100000:0.0:1746147192.902157:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3764:x1830967311232000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147192.902196:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3764:x1830967311232000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 39us (368us total) trans 17179874930 rc 0/0 00000100:00100000:0.0:1746147192.902200:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18309 00000100:00100000:0.0:1746147192.902207:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18310 00000100:00100000:0.0:1746147192.902211:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3764:x1830967311231104:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147192.902241:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147192.902243:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147192.902245:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147192.902246:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147192.902248:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746147192.902262:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3764:x1830967311231104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (373us total) trans 17179874931 rc 0/0 00000100:00100000:0.0:1746147192.902266:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18310 00000100:00100000:0.0:1746147192.902274:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18311 00000100:00100000:0.0:1746147192.902277:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3764:x1830967311231616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147192.902311:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:0.0:1746147192.902313:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:0.0:1746147192.902315:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147192.902317:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:0.0:1746147192.902318:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:0.0:1746147192.902335:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3764:x1830967311231616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (426us total) trans 17179874932 rc 0/0 00000100:00100000:0.0:1746147192.902340:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18311 00000100:00100000:0.0:1746147192.902347:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18312 00000100:00100000:0.0:1746147192.902351:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3764:x1830967311232128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147192.902394:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:3764:x1830967311232128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (469us total) trans 21474842288 rc 0/0 00000100:00100000:0.0:1746147192.902398:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18312 00000004:00080000:0.0:1746147192.902416:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4397480/2, rc 0, transno 17179874931 00000100:00100000:0.0:1746147192.902419:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311231104:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147192.902425:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4394a80/2, rc 0, transno 17179874932 00000100:00100000:0.0:1746147192.902428:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311231616:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147192.902433:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e484a80/2, rc 0, transno 21474842288 00000100:00100000:0.0:1746147192.902436:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311232128:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147192.902441:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e502a00/2, rc 0, transno 17179874929 00000100:00100000:0.0:1746147192.902444:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311230976:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147192.902449:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094527800/2, rc 0, transno 21474842287 00000100:00100000:0.0:1746147192.902451:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311231488:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147192.902456:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4397800/2, rc 0, transno 17179874930 00000100:00100000:0.0:1746147192.902458:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311232000:0@lo:2:osp-syn-1-0.0 00000004:00010000:0.0:1746147192.902489:0:16099:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800909f8e00 reply state ffff880098cab400 transno 8589936942 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x313993942505f094 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147192.902504:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x313993942505f094 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147192.902511:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147192.902514:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746147192.902517:0:16099:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1746147192.902572:0:16099:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746147192.902582:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2194:x1830967309780608:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 12889us (13010us total) trans 8589936942 rc 0/0 00000100:00100000:0.0:1746147192.902588:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16127 00010000:00010000:0.0:1746147192.902604:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x313993942505f094 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147192.902610:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x313993942505f094 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147192.902616:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x313993942505f094 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147192.902621:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a49c4600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147192.902625:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x313993942505f094 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147192.902630:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x313993942505f094 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147192.902639:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147192.902641:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147192.902643:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x313993942505f094 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147192.902648:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4600/0x313993942505f094 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147192.907894:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.910871:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.910899:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.910927:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.910945:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.910957:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.910977:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.911019:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18316 00000100:00100000:0.0:1746147192.911026:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309782400:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147192.911032:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147192.911039:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800982a3e00/0x313993942505f0be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7cdc4 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147192.911051:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x93:0x0] initial LVB size: 1048576, mtime: 0x68141777, atime: 0x68141773, ctime: 0x68141777, blocks: 0x7c8 00010000:00010000:0.0:1746147192.911060:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147192.911061:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147192.911069:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800982a3e00/0x313993942505f0be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cdc4 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.911080:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800982a3e00/0x313993942505f0be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cdc4 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147192.911103:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982a3e00, rc 0) 00000100:00100000:0.0:1746147192.911354:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967309782400:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 329us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.911360:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18316 00000100:00100000:0.0:1746147192.917969:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.918021:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.918053:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.918067:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.918080:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.918145:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.918441:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18322 00000100:00100000:0.0:1746147192.918452:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967309783424:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147192.918931:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967309783424:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 479us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.918937:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18322 00000100:00100000:0.0:1746147192.921555:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.921638:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.921690:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.921721:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.921735:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309783936 00000100:00100000:0.0:1746147192.921738:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309783936 00000100:00100000:0.0:1746147192.921757:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18328 00000100:00100000:0.0:1746147192.921763:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309784576:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147192.921800:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967309784576:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.921805:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18328 00000100:00100000:0.0:1746147192.921835:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.921895:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.921908:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309784448 00000100:00100000:0.0:1746147192.921911:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309784448 00000100:00100000:0.0:1746147192.922541:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18331 00000100:00100000:0.0:1746147192.922547:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967309784448:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147192.922594:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967309784448:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 47us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147192.922599:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18331 00000100:00100000:0.0:1746147192.925592:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.931232:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.939820:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.939877:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.945822:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.945873:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.948015:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147192.953250:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147192.958779:0:29478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505f0e8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.958794:0:29478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505f0e8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.958803:0:29478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505f0e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.958810:0:29478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2b600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147192.958814:0:29478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505f0e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.958826:0:29478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505f0e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.958843:0:29478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505f0e8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.958850:0:29478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b600/0x313993942505f0e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.958941:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967309785600:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 17327us (17743us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147192.958951:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6650 00010000:00010000:0.0:1746147192.963603:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800932d7400/0x313993942505f0f6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.963617:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7400/0x313993942505f0f6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.963623:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800932d7400/0x313993942505f0f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.963630:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147192.963633:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800932d7400/0x313993942505f0f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.963640:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800932d7400/0x313993942505f0f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.963661:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800932d7400/0x313993942505f0f6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147192.963666:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7400/0x313993942505f0f6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147192.963744:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967309785856:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 17661us (17926us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147192.963753:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6651 00000100:00100000:0.0:1746147192.999874:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.002840:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.003221:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.003246:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.003271:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.003551:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18337 00000100:00100000:0.0:1746147193.003557:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2002:x1830967309787648:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147193.003857:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147193.003860:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147192 -> 1746147192 00002000:00010000:0.0:1746147193.003861:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147192 -> 1746147192 00002000:00010000:0.0:1746147193.003863:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147192 -> 1746147192 00002000:00010000:0.0:1746147193.003864:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147193.003881:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2002:x1830967309787648:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 324us (610us total) trans 21474842292 rc 0/0 00000100:00100000:0.0:1746147193.003887:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18337 00000100:00100000:0.0:1746147193.004291:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.004325:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.006375:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.009779:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147193.010059:0:2705:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x313993942505f119 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2705 initiator: MDT0 00010000:00010000:0.0:1746147193.010066:0:2705:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x313993942505f119 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2705 initiator: MDT0 00000040:00080000:0.0:1746147193.010306:0:2705:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1036, 88 off99008 00000004:00080000:0.0:1746147193.010313:0:2705:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731000223128ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147193.010334:0:2705:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1060, 88 off101120 00000004:00080000:0.0:1746147193.010338:0:2705:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731000248302ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147193.010348:0:2705:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1061, 88 off101208 00000004:00080000:0.0:1746147193.010351:0:2705:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731000261584ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147193.010358:0:2705:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1037, 88 off99096 00000004:00080000:0.0:1746147193.010360:0:2705:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731000271073ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147193.010367:0:2705:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1038, 88 off99184 00000004:00080000:0.0:1746147193.010370:0:2705:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731000280161ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147193.010377:0:2705:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1062, 88 off101296 00000004:00080000:0.0:1746147193.010380:0:2705:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731000290374ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147193.010392:0:2705:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1063, 88 off101384 00000004:00080000:0.0:1746147193.010395:0:2705:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731000305532ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147193.010402:0:2705:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1064, 88 off101472 00000004:00080000:0.0:1746147193.010405:0:2705:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731000315344ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147193.010413:0:2705:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1039, 88 off99272 00000004:00080000:0.0:1746147193.010415:0:2705:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731000326068ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147193.010423:0:2705:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1065, 88 off101560 00000004:00080000:0.0:1746147193.010425:0:2705:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731000335658ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147193.010432:0:2705:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1040, 88 off99360 00000004:00080000:0.0:1746147193.010435:0:2705:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731000345308ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147193.010442:0:2705:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1066, 88 off101648 00000004:00080000:0.0:1746147193.010444:0:2705:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731000354737ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147193.010464:0:2705:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1041, 88 off99448 00000004:00080000:0.0:1746147193.010467:0:2705:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731000377194ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147193.010474:0:2705:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1042, 88 off99536 00000004:00080000:0.0:1746147193.010476:0:2705:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731000386877ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147193.010483:0:2705:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1043, 88 off99624 00000004:00080000:0.0:1746147193.010485:0:2705:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731000395631ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147193.010492:0:2705:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1044, 88 off99712 00000004:00080000:0.0:1746147193.010494:0:2705:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731000404863ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147193.010502:0:2705:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1067, 88 off101736 00000004:00080000:0.0:1746147193.010505:0:2705:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731000415354ns, next at 694367916532ns, rc = 0 00010000:00010000:0.0:1746147193.013582:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffac00/0x313993942505f112 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.013591:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffac00/0x313993942505f112 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.013598:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffac00/0x313993942505f112 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.013603:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ffac00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147193.013607:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffac00/0x313993942505f112 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.013613:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffac00/0x313993942505f112 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.013629:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147193.013632:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147193.013635:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffac00/0x313993942505f112 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.013639:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffac00/0x313993942505f112 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00000004:00010000:0.0:1746147193.014204:0:2705:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880129f54a80 reply state ffff880097d2d000 transno 8589936944 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x313993942505f119 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 2705 initiator: MDT0 00010000:00010000:0.0:1746147193.014215:0:2705:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x313993942505f119 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 2705 initiator: MDT0 00010000:00010000:0.0:1746147193.014219:0:2705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147193.014221:0:2705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746147193.014223:0:2705:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746147193.014227:0:2705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147193.014229:0:2705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147193.014234:0:2705:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094008200/0x313993942505f05c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cdaf expref: 7 pid: 16099 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1746147193.014293:0:2705:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746147193.014301:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2194:x1830967309788160:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 7675us (7931us total) trans 8589936944 rc 0/0 00000100:00100000:0.0:1746147193.014308:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5946 00000100:00100000:0.0:1746147193.014327:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18349 00000100:00100000:0.0:1746147193.014331:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3766:x1830967311234432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147193.014378:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:0.0:1746147193.014380:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147193.014382:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147193.014384:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147193.014387:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:0.0:1746147193.014406:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3766:x1830967311234432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (146us total) trans 21474842298 rc 0/0 00000100:00100000:0.0:1746147193.014411:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18349 00010000:00010000:0.0:1746147193.015491:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x313993942505f119 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 2705 initiator: MDT0 00010000:00010000:0.0:1746147193.015497:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x313993942505f119 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 2705 initiator: MDT0 00010000:00010000:0.0:1746147193.015502:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x313993942505f119 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 2705 initiator: MDT0 00010000:00010000:0.0:1746147193.015506:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ffb200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147193.015509:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x313993942505f119 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 2705 initiator: MDT0 00010000:00010000:0.0:1746147193.015513:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x313993942505f119 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 2705 initiator: MDT0 00010000:00010000:0.0:1746147193.015521:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147193.015523:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147193.015525:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x313993942505f119 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 2705 initiator: MDT0 00010000:00010000:0.0:1746147193.015529:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x313993942505f119 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 2705 initiator: MDT0 00000100:00100000:0.0:1746147193.018980:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.021954:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.040260:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.047029:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309789440 00000100:00100000:0.0:1746147193.047035:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309789440 00000100:00100000:0.0:1746147193.047071:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16134 00000100:00100000:0.0:1746147193.047076:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2205:x1830967309789440:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147193.047108:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147193.047119:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x313993942505f16d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ce03 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.047179:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x313993942505f174 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.047187:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x313993942505f174 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.047193:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x313993942505f174 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:0.0:1746147193.047200:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147193.047265:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x313993942505f16d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ce03 expref: 31 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.047292:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x313993942505f174 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ce03 expref: 30 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.047299:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147193.047300:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746147193.047302:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12da00, rc 0) 00000100:00100000:0.0:1746147193.047325:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2205:x1830967309789440:12345-192.168.204.25@tcp:101:cat.0 Request processed in 249us (600us total) trans 8589936948 rc 0/0 00000100:00100000:0.0:1746147193.047330:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16134 00000100:00100000:0.0:1746147193.049845:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.054873:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.054899:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.054933:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.057680:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.078430:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.080867:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.081152:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.083275:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.084211:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309791744 00000100:00100000:0.0:1746147193.084216:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309791744 00010000:00010000:0.0:1746147193.084237:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x313993942505f19e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ce1f expref: 12 pid: 9138 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746147193.084255:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8261 00000100:00100000:0.0:1746147193.084260:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b43bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967309791744:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147193.084268:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147193.084273:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x313993942505f19e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ce1f expref: 13 pid: 9138 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746147193.084282:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x313993942505f19e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ce1f expref: 13 pid: 9138 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746147193.084309:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32000/0x313993942505f19e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ce1f expref: 13 pid: 9138 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746147193.084733:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147193.084741:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33c00/0x313993942505f1c8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ce3b expref: 30 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.084749:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147193.084799:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b43bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967309791744:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 538us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.084807:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8261 00000100:00100000:0.0:1746147193.090490:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18372 00000100:00100000:0.0:1746147193.090496:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3767:x1830967311236736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147193.090560:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3767:x1830967311236736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (325us total) trans 21474842308 rc 0/0 00000100:00100000:0.0:1746147193.090565:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18372 00000100:00100000:0.0:1746147193.090575:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18374 00000100:00100000:0.0:1746147193.090579:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3767:x1830967311237248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147193.090629:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3767:x1830967311237248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (375us total) trans 21474842309 rc 0/0 00000100:00100000:0.0:1746147193.090634:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18374 00000100:00100000:0.0:1746147193.095844:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.095883:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.096160:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5949 00000100:00100000:0.0:1746147193.096177:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2206:x1830967309792128:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:0.0:1746147193.096280:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2206:x1830967309792128:12345-192.168.204.25@tcp:49:cat.0 Request processed in 110us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.096287:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5949 00000100:00100000:0.0:1746147193.097541:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.101492:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.104783:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094184380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311237888:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147193.104816:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32e00/0x313993942505f1d6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2703360->3145727] (req 2703360->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ce49 expref: 32 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.104838:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32e00, rc 0) 00000100:00100000:0.0:1746147193.104879:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2202:x1830967309792384:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3100us (3397us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.104887:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18378 00000100:00100000:0.0:1746147193.106882:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.106965:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.113021:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.121202:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.123070:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.125918:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.125977:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.128210:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.134845:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8264 00000100:00100000:0.0:1746147193.134856:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967309794304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147193.134869:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147193.134890:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33800/0x313993942505f189 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ce18 expref: 14 pid: 1398 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746147193.134902:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33800/0x313993942505f189 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ce18 expref: 14 pid: 1398 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746147193.134925:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33800/0x313993942505f189 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ce18 expref: 14 pid: 1398 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746147193.134949:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147193.134998:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967309794304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 145us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.135005:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8264 00000100:00100000:0.0:1746147193.140194:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.140262:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.140290:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.147643:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.151387:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.152725:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6665 00000100:00100000:0.0:1746147193.152734:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967309795968:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147193.152843:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967309795968:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 111us (1466us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147193.152848:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6665 00002000:00100000:0.0:1746147193.152862:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x93:0x0] (634880->638975) req@ffff880099155880 x1830967309795968/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147193.152870:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099155880 with x1830967309795968 ext(634880->638975) 00002000:00010000:0.0:1746147193.152873:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099155880 00000100:00100000:0.0:1746147193.159264:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.165712:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.179533:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.179569:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.187540:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.187595:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.187774:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18386 00000100:00100000:0.0:1746147193.187781:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967309797376:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147193.187795:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147193.187813:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1800/0x313993942505f207 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ce81 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147193.187864:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311238912:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147193.189692:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147193.198700:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.201322:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.205195:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.205240:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.209824:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.209874:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.212934:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.213528:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.213544:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309798656 00000100:00100000:0.0:1746147193.213547:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309798656 00002000:00100000:0.0:1746147193.213565:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff8801312efb80 x1830967309798656/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147193.213572:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312efb80 with x1830967309798656 ext(2097152->3145727) 00002000:00010000:0.0:1746147193.213575:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312efb80 00000100:00100000:0.0:1746147193.213600:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6671 00000100:00100000:0.0:1746147193.213605:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2002:x1830967309798656:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147193.223248:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.225552:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.228044:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.230781:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.235076:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.240122:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.248236:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.248377:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.276671:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.277760:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.286500:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.292979:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.295827:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.298195:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.304174:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.307876:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.359468:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.368400:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.368498:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.373454:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.373802:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093146a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311240704:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147193.373832:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0c800/0x313993942505f29a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cece expref: 32 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.373842:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c800/0x313993942505f29a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cece expref: 32 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.373856:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c800, rc 0) 00000100:00100000:0.0:1746147193.373895:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967309802240:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4444us (5397us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147193.373901:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18396 00000100:00100000:0.0:1746147193.373946:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311240576:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147193.373962:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932e2a00/0x313993942505f293 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ced5 expref: 33 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.373971:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932e2a00/0x313993942505f293 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ced5 expref: 33 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.373979:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932e2a00, rc 0) 00000100:00100000:0.0:1746147193.374009:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967309802368:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4782us (5621us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147193.374014:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18395 00000100:00100000:0.0:1746147193.375747:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.379461:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.382155:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.385649:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.398442:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.403290:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.416730:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.421017:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147193.422469:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.426865:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.428361:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.433695:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.433729:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.433771:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.433948:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8274 00000100:00100000:0.0:1746147193.433955:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5234c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967309804672:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147193.433963:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147193.433975:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ff4a00/0x313993942505f1ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ce26 expref: 33 pid: 1136 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746147193.434004:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ff4a00/0x313993942505f1ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ce26 expref: 33 pid: 1136 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746147193.434032:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ff4a00/0x313993942505f1ac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ce26 expref: 33 pid: 1136 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746147193.434046:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147193.434066:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5234c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967309804672:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 112us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.434074:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8274 00000100:00100000:0.0:1746147193.438567:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.439011:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.440932:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.444958:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2001:x1830967309805184:12345-192.168.204.25@tcp:4:cat.0 Request processed in 3829us (4020us total) trans 17179874954 rc 0/0 00000100:00100000:0.0:1746147193.444970:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1535 00002000:00100000:0.0:1746147193.444988:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x98:0x0] (2154496->2306047) req@ffff8800769af480 x1830967309805184/t17179874954(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:569/0 lens 488/448 e 0 to 0 dl 1746147204 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147193.444997:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769af480 with x1830967309805184 ext(2154496->2306047) 00010000:00010000:0.0:1746147193.445007:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009400ba00/0x313993942505f269 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->2306047) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cec0 expref: 15 pid: 12225 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746147193.445027:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009400ba00/0x313993942505f269 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->2306047) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cec0 expref: 15 pid: 12225 timeout: 831 lvb_type: 0 00002000:00010000:0.0:1746147193.445033:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800769af480 00000100:00100000:0.0:1746147193.447886:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.454494:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.454547:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.454846:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6681 00000100:00100000:0.0:1746147193.454852:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967309806080:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147193.478237:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.518079:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.522313:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.522424:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.522557:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.522706:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309806848 00000100:00100000:0.0:1746147193.522712:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309806848 00000100:00100000:0.0:1746147193.522750:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18402 00000100:00100000:0.0:1746147193.522757:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2001:x1830967309806976:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147193.522771:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147193.522786:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x313993942505f30a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7cf14 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.522805:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.522807:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.522816:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x313993942505f30a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf14 expref: 16 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.522832:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x313993942505f30a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf14 expref: 16 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.522843:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0000, rc 0) 00000100:00100000:0.0:1746147193.522874:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967309806976:12345-192.168.204.25@tcp:101:cat.0 Request processed in 118us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.522880:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18402 00000100:00100000:0.0:1746147193.523331:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.523359:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309807104 00000100:00100000:0.0:1746147193.523362:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309807104 00000100:00100000:0.0:1746147193.523391:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 941 00000100:00100000:0.0:1746147193.523396:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2001:x1830967309807104:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147193.523406:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147193.523427:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f400/0x313993942505f2f5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ceff expref: 15 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.523446:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147193.523450:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147193.523481:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967309807104:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 84us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.523486:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 941 00000100:00100000:0.0:1746147193.526210:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311242112:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147193.526252:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f212400/0x313993942505f303 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf06 expref: 17 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.526270:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f212400/0x313993942505f303 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf06 expref: 17 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.526281:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f212400, rc 0) 00000100:00100000:0.0:1746147193.526380:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967309806720:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3648us (4075us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147193.526388:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18401 00000100:00100000:0.0:1746147193.529261:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.533465:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.533525:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.533560:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.533587:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309808000 00000100:00100000:0.0:1746147193.533594:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309808000 00000100:00100000:0.0:1746147193.533640:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 942 00000100:00100000:0.0:1746147193.533646:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2003:x1830967309808000:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147193.533660:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147193.533686:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ee00/0x313993942505f334 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf22 expref: 16 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.533701:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147193.533705:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147193.533743:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2003:x1830967309808000:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 96us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.533748:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 942 00000100:00100000:0.0:1746147193.540912:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.546681:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.569748:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.572505:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.583698:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.593436:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.605782:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.611146:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.612932:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.621681:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.629442:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.634201:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.634246:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.634450:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6685 00000100:00100000:0.0:1746147193.634461:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967309810176:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147193.663406:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.665819:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.672219:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.672255:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.672296:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.672445:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 944 00000100:00100000:0.0:1746147193.672451:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967309811200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147193.672459:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147193.672479:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381800/0x313993942505f396 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf4c expref: 38 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.672496:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147193.672500:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147193.672534:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967309811200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 83us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.672540:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 944 00000100:00100000:0.0:1746147193.673419:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.676646:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309811968 00000100:00100000:0.0:1746147193.676652:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309811968 00002000:00100000:0.0:1746147193.676685:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x97:0x0] (2019328->2023423) req@ffff880093145500 x1830967309811968/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:569/0 lens 488/0 e 0 to 0 dl 1746147204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147193.676694:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093145500 with x1830967309811968 ext(2019328->2023423) 00002000:00010000:0.0:1746147193.676699:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093145500 00000100:00100000:0.0:1746147193.676721:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6687 00000100:00100000:0.0:1746147193.676727:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967309811968:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147193.676829:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967309811968:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 102us (221us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147193.676835:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6687 00002000:00100000:0.0:1746147193.676840:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x97:0x0] (2019328->2023423) req@ffff880093145500 x1830967309811968/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147193.676847:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093145500 with x1830967309811968 ext(2019328->2023423) 00002000:00010000:0.0:1746147193.676849:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093145500 00000100:00100000:0.0:1746147193.677747:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.678318:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.683297:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.683876:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.683910:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.683929:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.683961:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.684695:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18414 00000100:00100000:0.0:1746147193.684701:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967309812992:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147193.684707:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147193.684714:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a73600/0x313993942505f3c7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7cf76 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.684723:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.684729:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a73600/0x313993942505f3c7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 8 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf76 expref: 37 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.684736:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a73600/0x313993942505f3c7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 8 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf76 expref: 37 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.684747:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a73600, rc 0) 00000100:00100000:0.0:1746147193.684897:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967309812992:12345-192.168.204.25@tcp:101:cat.0 Request processed in 197us (935us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147193.684901:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18414 00000100:00100000:0.0:1746147193.694420:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.696834:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.716461:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.719771:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.726401:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.730795:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.744679:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.750534:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.752593:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147193.753037:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x313993942505f3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.753045:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x313993942505f3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:0.0:1746147193.753117:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 16777217 00000004:00200000:0.0:1746147193.753121:0:9138:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746147193.753139:0:9138:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x313993942505f3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.753149:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x313993942505f3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.753159:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e800/0x313993942505f3d5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.753165:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e800/0x313993942505f3d5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.753170:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e800/0x313993942505f3d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.753175:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e800/0x313993942505f3d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.753181:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009256e800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147193.753184:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e800/0x313993942505f3d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.753190:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e800/0x313993942505f3d5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.753198:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147193.753201:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147193.753205:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e800/0x313993942505f3d5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.753209:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e800/0x313993942505f3d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.753233:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x313993942505f3dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.753238:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x313993942505f3dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.753243:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x313993942505f3dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.753247:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009256f400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147193.753249:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x313993942505f3dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.753254:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x313993942505f3dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.753260:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f00c300) 00010000:00010000:0.0:1746147193.753262:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147193.753265:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x313993942505f3dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.753269:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x313993942505f3dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.753300:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x313993942505f3ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf7d expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.753315:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x313993942505f3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf7d expref: 7 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.753321:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147193.753323:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147193.753325:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256ec00, rc 0) 00000100:00100000:0.0:1746147193.753951:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2237:x1830967309814528:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 9015us (9281us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.753959:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16147 00000100:00100000:0.0:1746147193.757511:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.757545:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.757568:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.757591:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309815040 00000100:00100000:0.0:1746147193.757599:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309815040 00000100:00100000:0.0:1746147193.757635:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309815168 00000100:00100000:0.0:1746147193.757637:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309815168 00000100:00100000:0.0:1746147193.757647:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309815296 00000100:00100000:0.0:1746147193.757648:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309815296 00000100:00100000:0.0:1746147193.757660:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18415 00000100:00100000:0.0:1746147193.757668:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967309815040:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147193.757685:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147193.757704:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x313993942505f3ea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7cf84 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.757728:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.757730:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.757738:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x313993942505f3ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf84 expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.757755:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x313993942505f3ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf84 expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.757765:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a72000, rc 0) 00000100:00100000:0.0:1746147193.757803:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967309815040:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 136us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.757808:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18415 00000100:00100000:0.0:1746147193.757820:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18416 00000100:00100000:0.0:1746147193.757824:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967309815168:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147193.757830:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147193.757839:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x313993942505f3f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7cf8b expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.757895:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.757897:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.757901:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x313993942505f3f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf8b expref: 13 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.757912:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x313993942505f3f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf8b expref: 13 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147193.757919:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a73c00, rc 0) 00000100:00100000:0.0:1746147193.757932:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967309815168:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 108us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.757937:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18416 00000100:00100000:0.0:1746147193.757946:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18417 00000100:00100000:0.0:1746147193.757950:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967309815296:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147193.757955:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147193.757960:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a73e00/0x313993942505f3f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7cf92 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147193.758007:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132125c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311244672:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147193.758070:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147193.758117:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.758361:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.758404:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147193.760440:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147193.766020:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.769913:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147193.770296:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72800/0x313993942505f41b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.770302:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72800/0x313993942505f41b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:0.0:1746147193.770319:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 16777217 00010000:00010000:0.0:1746147193.770453:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21600/0x313993942505f414 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cfae expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.770482:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72800/0x313993942505f41b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cfae expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.770488:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147193.770490:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147193.770493:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a72800, rc 0) 00000100:00100000:0.0:1746147193.770523:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2237:x1830967309815936:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3854us (4515us total) trans 8589936969 rc 0/0 00000100:00100000:0.0:1746147193.770530:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16148 00000100:00100000:0.0:1746147193.772144:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.775661:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147193.776477:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x313993942505f430 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.776485:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x313993942505f430 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:0.0:1746147193.776536:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 16777217 00000004:00200000:0.0:1746147193.776540:0:9138:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746147193.776558:0:9138:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x313993942505f430 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.776589:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e800/0x313993942505f429 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cfb5 expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.776602:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ee00/0x313993942505f430 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cfb5 expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.776609:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147193.776611:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147193.776614:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256ee00, rc 0) 00000100:00100000:0.0:1746147193.776640:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2237:x1830967309816192:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4182us (4503us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.776646:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16149 00000100:00100000:0.0:1746147193.778557:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.778654:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.785143:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.787889:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.788107:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.788129:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.788158:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.788279:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.788332:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.788509:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18427 00000100:00100000:0.0:1746147193.788516:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967309817216:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147193.788533:0:12201:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x313993942505f476 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.788545:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e6800/0x313993942505f37a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf45 expref: 15 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.788551:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147193.788553:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147193.788555:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x313993942505f476 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.788573:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e6800/0x313993942505f37a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf45 expref: 15 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.788581:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958e6800/0x313993942505f37a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf45 expref: 15 pid: 9584 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746147193.788589:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311246336:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147193.788612:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147193.794162:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.794192:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.794287:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311246336:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147193.794320:0:12201:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x313993942505f476 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147193.794374:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.794390:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.794404:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309817984 00000100:00100000:0.0:1746147193.794407:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309817984 00010000:00010000:0.0:1746147193.794422:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136348a00/0x313993942505f373 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf3e expref: 34 pid: 9584 timeout: 831 lvb_type: 1 00000100:00100000:0.0:1746147193.794436:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8289 00000100:00100000:0.0:1746147193.794441:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2003:x1830967309817856:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147193.794449:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147193.794457:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x313993942505f342 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf29 expref: 16 pid: 9584 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746147193.794691:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x313993942505f342 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf29 expref: 16 pid: 9584 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746147193.794712:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009400b600/0x313993942505f342 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf29 expref: 16 pid: 9584 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746147193.794728:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147193.794743:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2003:x1830967309817856:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 301us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.795040:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8289 00000100:00100000:0.0:1746147193.795108:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.795159:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.795199:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.795217:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.795289:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.795298:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309818624 00000100:00100000:0.0:1746147193.795300:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309818624 00010000:00010000:0.0:1746147193.795310:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800990cda00/0x313993942505f40d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cfa7 expref: 14 pid: 1398 timeout: 831 lvb_type: 1 00000100:00100000:0.0:1746147193.795320:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309818240 00000100:00100000:0.0:1746147193.795322:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309818240 00010000:00010000:0.0:1746147193.795329:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x313993942505f3ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf84 expref: 18 pid: 17600 timeout: 831 lvb_type: 1 00000100:00100000:0.0:1746147193.795338:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309818752 00000100:00100000:0.0:1746147193.795340:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309818752 00010000:00010000:0.0:1746147193.795348:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009400ba00/0x313993942505f318 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf1b expref: 18 pid: 9584 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746147193.795359:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8292 00000100:00100000:0.0:1746147193.795362:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2002:x1830967309818624:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147193.795369:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147193.795377:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800990cda00/0x313993942505f40d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cfa7 expref: 14 pid: 1398 timeout: 831 lvb_type: 1 00010000:00010000:0.0:1746147193.795385:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800990cda00/0x313993942505f40d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cfa7 expref: 14 pid: 1398 timeout: 831 lvb_type: 1 00010000:00010000:0.0:1746147193.795395:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800990cda00/0x313993942505f40d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cfa7 expref: 14 pid: 1398 timeout: 831 lvb_type: 1 00010000:00010000:0.0:1746147193.795404:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147193.795415:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2002:x1830967309818624:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 52us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.795421:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8292 00000100:00100000:0.0:1746147193.795428:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309819008 00000100:00100000:0.0:1746147193.795430:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309819008 00010000:00010000:0.0:1746147193.795437:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093708400/0x313993942505f2d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cef8 expref: 33 pid: 1398 timeout: 831 lvb_type: 0 00000100:00100000:0.0:1746147193.795446:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309818880 00000100:00100000:0.0:1746147193.795447:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309818880 00010000:00010000:0.0:1746147193.795454:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x313993942505f30a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf14 expref: 17 pid: 1854 timeout: 831 lvb_type: 1 00000100:00100000:0.0:1746147193.795463:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8293 00000100:00100000:0.0:1746147193.795467:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967309818240:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147193.795473:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147193.795480:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x313993942505f3ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf84 expref: 18 pid: 17600 timeout: 831 lvb_type: 1 00010000:00010000:0.0:1746147193.795487:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x313993942505f3ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf84 expref: 18 pid: 17600 timeout: 831 lvb_type: 1 00010000:00010000:0.0:1746147193.795498:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x313993942505f3ea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf84 expref: 18 pid: 17600 timeout: 831 lvb_type: 1 00010000:00010000:0.0:1746147193.795506:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147193.795520:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967309818240:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 52us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.795526:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8293 00000100:00100000:0.0:1746147193.795536:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8294 00000100:00100000:0.0:1746147193.795540:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967309818752:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147193.795546:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147193.795552:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009400ba00/0x313993942505f318 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf1b expref: 18 pid: 9584 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746147193.795559:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009400ba00/0x313993942505f318 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf1b expref: 18 pid: 9584 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746147193.795568:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009400ba00/0x313993942505f318 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cf1b expref: 18 pid: 9584 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746147193.795574:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.795575:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.795578:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009256ec00/0x313993942505f468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.795583:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009256ec00/0x313993942505f468 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.795595:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147193.795605:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967309818752:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 65us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.795610:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8294 00000100:00100000:0.0:1746147193.795619:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8297 00000100:00100000:0.0:1746147193.795623:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967309819136:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147193.795627:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147193.795634:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958e7e00/0x313993942505f406 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cfa0 expref: 17 pid: 9585 timeout: 831 lvb_type: 1 00010000:00010000:0.0:1746147193.795641:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958e7e00/0x313993942505f406 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cfa0 expref: 17 pid: 9585 timeout: 831 lvb_type: 1 00010000:00010000:0.0:1746147193.795649:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7e00/0x313993942505f406 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cfa0 expref: 17 pid: 9585 timeout: 831 lvb_type: 1 00010000:00010000:0.0:1746147193.795656:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147193.795668:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2003:x1830967309819136:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 45us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.795672:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8297 00000100:00100000:0.0:1746147193.798077:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8299 00000100:00100000:0.0:1746147193.798084:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b404e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967309819264:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147193.798105:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147193.798114:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f03ce00/0x313993942505f22a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ce9d expref: 35 pid: 9585 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746147193.798260:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f03ce00/0x313993942505f22a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ce9d expref: 35 pid: 9585 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746147193.798286:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f03ce00/0x313993942505f22a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ce9d expref: 35 pid: 9585 timeout: 831 lvb_type: 0 00010000:00010000:0.0:1746147193.798310:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147193.798341:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b404e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967309819264:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 258us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.798348:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8299 00000100:00100000:0.0:1746147193.800506:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147193.800852:0:12201:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x313993942505f476 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.800860:0:12201:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x313993942505f476 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.800876:0:12201:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x313993942505f476 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.800883:0:12201:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x313993942505f476 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.800894:0:12201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x313993942505f476 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.800900:0:12201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f212200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147193.800903:0:12201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x313993942505f476 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.800910:0:12201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x313993942505f476 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.800919:0:12201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x313993942505f476 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.800925:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f212200/0x313993942505f476 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147193.800989:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967309817216:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 12472us (12708us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.800996:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18427 00000100:00100000:0.0:1746147193.803014:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.806732:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.811796:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.811825:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.812277:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.812307:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.812510:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147193.812825:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942505f484 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.812832:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942505f484 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000040:00080000:0.0:1746147193.813132:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1054, 88 off100592 00000004:00080000:0.0:1746147193.813136:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731803046593ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147193.813202:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1076, 88 off102528 00000004:00080000:0.0:1746147193.813205:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731803115538ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147193.813217:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1077, 88 off102616 00000004:00080000:0.0:1746147193.813220:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731803130364ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147193.813228:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1055, 88 off100680 00000004:00080000:0.0:1746147193.813231:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731803141216ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147193.813237:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1056, 88 off100768 00000004:00080000:0.0:1746147193.813240:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731803150358ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147193.813247:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1078, 88 off102704 00000004:00080000:0.0:1746147193.813250:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731803160313ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147193.813262:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1079, 88 off102792 00000004:00080000:0.0:1746147193.813264:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731803174713ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147193.813272:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1080, 88 off102880 00000004:00080000:0.0:1746147193.813274:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731803184498ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147193.813283:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1057, 88 off100856 00000004:00080000:0.0:1746147193.813285:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731803195621ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147193.813388:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1081, 88 off102968 00000004:00080000:0.0:1746147193.813392:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731803303004ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147193.813409:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1058, 88 off100944 00000004:00080000:0.0:1746147193.813412:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731803322261ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147193.813425:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1082, 88 off103056 00000004:00080000:0.0:1746147193.813428:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731803338672ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147193.813436:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1059, 88 off101032 00000004:00080000:0.0:1746147193.813439:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731803349812ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147193.813446:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1060, 88 off101120 00000004:00080000:0.0:1746147193.813448:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731803358772ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147193.813455:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1061, 88 off101208 00000004:00080000:0.0:1746147193.813458:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731803368217ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147193.813465:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1062, 88 off101296 00000004:00080000:0.0:1746147193.813467:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731803377412ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147193.813474:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1083, 88 off103144 00000004:00080000:0.0:1746147193.813476:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 731803386682ns, next at 694367916532ns, rc = 0 00000100:00100000:0.0:1746147193.814916:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746147193.814935:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311247872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147193.816646:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147193.816668:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311247872 00000100:00100000:0.0:1746147193.816671:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311247872 00000100:00100000:0.0:1746147193.816687:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18445 00000100:00100000:0.0:1746147193.816691:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3766:x1830967311247872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147193.816747:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3766:x1830967311247872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (101us total) trans 17179874963 rc 0/0 00000100:00100000:0.0:1746147193.816752:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18445 00000004:00080000:0.0:1746147193.816771:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094184a80/2, rc 0, transno 17179874963 00000100:00100000:0.0:1746147193.816773:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311247872:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746147193.817109:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942505f484 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.817117:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942505f484 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.817123:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942505f484 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.817129:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d42600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147193.817133:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942505f484 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.817140:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942505f484 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.817149:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147193.817151:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147193.817154:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942505f484 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147193.817159:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942505f484 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147193.819582:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.821730:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.823189:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.823249:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.823485:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.823628:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.824011:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.824219:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.827486:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309821952 00000100:00100000:0.0:1746147193.827491:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309821952 00000100:00100000:0.0:1746147193.827520:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18453 00000100:00100000:0.0:1746147193.827526:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967309821952:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147193.827611:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967309821952:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 85us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.827617:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18453 00000100:00100000:0.0:1746147193.830503:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309822464 00000100:00100000:0.0:1746147193.830513:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309822464 00000100:00100000:0.0:1746147193.830550:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309822720 00000100:00100000:0.0:1746147193.830552:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309822720 00000100:00100000:0.0:1746147193.830562:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309822976 00000100:00100000:0.0:1746147193.830564:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309822976 00000100:00100000:0.0:1746147193.830574:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309822592 00000100:00100000:0.0:1746147193.830576:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309822592 00000100:00100000:0.0:1746147193.830585:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309822848 00000100:00100000:0.0:1746147193.830586:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309822848 00000100:00100000:0.0:1746147193.830600:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18458 00000100:00100000:0.0:1746147193.830607:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967309822464:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147193.830706:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967309822464:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 98us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.830721:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18458 00000100:00100000:0.0:1746147193.830733:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18461 00000100:00100000:0.0:1746147193.830738:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967309822592:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147193.830772:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967309822592:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 34us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.830777:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18461 00000100:00100000:0.0:1746147193.833591:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.837296:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.844755:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.844798:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.844827:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.844841:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.844870:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.845210:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.845240:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309824896 00000100:00100000:0.0:1746147193.845243:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309824896 00000100:00100000:0.0:1746147193.845266:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6692 00000100:00100000:0.0:1746147193.845271:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2002:x1830967309824128:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147193.845285:0:29478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880096d43000/0x313993942505f4d1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.845293:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.845294:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.845297:0:29478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d43000/0x313993942505f4d1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.845304:0:29478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d43000/0x313993942505f4d1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147193.847936:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147193.869182:0:29475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800958e6c00/0x313993942505f4df lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.869199:0:29475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e6c00/0x313993942505f4df lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.869206:0:29475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800958e6c00/0x313993942505f4df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.869218:0:29475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958e6c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147193.869222:0:29475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800958e6c00/0x313993942505f4df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.869230:0:29475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800958e6c00/0x313993942505f4df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.869251:0:29475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800958e6c00/0x313993942505f4df lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.869257:0:29475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e6c00/0x313993942505f4df lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147193.869343:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2002:x1830967309823616:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 24179us (24597us total) trans 0 rc 1032192/1032192 00000100:00100000:0.0:1746147193.869353:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6690 00000100:00100000:0.0:1746147193.887551:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309825664 00000100:00100000:0.0:1746147193.887563:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309825664 00000100:00100000:0.0:1746147193.887627:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16154 00000100:00100000:0.0:1746147193.887635:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2237:x1830967309825664:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:0.0:1746147193.888375:0:16099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147193.888405:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b400/0x313993942505f499 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cfd8 expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.888436:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147193.888440:0:16099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147193.888488:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942505f502 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147193.888499:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942505f502 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147193.888508:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942505f502 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00010000:0.0:1746147193.888609:0:16099:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098c70000 reply state ffff88009894b000 transno 8589936972 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942505f502 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147193.888618:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942505f502 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147193.888623:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147193.888625:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746147193.888628:0:16099:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746147193.888716:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2237:x1830967309825664:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 1080us (2402us total) trans 8589936972 rc 0/0 00000100:00100000:0.0:1746147193.888723:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16154 00000100:00100000:0.0:1746147193.890270:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.890435:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.890464:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.891368:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.891405:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.891440:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.894595:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.897268:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147193.901364:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942505f502 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147193.901376:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942505f502 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147193.901386:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942505f502 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147193.901392:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d42000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147193.901396:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942505f502 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147193.901403:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942505f502 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147193.901420:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147193.901423:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147193.901427:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942505f502 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147193.901431:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942505f502 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147193.902225:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311250176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147193.902705:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147193.902728:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311250688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147193.902742:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147193.902754:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311251200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147193.902770:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147193.902780:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013232c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311251712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147193.902795:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147193.902815:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311251456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147193.902831:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147193.902843:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311251968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147193.902857:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147193.902865:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746147193.902868:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013232f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311251584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147193.902881:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147193.902888:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311252096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147193.902902:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147193.902917:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311252096 00000100:00100000:0.0:1746147193.902920:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311252096 00000100:00100000:0.0:1746147193.902936:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18476 00000100:00100000:0.0:1746147193.902941:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3764:x1830967311250688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147193.903018:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+56:3764:x1830967311250688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (275us total) trans 21474842335 rc 0/0 00000100:00100000:0.0:1746147193.903024:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18476 00000100:00100000:0.0:1746147193.903034:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18479 00000100:00100000:0.0:1746147193.903038:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3766:x1830967311251456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147193.903082:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147193.903085:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147193 -> 1746147193 00002000:00010000:0.0:1746147193.903087:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147193 -> 1746147193 00002000:00010000:0.0:1746147193.903105:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147193 -> 1746147193 00002000:00010000:0.0:1746147193.903107:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746147193.903129:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3766:x1830967311251456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (297us total) trans 17179874971 rc 0/0 00000100:00100000:0.0:1746147193.903134:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18479 00000100:00100000:0.0:1746147193.903144:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18482 00000100:00100000:0.0:1746147193.903149:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3766:x1830967311252096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147193.903204:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3766:x1830967311252096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (301us total) trans 17179874974 rc 0/0 00000100:00100000:0.0:1746147193.903209:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18482 00000100:00100000:0.0:1746147193.903218:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311250816 00000100:00100000:0.0:1746147193.903221:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311250816 00000100:00100000:0.0:1746147193.903229:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311251328 00000100:00100000:0.0:1746147193.903231:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311251328 00000100:00100000:0.0:1746147193.903239:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18484 00000100:00100000:0.0:1746147193.903242:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3765:x1830967311250816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147193.903293:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3765:x1830967311250816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (97us total) trans 21474842337 rc 0/0 00000100:00100000:0.0:1746147193.903298:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18484 00000004:00080000:0.0:1746147193.903331:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013232f800/2, rc 0, transno 17179874973 00000100:00100000:0.0:1746147193.903336:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013232f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311251584:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147193.903343:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e487b80/2, rc 0, transno 17179874974 00000100:00100000:0.0:1746147193.903345:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311252096:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147193.903351:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4395180/2, rc 0, transno 17179874971 00000100:00100000:0.0:1746147193.903353:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311251456:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147193.903359:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e487480/2, rc 0, transno 17179874972 00000100:00100000:0.0:1746147193.903362:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311251968:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147193.903374:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013232c380/2, rc 0, transno 17179874970 00000100:00100000:0.0:1746147193.903376:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013232c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311251712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147193.903383:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c71880/2, rc 0, transno 21474842333 00000100:00100000:0.0:1746147193.903386:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311250176:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147193.903394:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c71c00/2, rc 0, transno 21474842335 00000100:00100000:0.0:1746147193.903397:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311250688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147193.903404:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311252224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147193.903422:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147193.903456:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f57b80/2, rc 0, transno 17179874969 00000100:00100000:0.0:1746147193.903459:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311251200:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746147193.904128:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091f28600/0x313993942505f509 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147193.904137:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091f28600/0x313993942505f509 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147193.904145:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091f28600/0x313993942505f509 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147193.904150:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091f28600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147193.904154:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091f28600/0x313993942505f509 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147193.904160:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091f28600/0x313993942505f509 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147193.904170:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147193.904172:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147193.904175:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091f28600/0x313993942505f509 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147193.905906:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091f28600/0x313993942505f509 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7240 initiator: MDT0 00000004:00080000:0.0:1746147193.905967:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5577100/2, rc 0, transno 21474842338 00000100:00100000:0.0:1746147193.905988:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311252224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147193.906771:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.910059:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.924742:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.926173:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.929342:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.930159:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.932310:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.932781:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.933109:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18490 00000100:00100000:0.0:1746147193.933117:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2249:x1830967309828480:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147193.933124:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147193.933131:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d43a00/0x313993942505f58e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d033 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.933142:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.933143:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.933147:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d43a00/0x313993942505f58e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d033 expref: 34 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.933156:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d43a00/0x313993942505f58e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d033 expref: 34 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.933165:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43a00, rc 0) 00000100:00100000:0.0:1746147193.933205:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2249:x1830967309828480:12345-192.168.204.25@tcp:101:cat.0 Request processed in 90us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.933349:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18490 00000100:00100000:0.0:1746147193.939020:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.939151:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.946121:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.946157:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.946445:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.947018:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.947467:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.952292:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147193.952308:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311253120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147193.952363:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311252864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147193.952441:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311253248 00000100:00100000:0.0:1746147193.952447:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311253248 00000100:00100000:0.0:1746147193.952476:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311252992 00000100:00100000:0.0:1746147193.952478:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311252992 00000100:00100000:0.0:1746147193.952488:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311254016 00000100:00100000:0.0:1746147193.952489:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311254016 00000100:00100000:0.0:1746147193.952502:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18491 00000100:00100000:0.0:1746147193.952507:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+62:3765:x1830967311253248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147193.952583:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311254144 00000100:00100000:0.0:1746147193.952585:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311254144 00000100:00100000:0.0:1746147193.952596:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18493 00000100:00100000:0.0:1746147193.952600:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+65:3767:x1830967311253504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147193.952634:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147193.952636:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147193.952638:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147193.952639:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147193.952641:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:0.0:1746147193.952660:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+65:3767:x1830967311253504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (242us total) trans 21474842342 rc 0/0 00000100:00100000:0.0:1746147193.952664:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18493 00000100:00100000:0.0:1746147193.952672:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18496 00000100:00100000:0.0:1746147193.952676:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3765:x1830967311254272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147193.952686:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18497 00000100:00100000:0.0:1746147193.952690:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+64:3765:x1830967311253632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147193.952726:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:0.0:1746147193.952728:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147193.952730:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147193.952731:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147193.952733:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:0.0:1746147193.952748:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+65:3765:x1830967311253632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (217us total) trans 21474842343 rc 0/0 00000100:00100000:0.0:1746147193.952753:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18497 00000100:00100000:0.0:1746147193.952760:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311254528 00000100:00100000:0.0:1746147193.952762:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311254528 00000100:00100000:0.0:1746147193.952772:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18500 00000100:00100000:0.0:1746147193.952776:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3767:x1830967311254528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147193.952827:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3767:x1830967311254528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (76us total) trans 17179874980 rc 0/0 00000100:00100000:0.0:1746147193.952832:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18500 00000100:00100000:0.0:1746147193.952844:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147193.952857:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311253376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147193.952872:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147193.952927:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3765:x1830967311254272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 251us (425us total) trans 17179874982 rc 0/0 00000100:00100000:0.0:1746147193.952931:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18496 00000004:00080000:0.0:1746147193.952947:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5575880/2, rc 0, transno 21474842344 00000100:00100000:0.0:1746147193.952951:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311252864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147193.952998:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3765:x1830967311253248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 490us (637us total) trans 21474842340 rc 0/0 00000100:00100000:0.0:1746147193.953002:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18491 00000004:00080000:0.0:1746147193.953287:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f085880/2, rc 0, transno 21474842345 00000100:00100000:0.0:1746147193.953290:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311253376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147193.953397:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311253120 00000100:00100000:0.0:1746147193.953462:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311253120 00000100:00100000:0.0:1746147193.953863:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18504 00000100:00100000:0.0:1746147193.953869:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3764:x1830967311253120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147193.953914:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147193.953916:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147193.953918:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147193.953919:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147193.953921:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:0.0:1746147193.953944:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+69:3764:x1830967311253120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (617us total) trans 21474842346 rc 0/0 00000100:00100000:0.0:1746147193.953948:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18504 00000100:00100000:0.0:1746147193.956709:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.956773:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.962578:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.965613:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309830528 00000100:00100000:0.0:1746147193.965618:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309830528 00000100:00100000:0.0:1746147193.965642:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18510 00000100:00100000:0.0:1746147193.965647:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2249:x1830967309830528:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147193.965656:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147193.965665:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505f5b8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d056 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.965678:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.965680:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147193.965685:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505f5b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d056 expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.965694:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974a7c00/0x313993942505f5b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d056 expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147193.965707:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974a7c00, rc 0) 00000100:00100000:0.0:1746147193.965729:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2249:x1830967309830528:12345-192.168.204.25@tcp:101:cat.0 Request processed in 81us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147193.965734:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18510 00000100:00100000:0.0:1746147193.969736:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.971237:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967309830400:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5684us (5868us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147193.971243:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6700 00002000:00100000:0.0:1746147193.971248:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88011e502680 x1830967309830400/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:569/0 lens 488/440 e 0 to 0 dl 1746147204 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147193.971255:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e502680 with x1830967309830400 ext(1048576->2097151) 00002000:00010000:0.0:1746147193.971259:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e502680 00000100:00100000:0.0:1746147193.973729:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.978828:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.978860:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.981649:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.983110:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.983127:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309832576 00000100:00100000:0.0:1746147193.983130:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309832576 00000100:00100000:0.0:1746147193.983170:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5965 00000100:00100000:0.0:1746147193.983176:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2243:x1830967309832576:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147193.983355:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2243:x1830967309832576:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 177us (244us total) trans 8589936980 rc 0/0 00000100:00100000:0.0:1746147193.983361:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5965 00000100:00100000:0.0:1746147193.983394:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.983447:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.986793:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.991608:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.993710:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147193.998172:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.002495:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.002541:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147194.002874:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147194.018625:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.033800:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147194.034107:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147194.035332:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.037930:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.043649:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.054128:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.056934:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.057320:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.065196:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.065236:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.065530:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.065673:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.107260:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147194.108235:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147194.108270:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.118320:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2003:x1830967309837696:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5798us (6556us total) trans 0 rc 696320/696320 00000100:00100000:0.0:1746147194.118327:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6712 00002000:00100000:0.0:1746147194.118333:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff8800769ad880 x1830967309837696/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.118340:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ad880 with x1830967309837696 ext(4194304->4890623) 00002000:00010000:0.0:1746147194.118343:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769ad880 00000100:00100000:0.0:1746147194.126038:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.126078:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.126913:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.127236:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309838336 00000100:00100000:0.0:1746147194.127239:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309838336 00000100:00100000:0.0:1746147194.127261:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18520 00000100:00100000:0.0:1746147194.127266:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2253:x1830967309838336:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147194.127276:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.127290:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x313993942505f621 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d0a3 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.127317:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x313993942505f4c3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d002 expref: 16 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.127324:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db81a00/0x313993942505f5f7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d095 expref: 21 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.127330:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x313993942505f5e2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d087 expref: 36 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.127334:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.127336:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.127339:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x313993942505f621 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d0a3 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.127360:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x313993942505f5e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d087 expref: 36 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.127371:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x313993942505f5e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d087 expref: 36 pid: 1853 timeout: 832 lvb_type: 1 00000100:00100000:0.0:1746147194.127380:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311256064:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147194.127448:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db81a00/0x313993942505f5f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d095 expref: 21 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.127456:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db81a00/0x313993942505f5f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d095 expref: 21 pid: 10340 timeout: 832 lvb_type: 1 00000100:00100000:0.0:1746147194.127463:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311256192:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147194.127483:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x313993942505f4c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d002 expref: 16 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.127490:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x313993942505f4c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d002 expref: 16 pid: 17600 timeout: 832 lvb_type: 1 00000100:00100000:0.0:1746147194.127497:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311256320:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147194.127509:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.132439:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.132475:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.132513:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.133285:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309838592 00000100:00100000:0.0:1746147194.133289:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309838592 00010000:00010000:0.0:1746147194.133307:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x313993942505f5e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d087 expref: 37 pid: 1853 timeout: 832 lvb_type: 1 00000100:00100000:0.0:1746147194.133329:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8314 00000100:00100000:0.0:1746147194.133335:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967309838720:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147194.133346:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147194.133362:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x313993942505f4c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d002 expref: 17 pid: 17600 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746147194.133750:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x313993942505f4c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d002 expref: 17 pid: 17600 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746147194.133770:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e7200/0x313993942505f4c3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d002 expref: 17 pid: 17600 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746147194.133788:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147194.133888:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967309838720:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 551us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.133894:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8314 00000100:00100000:0.0:1746147194.137704:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.140545:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147194.145499:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147194.148758:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.150228:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.156479:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.161437:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.224448:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.228288:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.230763:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.233407:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.234819:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.240949:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.247983:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.251757:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.253913:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.255596:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.261216:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.261248:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.261293:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.276225:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309842944 00000100:00100000:0.0:1746147194.276230:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309842944 00002000:00100000:0.0:1746147194.276250:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880129f57800 x1830967309842944/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.276257:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f57800 with x1830967309842944 ext(0->1048575) 00002000:00010000:0.0:1746147194.276261:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f57800 00000100:00100000:0.0:1746147194.276273:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6718 00000100:00100000:0.0:1746147194.276278:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967309842944:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147194.285904:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.294942:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.297671:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309843456 00000100:00100000:0.0:1746147194.297679:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309843456 00000100:00100000:0.0:1746147194.298125:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18527 00000100:00100000:0.0:1746147194.298132:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2264:x1830967309843456:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147194.302979:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.303029:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.327467:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.327517:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.332849:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.341656:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18534 00000100:00100000:0.0:1746147194.341663:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967309845248:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147194.341668:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.341674:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x313993942505f6ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d113 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.341687:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.341688:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.341692:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x313993942505f6ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d113 expref: 20 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.341701:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x313993942505f6ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d113 expref: 20 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.341707:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a30a00, rc 0) 00000100:00100000:0.0:1746147194.341723:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967309845248:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 60us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.341728:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18534 00000100:00100000:0.0:1746147194.342555:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309845632 00000100:00100000:0.0:1746147194.342559:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309845632 00002000:00100000:0.0:1746147194.342581:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4485119) req@ffff880097d77b80 x1830967309845632/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.342589:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d77b80 with x1830967309845632 ext(4194304->4485119) 00010000:00010000:0.0:1746147194.342594:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091cb6c00/0x313993942505f628 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4485119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d0aa expref: 21 pid: 1854 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746147194.342604:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091cb6c00/0x313993942505f628 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4485119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d0aa expref: 21 pid: 1854 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746147194.342609:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097d77b80 00000100:00100000:0.0:1746147194.342633:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1549 00000100:00100000:0.0:1746147194.342637:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967309845632:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147194.348203:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967309845632:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5562us (5687us total) trans 21474842349 rc 0/0 00000100:00100000:0.0:1746147194.348211:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1549 00002000:00100000:0.0:1746147194.348218:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4485119) req@ffff880097d77b80 x1830967309845632/t21474842349(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 488/448 e 0 to 0 dl 1746147205 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.348226:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d77b80 with x1830967309845632 ext(4194304->4485119) 00010000:00010000:0.0:1746147194.348231:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091cb6c00/0x313993942505f628 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4485119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d0aa expref: 21 pid: 1854 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746147194.348241:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091cb6c00/0x313993942505f628 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4485119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d0aa expref: 21 pid: 1854 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746147194.348247:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097d77b80 00000100:00100000:0.0:1746147194.353612:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.356214:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.356245:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.356274:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.356299:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.358135:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.360000:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.360288:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.364527:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.365733:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.370220:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.370253:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.377500:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.379011:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.384701:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.384731:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.384758:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.385696:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18540 00000100:00100000:0.0:1746147194.385704:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967309848192:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147194.385723:0:1398:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093731a00/0x313993942505f74e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.385734:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095053400/0x313993942505f698 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d0e2 expref: 19 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.385747:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d98200/0x313993942505f6d7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d10c expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.385753:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093730400/0x313993942505f69f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d0e9 expref: 38 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.385758:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.385760:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.385761:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093731a00/0x313993942505f74e lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.385776:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093730400/0x313993942505f69f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d0e9 expref: 38 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.385803:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093730400/0x313993942505f69f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d0e9 expref: 38 pid: 1398 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746147194.385816:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311260160:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147194.385844:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d98200/0x313993942505f6d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d10c expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.385852:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d98200/0x313993942505f6d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d10c expref: 18 pid: 1854 timeout: 832 lvb_type: 1 00000100:00100000:0.0:1746147194.385860:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311260544:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147194.385883:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095053400/0x313993942505f698 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d0e2 expref: 19 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.385890:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095053400/0x313993942505f698 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d0e2 expref: 19 pid: 1398 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746147194.385898:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311260800:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147194.385916:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.385946:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.385983:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.386004:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.386030:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.397863:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.397880:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309849216 00000100:00100000:0.0:1746147194.397886:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309849216 00010000:00010000:0.0:1746147194.397910:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009256f800/0x313993942505f4a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cfdf expref: 23 pid: 10340 timeout: 832 lvb_type: 1 00000100:00100000:0.0:1746147194.397930:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8329 00000100:00100000:0.0:1746147194.397935:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2003:x1830967309849216:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147194.397945:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147194.397960:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009256f800/0x313993942505f4a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cfdf expref: 23 pid: 10340 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746147194.397978:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009256f800/0x313993942505f4a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cfdf expref: 23 pid: 10340 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746147194.397997:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009256f800/0x313993942505f4a7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7cfdf expref: 23 pid: 10340 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746147194.398022:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147194.398050:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2003:x1830967309849216:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 115us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.398056:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8329 00000100:00100000:0.0:1746147194.398080:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.398237:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309849344 00000100:00100000:0.0:1746147194.398239:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309849344 00010000:00010000:0.0:1746147194.398250:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38fe00/0x313993942505f587 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d02c expref: 23 pid: 1398 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746147194.398405:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309849600 00000100:00100000:0.0:1746147194.398407:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309849600 00010000:00010000:0.0:1746147194.398418:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x313993942505f6ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d113 expref: 20 pid: 10340 timeout: 832 lvb_type: 1 00000100:00100000:0.0:1746147194.398437:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8330 00000100:00100000:0.0:1746147194.398441:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2001:x1830967309849344:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147194.398447:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147194.398454:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f38fe00/0x313993942505f587 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d02c expref: 23 pid: 1398 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746147194.398462:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f38fe00/0x313993942505f587 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d02c expref: 23 pid: 1398 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746147194.398472:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38fe00/0x313993942505f587 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d02c expref: 23 pid: 1398 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746147194.398480:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147194.398492:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967309849344:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 51us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.398496:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8330 00000100:00100000:0.0:1746147194.398504:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8331 00000100:00100000:0.0:1746147194.398741:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967309849600:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147194.398750:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147194.398759:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x313993942505f6ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d113 expref: 20 pid: 10340 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746147194.398766:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x313993942505f6ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d113 expref: 20 pid: 10340 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746147194.398781:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a30a00/0x313993942505f6ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d113 expref: 20 pid: 10340 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746147194.398790:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147194.398803:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967309849600:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 295us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.398808:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8331 00000100:00100000:0.0:1746147194.398842:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.399537:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.399569:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.399588:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.399609:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.399672:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096899f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311260928:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147194.399694:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009689b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311261184:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147194.399730:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093146300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311261568:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147194.399744:0:1854:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x313993942505f75c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147194.399763:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.399809:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.399817:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.399827:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.399837:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.399855:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147194.401783:0:1854:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x313993942505f75c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.401790:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x313993942505f75c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.401801:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x313993942505f75c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.401807:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x313993942505f75c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.401812:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x313993942505f75c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.401816:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e260a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147194.401818:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x313993942505f75c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.401823:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x313993942505f75c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.401831:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x313993942505f75c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.401836:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x313993942505f75c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147194.401920:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967309848448:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 15789us (15925us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.401925:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18542 00010000:00010000:0.0:1746147194.402734:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1800/0x313993942505f739 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d152 expref: 9 pid: 9138 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746147194.402743:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311261824:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147194.402751:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x313993942505f786 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.402756:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x313993942505f786 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.402760:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x313993942505f786 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:0.0:1746147194.402770:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147194.403298:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x313993942505f786 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403303:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x313993942505f786 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403307:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x313993942505f786 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403311:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800909c0600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147194.403314:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x313993942505f786 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403321:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x313993942505f786 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403327:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147194.403330:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147194.403332:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x313993942505f786 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403336:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x313993942505f786 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403347:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x313993942505f778 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403352:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x313993942505f778 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403356:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x313993942505f778 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403359:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbe0c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147194.403362:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x313993942505f778 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403366:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x313993942505f778 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403371:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147194.403373:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147194.403375:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x313993942505f778 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403379:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x313993942505f778 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403387:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007923c000/0x313993942505f77f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403391:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007923c000/0x313993942505f77f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403394:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007923c000/0x313993942505f77f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403397:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007923c000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147194.403398:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007923c000/0x313993942505f77f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403401:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007923c000/0x313993942505f77f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403405:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094553a00) 00010000:00010000:0.0:1746147194.403407:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147194.403408:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007923c000/0x313993942505f77f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403412:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007923c000/0x313993942505f77f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.403445:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1a00/0x313993942505f771 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d159 expref: 16 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.403451:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1a00/0x313993942505f771 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d159 expref: 16 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.403457:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe1a00, rc 0) 00000100:00100000:0.0:1746147194.403831:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2268:x1830967309851008:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5349us (5391us total) trans 8589936992 rc 301/301 00000100:00100000:0.0:1746147194.403837:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16170 00000100:00100000:0.0:1746147194.404012:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18548 00000100:00100000:0.0:1746147194.404017:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967309851904:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147194.404024:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.404031:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x313993942505f7a9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d175 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147194.404040:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x68141779, atime: 0x68141779, ctime: 0x68141779, blocks: 0x808 00010000:00010000:0.0:1746147194.404046:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.404047:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.404051:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x313993942505f7a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d175 expref: 23 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.404059:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x313993942505f7a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d175 expref: 23 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.404065:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c7fa00, rc 0) 00000100:00100000:0.0:1746147194.404077:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2002:x1830967309851904:12345-192.168.204.25@tcp:101:cat.0 Request processed in 60us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.404176:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18548 00000100:00100000:0.0:1746147194.408327:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309852544 00000100:00100000:0.0:1746147194.408333:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309852544 00002000:00100000:0.0:1746147194.408365:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3145727) req@ffff880097d75f80 x1830967309852544/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.408375:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d75f80 with x1830967309852544 ext(2097152->3145727) 00010000:00010000:0.0:1746147194.408382:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d99a00/0x313993942505f72b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d14b expref: 37 pid: 1136 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746147194.408392:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d99a00/0x313993942505f72b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d14b expref: 37 pid: 1136 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746147194.408397:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d75f80 00000100:00100000:0.0:1746147194.408420:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1552 00000100:00100000:0.0:1746147194.408425:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967309852544:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147194.418307:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.423310:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309852928 00000100:00100000:0.0:1746147194.423318:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309852928 00000100:00100000:0.0:1746147194.423363:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18553 00000100:00100000:0.0:1746147194.423371:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2264:x1830967309852928:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147194.423385:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.423399:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x313993942505f7cc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d198 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.423421:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.423422:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.423429:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x313993942505f7cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d198 expref: 34 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.423442:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f007e00/0x313993942505f7cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d198 expref: 34 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.423450:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f007e00, rc 0) 00000100:00100000:0.0:1746147194.423496:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2264:x1830967309852928:12345-192.168.204.25@tcp:101:cat.0 Request processed in 126us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.423502:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18553 00000100:00100000:0.0:1746147194.424829:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.424902:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.426681:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.431233:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.435808:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.442626:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.443423:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.449238:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.463235:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.463272:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.463298:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.463319:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309854976 00000100:00100000:0.0:1746147194.463327:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309854976 00000100:00100000:0.0:1746147194.463375:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309854848 00000100:00100000:0.0:1746147194.463377:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309854848 00000100:00100000:0.0:1746147194.463720:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18558 00000100:00100000:0.0:1746147194.463725:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967309854848:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147194.463730:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.463736:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x313993942505f7ef lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d1a6 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.463751:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.463753:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.463757:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x313993942505f7ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1a6 expref: 36 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.463771:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x313993942505f7ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1a6 expref: 36 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.463777:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261c00, rc 0) 00000100:00100000:0.0:1746147194.463805:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967309854848:12345-192.168.204.25@tcp:101:cat.0 Request processed in 79us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.463810:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18558 00000100:00100000:0.0:1746147194.469183:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.472771:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.478870:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.481293:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.481519:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.481548:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309856128 00000100:00100000:0.0:1746147194.481550:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309856128 00010000:00010000:0.0:1746147194.481563:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a72000/0x313993942505f78d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d160 expref: 21 pid: 1853 timeout: 832 lvb_type: 1 00000100:00100000:0.0:1746147194.481582:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8347 00000100:00100000:0.0:1746147194.481587:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967309856000:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147194.481594:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147194.481608:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x313993942505f7ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1a6 expref: 37 pid: 1136 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746147194.481616:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x313993942505f7ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1a6 expref: 37 pid: 1136 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746147194.481634:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x313993942505f7ef lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1a6 expref: 37 pid: 1136 timeout: 832 lvb_type: 1 00010000:00010000:0.0:1746147194.481645:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147194.481658:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967309856000:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 71us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.481664:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8347 00000100:00100000:0.0:1746147194.485086:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.487467:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.490177:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.525992:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.528737:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.529066:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.529202:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309857280 00000100:00100000:0.0:1746147194.529208:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309857280 00010000:00010000:0.0:1746147194.529230:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1600/0x313993942505f7e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1bb expref: 36 pid: 9584 timeout: 832 lvb_type: 1 00000100:00100000:0.0:1746147194.529251:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8349 00000100:00100000:0.0:1746147194.531547:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.535394:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.540289:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.549954:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.648697:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.656544:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.658693:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.658827:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.666871:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.671420:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.677627:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.677664:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.680874:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.680907:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.688304:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.688354:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.688380:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.688410:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.689964:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6734 00000100:00100000:0.0:1746147194.689974:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967309860608:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147194.723757:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309861504 00000100:00100000:0.0:1746147194.723765:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309861504 00000100:00100000:0.0:1746147194.723802:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18565 00000100:00100000:0.0:1746147194.723808:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2281:x1830967309861504:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147194.723823:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.723838:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e260c00/0x313993942505f89e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d208 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.723864:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a73e00/0x313993942505f794 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d167 expref: 23 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.723872:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f03cc00/0x313993942505f7da lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1ad expref: 38 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.723884:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.723886:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.723889:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e260c00/0x313993942505f89e lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1867776->2097151] (req 1867776->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d208 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.723918:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f03cc00/0x313993942505f7da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1ad expref: 38 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.723930:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f03cc00/0x313993942505f7da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1ad expref: 38 pid: 12201 timeout: 832 lvb_type: 1 00000100:00100000:0.0:1746147194.723942:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094733480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311263872:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147194.724621:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a73e00/0x313993942505f794 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d167 expref: 23 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.724631:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a73e00/0x313993942505f794 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d167 expref: 23 pid: 1853 timeout: 832 lvb_type: 1 00000100:00100000:0.0:1746147194.724639:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094733800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311264000:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147194.725386:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.728274:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.730330:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.731850:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.732683:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.732747:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.732765:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.732776:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.732797:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.732814:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309862144 00000100:00100000:0.0:1746147194.732817:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309862144 00000100:00100000:0.0:1746147194.732839:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309862400 00000100:00100000:0.0:1746147194.732841:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309862400 00000100:00100000:0.0:1746147194.732851:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309862272 00000100:00100000:0.0:1746147194.732853:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309862272 00000100:00100000:0.0:1746147194.732861:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309862528 00000100:00100000:0.0:1746147194.732862:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309862528 00000100:00100000:0.0:1746147194.732874:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18566 00000100:00100000:0.0:1746147194.732879:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967309862144:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147194.732895:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.732912:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e261e00/0x313993942505f8a5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d20f expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.732930:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.732932:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.732940:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e261e00/0x313993942505f8a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d20f expref: 38 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.732964:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e261e00/0x313993942505f8a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d20f expref: 38 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.732974:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261e00, rc 0) 00000100:00100000:0.0:1746147194.733014:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967309862144:12345-192.168.204.25@tcp:101:cat.0 Request processed in 135us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.733020:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18566 00000100:00100000:0.0:1746147194.733034:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18567 00000100:00100000:0.0:1746147194.733039:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967309862400:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147194.733044:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.733050:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e260800/0x313993942505f8ac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d21d expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147194.733087:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096899f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311264128:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147194.733159:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.733182:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18568 00000100:00100000:0.0:1746147194.733188:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2002:x1830967309862272:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147194.733195:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.733202:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e260000/0x313993942505f8b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d216 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147194.734014:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311264512:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147194.734038:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.735579:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00010000:0.0:1746147194.736025:0:1136:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746147193 -> 1746147194 00002000:00010000:0.0:1746147194.736029:0:1136:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746147193 -> 1746147194 00002000:00010000:0.0:1746147194.736031:0:1136:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746147193 -> 1746147194 00000100:00100000:0.0:1746147194.736047:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096899f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311264128:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147194.736067:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e260800/0x313993942505f8ac lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d21d expref: 39 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.736078:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e260800/0x313993942505f8ac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d21d expref: 39 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.736117:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260800, rc 0) 00000100:00100000:0.0:1746147194.736139:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967309862400:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3099us (3372us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147194.736145:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18567 00010000:00010000:1.0:1746147194.737250:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e260c00/0x313993942505f89e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d208 expref: 23 pid: 9586 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746147194.737263:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e260c00/0x313993942505f89e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1867776->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d208 expref: 23 pid: 9586 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746147194.737269:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009455ca80 00000100:00100000:0.0:1746147194.737622:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.737854:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.741050:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.741110:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309863936 00000100:00100000:0.0:1746147194.741112:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.741117:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309863936 00000100:00100000:0.0:1746147194.741138:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.741859:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18572 00000100:00100000:1.0:1746147194.741866:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2281:x1830967309863936:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147194.741878:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147194.741892:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x313993942505f8f2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d240 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.741913:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5565600/0x313993942505f7a2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d16e expref: 24 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.741922:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f03c000/0x313993942505f7e8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1b4 expref: 37 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.741927:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.741928:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.741931:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x313993942505f8f2 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->1159167] (req 1048576->1159167) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d240 expref: 24 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.741967:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f03c000/0x313993942505f7e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1b4 expref: 37 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.741983:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f03c000/0x313993942505f7e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1b4 expref: 37 pid: 12201 timeout: 832 lvb_type: 1 00000100:00100000:1.0:1746147194.741994:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311264896:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147194.742701:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5565600/0x313993942505f7a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d16e expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.742710:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5565600/0x313993942505f7a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d16e expref: 26 pid: 1853 timeout: 832 lvb_type: 1 00000100:00100000:1.0:1746147194.742718:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311265024:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147194.742738:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9623c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.743076:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.743108:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309864192 00000100:00100000:0.0:1746147194.743111:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309864192 00002000:00100000:0.0:1746147194.743129:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3026943) req@ffff880097d77480 x1830967309864192/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.743136:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d77480 with x1830967309864192 ext(2097152->3026943) 00010000:00010000:0.0:1746147194.743141:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d99200/0x313993942505f827 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1d7 expref: 21 pid: 12201 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746147194.743148:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d99200/0x313993942505f827 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1d7 expref: 21 pid: 12201 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746147194.743154:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097d77480 00000100:00100000:0.0:1746147194.743165:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1556 00000100:00100000:0.0:1746147194.743170:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967309864192:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147194.750642:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.754647:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.757548:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.758700:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967309864192:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 15526us (15621us total) trans 21474842351 rc 0/0 00000100:00100000:0.0:1746147194.758710:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1556 00002000:00100000:0.0:1746147194.758719:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3026943) req@ffff880097d77480 x1830967309864192/t21474842351(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 488/448 e 0 to 0 dl 1746147205 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.758728:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d77480 with x1830967309864192 ext(2097152->3026943) 00010000:00010000:0.0:1746147194.758736:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d99200/0x313993942505f827 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1d7 expref: 23 pid: 12201 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746147194.758747:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d99200/0x313993942505f827 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1d7 expref: 23 pid: 12201 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746147194.758753:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097d77480 00000100:00100000:1.0:1746147194.759027:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.759645:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309864832 00000100:00100000:0.0:1746147194.759651:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309864832 00000100:00100000:1.0:1746147194.759697:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:0.0:1746147194.759994:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1155072->1159167) req@ffff88009455fb80 x1830967309864832/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.760003:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455fb80 with x1830967309864832 ext(1155072->1159167) 00002000:00010000:0.0:1746147194.760007:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009455fb80 00000100:00100000:0.0:1746147194.760025:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6738 00000100:00100000:0.0:1746147194.760032:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2001:x1830967309864832:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147194.760184:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2001:x1830967309864832:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 152us (1156us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147194.760191:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6738 00002000:00100000:0.0:1746147194.760196:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1155072->1159167) req@ffff88009455fb80 x1830967309864832/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.760202:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455fb80 with x1830967309864832 ext(1155072->1159167) 00002000:00010000:0.0:1746147194.760205:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009455fb80 00010000:00010000:1.0:1746147194.761473:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147194.761932:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.764330:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309865344 00000100:00100000:0.0:1746147194.764337:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309865344 00010000:00010000:0.0:1746147194.764368:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d99200/0x313993942505f827 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1d7 expref: 23 pid: 12201 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746147194.764393:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8361 00000100:00100000:0.0:1746147194.764399:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2001:x1830967309865344:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147194.764410:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147194.764428:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d99200/0x313993942505f827 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1d7 expref: 23 pid: 12201 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746147194.764439:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d99200/0x313993942505f827 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3026943) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1d7 expref: 23 pid: 12201 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746147194.764458:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d99200/0x313993942505f827 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3026943) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1d7 expref: 23 pid: 12201 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746147194.764483:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.764485:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.764493:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d99a00/0x313993942505f8eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3399679) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d239 expref: 36 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.764501:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d99a00/0x313993942505f8eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3399679) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d239 expref: 36 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.764533:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d99a00/0x313993942505f8eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3399679) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d239 expref: 36 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147194.764545:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311265408:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147194.764611:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.766480:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.766554:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309865600 00000100:00100000:1.0:1746147194.766562:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309865600 00002000:00100000:1.0:1746147194.766596:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880099888380 x1830967309865600/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.766603:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888380 with x1830967309865600 ext(1048576->2097151) 00002000:00010000:1.0:1746147194.766608:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099888380 00000100:00100000:1.0:1746147194.766634:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6740 00000100:00100000:1.0:1746147194.766639:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967309865600:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147194.768759:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311265408:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147194.768783:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147194.768820:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967309865344:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4419us (4552us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.768830:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8361 00000100:00100000:0.0:1746147194.771297:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2001:x1830967309865216:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 9115us (9356us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147194.771311:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6739 00002000:00100000:0.0:1746147194.771322:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88009988bb80 x1830967309865216/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.771332:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009988bb80 with x1830967309865216 ext(1048576->2097151) 00002000:00010000:0.0:1746147194.771338:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009988bb80 00000100:00100000:0.0:1746147194.771588:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309865856 00000100:00100000:0.0:1746147194.771597:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309865856 00002000:00100000:0.0:1746147194.771629:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3354624->3358719) req@ffff88012dbc1500 x1830967309865856/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.771636:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc1500 with x1830967309865856 ext(3354624->3358719) 00002000:00010000:0.0:1746147194.771640:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbc1500 00000100:00100000:0.0:1746147194.772207:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6741 00000100:00100000:0.0:1746147194.772217:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967309865856:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147194.772393:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967309865856:12345-192.168.204.25@tcp:3:cat.0 Request processed in 176us (871us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147194.772399:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6741 00002000:00100000:0.0:1746147194.772405:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3354624->3358719) req@ffff88012dbc1500 x1830967309865856/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.772412:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc1500 with x1830967309865856 ext(3354624->3358719) 00002000:00010000:0.0:1746147194.772415:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbc1500 00000100:00100000:1.0:1746147194.774080:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967309865600:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7431us (7597us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147194.774109:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6740 00002000:00100000:1.0:1746147194.774118:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880099888380 x1830967309865600/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.774126:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888380 with x1830967309865600 ext(1048576->2097151) 00002000:00010000:1.0:1746147194.774132:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099888380 00000100:00100000:0.0:1746147194.775419:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.775506:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309866240 00000100:00100000:1.0:1746147194.775518:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309866240 00002000:00100000:1.0:1746147194.775569:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1159168->2097151) req@ffff880099889f80 x1830967309866240/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.775578:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099889f80 with x1830967309866240 ext(1159168->2097151) 00002000:00010000:1.0:1746147194.775583:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099889f80 00000100:00100000:1.0:1746147194.775614:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6742 00000100:00100000:1.0:1746147194.775627:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2002:x1830967309866240:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147194.775770:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.777883:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.782709:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2002:x1830967309866240:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 7072us (7285us total) trans 0 rc 937984/937984 00000100:00100000:1.0:1746147194.782826:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6742 00002000:00100000:1.0:1746147194.782839:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1159168->2097151) req@ffff880099889f80 x1830967309866240/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 937984/937984 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.782849:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099889f80 with x1830967309866240 ext(1159168->2097151) 00002000:00010000:1.0:1746147194.782855:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099889f80 00000100:00100000:0.0:1746147194.787674:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309866752 00000100:00100000:0.0:1746147194.787685:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309866752 00000100:00100000:0.0:1746147194.787741:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18574 00000100:00100000:0.0:1746147194.787749:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2284:x1830967309866752:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147194.787769:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.787788:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x313993942505f900 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d24e expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.787822:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x313993942505f8f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d240 expref: 23 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.787830:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147194.787832:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147194.787835:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x313993942505f900 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d24e expref: 39 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.787876:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x313993942505f8f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d240 expref: 23 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.787888:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x313993942505f8f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d240 expref: 23 pid: 9584 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746147194.787900:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311265536:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147194.788012:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.791284:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.791746:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311265536:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147194.791780:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x313993942505f900 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d24e expref: 39 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.791798:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c6400, rc 0) 00000100:00100000:1.0:1746147194.791843:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2284:x1830967309866752:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4096us (4979us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.791849:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18574 00000100:00100000:0.0:1746147194.792315:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.792360:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309867008 00000100:00100000:1.0:1746147194.792363:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309867008 00002000:00100000:1.0:1746147194.792388:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1159167) req@ffff880099889c00 x1830967309867008/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.792397:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099889c00 with x1830967309867008 ext(1048576->1159167) 00010000:00010000:1.0:1746147194.792403:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x313993942505f8f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d240 expref: 24 pid: 9584 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746147194.792411:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x313993942505f8f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d240 expref: 24 pid: 9584 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746147194.792416:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099889c00 00000100:00100000:1.0:1746147194.792428:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1557 00000100:00100000:1.0:1746147194.792432:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2003:x1830967309867008:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147194.795132:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.795218:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309867136 00000100:00100000:1.0:1746147194.795224:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309867136 00002000:00100000:1.0:1746147194.795258:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3354624->3399679) req@ffff880091c3e680 x1830967309867136/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.795266:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c3e680 with x1830967309867136 ext(3354624->3399679) 00010000:00010000:1.0:1746147194.795273:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d99a00/0x313993942505f8eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3399679) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d239 expref: 37 pid: 1854 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746147194.795283:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d99a00/0x313993942505f8eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3399679) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d239 expref: 37 pid: 1854 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746147194.795290:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c3e680 00000100:00100000:0.0:1746147194.795805:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2003:x1830967309867008:12345-192.168.204.25@tcp:4:cat.0 Request processed in 3368us (3486us total) trans 17179874990 rc 0/0 00000100:00100000:0.0:1746147194.795817:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1557 00002000:00100000:0.0:1746147194.795829:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1159167) req@ffff880099889c00 x1830967309867008/t17179874990(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 488/448 e 0 to 0 dl 1746147205 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147194.795839:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099889c00 with x1830967309867008 ext(1048576->1159167) 00010000:00010000:0.0:1746147194.795860:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x313993942505f8f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d240 expref: 26 pid: 9584 timeout: 832 lvb_type: 0 00010000:00010000:0.0:1746147194.795871:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x313993942505f8f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d240 expref: 26 pid: 9584 timeout: 832 lvb_type: 0 00002000:00010000:0.0:1746147194.795877:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099889c00 00000100:00100000:0.0:1746147194.799371:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.799521:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309867264 00000100:00100000:1.0:1746147194.799529:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309867264 00010000:00010000:1.0:1746147194.799559:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x313993942505f8f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d240 expref: 26 pid: 9584 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746147194.799597:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8362 00000100:00100000:1.0:1746147194.799603:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2000:x1830967309867264:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147194.799617:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147194.799633:0:4349:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147193 -> 1746147194 00002000:00010000:1.0:1746147194.799635:0:4349:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147193 -> 1746147194 00002000:00010000:1.0:1746147194.799638:0:4349:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147193 -> 1746147194 00010000:00010000:1.0:1746147194.799642:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x313993942505f8f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d240 expref: 26 pid: 9584 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746147194.799657:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x313993942505f8f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d240 expref: 26 pid: 9584 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746147194.799681:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x313993942505f8f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d240 expref: 26 pid: 9584 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746147194.799713:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.799716:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.799726:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x313993942505f900 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d24e expref: 38 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.799733:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x313993942505f900 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d24e expref: 38 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.799803:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x313993942505f900 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d24e expref: 38 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147194.799827:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311265792:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147194.799897:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.801523:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.801639:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311265792:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147194.801652:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147194.801696:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2000:x1830967309867264:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2092us (2331us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.801704:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8362 00000100:00100000:0.0:1746147194.803321:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.811978:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.812026:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.812083:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309868032 00000100:00100000:1.0:1746147194.812116:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309868032 00002000:00100000:1.0:1746147194.812155:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff8800769adf80 x1830967309868032/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.812165:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769adf80 with x1830967309868032 ext(2097152->4194303) 00002000:00010000:1.0:1746147194.812171:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769adf80 00000100:00100000:1.0:1746147194.812189:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309868160 00000100:00100000:1.0:1746147194.812191:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309868160 00002000:00100000:1.0:1746147194.812203:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff8800769aea00 x1830967309868160/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.812209:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769aea00 with x1830967309868160 ext(2097152->4194303) 00002000:00010000:1.0:1746147194.812212:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769aea00 00000100:00100000:1.0:1746147194.812240:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6745 00000100:00100000:1.0:1746147194.812247:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2003:x1830967309868032:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147194.817704:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.826436:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309868416 00000100:00100000:1.0:1746147194.826443:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309868416 00002000:00100000:1.0:1746147194.826478:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (2084864->2097151) req@ffff88012dbc0a80 x1830967309868416/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 12776/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.826487:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc0a80 with x1830967309868416 ext(2084864->2097151) 00010000:00010000:1.0:1746147194.826495:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x313993942505f820 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1d0 expref: 25 pid: 12201 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746147194.826508:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x313993942505f820 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1d0 expref: 25 pid: 12201 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746147194.826514:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dbc0a80 00000100:00100000:1.0:1746147194.826542:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1559 00000100:00100000:1.0:1746147194.826549:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2000:x1830967309868416:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147194.828043:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2000:x1830967309868416:12345-192.168.204.25@tcp:4:cat.0 Request processed in 1489us (1796us total) trans 21474842353 rc 0/0 00000100:00100000:1.0:1746147194.828052:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1559 00002000:00100000:1.0:1746147194.828059:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (2084864->2097151) req@ffff88012dbc0a80 x1830967309868416/t21474842353(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 12776/448 e 0 to 0 dl 1746147205 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.828067:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc0a80 with x1830967309868416 ext(2084864->2097151) 00010000:00010000:1.0:1746147194.828074:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x313993942505f820 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1d0 expref: 27 pid: 12201 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746147194.828085:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x313993942505f820 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1d0 expref: 27 pid: 12201 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746147194.828115:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dbc0a80 00000100:00100000:1.0:1746147194.829349:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2003:x1830967309868032:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17099us (17373us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147194.829358:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6745 00002000:00100000:1.0:1746147194.829364:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff8800769adf80 x1830967309868032/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.829372:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769adf80 with x1830967309868032 ext(2097152->4194303) 00002000:00010000:1.0:1746147194.829376:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769adf80 00000100:00100000:0.0:1746147194.832446:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.841911:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.845776:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.845869:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.846254:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18578 00000100:00100000:0.0:1746147194.846260:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2002:x1830967309869056:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147194.846268:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.846277:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e1a00/0x313993942505f91c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d26a expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.846289:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.846290:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.846295:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e1a00/0x313993942505f91c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d26a expref: 25 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.846304:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e1a00/0x313993942505f91c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d26a expref: 25 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.846310:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e1a00, rc 0) 00000100:00100000:0.0:1746147194.846326:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2002:x1830967309869056:12345-192.168.204.25@tcp:101:cat.0 Request processed in 66us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.846331:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18578 00000100:00100000:0.0:1746147194.851605:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.851672:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309869312 00000100:00100000:1.0:1746147194.851679:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309869312 00002000:00100000:1.0:1746147194.851706:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880099154700 x1830967309869312/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.851716:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099154700 with x1830967309869312 ext(4194304->4890623) 00002000:00010000:1.0:1746147194.851719:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099154700 00000100:00100000:1.0:1746147194.851735:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6748 00000100:00100000:1.0:1746147194.851740:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2002:x1830967309869312:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147194.856740:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2002:x1830967309869312:12345-192.168.204.25@tcp:3:cat.0 Request processed in 4991us (5135us total) trans 0 rc 696320/696320 00000100:00100000:1.0:1746147194.856752:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6748 00002000:00100000:1.0:1746147194.856761:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880099154700 x1830967309869312/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.856770:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099154700 with x1830967309869312 ext(4194304->4890623) 00002000:00010000:1.0:1746147194.856776:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099154700 00000100:00100000:0.0:1746147194.858866:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.863766:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.863841:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309869568 00000100:00100000:1.0:1746147194.863851:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309869568 00000100:00100000:1.0:1746147194.863906:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16177 00000100:00100000:1.0:1746147194.863913:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2289:x1830967309869568:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147194.863934:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147194.863950:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x313993942505f92a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d278 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.864011:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x313993942505f931 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147194.864021:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x313993942505f931 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147194.864030:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x313993942505f931 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147194.864043:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261000/0x313993942505f938 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147194.864049:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261000/0x313993942505f938 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147194.864054:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261000/0x313993942505f938 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147194.864149:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x313993942505f93f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147194.864160:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0600/0x313993942505f86d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1fa expref: 19 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.864165:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x313993942505f93f lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147194.864191:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0600/0x313993942505f86d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1fa expref: 19 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.864201:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0600/0x313993942505f86d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1fa expref: 19 pid: 16099 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746147194.864212:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311266304:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147194.865161:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9629c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.867774:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.868136:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311266304:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147194.868154:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x313993942505f93f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147194.869857:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147194.870736:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x313993942505f93f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.870743:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x313993942505f93f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:0.0:1746147194.870782:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:0.0:1746147194.870785:0:16099:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746147194.870800:0:16099:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x313993942505f93f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.870809:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x313993942505f93f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.870817:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x313993942505f931 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.870822:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x313993942505f931 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.870827:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x313993942505f931 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.870831:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e261400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147194.870834:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x313993942505f931 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.870839:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x313993942505f931 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.870850:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147194.870853:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147194.870856:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x313993942505f931 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.870860:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261400/0x313993942505f931 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.870884:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261000/0x313993942505f938 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.870889:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261000/0x313993942505f938 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.870893:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261000/0x313993942505f938 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.870896:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e261000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147194.870898:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261000/0x313993942505f938 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.870902:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261000/0x313993942505f938 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.870908:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094553700) 00010000:00010000:0.0:1746147194.870909:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147194.870912:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261000/0x313993942505f938 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.870916:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261000/0x313993942505f938 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147194.870941:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x313993942505f92a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d278 expref: 12 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.870960:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x313993942505f93f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d278 expref: 11 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.870966:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147194.870968:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147194.870970:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261800, rc 0) 00000100:00100000:0.0:1746147194.871007:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2289:x1830967309869568:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 7094us (7249us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.871012:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16177 00000100:00100000:0.0:1746147194.873772:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.873948:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.874013:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309870208 00000100:00100000:1.0:1746147194.874021:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309870208 00002000:00100000:1.0:1746147194.874056:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880099157100 x1830967309870208/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.874064:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099157100 with x1830967309870208 ext(2097152->4194303) 00002000:00010000:1.0:1746147194.874069:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099157100 00000100:00100000:1.0:1746147194.874303:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6750 00000100:00100000:1.0:1746147194.874308:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967309870208:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147194.878844:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.878884:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.878911:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.878931:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309870592 00000100:00100000:0.0:1746147194.878938:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309870592 00000100:00100000:0.0:1746147194.878993:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309870720 00000100:00100000:0.0:1746147194.878996:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309870720 00000100:00100000:0.0:1746147194.879008:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309870848 00000100:00100000:0.0:1746147194.879010:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309870848 00000100:00100000:0.0:1746147194.879023:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18580 00000100:00100000:0.0:1746147194.879031:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967309870592:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147194.879047:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.879062:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e0000/0x313993942505f94d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d27f expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.879080:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.879082:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.879112:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e0000/0x313993942505f94d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d27f expref: 18 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.879125:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e0000/0x313993942505f94d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d27f expref: 18 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.879135:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0000, rc 0) 00000100:00100000:1.0:1746147194.879223:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18582 00000100:00100000:1.0:1746147194.879230:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2002:x1830967309870848:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147194.879237:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147194.879244:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e260800/0x313993942505f954 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d28d expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.879254:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.879255:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.879260:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e260800/0x313993942505f954 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d28d expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.879269:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e260800/0x313993942505f954 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d28d expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.879282:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260800, rc 0) 00000100:00100000:1.0:1746147194.879299:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2002:x1830967309870848:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 70us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.879306:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18582 00000100:00100000:0.0:1746147194.879639:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2003:x1830967309870592:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 145us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.879647:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18580 00000100:00100000:0.0:1746147194.879705:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.879719:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309870976 00000100:00100000:0.0:1746147194.879722:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309870976 00000100:00100000:0.0:1746147194.880131:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18583 00000100:00100000:0.0:1746147194.880137:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2002:x1830967309870976:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147194.880145:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.880153:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e1400/0x313993942505f95b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d294 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.880166:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.880167:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.880172:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e1400/0x313993942505f95b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d294 expref: 19 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.880181:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e1400/0x313993942505f95b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d294 expref: 19 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.880193:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e1400, rc 0) 00000100:00100000:0.0:1746147194.880211:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2002:x1830967309870976:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 75us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.880215:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18583 00000100:00100000:0.0:1746147194.880269:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.880280:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309871104 00000100:00100000:0.0:1746147194.880282:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309871104 00000100:00100000:0.0:1746147194.880294:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18584 00000100:00100000:0.0:1746147194.880298:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2003:x1830967309871104:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147194.880304:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.880309:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e0400/0x313993942505f962 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d29b expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.880318:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.880319:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147194.880323:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e0400/0x313993942505f962 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d29b expref: 20 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.880331:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e0400/0x313993942505f962 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d29b expref: 20 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147194.880338:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0400, rc 0) 00000100:00100000:0.0:1746147194.880350:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2003:x1830967309871104:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 51us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147194.880355:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18584 00000100:00100000:0.0:1746147194.886285:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.889461:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967309870208:12345-192.168.204.25@tcp:3:cat.0 Request processed in 15144us (15688us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147194.889469:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6750 00002000:00100000:1.0:1746147194.889478:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880099157100 x1830967309870208/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.889486:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099157100 with x1830967309870208 ext(2097152->4194303) 00002000:00010000:1.0:1746147194.889490:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099157100 00000100:00100000:0.0:1746147194.890626:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.890974:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.891524:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16179 00000100:00100000:0.0:1746147194.891531:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2289:x1830967309871744:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147194.891544:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147194.891558:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0200/0x313993942505f970 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d2b0 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.892214:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1800/0x313993942505f99a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147194.892223:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x313993942505f93f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d278 expref: 12 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.892229:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942505f98c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2a9 expref: 21 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.892235:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1800/0x313993942505f99a lrc: 5/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147194.892256:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942505f98c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2a9 expref: 21 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.892267:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942505f98c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2a9 expref: 21 pid: 9138 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746147194.892276:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e6e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311266432:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147194.892334:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x313993942505f93f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d278 expref: 12 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147194.892342:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x313993942505f93f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d278 expref: 12 pid: 16099 timeout: 832 lvb_type: 0 00000100:00100000:0.0:1746147194.892348:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e6e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311266560:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147194.892365:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.895823:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.895993:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309871872 00000100:00100000:1.0:1746147194.896000:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309871872 00000100:00100000:1.0:1746147194.896120:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18586 00000100:00100000:1.0:1746147194.896129:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2292:x1830967309871872:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147194.896145:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147194.896160:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e261400/0x313993942505f9a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d2b7 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.896185:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0000/0x313993942505f90e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d25c expref: 39 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.896194:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e1400/0x313993942505f95b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d294 expref: 19 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.896200:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e1a00/0x313993942505f91c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d26a expref: 26 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.896210:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.896211:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.896215:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e261400/0x313993942505f9a1 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1839104->1867775] (req 1839104->1867775) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2b7 expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.896239:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e1a00/0x313993942505f91c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d26a expref: 26 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.896249:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958e1a00/0x313993942505f91c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d26a expref: 26 pid: 1136 timeout: 832 lvb_type: 1 00000100:00100000:1.0:1746147194.896260:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311266688:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147194.896326:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e1400/0x313993942505f95b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d294 expref: 19 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.896334:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958e1400/0x313993942505f95b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d294 expref: 19 pid: 12201 timeout: 832 lvb_type: 1 00000100:00100000:1.0:1746147194.896341:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311266816:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147194.896365:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0000/0x313993942505f90e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d25c expref: 39 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.896373:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0000/0x313993942505f90e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d25c expref: 39 pid: 9584 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746147194.896384:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311266944:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147194.896400:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9629c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.898727:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.898914:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309872128 00000100:00100000:1.0:1746147194.898919:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309872128 00010000:00010000:1.0:1746147194.898944:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x313993942505f93f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d278 expref: 13 pid: 16099 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746147194.898987:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8366 00000100:00100000:1.0:1746147194.898993:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967309872128:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147194.899003:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147194.899008:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x313993942505f93f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d278 expref: 13 pid: 16099 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746147194.899017:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x313993942505f93f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d278 expref: 13 pid: 16099 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746147194.899033:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x313993942505f93f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d278 expref: 13 pid: 16099 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746147194.899059:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147194.899063:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1800/0x313993942505f99a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147194.899070:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1800/0x313993942505f99a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147194.899074:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147194.899287:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967309872128:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 293us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.899293:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8366 00000100:00100000:0.0:1746147194.899430:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.902791:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.902829:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.902860:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.903041:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311266688:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147194.903051:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311266816:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147194.903057:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311266944:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147194.903081:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e261400/0x313993942505f9a1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1839104->1867775] (req 1839104->1867775) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2b7 expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.903118:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261400, rc 0) 00000100:00100000:1.0:1746147194.903158:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2292:x1830967309871872:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7021us (7333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.903165:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18586 00000100:00100000:0.0:1746147194.905223:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.907513:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.907615:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309872768 00000100:00100000:1.0:1746147194.907621:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309872768 00000100:00100000:1.0:1746147194.907663:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18587 00000100:00100000:1.0:1746147194.907669:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967309872768:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147194.907681:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147194.907693:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f381a00/0x313993942505f9bd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d2c5 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147194.907733:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311267328:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147194.907784:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9629c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.908071:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.908384:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309873024 00000100:00100000:1.0:1746147194.908388:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309873024 00002000:00100000:1.0:1746147194.908407:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1863680->1867775) req@ffff88009885b480 x1830967309873024/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.908414:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885b480 with x1830967309873024 ext(1863680->1867775) 00002000:00010000:1.0:1746147194.908418:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009885b480 00000100:00100000:1.0:1746147194.908518:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6751 00000100:00100000:1.0:1746147194.908524:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2002:x1830967309873024:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147194.908757:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2002:x1830967309873024:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 232us (685us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147194.908763:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6751 00002000:00100000:1.0:1746147194.908768:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1863680->1867775) req@ffff88009885b480 x1830967309873024/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.908775:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885b480 with x1830967309873024 ext(1863680->1867775) 00002000:00010000:1.0:1746147194.908778:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009885b480 00000100:00100000:0.0:1746147194.909168:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.914634:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311267328:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147194.914652:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f381a00/0x313993942505f9bd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2c5 expref: 40 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.914659:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f381a00/0x313993942505f9bd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2c5 expref: 40 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.914673:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f381a00, rc 0) 00000100:00100000:1.0:1746147194.914692:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967309872768:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7024us (7653us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147194.914698:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18587 00000100:00100000:1.0:1746147194.914711:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309873536 00000100:00100000:1.0:1746147194.914713:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309873536 00000100:00100000:1.0:1746147194.914734:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18588 00000100:00100000:1.0:1746147194.914738:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967309873536:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147194.914745:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147194.914752:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098447e00/0x313993942505f9e7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d2d3 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147194.914785:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311267456:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147194.914831:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9629c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147194.917291:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311267456:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147194.917314:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098447e00/0x313993942505f9e7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2d3 expref: 20 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.917323:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098447e00/0x313993942505f9e7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2d3 expref: 20 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.917332:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098447e00, rc 0) 00000100:00100000:1.0:1746147194.917413:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967309873536:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2673us (2922us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147194.917419:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18588 00000100:00100000:0.0:1746147194.918929:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.919018:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309874048 00000100:00100000:1.0:1746147194.919024:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309874048 00002000:00100000:1.0:1746147194.919058:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880098858380 x1830967309874048/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.919067:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098858380 with x1830967309874048 ext(4194304->4890623) 00002000:00010000:1.0:1746147194.919072:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098858380 00000100:00100000:1.0:1746147194.919125:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6752 00000100:00100000:1.0:1746147194.919132:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967309874048:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147194.924545:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967309874048:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5414us (5620us total) trans 0 rc 696320/696320 00000100:00100000:1.0:1746147194.924553:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6752 00002000:00100000:1.0:1746147194.924560:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880098858380 x1830967309874048/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:570/0 lens 488/440 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.924568:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098858380 with x1830967309874048 ext(4194304->4890623) 00002000:00010000:1.0:1746147194.924571:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098858380 00000100:00100000:0.0:1746147194.926861:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.933052:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.936104:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309874688 00000100:00100000:1.0:1746147194.936115:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309874688 00000100:00100000:1.0:1746147194.936158:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18589 00000100:00100000:1.0:1746147194.936165:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967309874688:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147194.936179:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147194.936195:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x313993942505f9fc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d2e1 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147194.936248:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311267584:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147194.938572:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9629c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147194.941771:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311267584:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147194.941800:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x313993942505f9fc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2e1 expref: 40 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.941813:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x313993942505f9fc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2e1 expref: 40 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.941829:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098447a00, rc 0) 00000100:00100000:1.0:1746147194.941869:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967309874688:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5703us (8824us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147194.941876:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18589 00000100:00100000:0.0:1746147194.948460:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.948576:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309874816 00000100:00100000:1.0:1746147194.948585:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309874816 00000100:00100000:1.0:1746147194.948733:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18590 00000100:00100000:1.0:1746147194.948740:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967309874816:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147194.948755:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147194.948770:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505fa03 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d2e8 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147194.948812:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311267712:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147194.948890:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9629c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147194.950222:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311267712:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147194.950241:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505fa03 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2e8 expref: 40 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.950251:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505fa03 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2e8 expref: 40 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.950269:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098446600, rc 0) 00000100:00100000:1.0:1746147194.950297:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967309874816:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1558us (1845us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147194.950307:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18590 00000100:00100000:0.0:1746147194.981775:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.986342:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.988912:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.988962:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309875456 00000100:00100000:1.0:1746147194.988968:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309875456 00000100:00100000:1.0:1746147194.989010:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18591 00000100:00100000:1.0:1746147194.989016:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2294:x1830967309875456:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147194.989028:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147194.989044:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098446200/0x313993942505fa2d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d2f6 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.989069:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f03ca00/0x313993942505f85f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1f3 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.989077:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e0000/0x313993942505f94d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d27f expref: 18 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.989083:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e261e00/0x313993942505f8a5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d20f expref: 40 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.989121:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.989123:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147194.989127:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098446200/0x313993942505fa2d lrc: 6/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [716800->1048575] (req 716800->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2f6 expref: 40 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.989153:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e261e00/0x313993942505f8a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d20f expref: 40 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.989163:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e261e00/0x313993942505f8a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d20f expref: 40 pid: 1136 timeout: 832 lvb_type: 1 00000100:00100000:1.0:1746147194.989173:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311267840:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147194.989261:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e0000/0x313993942505f94d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d27f expref: 18 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.989269:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958e0000/0x313993942505f94d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d27f expref: 18 pid: 1136 timeout: 832 lvb_type: 1 00000100:00100000:1.0:1746147194.989278:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311267968:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147194.989301:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f03ca00/0x313993942505f85f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1f3 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.989309:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f03ca00/0x313993942505f85f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1f3 expref: 24 pid: 9586 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746147194.989317:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311268096:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147194.989333:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9629c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147194.991906:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.992248:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311267840:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147194.992258:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311267968:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147194.993275:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311268096:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147194.993301:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098446200/0x313993942505fa2d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [716800->1048575] (req 716800->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2f6 expref: 40 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147194.993316:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147194.993318:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098446200, rc 0) 00000100:00100000:1.0:1746147194.993521:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2294:x1830967309875456:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4330us (4435us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147194.993528:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18591 00000100:00100000:0.0:1746147194.994324:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147194.995434:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.995554:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309875968 00000100:00100000:1.0:1746147194.995558:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309875968 00000100:00100000:1.0:1746147194.995588:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18592 00000100:00100000:1.0:1746147194.995593:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2000:x1830967309875968:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147194.995603:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147194.995613:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098db1e00/0x313993942505fa34 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d2fd expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147194.995640:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311268352:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147194.995692:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9629c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147194.997052:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311268352:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147194.997071:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098db1e00/0x313993942505fa34 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2fd expref: 25 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.997081:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098db1e00/0x313993942505fa34 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2fd expref: 25 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147194.997120:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098db1e00, rc 0) 00000100:00100000:1.0:1746147194.997142:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2000:x1830967309875968:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1548us (1708us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147194.997151:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18592 00000100:00100000:1.0:1746147194.997210:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.997227:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309876224 00000100:00100000:1.0:1746147194.997230:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309876224 00002000:00100000:1.0:1746147194.997254:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x93:0x0] (716800->720895) req@ffff88009455f800 x1830967309876224/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:570/0 lens 488/0 e 0 to 0 dl 1746147205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.997263:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455f800 with x1830967309876224 ext(716800->720895) 00002000:00010000:1.0:1746147194.997266:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009455f800 00000100:00100000:1.0:1746147194.997295:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6753 00000100:00100000:1.0:1746147194.997301:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967309876224:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147194.997393:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967309876224:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 92us (183us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147194.997399:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6753 00002000:00100000:1.0:1746147194.997404:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x93:0x0] (716800->720895) req@ffff88009455f800 x1830967309876224/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746147205 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147194.997410:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455f800 with x1830967309876224 ext(716800->720895) 00002000:00010000:1.0:1746147194.997413:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009455f800 00000100:00100000:0.0:1746147194.999004:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147194.999157:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309876352 00000100:00100000:1.0:1746147194.999162:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309876352 00000100:00100000:1.0:1746147194.999237:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18593 00000100:00100000:1.0:1746147194.999321:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2300:x1830967309876352:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147194.999489:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147194.999503:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505fa3b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d304 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.999529:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098446200/0x313993942505fa2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2f6 expref: 38 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.999536:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147194.999537:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147194.999541:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505fa3b lrc: 4/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d304 expref: 25 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.999564:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098446200/0x313993942505fa2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2f6 expref: 38 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147194.999575:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098446200/0x313993942505fa2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2f6 expref: 38 pid: 1136 timeout: 832 lvb_type: 0 00000100:00100000:1.0:1746147194.999584:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311268480:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147194.999695:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9629c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.002849:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.004013:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311268480:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147195.004029:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505fa3b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d304 expref: 25 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.004039:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098446600, rc 0) 00000100:00100000:0.0:1746147195.004056:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2300:x1830967309876352:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4813us (5054us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.004061:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18593 00000100:00100000:0.0:1746147195.005079:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.005132:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309876608 00000100:00100000:1.0:1746147195.005137:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309876608 00002000:00100000:1.0:1746147195.005165:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x93:0x0] (716800->1048575) req@ffff8800975a6d80 x1830967309876608/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.005175:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a6d80 with x1830967309876608 ext(716800->1048575) 00010000:00010000:1.0:1746147195.005181:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098446200/0x313993942505fa2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2f6 expref: 39 pid: 1136 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746147195.005191:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098446200/0x313993942505fa2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2f6 expref: 39 pid: 1136 timeout: 832 lvb_type: 0 00002000:00010000:1.0:1746147195.005202:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800975a6d80 00000100:00100000:1.0:1746147195.005229:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1560 00000100:00100000:1.0:1746147195.005235:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967309876608:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147195.006735:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147195.007053:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147195.009845:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.010065:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147195.011246:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147195.011423:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967309876608:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 6186us (6345us total) trans 21474842354 rc 0/0 00000100:00100000:1.0:1746147195.011431:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1560 00002000:00100000:1.0:1746147195.011437:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x93:0x0] (716800->1048575) req@ffff8800975a6d80 x1830967309876608/t21474842354(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:571/0 lens 488/448 e 0 to 0 dl 1746147206 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.011995:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a6d80 with x1830967309876608 ext(716800->1048575) 00010000:00010000:1.0:1746147195.012006:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098446200/0x313993942505fa2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2f6 expref: 41 pid: 1136 timeout: 832 lvb_type: 0 00010000:00010000:1.0:1746147195.012019:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098446200/0x313993942505fa2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 716800->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d2f6 expref: 41 pid: 1136 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746147195.012027:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800975a6d80 00000100:00100000:0.0:1746147195.016060:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.018652:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.018807:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309877376 00000100:00100000:1.0:1746147195.018814:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309877376 00002000:00100000:1.0:1746147195.018850:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x96:0x0] (1417216->1421311) req@ffff880094730e00 x1830967309877376/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.018859:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094730e00 with x1830967309877376 ext(1417216->1421311) 00002000:00010000:1.0:1746147195.018864:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094730e00 00000100:00100000:1.0:1746147195.018893:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6754 00000100:00100000:1.0:1746147195.018900:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967309877376:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147195.019030:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967309877376:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 130us (382us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147195.019036:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6754 00002000:00100000:1.0:1746147195.019041:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x96:0x0] (1417216->1421311) req@ffff880094730e00 x1830967309877376/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.019048:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094730e00 with x1830967309877376 ext(1417216->1421311) 00002000:00010000:1.0:1746147195.019050:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094730e00 00000100:00100000:0.0:1746147195.026308:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.026484:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147195.026811:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746147195.027218:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147195.040832:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.045115:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.045183:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.047237:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.047282:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147195.048320:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147195.050166:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.065196:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.068452:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.070367:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.074152:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.075810:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.076020:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309879552 00000100:00100000:1.0:1746147195.076025:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309879552 00010000:00010000:1.0:1746147195.076048:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d98e00/0x313993942505f907 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d255 expref: 26 pid: 9584 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746147195.077629:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.080915:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.080960:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.081022:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.081132:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.081610:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309880448 00000100:00100000:1.0:1746147195.081614:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309880448 00002000:00100000:1.0:1746147195.081631:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1822719) req@ffff880132127b80 x1830967309880448/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.081638:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132127b80 with x1830967309880448 ext(1048576->1822719) 00002000:00010000:1.0:1746147195.081641:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132127b80 00000100:00100000:0.0:1746147195.081668:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6757 00000100:00100000:0.0:1746147195.081675:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2000:x1830967309879936:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147195.082467:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6760 00000100:00100000:0.0:1746147195.082474:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2001:x1830967309880192:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147195.098994:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2001:x1830967309880192:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 16518us (18041us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147195.099003:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6760 00002000:00100000:1.0:1746147195.099009:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880132127480 x1830967309880192/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.099016:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132127480 with x1830967309880192 ext(1048576->2097151) 00002000:00010000:1.0:1746147195.099021:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132127480 00000100:00100000:0.0:1746147195.110288:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.110411:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309880960 00000100:00100000:1.0:1746147195.110421:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309880960 00002000:00100000:1.0:1746147195.110469:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2183168->4194303) req@ffff880132124e00 x1830967309880960/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.110480:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132124e00 with x1830967309880960 ext(2183168->4194303) 00002000:00010000:1.0:1746147195.110486:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132124e00 00000100:00100000:1.0:1746147195.110554:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6761 00000100:00100000:1.0:1746147195.110562:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2001:x1830967309880960:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147195.139010:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.172612:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.172650:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.172682:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.172704:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309881344 00000100:00100000:0.0:1746147195.172713:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309881344 00000100:00100000:0.0:1746147195.172755:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309881600 00000100:00100000:0.0:1746147195.172757:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309881600 00000100:00100000:0.0:1746147195.172972:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18598 00000100:00100000:0.0:1746147195.172980:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967309881472:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147195.172996:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.173010:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x313993942505fa7a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d32e expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.173027:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.173029:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.173036:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x313993942505fa7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d32e expref: 41 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.173051:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x313993942505fa7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d32e expref: 41 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.173063:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80c00, rc 0) 00000100:00100000:0.0:1746147195.173234:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967309881472:12345-192.168.204.25@tcp:101:cat.0 Request processed in 254us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.173241:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18598 00000100:00100000:1.0:1746147195.173397:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.186300:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.186352:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.210459:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.215514:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.228787:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.237511:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.255670:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.257271:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.260594:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.277811:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.294246:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.320332:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.323257:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.324544:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.329811:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.337516:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.344695:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.344743:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.344792:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.345305:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8390 00000100:00100000:0.0:1746147195.345316:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2001:x1830967309884928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147195.345330:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147195.345350:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f03dc00/0x313993942505f851 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1ec expref: 26 pid: 9586 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746147195.345364:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f03dc00/0x313993942505f851 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1ec expref: 26 pid: 9586 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746147195.345382:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f03dc00/0x313993942505f851 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d1ec expref: 26 pid: 9586 timeout: 833 lvb_type: 1 00010000:00010000:0.0:1746147195.345401:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.345403:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.345411:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbed600/0x313993942505face lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3256320->3862527) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d35f expref: 42 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.345419:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbed600/0x313993942505face lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3256320->3862527) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d35f expref: 42 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.345469:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbed600/0x313993942505face lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3862527) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d35f expref: 41 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147195.345481:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311271552:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147195.345720:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.347469:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.347603:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.347744:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311271552:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147195.347765:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147195.347810:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2001:x1830967309884928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2494us (3014us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147195.347820:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8390 00000100:00100000:0.0:1746147195.355938:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.375444:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.383714:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.383769:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.383832:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309886336 00000100:00100000:1.0:1746147195.383842:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309886336 00000100:00100000:1.0:1746147195.383951:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5984 00000100:00100000:1.0:1746147195.383962:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2317:x1830967309886336:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147195.384225:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2317:x1830967309886336:12345-192.168.204.25@tcp:35:cat.0 Request processed in 266us (522us total) trans 8589937019 rc 0/0 00000100:00100000:1.0:1746147195.384413:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5984 00000100:00100000:0.0:1746147195.387969:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.388007:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.388035:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.388064:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309886592 00000100:00100000:0.0:1746147195.388071:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309886592 00000100:00100000:0.0:1746147195.388126:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309886848 00000100:00100000:0.0:1746147195.388128:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309886848 00000100:00100000:0.0:1746147195.388146:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18606 00000100:00100000:0.0:1746147195.388153:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2000:x1830967309886592:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147195.388171:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.388188:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x313993942505fb06 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d37b expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.388209:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.388210:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.388218:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x313993942505fb06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d37b expref: 30 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.388232:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x313993942505fb06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d37b expref: 30 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.388242:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81c00, rc 0) 00000100:00100000:0.0:1746147195.388278:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2000:x1830967309886592:12345-192.168.204.25@tcp:101:cat.0 Request processed in 126us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.388283:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18606 00000100:00100000:0.0:1746147195.388296:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18608 00000100:00100000:0.0:1746147195.388300:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2000:x1830967309886848:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147195.388306:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.388315:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x313993942505fb14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d389 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147195.388349:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311271808:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147195.389400:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.403373:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.424959:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.434144:0:12153:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311271936 00000100:00100000:1.0:1746147195.434156:0:12153:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311271936 00000100:00100000:1.0:1746147195.434229:0:12153:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1746147195.434237:0:12153:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311271936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1746147195.434260:0:12153:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1145521216 pending 4669440 free 3911233536 avail 3679711232 00000100:00100000:1.0:1746147195.434329:0:12153:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311271936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147195.434335:0:12153:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00080000:0.0:1746147195.434373:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147195.440334:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.443353:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.450300:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.462700:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.463200:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.463247:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309888000 00000100:00100000:1.0:1746147195.463257:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309888000 00002000:00100000:1.0:1746147195.463304:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff880099150380 x1830967309888000/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.463314:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150380 with x1830967309888000 ext(2097152->4194303) 00002000:00010000:1.0:1746147195.463319:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099150380 00000100:00100000:1.0:1746147195.463342:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6772 00000100:00100000:1.0:1746147195.463350:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2002:x1830967309888000:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147195.481606:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2002:x1830967309888000:12345-192.168.204.25@tcp:3:cat.0 Request processed in 18246us (18910us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147195.481617:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6772 00002000:00100000:1.0:1746147195.481629:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff880099150380 x1830967309888000/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.481636:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150380 with x1830967309888000 ext(2097152->4194303) 00002000:00010000:1.0:1746147195.481641:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099150380 00000100:00100000:0.0:1746147195.491483:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.492678:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.493271:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309888512 00000100:00100000:1.0:1746147195.493276:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309888512 00000100:00100000:1.0:1746147195.493319:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18611 00000100:00100000:1.0:1746147195.493325:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967309888512:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147195.493337:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147195.493351:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd200/0x313993942505fb29 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d39e expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.493367:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.493369:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.493374:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd200/0x313993942505fb29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d39e expref: 43 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.493387:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd200/0x313993942505fb29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d39e expref: 43 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.493396:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fd200, rc 0) 00000100:00100000:1.0:1746147195.493432:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2003:x1830967309888512:12345-192.168.204.25@tcp:101:cat.0 Request processed in 106us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147195.493438:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18611 00000100:00100000:0.0:1746147195.495129:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.498399:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.498483:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.502141:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.502793:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311272576:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147195.502813:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147195.502838:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967309889024:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4002us (4354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.502847:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8393 00000100:00100000:0.0:1746147195.503511:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.513852:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.514045:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.520828:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.522557:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.522879:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309890048 00000100:00100000:0.0:1746147195.522885:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309890048 00010000:00010000:0.0:1746147195.522910:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800932e2200/0x313993942505fa96 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d34a expref: 42 pid: 9584 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746147195.522948:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8395 00000100:00100000:0.0:1746147195.522955:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967309890048:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147195.522964:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147195.522978:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800932e2200/0x313993942505fa96 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d34a expref: 42 pid: 9584 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746147195.522987:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800932e2200/0x313993942505fa96 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d34a expref: 42 pid: 9584 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746147195.523003:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932e2200/0x313993942505fa96 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d34a expref: 42 pid: 9584 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746147195.523019:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.523021:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.523028:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x313993942505fb37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2543615) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3ac expref: 30 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.523035:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x313993942505fb37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2543615) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3ac expref: 30 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.523062:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x313993942505fb37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2543615) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3ac expref: 30 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147195.523072:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011da9d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311273088:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147195.523153:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154e40 going to sleep for 11 seconds 00000001:00080000:1.0:1746147195.527247:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842357 is committed 00000001:00080000:1.0:1746147195.527265:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842354 is committed 00000001:00080000:1.0:1746147195.527290:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842348 is committed 00000001:00080000:1.0:1746147195.527316:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842330 is committed 00000100:00100000:0.0:1746147195.529179:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.529636:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.533547:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.533616:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309890688 00000100:00100000:1.0:1746147195.533625:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309890688 00002000:00100000:1.0:1746147195.533668:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88011da9c000 x1830967309890688/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.533683:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9c000 with x1830967309890688 ext(1048576->2097151) 00002000:00010000:1.0:1746147195.533688:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011da9c000 00000100:00100000:1.0:1746147195.533799:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6776 00000100:00100000:1.0:1746147195.533806:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2002:x1830967309890688:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147195.542643:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2002:x1830967309890688:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8825us (9096us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147195.542657:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6776 00002000:00100000:0.0:1746147195.542669:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88011da9c000 x1830967309890688/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.542678:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9c000 with x1830967309890688 ext(1048576->2097151) 00002000:00010000:0.0:1746147195.542685:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011da9c000 00000100:00100000:0.0:1746147195.554280:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.562925:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.562997:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309890944 00000100:00100000:1.0:1746147195.563008:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309890944 00002000:00100000:1.0:1746147195.563051:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2543615) req@ffff88011da9fb80 x1830967309890944/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.563059:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9fb80 with x1830967309890944 ext(2097152->2543615) 00010000:00010000:1.0:1746147195.563065:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x313993942505fb37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3ac expref: 7 pid: 10340 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746147195.563076:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x313993942505fb37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3ac expref: 7 pid: 10340 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746147195.563081:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011da9fb80 00000100:00100000:1.0:1746147195.563141:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1567 00000100:00100000:1.0:1746147195.563148:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2003:x1830967309890944:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147195.567317:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967309890944:12345-192.168.204.25@tcp:4:cat.0 Request processed in 4157us (4390us total) trans 21474842358 rc 0/0 00000100:00100000:1.0:1746147195.567331:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1567 00002000:00100000:1.0:1746147195.567342:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2543615) req@ffff88011da9fb80 x1830967309890944/t21474842358(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:571/0 lens 488/448 e 0 to 0 dl 1746147206 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.567359:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9fb80 with x1830967309890944 ext(2097152->2543615) 00010000:00010000:1.0:1746147195.567369:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x313993942505fb37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3ac expref: 9 pid: 10340 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746147195.567384:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d94a00/0x313993942505fb37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3ac expref: 9 pid: 10340 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746147195.567391:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011da9fb80 00000100:00100000:0.0:1746147195.569363:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.584608:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.584665:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.584757:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309891584 00000100:00100000:1.0:1746147195.584762:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309891584 00002000:00100000:1.0:1746147195.584790:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88011da9c380 x1830967309891584/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.584799:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9c380 with x1830967309891584 ext(2097152->4194303) 00002000:00010000:1.0:1746147195.584805:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011da9c380 00000100:00100000:1.0:1746147195.585079:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6778 00000100:00100000:1.0:1746147195.585085:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967309891584:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147195.607703:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967309891584:12345-192.168.204.25@tcp:3:cat.0 Request processed in 22606us (23025us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147195.607717:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6778 00002000:00100000:1.0:1746147195.607730:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88011da9c380 x1830967309891584/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.607739:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9c380 with x1830967309891584 ext(2097152->4194303) 00002000:00010000:1.0:1746147195.607745:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011da9c380 00000100:00100000:0.0:1746147195.617888:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.619773:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309891840 00000100:00100000:1.0:1746147195.619789:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309891840 00002000:00100000:1.0:1746147195.619847:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88011da9d500 x1830967309891840/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.619857:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9d500 with x1830967309891840 ext(4194304->4890623) 00002000:00010000:1.0:1746147195.619864:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011da9d500 00000100:00100000:1.0:1746147195.619904:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6779 00000100:00100000:1.0:1746147195.619913:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011da9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2000:x1830967309891840:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147195.625137:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011da9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2000:x1830967309891840:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5212us (7248us total) trans 0 rc 696320/696320 00000100:00100000:1.0:1746147195.625151:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6779 00002000:00100000:1.0:1746147195.625164:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88011da9d500 x1830967309891840/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.625174:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011da9d500 with x1830967309891840 ext(4194304->4890623) 00002000:00010000:1.0:1746147195.625181:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011da9d500 00000100:00100000:0.0:1746147195.629175:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.638873:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.643430:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.653177:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.657801:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.659242:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.659303:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.659614:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8400 00000100:00100000:1.0:1746147195.660134:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2003:x1830967309892992:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147195.660145:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147195.660155:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093709600/0x313993942505fb1b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d390 expref: 26 pid: 10340 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746147195.660166:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093709600/0x313993942505fb1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d390 expref: 26 pid: 10340 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746147195.660183:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093709600/0x313993942505fb1b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d390 expref: 26 pid: 10340 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746147195.660210:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.660212:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.660220:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f588c00/0x313993942505fb4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3c1 expref: 42 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.660227:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f588c00/0x313993942505fb4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3c1 expref: 42 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.660254:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f588c00/0x313993942505fb4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3c1 expref: 42 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147195.660267:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311274112:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147195.660330:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9623c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.662033:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.662076:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.662204:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309893376 00000100:00100000:1.0:1746147195.662210:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309893376 00000100:00100000:1.0:1746147195.662261:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5985 00000100:00100000:1.0:1746147195.662268:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2328:x1830967309893376:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147195.662469:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2328:x1830967309893376:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 200us (391us total) trans 8589937021 rc 0/0 00000100:00100000:1.0:1746147195.662475:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5985 00000100:00100000:1.0:1746147195.662506:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311274112:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147195.662521:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147195.662538:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2003:x1830967309892992:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2918us (3236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147195.662545:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8400 00000100:00100000:0.0:1746147195.662690:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.694848:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.695206:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18617 00000100:00100000:1.0:1746147195.695218:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2328:x1830967309893760:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147195.695236:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147195.697989:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.704739:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.709471:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.716866:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.736346:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.739411:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.743269:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.747490:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.747584:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309895296 00000100:00100000:0.0:1746147195.747594:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309895296 00000100:00100000:0.0:1746147195.747804:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16190 00000100:00100000:0.0:1746147195.747812:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2334:x1830967309895296:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147195.747835:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.747854:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x313993942505fba0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d3dd expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.747912:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56400/0x313993942505fba7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147195.747924:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56400/0x313993942505fba7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147195.747946:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56400/0x313993942505fba7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147195.747957:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x313993942505fbae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147195.747963:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x313993942505fbae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147195.747968:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x313993942505fbae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147195.748045:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x313993942505fbb5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147195.748056:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0600/0x313993942505fa50 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d312 expref: 34 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.748064:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x313993942505fa9d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d351 expref: 43 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.748069:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x313993942505fbb5 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147195.748130:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x313993942505fa9d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d351 expref: 43 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.748143:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x313993942505fa9d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d351 expref: 43 pid: 6215 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746147195.748155:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311274496:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147195.748906:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0600/0x313993942505fa50 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d312 expref: 34 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.748915:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0600/0x313993942505fa50 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d312 expref: 34 pid: 6215 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746147195.748924:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311274624:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147195.748957:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.749514:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.749548:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.756173:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.756643:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309895808 00000100:00100000:1.0:1746147195.756651:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309895808 00000100:00100000:1.0:1746147195.756686:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5987 00000100:00100000:1.0:1746147195.756693:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:30748:x1830967309895808:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746147195.756724:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.757222:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:30748:x1830967309895808:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 529us (1057us total) trans 8589937024 rc 0/0 00000100:00100000:1.0:1746147195.757228:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5987 00000100:00100000:1.0:1746147195.757258:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311274496:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147195.757267:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311274624:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147195.757286:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x313993942505fbb5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147195.758021:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309896192 00000100:00100000:0.0:1746147195.758025:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309896192 00000100:00100000:0.0:1746147195.759685:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.759778:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147195.760650:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x313993942505fbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147195.760657:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x313993942505fbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:1.0:1746147195.760703:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:1.0:1746147195.760707:0:16099:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147195.760724:0:16099:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x313993942505fbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147195.760733:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x313993942505fbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147195.760741:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56400/0x313993942505fba7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147195.760746:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56400/0x313993942505fba7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147195.760752:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56400/0x313993942505fba7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147195.760758:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a56400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147195.760761:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56400/0x313993942505fba7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147195.760767:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56400/0x313993942505fba7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147195.760775:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147195.760778:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147195.760781:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56400/0x313993942505fba7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147195.760786:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56400/0x313993942505fba7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147195.760794:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x313993942505fbae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147195.760798:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x313993942505fbae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147195.760803:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x313993942505fbae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147195.760807:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a57400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147195.760809:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x313993942505fbae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147195.760814:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x313993942505fbae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147195.760819:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096bb1800) 00010000:00010000:1.0:1746147195.760820:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147195.760822:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x313993942505fbae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147195.760826:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57400/0x313993942505fbae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147195.760853:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x313993942505fba0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3dd expref: 14 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.760867:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x313993942505fbb5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3dd expref: 13 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.760873:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147195.760875:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147195.760877:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56a00, rc 0) 00000100:00100000:1.0:1746147195.760899:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2334:x1830967309895296:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 13089us (13427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147195.760905:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16190 00010000:00010000:1.0:1746147195.763557:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147195.766877:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.766979:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.767012:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.767041:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.767068:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309896576 00000100:00100000:0.0:1746147195.767077:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309896576 00000100:00100000:0.0:1746147195.767607:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309896832 00000100:00100000:1.0:1746147195.767608:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309897088 00000100:00100000:0.0:1746147195.767610:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309896832 00000100:00100000:1.0:1746147195.767611:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309897088 00000100:00100000:0.0:1746147195.767625:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309896704 00000100:00100000:0.0:1746147195.767627:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309896704 00000100:00100000:0.0:1746147195.767642:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18621 00000100:00100000:0.0:1746147195.767650:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967309896576:12345-192.168.204.25@tcp:101:mirror_io.0 00000100:00100000:1.0:1746147195.767684:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18623 00000100:00100000:1.0:1746147195.767689:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967309897088:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147195.767701:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147195.767718:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097035800/0x313993942505fbd8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d415 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147195.767767:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311275008:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147195.768083:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962900 going to sleep for 11 seconds 00010000:00010000:0.0:1746147195.768150:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.768158:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a57000/0x313993942505fbe6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d3f9 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.768169:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.768170:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.768175:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a57000/0x313993942505fbe6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3f9 expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.768595:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a57000/0x313993942505fbe6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3f9 expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.768602:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57000, rc 0) 00000100:00100000:0.0:1746147195.768619:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967309896576:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 971us (1753us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.768624:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18621 00000100:00100000:0.0:1746147195.768655:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.768757:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309896960 00000100:00100000:1.0:1746147195.768761:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309896960 00000100:00100000:1.0:1746147195.768986:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18625 00000100:00100000:1.0:1746147195.768992:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967309896960:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147195.769000:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147195.769009:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x313993942505fbed lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d40e expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147195.769037:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311275136:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147195.769080:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.769527:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.769730:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309897344 00000100:00100000:1.0:1746147195.769733:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309897344 00002000:00100000:1.0:1746147195.769763:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009258e300 x1830967309897344/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.769772:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258e300 with x1830967309897344 ext(1048576->2097151) 00002000:00010000:1.0:1746147195.769777:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258e300 00000100:00100000:1.0:1746147195.769802:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6784 00000100:00100000:1.0:1746147195.769808:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967309897344:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147195.771993:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311275136:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147195.772013:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x313993942505fbed lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d40e expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.772023:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x313993942505fbed lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d40e expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.772031:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097034400, rc 0) 00000100:00100000:1.0:1746147195.772065:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967309896960:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 3073us (3409us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147195.772071:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18625 00000100:00100000:0.0:1746147195.775760:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.780155:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.781729:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967309897344:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11918us (12200us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147195.781740:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6784 00002000:00100000:1.0:1746147195.781750:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009258e300 x1830967309897344/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.781759:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258e300 with x1830967309897344 ext(1048576->2097151) 00002000:00010000:1.0:1746147195.781764:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258e300 00000100:00100000:1.0:1746147195.785033:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.785213:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309897984 00000100:00100000:0.0:1746147195.785220:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309897984 00010000:00010000:0.0:1746147195.785248:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x313993942505fbb5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3dd expref: 15 pid: 16099 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746147195.785272:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8404 00000100:00100000:0.0:1746147195.785279:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2002:x1830967309897984:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147195.785291:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147195.785297:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x313993942505fbb5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3dd expref: 15 pid: 16099 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746147195.785308:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x313993942505fbb5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3dd expref: 15 pid: 16099 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746147195.785330:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x313993942505fbb5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3dd expref: 15 pid: 16099 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746147195.785346:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147195.785350:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x313993942505fbfb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147195.785360:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x313993942505fbfb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147195.785366:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x313993942505fbfb lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147195.785382:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147195.785401:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2002:x1830967309897984:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 123us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.785407:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8404 00000100:00100000:0.0:1746147195.788733:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.788824:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309898624 00000100:00100000:1.0:1746147195.788833:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309898624 00000100:00100000:1.0:1746147195.788885:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18626 00000100:00100000:1.0:1746147195.788893:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2333:x1830967309898624:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147195.788910:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147195.788929:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801312e6600/0x313993942505fc09 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d431 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.788971:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x313993942505fb45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3ba expref: 21 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.788979:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147195.788980:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147195.788984:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e6600/0x313993942505fc09 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d431 expref: 10 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.789014:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x313993942505fb45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3ba expref: 21 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.789025:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x313993942505fb45 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3280896->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3ba expref: 21 pid: 10340 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746147195.789038:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311275392:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147195.789137:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.789562:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.789612:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.791579:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311275392:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147195.791606:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801312e6600/0x313993942505fc09 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d431 expref: 10 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.791846:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e6600, rc 0) 00000100:00100000:1.0:1746147195.791984:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2333:x1830967309898624:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3091us (3262us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147195.791992:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18626 00000100:00100000:0.0:1746147195.792983:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.793027:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.793242:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309899008 00000100:00100000:1.0:1746147195.793245:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309899008 00000100:00100000:0.0:1746147195.793495:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.793663:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18627 00000100:00100000:1.0:1746147195.793668:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2337:x1830967309899008:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147195.793681:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147195.793694:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312e7000/0x313993942505fc33 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d438 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.793721:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x313993942505fb76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2965503) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3cf expref: 25 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.793727:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147195.793729:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147195.793732:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e7000/0x313993942505fc33 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d438 expref: 45 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.793759:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x313993942505fb76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2965503) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3cf expref: 25 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.793769:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x313993942505fb76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2965503) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3cf expref: 25 pid: 9584 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746147195.793779:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311275648:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147195.793820:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.804540:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.804616:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.805180:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309899392 00000100:00100000:1.0:1746147195.805184:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309899392 00002000:00100000:1.0:1746147195.805210:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (2461696->2965503) req@ffff880099011c00 x1830967309899392/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.805218:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099011c00 with x1830967309899392 ext(2461696->2965503) 00010000:00010000:1.0:1746147195.805225:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x313993942505fb76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3cf expref: 26 pid: 9584 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746147195.805235:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x313993942505fb76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3cf expref: 26 pid: 9584 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746147195.805242:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099011c00 00000100:00100000:1.0:1746147195.805258:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1570 00000100:00100000:1.0:1746147195.805264:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2003:x1830967309899392:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147195.823176:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2003:x1830967309899392:12345-192.168.204.25@tcp:4:cat.0 Request processed in 17901us (18547us total) trans 17179874994 rc 0/0 00000100:00100000:1.0:1746147195.823193:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1570 00002000:00100000:1.0:1746147195.823205:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (2461696->2965503) req@ffff880099011c00 x1830967309899392/t17179874994(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:571/0 lens 488/448 e 0 to 0 dl 1746147206 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.823215:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099011c00 with x1830967309899392 ext(2461696->2965503) 00010000:00010000:1.0:1746147195.823226:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x313993942505fb76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3cf expref: 28 pid: 9584 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746147195.823239:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x313993942505fb76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3cf expref: 28 pid: 9584 timeout: 833 lvb_type: 0 00002000:00010000:1.0:1746147195.823246:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099011c00 00000100:00100000:0.0:1746147195.824207:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.824261:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.825536:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.825598:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309899776 00000100:00100000:0.0:1746147195.825602:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309899776 00010000:00010000:0.0:1746147195.825618:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x313993942505fb76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3cf expref: 28 pid: 9584 timeout: 833 lvb_type: 0 00000100:00100000:0.0:1746147195.825652:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8407 00000100:00100000:0.0:1746147195.825658:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2002:x1830967309899776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147195.825667:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147195.825678:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x313993942505fb76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3cf expref: 28 pid: 9584 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746147195.825686:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x313993942505fb76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->2965503) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3cf expref: 28 pid: 9584 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746147195.825700:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95e00/0x313993942505fb76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->2965503) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3cf expref: 28 pid: 9584 timeout: 833 lvb_type: 0 00010000:00010000:0.0:1746147195.825714:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.825715:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.825719:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e7000/0x313993942505fc33 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d438 expref: 44 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.825724:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e7000/0x313993942505fc33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d438 expref: 44 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.825742:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e7000/0x313993942505fc33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d438 expref: 44 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147195.825750:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311276288:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147195.825771:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.831953:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.831981:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.832007:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.832035:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.832130:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311276288:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147195.832143:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147195.832178:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2002:x1830967309899776:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6519us (6642us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147195.832186:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8407 00000100:00100000:1.0:1746147195.832215:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8410 00000100:00100000:1.0:1746147195.832220:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2002:x1830967309900416:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147195.832228:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147195.832235:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505fa3b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d304 expref: 10 pid: 1136 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746147195.832246:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505fa3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d304 expref: 10 pid: 1136 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746147195.832259:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x313993942505fa3b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d304 expref: 10 pid: 1136 timeout: 833 lvb_type: 0 00010000:00010000:1.0:1746147195.832276:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147195.832290:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2002:x1830967309900416:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 71us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147195.832295:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8410 00000100:00100000:1.0:1746147195.832325:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309900160 00000100:00100000:1.0:1746147195.832328:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309900160 00002000:00100000:1.0:1746147195.832352:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880099012680 x1830967309900160/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147195.832361:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099012680 with x1830967309900160 ext(2097152->3145727) 00002000:00010000:1.0:1746147195.832365:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099012680 00000100:00100000:1.0:1746147195.832386:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6786 00000100:00100000:1.0:1746147195.832390:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967309900160:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147195.835611:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.838187:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.838215:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309900928 00000100:00100000:0.0:1746147195.838221:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309900928 00002000:00100000:0.0:1746147195.838250:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x93:0x0] (172032->176127) req@ffff88009455e300 x1830967309900928/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.838259:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455e300 with x1830967309900928 ext(172032->176127) 00002000:00010000:0.0:1746147195.838264:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009455e300 00000100:00100000:0.0:1746147195.838285:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6788 00000100:00100000:0.0:1746147195.838290:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2000:x1830967309900928:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147195.838461:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2000:x1830967309900928:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 170us (274us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147195.838467:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6788 00002000:00100000:0.0:1746147195.838472:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x93:0x0] (172032->176127) req@ffff88009455e300 x1830967309900928/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.838479:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455e300 with x1830967309900928 ext(172032->176127) 00002000:00010000:0.0:1746147195.838482:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009455e300 00000100:00100000:0.0:1746147195.845451:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.856967:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309901440 00000100:00100000:0.0:1746147195.856972:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309901440 00000100:00100000:0.0:1746147195.857014:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18630 00000100:00100000:0.0:1746147195.857020:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2337:x1830967309901440:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147195.857032:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.857050:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801312e7600/0x313993942505fc48 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d44d expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.857072:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.857074:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.857082:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e7600/0x313993942505fc48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d44d expref: 24 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.857117:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801312e7600/0x313993942505fc48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d44d expref: 24 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.857127:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e7600, rc 0) 00000100:00100000:0.0:1746147195.857162:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2337:x1830967309901440:12345-192.168.204.25@tcp:101:cat.0 Request processed in 142us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.857168:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18630 00000100:00100000:0.0:1746147195.857559:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.857596:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.864814:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.866743:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.866825:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.881540:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309902848 00000100:00100000:1.0:1746147195.881549:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309902848 00000100:00100000:0.0:1746147195.881836:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967309902720:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 14592us (15004us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147195.881843:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6793 00002000:00100000:0.0:1746147195.881848:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff880134b6c380 x1830967309902720/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.881861:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b6c380 with x1830967309902720 ext(3145728->4194303) 00002000:00010000:0.0:1746147195.881865:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b6c380 00000100:00100000:1.0:1746147195.882020:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18631 00000100:00100000:1.0:1746147195.882029:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967309902848:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147195.882044:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147195.882062:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0f600/0x313993942505fc4f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d454 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147195.882130:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311276544:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147195.882193:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962240 going to sleep for 11 seconds 00002000:00010000:1.0:1746147195.887400:0:9584:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime: 1746147194 -> 1746147195 00002000:00010000:1.0:1746147195.887407:0:9584:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime: 1746147194 -> 1746147195 00002000:00010000:1.0:1746147195.887409:0:9584:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime: 1746147194 -> 1746147195 00000100:00100000:1.0:1746147195.887434:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311276544:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147195.887468:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0f600/0x313993942505fc4f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d454 expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.887482:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0f600/0x313993942505fc4f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d454 expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.887498:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0f600, rc 0) 00000100:00100000:1.0:1746147195.887598:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967309902848:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5570us (6244us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147195.887607:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18631 00000100:00100000:0.0:1746147195.888741:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309903104 00000100:00100000:0.0:1746147195.888751:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309903104 00002000:00100000:0.0:1746147195.888792:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88012dbc0e00 x1830967309903104/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:571/0 lens 488/0 e 0 to 0 dl 1746147206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.888801:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc0e00 with x1830967309903104 ext(4194304->4890623) 00002000:00010000:0.0:1746147195.888807:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbc0e00 00000100:00100000:0.0:1746147195.888838:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6794 00000100:00100000:0.0:1746147195.888845:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967309903104:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147195.893982:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.895271:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967309903104:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 6420us (7419us total) trans 0 rc 696320/696320 00000100:00100000:0.0:1746147195.895280:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6794 00002000:00100000:0.0:1746147195.895288:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88012dbc0e00 x1830967309903104/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:571/0 lens 488/440 e 0 to 0 dl 1746147206 ref 1 fl Complete:/200/0 rc 696320/696320 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147195.895295:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc0e00 with x1830967309903104 ext(4194304->4890623) 00002000:00010000:0.0:1746147195.895299:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbc0e00 00000100:00100000:0.0:1746147195.903103:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.903403:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309903488 00000100:00100000:1.0:1746147195.903413:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309903488 00000100:00100000:1.0:1746147195.903465:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18632 00000100:00100000:1.0:1746147195.903473:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967309903488:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147195.903490:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147195.903507:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x313993942505fc56 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d45b expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147195.903560:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311276672:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147195.903652:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147195.905054:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311276672:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147195.905083:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x313993942505fc56 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d45b expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.905254:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x313993942505fc56 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d45b expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.905278:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0f400, rc 0) 00000100:00100000:1.0:1746147195.905323:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967309903488:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1849us (2245us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147195.905331:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18632 00000100:00100000:0.0:1746147195.908250:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.908337:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309903616 00000100:00100000:1.0:1746147195.908345:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309903616 00000100:00100000:1.0:1746147195.908394:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18633 00000100:00100000:1.0:1746147195.908402:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967309903616:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147195.908419:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147195.908436:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0f200/0x313993942505fc5d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d462 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147195.908491:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311276800:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147195.908574:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147195.909706:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311276800:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147195.909729:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0f200/0x313993942505fc5d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d462 expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.909739:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0f200/0x313993942505fc5d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d462 expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.909753:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0f200, rc 0) 00000100:00100000:1.0:1746147195.909778:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967309903616:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1377us (1537us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147195.909785:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18633 00000100:00100000:0.0:1746147195.923148:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.928379:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.928404:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309903872 00000100:00100000:1.0:1746147195.928413:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309903872 00000100:00100000:1.0:1746147195.928455:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18634 00000100:00100000:1.0:1746147195.928463:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2002:x1830967309903872:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147195.928481:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147195.928499:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0e800/0x313993942505fc80 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d470 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147195.928552:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311276928:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147195.928634:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147195.928778:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.928857:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.928900:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309904128 00000100:00100000:0.0:1746147195.928904:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309904128 00000100:00100000:0.0:1746147195.928928:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18636 00000100:00100000:0.0:1746147195.928947:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2002:x1830967309904128:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147195.928956:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147195.928967:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x313993942505fc8e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d47e expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.928981:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.928982:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147195.928988:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x313993942505fc8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d47e expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.928998:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x313993942505fc8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d47e expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147195.929006:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822a000, rc 0) 00000100:00100000:0.0:1746147195.929254:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2002:x1830967309904128:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 320us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.929260:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18636 00000100:00100000:1.0:1746147195.930229:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311276928:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147195.930255:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0e800/0x313993942505fc80 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d470 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.930265:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0e800/0x313993942505fc80 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d470 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.930277:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0e800, rc 0) 00000100:00100000:1.0:1746147195.930312:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2002:x1830967309903872:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 1850us (1943us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147195.930318:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18634 00000100:00100000:0.0:1746147195.934583:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.937643:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.940083:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.940335:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.944270:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.945009:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.959198:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.959338:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309905536 00000100:00100000:1.0:1746147195.959349:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309905536 00000100:00100000:1.0:1746147195.959818:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18637 00000100:00100000:1.0:1746147195.959829:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2346:x1830967309905536:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147195.959848:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147195.959868:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x313993942505fcdb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d49a expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.959898:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801312e6600/0x313993942505fc09 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d431 expref: 10 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.959907:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c43400/0x313993942505fc87 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d477 expref: 9 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.959914:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801312e7600/0x313993942505fc48 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d44d expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.959921:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.959923:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147195.959926:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x313993942505fcdb lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d49a expref: 10 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.959966:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801312e7600/0x313993942505fc48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d44d expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.959983:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801312e7600/0x313993942505fc48 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d44d expref: 23 pid: 1854 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746147195.959996:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311277184:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147195.962728:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c43400/0x313993942505fc87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d477 expref: 9 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147195.962746:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c43400/0x313993942505fc87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d477 expref: 9 pid: 10340 timeout: 833 lvb_type: 1 00000100:00100000:1.0:1746147195.962761:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311277312:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147195.963263:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801312e6600/0x313993942505fc09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d431 expref: 10 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147195.963274:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801312e6600/0x313993942505fc09 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d431 expref: 10 pid: 1854 timeout: 833 lvb_type: 0 00000100:00100000:1.0:1746147195.963282:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311277440:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147195.963619:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147195.967011:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.967955:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311277184:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147195.968552:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c43400/0x313993942505fc87 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d477 expref: 9 pid: 10340 timeout: 833 lvb_type: 1 00000100:00100000:0.0:1746147195.968571:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311277312:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147195.968582:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311277440:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147195.968608:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x313993942505fcdb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d49a expref: 10 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147195.968619:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0fa00, rc 0) 00000100:00100000:0.0:1746147195.968642:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2346:x1830967309905536:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8815us (9455us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147195.968648:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18637 00000100:00100000:0.0:1746147195.969316:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.971874:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.974224:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.979685:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.981697:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147195.981752:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.987483:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147195.991385:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.025586:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3764:1830967311278208:0@lo:400:kworker.0 00000100:00100000:1.0:1746147196.025671:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147196.025729:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746147196.025735:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967311278336:0@lo:400:kworker.0 00000100:00100000:1.0:1746147196.025760:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147196.025798:0:9510:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311278336 00000100:00100000:1.0:1746147196.025805:0:9510:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311278336 00000100:00100000:1.0:1746147196.025845:0:9510:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:1.0:1746147196.025852:0:9510:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3764:x1830967311278336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147196.025904:0:9510:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3764:x1830967311278336:12345-0@lo:400:kworker.0 Request processed in 52us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147196.025910:0:9510:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:1.0:1746147196.025954:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967311278336:0@lo:400:kworker.0 00000100:00100000:0.0:1746147196.026187:0:8098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311278208 00000100:00100000:0.0:1746147196.026191:0:8098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311278208 00000100:00100000:0.0:1746147196.026216:0:8098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1746147196.026221:0:8098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3764:x1830967311278208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147196.026251:0:8098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3764:x1830967311278208:12345-0@lo:400:kworker.0 Request processed in 30us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147196.026256:0:8098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1746147196.026352:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3764:1830967311278208:0@lo:400:kworker.0 00000100:00100000:0.0:1746147196.026424:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746147196.026432:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098823b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3767:1830967311278464:0@lo:400:kworker.0 00000100:00100000:0.0:1746147196.026474:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147196.026507:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967311278720:0@lo:400:kworker.0 00000100:00100000:1.0:1746147196.026527:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147196.026551:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3764:1830967311279232:0@lo:400:kworker.0 00000100:00100000:0.0:1746147196.026669:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311278592:0@lo:400:kworker.0 00000100:00100000:0.0:1746147196.026686:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147196.026696:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3767:1830967311279104:0@lo:400:kworker.0 00000100:00100000:0.0:1746147196.026709:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147196.026719:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311279616:0@lo:400:kworker.0 00000100:00100000:0.0:1746147196.026733:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147196.026749:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098823b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3767:1830967311278464:0@lo:400:kworker.0 00000100:00100000:0.0:1746147196.026765:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311278592 00000100:00100000:0.0:1746147196.026767:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311278592 00000100:00100000:0.0:1746147196.026786:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311279616 00000100:00100000:0.0:1746147196.026788:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311279616 00000100:00100000:0.0:1746147196.026804:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:0.0:1746147196.026808:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311278592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147196.026833:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311278592:12345-0@lo:400:kworker.0 Request processed in 25us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147196.026838:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:0.0:1746147196.026847:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1746147196.026851:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:3767:x1830967311279616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147196.026876:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:3767:x1830967311279616:12345-0@lo:400:kworker.0 Request processed in 25us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147196.026881:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1746147196.027261:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311279488 00000100:00100000:0.0:1746147196.027265:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311279488 00000100:00100000:0.0:1746147196.027296:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1746147196.027305:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3766:x1830967311279488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147196.027338:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147196.027355:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3764:1830967311279744:0@lo:400:kworker.0 00000100:00100000:1.0:1746147196.027373:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147196.027391:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967311278720:0@lo:400:kworker.0 00000100:00100000:1.0:1746147196.027397:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746147196.027402:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3764:1830967311278848:0@lo:400:kworker.0 00000100:00100000:1.0:1746147196.027417:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147196.027465:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3766:x1830967311279488:12345-0@lo:400:kworker.0 Request processed in 164us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147196.027470:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00080000:0.0:1746147196.027483:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1746147196.027486:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746147196.027488:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746147196.027489:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147196.027508:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311279360:0@lo:400:kworker.0 00000100:00080000:0.0:1746147196.027636:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147196.027654:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:0.0:1746147196.027661:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3764:x1830967311278848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147196.027687:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3764:x1830967311278848:12345-0@lo:400:kworker.0 Request processed in 28us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147196.027692:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00100000:1.0:1746147196.027864:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147196.027885:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3764:1830967311279232:0@lo:400:kworker.0 00000100:00100000:1.0:1746147196.027892:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3764:1830967311279744:0@lo:400:kworker.0 00000100:00100000:0.0:1746147196.029700:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311279360 00000100:00100000:0.0:1746147196.029710:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311279360 00000100:00100000:0.0:1746147196.029769:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1746147196.029775:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3764:x1830967311279360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147196.029831:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3764:x1830967311279360:12345-0@lo:400:kworker.0 Request processed in 56us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147196.029836:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:1.0:1746147196.029985:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3764:1830967311278848:0@lo:400:kworker.0 00000100:00100000:1.0:1746147196.029995:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311279360:0@lo:400:kworker.0 00000100:00100000:1.0:1746147196.041518:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746147196.041539:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311279872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746147196.041607:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147196.041902:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311279872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746147196.059126:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311280000 00000100:00100000:0.0:1746147196.059134:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311280000 00000100:00100000:0.0:1746147196.059179:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1746147196.059187:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3767:x1830967311280000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1746147196.059223:0:7244:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445560320 avail 1316098048 00000100:00100000:0.0:1746147196.059264:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3767:x1830967311280000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147196.059274:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1746147196.104907:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.106946:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309907456 00000100:00100000:1.0:1746147196.106960:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309907456 00000100:00100000:1.0:1746147196.107027:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16198 00000100:00100000:1.0:1746147196.107035:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2350:x1830967309907456:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147196.107065:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147196.107087:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009371da00/0x313993942505fce9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d4a8 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.107224:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009371c600/0x313993942505fcf0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.107243:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009371c600/0x313993942505fcf0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.107256:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009371c600/0x313993942505fcf0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:1.0:1746147196.107266:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147196.107366:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009371da00/0x313993942505fce9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4a8 expref: 49 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.107392:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009371c600/0x313993942505fcf0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4a8 expref: 48 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.107400:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147196.107402:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147196.107406:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371c600, rc 0) 00000100:00100000:1.0:1746147196.107458:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2350:x1830967309907456:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 424us (2562us total) trans 8589937034 rc 0/0 00000100:00100000:1.0:1746147196.107463:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16198 00000100:00100000:1.0:1746147196.121566:0:12153:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311280128 00000100:00100000:1.0:1746147196.121575:0:12153:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311280128 00000100:00100000:1.0:1746147196.121614:0:12153:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1746147196.121622:0:12153:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3766:x1830967311280128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746147196.121653:0:12153:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1146754112 pending 5902336 free 3911233536 avail 3679711232 00000100:00100000:1.0:1746147196.121693:0:12153:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3766:x1830967311280128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147196.121699:0:12153:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:0.0:1746147196.122035:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746147196.122044:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311280256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147196.122072:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147196.122218:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311280256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746147196.122363:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147196.123192:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147196.130404:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.142664:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147196.143865:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147196.146331:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.146380:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.146464:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309908096 00000100:00100000:1.0:1746147196.146473:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309908096 00000100:00100000:1.0:1746147196.146523:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18640 00000100:00100000:1.0:1746147196.146531:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967309908096:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147196.146548:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147196.146565:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009371c000/0x313993942505fd28 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d4bd expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147196.146623:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311280512:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147196.146714:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147196.147999:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311280384:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147196.148023:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x313993942505fd21 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4b6 expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147196.148033:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x313993942505fd21 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4b6 expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147196.148045:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c7fa00, rc 0) 00000100:00100000:0.0:1746147196.148072:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2000:x1830967309907968:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5046us (5424us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147196.148078:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18639 00000100:00100000:1.0:1746147196.148799:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311280512:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147196.148818:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009371c000/0x313993942505fd28 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4bd expref: 45 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147196.148827:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009371c000/0x313993942505fd28 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4bd expref: 45 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147196.148837:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371c000, rc 0) 00000100:00100000:1.0:1746147196.148857:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967309908096:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2327us (2534us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147196.148863:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18640 00000100:00100000:0.0:1746147196.158317:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.158360:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.158412:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.158483:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309908992 00000100:00100000:1.0:1746147196.158493:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309908992 00000100:00100000:1.0:1746147196.158547:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5993 00000100:00100000:1.0:1746147196.158554:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+40:2358:x1830967309908992:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147196.158743:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+41:2358:x1830967309908992:12345-192.168.204.25@tcp:35:cat.0 Request processed in 188us (329us total) trans 8589937037 rc 0/0 00000100:00100000:1.0:1746147196.158749:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5993 00000100:00100000:1.0:1746147196.163041:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.163072:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309909120 00000100:00100000:1.0:1746147196.163078:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309909120 00000100:00100000:1.0:1746147196.163130:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18641 00000100:00100000:1.0:1746147196.163137:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967309909120:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147196.163152:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147196.163170:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x313993942505fd52 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d4cb expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147196.163223:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311280640:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147196.163497:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9623c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147196.165392:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.168946:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309909248 00000100:00100000:1.0:1746147196.168955:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309909248 00000100:00100000:1.0:1746147196.169007:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16201 00000100:00100000:1.0:1746147196.169014:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2359:x1830967309909248:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147196.169037:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147196.169055:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x313993942505fd59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d4d2 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.169129:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8800/0x313993942505fd60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.169141:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8800/0x313993942505fd60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.169152:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8800/0x313993942505fd60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.169163:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x313993942505fd67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.169168:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x313993942505fd67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.169172:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x313993942505fd67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.169238:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9e00/0x313993942505fd6e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.169248:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009371c600/0x313993942505fcf0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4a8 expref: 47 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.169254:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9e00/0x313993942505fd6e lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.169282:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009371c600/0x313993942505fcf0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4a8 expref: 47 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.169294:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009371c600/0x313993942505fcf0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4a8 expref: 47 pid: 7239 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746147196.169306:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311280768:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147196.169347:0:7239:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147196.171464:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.171590:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311280768:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147196.171592:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147196.171607:0:7239:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9e00/0x313993942505fd6e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.172046:0:7239:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9e00/0x313993942505fd6e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.172053:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9e00/0x313993942505fd6e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:1.0:1746147196.172126:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:1.0:1746147196.172131:0:7239:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147196.172150:0:7239:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9e00/0x313993942505fd6e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.172160:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9e00/0x313993942505fd6e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.172170:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8800/0x313993942505fd60 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.172176:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8800/0x313993942505fd60 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.172181:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8800/0x313993942505fd60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.172187:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8800/0x313993942505fd60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.172192:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2e8800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147196.172196:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8800/0x313993942505fd60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.172202:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8800/0x313993942505fd60 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.172210:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147196.172213:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147196.172216:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8800/0x313993942505fd60 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.172221:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8800/0x313993942505fd60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.172236:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x313993942505fd67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.172244:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x313993942505fd67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.172249:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x313993942505fd67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.172253:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2e9200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147196.172255:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x313993942505fd67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.172260:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x313993942505fd67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.172266:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bf4eb00) 00010000:00010000:1.0:1746147196.172268:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147196.172270:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x313993942505fd67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.172274:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x313993942505fd67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147196.172303:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9800/0x313993942505fd59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4d2 expref: 18 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.172313:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9e00/0x313993942505fd6e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4d2 expref: 17 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.172319:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147196.172320:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147196.172322:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9e00, rc 0) 00000100:00100000:1.0:1746147196.172342:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2359:x1830967309909248:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 3329us (6958us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147196.172349:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16201 00000100:00100000:0.0:1746147196.178989:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.179055:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.179371:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147196.179561:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147196.179684:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.186040:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.190778:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.190791:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.190812:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.190832:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309910272 00000100:00100000:1.0:1746147196.190837:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309910272 00000100:00100000:1.0:1746147196.191493:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309910528 00000100:00100000:1.0:1746147196.191497:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309910528 00000100:00100000:1.0:1746147196.191521:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18648 00000100:00100000:1.0:1746147196.191527:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967309910272:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147196.191534:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147196.191545:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8000/0x313993942505fd9f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d4fc expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147196.191590:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311281664:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147196.191651:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147196.194399:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.194503:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311281664:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147196.194530:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8000/0x313993942505fd9f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4fc expref: 30 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147196.194545:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e8000/0x313993942505fd9f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4fc expref: 30 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147196.194562:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e8000, rc 0) 00000100:00100000:1.0:1746147196.194599:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967309910272:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3071us (3823us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147196.194608:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18648 00000100:00100000:0.0:1746147196.194755:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309910656 00000100:00100000:0.0:1746147196.194762:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309910656 00002000:00100000:0.0:1746147196.194795:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->3469311) req@ffff8800984d4380 x1830967309910656/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:572/0 lens 488/0 e 0 to 0 dl 1746147207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147196.194805:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d4380 with x1830967309910656 ext(3145728->3469311) 00010000:00010000:0.0:1746147196.194812:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f01b800/0x313993942505fce2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3469311) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4a1 expref: 28 pid: 9584 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746147196.194822:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f01b800/0x313993942505fce2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3469311) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4a1 expref: 28 pid: 9584 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746147196.194828:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800984d4380 00000100:00100000:0.0:1746147196.194845:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1572 00000100:00100000:0.0:1746147196.194851:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2000:x1830967309910656:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147196.198557:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.198689:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.198762:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309911040 00000100:00100000:0.0:1746147196.198766:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309911040 00000100:00100000:0.0:1746147196.198795:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16202 00000100:00100000:0.0:1746147196.198801:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2359:x1830967309911040:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147196.198817:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147196.198836:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ac00/0x313993942505fdad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d511 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147196.198977:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x313993942505fdb4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147196.198992:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9e00/0x313993942505fd6e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4d2 expref: 18 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147196.198999:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x313993942505fdb4 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147196.199161:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9e00/0x313993942505fd6e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4d2 expref: 18 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147196.199171:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9e00/0x313993942505fd6e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4d2 expref: 18 pid: 7239 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746147196.199179:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311282048:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147196.200391:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.202529:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.202554:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.204176:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.206359:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309911936 00000100:00100000:0.0:1746147196.206369:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309911936 00010000:00010000:0.0:1746147196.206401:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f01b800/0x313993942505fce2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3469311) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4a1 expref: 31 pid: 9584 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746147196.207314:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8421 00000100:00100000:0.0:1746147196.207323:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2000:x1830967309911936:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147196.207333:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147196.207350:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f01b800/0x313993942505fce2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3469311) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4a1 expref: 31 pid: 9584 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746147196.207359:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f01b800/0x313993942505fce2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3469311) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4a1 expref: 31 pid: 9584 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746147196.207374:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f01b800/0x313993942505fce2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3469311) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4a1 expref: 31 pid: 9584 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746147196.207388:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147196.207390:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147196.207397:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f007e00/0x313993942505fd8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->3473407] (req 2818048->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4f5 expref: 44 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147196.207403:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f007e00/0x313993942505fd8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->3473407] (req 2818048->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4f5 expref: 44 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147196.207410:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147196.207411:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147196.207414:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095052e00/0x313993942505fdc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3526656->18446744073709551615] (req 3526656->4104191) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d518 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147196.207419:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095052e00/0x313993942505fdc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3526656->18446744073709551615] (req 3526656->4104191) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d518 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147196.207452:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095052e00/0x313993942505fdc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3526656->18446744073709551615] (req 3526656->4104191) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d518 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147196.207464:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311282304:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147196.207620:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f007e00/0x313993942505fd8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->3473407] (req 2818048->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4f5 expref: 44 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147196.207628:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311282432:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147196.207648:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147196.213699:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.213734:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.213759:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.213777:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309912960 00000100:00100000:0.0:1746147196.213779:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309912960 00002000:00100000:0.0:1746147196.213794:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (3526656->3530751) req@ffff880098823b80 x1830967309912960/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:572/0 lens 488/0 e 0 to 0 dl 1746147207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147196.213801:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098823b80 with x1830967309912960 ext(3526656->3530751) 00002000:00010000:0.0:1746147196.213804:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098823b80 00000100:00100000:1.0:1746147196.213811:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309912704 00000100:00100000:0.0:1746147196.213813:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6801 00000100:00100000:1.0:1746147196.213817:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309912704 00000100:00100000:0.0:1746147196.213818:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2003:x1830967309912960:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147196.213846:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5994 00000100:00100000:1.0:1746147196.213852:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909c7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2359:x1830967309912704:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:0.0:1746147196.213899:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2003:x1830967309912960:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 80us (137us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147196.213907:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6801 00002000:00100000:0.0:1746147196.213910:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (3526656->3530751) req@ffff880098823b80 x1830967309912960/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:572/0 lens 488/4536 e 0 to 0 dl 1746147207 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147196.213917:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098823b80 with x1830967309912960 ext(3526656->3530751) 00002000:00010000:0.0:1746147196.213920:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098823b80 00000100:00100000:1.0:1746147196.214055:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909c7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2359:x1830967309912704:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 202us (319us total) trans 8589937039 rc 0/0 00000100:00100000:1.0:1746147196.214061:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5994 00000100:00100000:1.0:1746147196.214144:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098821880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311282304:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147196.214154:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098820e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311282432:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147196.214174:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147196.216331:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.216463:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2000:x1830967309911936:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 9138us (11432us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147196.216473:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8421 00000100:00100000:1.0:1746147196.216496:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8422 00000100:00100000:1.0:1746147196.216503:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2003:x1830967309913088:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147196.216515:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147196.216534:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x313993942505fcdb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d49a expref: 12 pid: 9584 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746147196.216548:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x313993942505fcdb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d49a expref: 12 pid: 9584 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746147196.216572:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x313993942505fcdb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d49a expref: 12 pid: 9584 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746147196.216585:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147196.216587:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147196.216594:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095052a00/0x313993942505fdbb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d51f expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.216602:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095052a00/0x313993942505fdbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d51f expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.216634:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095052a00/0x313993942505fdbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d51f expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147196.216645:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311282560:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147196.216693:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9623c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147196.222947:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.223234:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311282560:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147196.223255:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147196.223428:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2003:x1830967309913088:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6924us (7104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147196.223437:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8422 00000100:00100000:0.0:1746147196.227452:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.227509:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.227770:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6803 00000100:00100000:0.0:1746147196.227778:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967309913984:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147196.231587:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.231630:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.231649:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309914240 00000100:00100000:1.0:1746147196.231663:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309914240 00000100:00100000:1.0:1746147196.232149:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5995 00000100:00100000:1.0:1746147196.232159:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+40:2352:x1830967309914240:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147196.232376:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+41:2352:x1830967309914240:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 219us (799us total) trans 8589937040 rc 0/0 00000100:00100000:1.0:1746147196.232381:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5995 00000100:00100000:0.0:1746147196.239860:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.239907:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309914624 00000100:00100000:1.0:1746147196.239918:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309914624 00002000:00100000:1.0:1746147196.239974:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88009f087480 x1830967309914624/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:572/0 lens 488/0 e 0 to 0 dl 1746147207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147196.239984:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087480 with x1830967309914624 ext(2097152->3145727) 00002000:00010000:1.0:1746147196.239991:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f087480 00000100:00100000:1.0:1746147196.240026:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6804 00000100:00100000:1.0:1746147196.240033:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967309914624:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147196.242171:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967309913984:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14385us (14652us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147196.242182:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6803 00002000:00100000:1.0:1746147196.242191:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3473407) req@ffff88009f085500 x1830967309913984/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:572/0 lens 504/440 e 0 to 0 dl 1746147207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147196.242199:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f085500 with x1830967309913984 ext(2097152->3473407) 00002000:00010000:1.0:1746147196.242204:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f085500 00000100:00100000:1.0:1746147196.247262:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967309914624:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7215us (7398us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147196.247276:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6804 00002000:00100000:1.0:1746147196.247290:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88009f087480 x1830967309914624/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:572/0 lens 488/440 e 0 to 0 dl 1746147207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147196.247307:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087480 with x1830967309914624 ext(2097152->3145727) 00002000:00010000:1.0:1746147196.247314:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f087480 00000100:00100000:0.0:1746147196.251688:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.254364:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.254543:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309914880 00000100:00100000:1.0:1746147196.254551:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309914880 00010000:00010000:1.0:1746147196.254585:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095052a00/0x313993942505fdbb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d51f expref: 27 pid: 17600 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746147196.254611:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8423 00000100:00100000:1.0:1746147196.254617:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967309914880:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147196.254629:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147196.254650:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095052a00/0x313993942505fdbb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d51f expref: 27 pid: 17600 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746147196.254662:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095052a00/0x313993942505fdbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d51f expref: 27 pid: 17600 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746147196.254685:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095052a00/0x313993942505fdbb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d51f expref: 27 pid: 17600 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746147196.254703:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147196.254705:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147196.254712:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x313993942505fdde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3403775) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d52d expref: 26 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.254720:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x313993942505fdde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3403775) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d52d expref: 26 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.254754:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x313993942505fdde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3403775) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d52d expref: 26 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.254766:0:16749:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x313993942505fdde lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3403775) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d52d expref: 26 pid: 17600 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746147196.254778:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311282944:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147196.254861:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5506600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147196.255275:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.257027:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311282944:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147196.257050:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147196.257276:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967309914880:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2654us (2915us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147196.257287:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8423 00000100:00100000:0.0:1746147196.257906:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.257964:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309915136 00000100:00100000:1.0:1746147196.257970:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309915136 00002000:00100000:1.0:1746147196.258002:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (2818048->3145727) req@ffff88009f087b80 x1830967309915136/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:572/0 lens 488/0 e 0 to 0 dl 1746147207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147196.258011:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087b80 with x1830967309915136 ext(2818048->3145727) 00010000:00010000:1.0:1746147196.258017:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f007e00/0x313993942505fd8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->3473407] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4f5 expref: 45 pid: 9586 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746147196.258027:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f007e00/0x313993942505fd8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->3473407] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4f5 expref: 45 pid: 9586 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746147196.258037:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f087b80 00000100:00100000:1.0:1746147196.258061:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1575 00000100:00100000:1.0:1746147196.258067:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967309915136:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147196.259669:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.264128:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2001:x1830967309915136:12345-192.168.204.25@tcp:4:cat.0 Request processed in 6048us (6211us total) trans 17179874996 rc 0/0 00000100:00100000:1.0:1746147196.264141:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1575 00002000:00100000:1.0:1746147196.264154:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (2818048->3145727) req@ffff88009f087b80 x1830967309915136/t17179874996(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:572/0 lens 488/448 e 0 to 0 dl 1746147207 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147196.264164:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087b80 with x1830967309915136 ext(2818048->3145727) 00010000:00010000:1.0:1746147196.264174:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f007e00/0x313993942505fd8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->3473407] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4f5 expref: 47 pid: 9586 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746147196.264725:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f007e00/0x313993942505fd8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->3473407] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4f5 expref: 47 pid: 9586 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746147196.264734:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f087b80 00000100:00100000:0.0:1746147196.267796:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.267840:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.267894:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.268292:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309915776 00000100:00100000:1.0:1746147196.268296:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309915776 00000100:00100000:0.0:1746147196.268655:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309916032 00000100:00100000:0.0:1746147196.268659:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309916032 00010000:00010000:0.0:1746147196.268678:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f007e00/0x313993942505fd8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->3473407] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4f5 expref: 47 pid: 9586 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746147196.269123:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5996 00000100:00100000:1.0:1746147196.269130:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2350:x1830967309915776:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147196.269194:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8424 00000100:00100000:0.0:1746147196.269200:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2001:x1830967309916032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147196.269210:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147196.269225:0:16749:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147195 -> 1746147196 00002000:00010000:0.0:1746147196.269228:0:16749:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147195 -> 1746147196 00010000:00010000:0.0:1746147196.269234:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f007e00/0x313993942505fd8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->3473407] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4f5 expref: 47 pid: 9586 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746147196.269245:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f007e00/0x313993942505fd8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->3473407] (req 2818048->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4f5 expref: 47 pid: 9586 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746147196.269268:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f007e00/0x313993942505fd8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->3473407] (req 2818048->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d4f5 expref: 47 pid: 9586 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746147196.269288:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147196.269289:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147196.269297:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x313993942505fdf3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d542 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147196.269305:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x313993942505fdf3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d542 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147196.269520:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2350:x1830967309915776:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 389us (1733us total) trans 8589937041 rc 0/0 00000100:00100000:1.0:1746147196.269526:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5996 00010000:00010000:0.0:1746147196.269570:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x313993942505fdf3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d542 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147196.269583:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311283200:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147196.269638:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147196.273410:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311283200:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147196.273434:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147196.273481:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967309916032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4280us (5585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147196.273493:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8424 00000100:00100000:0.0:1746147196.278279:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.278544:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.280952:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309916416 00000100:00100000:1.0:1746147196.280963:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309916416 00010000:00010000:1.0:1746147196.281126:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x313993942505fdde lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3403775) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d52d expref: 28 pid: 17600 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746147196.281174:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8425 00000100:00100000:1.0:1746147196.281182:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967309916416:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147196.281195:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147196.281212:0:16749:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147195 -> 1746147196 00002000:00010000:1.0:1746147196.281214:0:16749:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147195 -> 1746147196 00010000:00010000:1.0:1746147196.281221:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x313993942505fdde lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3403775) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d52d expref: 28 pid: 17600 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746147196.281233:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x313993942505fdde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3403775) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d52d expref: 28 pid: 17600 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746147196.281257:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x313993942505fdde lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3403775) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d52d expref: 28 pid: 17600 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746147196.281285:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147196.281287:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147196.281294:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009372ca00/0x313993942505fdec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d53b expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.281303:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009372ca00/0x313993942505fdec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d53b expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.281334:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009372ca00/0x313993942505fdec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d53b expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147196.281345:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311283328:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147196.281431:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147196.286319:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311283328:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147196.286340:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147196.286363:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967309916416:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5182us (7819us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147196.286371:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8425 00000100:00100000:0.0:1746147196.290343:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.290438:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.297680:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.305325:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.305372:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309917184 00000100:00100000:1.0:1746147196.305380:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309917184 00000100:00100000:1.0:1746147196.305422:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18657 00000100:00100000:1.0:1746147196.305429:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2357:x1830967309917184:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147196.305444:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147196.305461:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x313993942505fe01 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d550 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.305489:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095052e00/0x313993942505fdc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3526656->18446744073709551615] (req 3526656->4104191) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d518 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.305496:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147196.305498:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147196.305501:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x313993942505fe01 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d550 expref: 47 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.305654:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095052e00/0x313993942505fdc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3526656->18446744073709551615] (req 3526656->4104191) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d518 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.305668:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095052e00/0x313993942505fdc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3526656->18446744073709551615] (req 3526656->4104191) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d518 expref: 30 pid: 1136 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746147196.305681:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311283456:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147196.305768:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147196.312159:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311283456:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147196.312159:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147196.312193:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x313993942505fe01 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d550 expref: 47 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.312211:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3ec00, rc 0) 00000100:00100000:0.0:1746147196.312212:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.312263:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2357:x1830967309917184:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6833us (6945us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147196.312272:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18657 00000100:00100000:1.0:1746147196.312298:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309917440 00000100:00100000:1.0:1746147196.312301:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309917440 00000100:00100000:1.0:1746147196.312326:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18658 00000100:00100000:1.0:1746147196.312331:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2358:x1830967309917440:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147196.312343:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147196.312357:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e3fc00/0x313993942505fe08 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d557 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.312377:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147196.312381:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3fc00/0x313993942505fe08 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d557 expref: 33 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.312390:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e3fc00/0x313993942505fe08 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d557 expref: 33 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.312396:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3fc00, rc 0) 00000100:00100000:1.0:1746147196.312408:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2358:x1830967309917440:12345-192.168.204.25@tcp:101:cat.0 Request processed in 78us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147196.312413:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18658 00000100:00100000:0.0:1746147196.324026:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.325180:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309917568 00000100:00100000:1.0:1746147196.325191:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309917568 00010000:00010000:1.0:1746147196.325230:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095052e00/0x313993942505fdc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3526656->18446744073709551615] (req 3526656->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d518 expref: 34 pid: 1136 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746147196.325272:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8426 00000100:00100000:1.0:1746147196.325280:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2000:x1830967309917568:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147196.325295:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147196.325315:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095052e00/0x313993942505fdc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3526656->18446744073709551615] (req 3526656->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d518 expref: 34 pid: 1136 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746147196.325326:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095052e00/0x313993942505fdc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3526656->18446744073709551615] (req 3526656->4104191) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d518 expref: 34 pid: 1136 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746147196.325354:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095052e00/0x313993942505fdc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3526656->18446744073709551615] (req 3526656->4104191) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d518 expref: 34 pid: 1136 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746147196.325373:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147196.325375:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147196.325381:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x313993942505fe01 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d550 expref: 46 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.325388:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x313993942505fe01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d550 expref: 46 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.325398:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147196.325399:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147196.325401:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e3fc00/0x313993942505fe08 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d557 expref: 33 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.325407:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3fc00/0x313993942505fe08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d557 expref: 33 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.325439:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096e3fc00/0x313993942505fe08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d557 expref: 33 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147196.325451:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311283584:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147196.325532:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x313993942505fe01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d550 expref: 46 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147196.325545:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311283712:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147196.325564:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147196.327952:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311283584:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147196.327968:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311283712:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147196.327991:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147196.328027:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2000:x1830967309917568:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2747us (4010us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147196.328037:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8426 00000100:00100000:0.0:1746147196.330617:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.348872:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.350283:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.350516:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309918464 00000100:00100000:0.0:1746147196.350520:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309918464 00000100:00100000:0.0:1746147196.350550:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18659 00000100:00100000:0.0:1746147196.350556:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967309918464:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147196.350566:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147196.350584:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x313993942505fe0f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d55e expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147196.350604:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147196.350605:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147196.350614:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x313993942505fe0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d55e expref: 28 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147196.350629:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x313993942505fe0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d55e expref: 28 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147196.350640:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81c00, rc 0) 00000100:00100000:0.0:1746147196.350669:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967309918464:12345-192.168.204.25@tcp:101:cat.0 Request processed in 113us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147196.350675:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18659 00000100:00100000:0.0:1746147196.354209:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.369047:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.491758:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.495015:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.495355:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309919360 00000100:00100000:1.0:1746147196.495362:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309919360 00010000:00010000:1.0:1746147196.495393:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aee00/0x313993942505fe2b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d565 expref: 43 pid: 7238 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746147196.496290:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8427 00000100:00100000:1.0:1746147196.496299:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+43:2000:x1830967309919360:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147196.496312:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147196.496318:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aee00/0x313993942505fe2b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d565 expref: 43 pid: 7238 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746147196.496329:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aee00/0x313993942505fe2b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d565 expref: 43 pid: 7238 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746147196.496607:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aee00/0x313993942505fe2b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d565 expref: 43 pid: 7238 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746147196.497128:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147196.497133:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x313993942505fe40 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147196.497144:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x313993942505fe40 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147196.497150:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x313993942505fe40 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147196.497181:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147196.497231:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+42:2000:x1830967309919360:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 934us (2218us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147196.497238:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8427 00000100:00100000:0.0:1746147196.503993:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309919488 00000100:00100000:0.0:1746147196.504005:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309919488 00000100:00100000:0.0:1746147196.504085:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18660 00000100:00100000:1.0:1746147196.505026:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2364:x1830967309919488:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147196.505048:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147196.506631:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800990c7600/0x313993942505fe4e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d573 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.506675:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x313993942505fe01 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d550 expref: 46 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.506683:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e3fc00/0x313993942505fe08 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d557 expref: 34 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.506690:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x313993942505fdf3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d542 expref: 34 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.506702:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147196.506704:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147196.506709:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800990c7600/0x313993942505fe4e lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2580480->3145727] (req 2580480->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d573 expref: 34 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.506749:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x313993942505fdf3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d542 expref: 34 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.506763:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x313993942505fdf3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d542 expref: 34 pid: 1136 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746147196.506778:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311283968:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147196.506940:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e3fc00/0x313993942505fe08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d557 expref: 34 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.506948:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e3fc00/0x313993942505fe08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d557 expref: 34 pid: 17600 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746147196.506955:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311284096:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147196.506980:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x313993942505fe01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d550 expref: 46 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.506987:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x313993942505fe01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d550 expref: 46 pid: 17600 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746147196.506999:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098822a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311284224:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147196.507013:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147196.522645:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.522833:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311283968:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147196.522850:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311284096:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147196.522860:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098822a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311284224:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147196.522905:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800990c7600/0x313993942505fe4e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2580480->3145727] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d573 expref: 34 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.522938:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7600, rc 0) 00000100:00100000:1.0:1746147196.523026:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2364:x1830967309919488:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 18101us (19305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147196.523036:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18660 00000100:00100000:0.0:1746147196.526545:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.526582:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.527212:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309919872 00000100:00100000:0.0:1746147196.527222:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309919872 00010000:00010000:0.0:1746147196.527257:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3ec00/0x313993942505fe01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d550 expref: 47 pid: 17600 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746147196.527284:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309919744 00000100:00100000:0.0:1746147196.527286:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309919744 00010000:00010000:0.0:1746147196.527295:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3fc00/0x313993942505fe08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d557 expref: 35 pid: 17600 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746147196.528705:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8429 00000100:00100000:0.0:1746147196.528717:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+35:2003:x1830967309919616:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147196.528731:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147196.528749:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x313993942505fdf3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d542 expref: 35 pid: 1136 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746147196.528761:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x313993942505fdf3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d542 expref: 35 pid: 1136 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746147196.530711:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x313993942505fdf3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d542 expref: 35 pid: 1136 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746147196.530754:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147196.530844:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2003:x1830967309919616:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2126us (8208us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147196.530855:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8429 00000100:00100000:0.0:1746147196.539634:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.557592:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.557663:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309920256 00000100:00100000:1.0:1746147196.557673:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309920256 00000100:00100000:1.0:1746147196.558619:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18661 00000100:00100000:1.0:1746147196.558633:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2364:x1830967309920256:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147196.558657:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147196.558680:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c6e00/0x313993942505fe55 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d57a expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.558718:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009372ca00/0x313993942505fdec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d53b expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.558731:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095052a00/0x313993942505fdfa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d549 expref: 14 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.558737:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147196.558740:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147196.558744:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c6e00/0x313993942505fe55 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->3575807] (req 3145728->3575807) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d57a expref: 14 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.558781:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095052a00/0x313993942505fdfa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d549 expref: 14 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.558795:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095052a00/0x313993942505fdfa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d549 expref: 14 pid: 1136 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746147196.558808:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098822a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311284480:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147196.560281:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009372ca00/0x313993942505fdec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d53b expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.560291:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009372ca00/0x313993942505fdec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d53b expref: 27 pid: 1136 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746147196.560301:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311284608:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147196.560985:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147196.561011:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098822a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311284480:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147196.561022:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311284608:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147196.561353:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c6e00/0x313993942505fe55 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->3575807] (req 3145728->3575807) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d57a expref: 14 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.561369:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c6e00, rc 0) 00000100:00100000:1.0:1746147196.561405:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2364:x1830967309920256:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2777us (3824us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147196.561412:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18661 00000100:00100000:0.0:1746147196.562856:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.566503:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.575958:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.582345:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.582489:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309921024 00000100:00100000:1.0:1746147196.582502:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309921024 00000100:00100000:1.0:1746147196.582582:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5997 00000100:00100000:1.0:1746147196.582592:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+42:2364:x1830967309921024:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147196.582876:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+43:2364:x1830967309921024:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 283us (543us total) trans 8589937044 rc 0/0 00000100:00100000:1.0:1746147196.582883:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5997 00000100:00100000:0.0:1746147196.592902:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.594085:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309921152 00000100:00100000:1.0:1746147196.594110:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309921152 00000100:00100000:1.0:1746147196.594463:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18662 00000100:00100000:1.0:1746147196.594472:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967309921152:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147196.594491:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147196.594561:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c7c00/0x313993942505fe5c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d581 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147196.594621:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311284864:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147196.596841:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1503c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147196.605674:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311284864:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147196.605715:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c7c00/0x313993942505fe5c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d581 expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147196.605728:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c7c00/0x313993942505fe5c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d581 expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147196.605744:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7c00, rc 0) 00000100:00100000:1.0:1746147196.605801:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967309921152:12345-192.168.204.25@tcp:101:cat.0 Request processed in 11330us (12909us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147196.605810:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18662 00000100:00100000:1.0:1746147196.616437:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309921280 00000100:00100000:1.0:1746147196.616449:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309921280 00000100:00100000:1.0:1746147196.616506:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18663 00000100:00100000:1.0:1746147196.616514:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967309921280:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147196.616532:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147196.616553:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942505fe63 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d588 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147196.616607:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311284992:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147196.616696:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1503c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147196.626057:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311284992:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147196.626124:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942505fe63 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d588 expref: 28 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147196.626143:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942505fe63 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d588 expref: 28 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147196.626178:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7800, rc 0) 00000100:00100000:1.0:1746147196.626264:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967309921280:12345-192.168.204.25@tcp:101:cat.0 Request processed in 9749us (11586us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147196.626272:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18663 00000100:00100000:0.0:1746147196.629048:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.629084:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.633043:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.640322:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.648660:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.651142:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.658855:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.659803:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.661890:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309923200 00000100:00100000:1.0:1746147196.661895:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309923200 00000100:00100000:1.0:1746147196.661970:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309923328 00000100:00100000:1.0:1746147196.661972:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309923328 00000100:00100000:1.0:1746147196.662165:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309923456 00000100:00100000:1.0:1746147196.662168:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309923456 00000100:00100000:1.0:1746147196.662373:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18667 00000100:00100000:1.0:1746147196.662380:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967309923200:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147196.662394:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147196.662409:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505fe7f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d5a4 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147196.662448:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311285632:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147196.662498:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1503c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147196.662512:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18668 00000100:00100000:1.0:1746147196.662517:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2368:x1830967309923328:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147196.662525:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147196.662535:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b81e00/0x313993942505fe86 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d5ab expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.662553:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800990c7600/0x313993942505fe4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d573 expref: 31 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.662560:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147196.662562:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147196.662565:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b81e00/0x313993942505fe86 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5ab expref: 48 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.662583:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800990c7600/0x313993942505fe4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d573 expref: 31 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.662595:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800990c7600/0x313993942505fe4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d573 expref: 31 pid: 17600 timeout: 834 lvb_type: 0 00000100:00100000:1.0:1746147196.662603:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098822a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311285760:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147196.662621:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa150840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147196.662728:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18669 00000100:00100000:0.0:1746147196.662736:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2000:x1830967309923456:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147196.662742:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147196.662749:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e3f000/0x313993942505fe8d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d5b2 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147196.662770:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311285888:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147196.662796:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147196.664863:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311285632:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147196.665296:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505fe7f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5a4 expref: 29 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147196.665310:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b80400/0x313993942505fe7f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5a4 expref: 29 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147196.665340:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80400, rc 0) 00000100:00100000:1.0:1746147196.665381:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967309923200:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3000us (3613us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147196.665390:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18667 00000100:00100000:1.0:1746147196.665433:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098822a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311285760:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147196.665451:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b81e00/0x313993942505fe86 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5ab expref: 49 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147196.665462:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81e00, rc 0) 00000100:00100000:1.0:1746147196.665478:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2368:x1830967309923328:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2960us (3676us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147196.665484:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18668 00000100:00100000:1.0:1746147196.667198:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.667894:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094524000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311285888:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147196.667928:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e3f000/0x313993942505fe8d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5b2 expref: 48 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147196.667937:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e3f000/0x313993942505fe8d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5b2 expref: 48 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147196.667950:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3f000, rc 0) 00000100:00100000:0.0:1746147196.667972:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2000:x1830967309923456:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5237us (6144us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147196.667978:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18669 00000100:00100000:0.0:1746147196.672334:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.672372:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309923712 00000100:00100000:0.0:1746147196.672381:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309923712 00000100:00100000:0.0:1746147196.672437:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18670 00000100:00100000:0.0:1746147196.672446:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2375:x1830967309923712:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147196.672464:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147196.672483:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e3e600/0x313993942505fe94 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d5b9 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147196.672510:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x313993942505fe71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2662400->3145727] (req 2662400->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d596 expref: 29 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147196.672523:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147196.672525:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147196.672528:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e3e600/0x313993942505fe94 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5b9 expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147196.672559:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x313993942505fe71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2662400->3145727] (req 2662400->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d596 expref: 29 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147196.672569:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x313993942505fe71 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2662400->3145727] (req 2662400->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d596 expref: 29 pid: 1398 timeout: 834 lvb_type: 0 00000100:00100000:0.0:1746147196.672580:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311286016:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147196.672648:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147196.674888:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094524700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311286016:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147196.674915:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e3e600/0x313993942505fe94 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5b9 expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147196.674943:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3e600, rc 0) 00000100:00100000:0.0:1746147196.674981:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2375:x1830967309923712:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2536us (2658us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147196.674989:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18670 00000001:00080000:1.0:1746147196.675767:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874998 is committed 00000001:00080000:1.0:1746147196.675782:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874996 is committed 00000001:00080000:1.0:1746147196.675827:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874984 is committed 00000001:00080000:1.0:1746147196.675848:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874968 is committed 00000100:00100000:0.0:1746147196.676390:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309923840 00000100:00100000:0.0:1746147196.676397:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309923840 00002000:00100000:0.0:1746147196.676431:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2662400->3145727) req@ffff88009f087800 x1830967309923840/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:572/0 lens 488/0 e 0 to 0 dl 1746147207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147196.676446:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087800 with x1830967309923840 ext(2662400->3145727) 00010000:00010000:0.0:1746147196.676453:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x313993942505fe71 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2662400->3145727] (req 2662400->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d596 expref: 29 pid: 1398 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746147196.676464:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x313993942505fe71 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2662400->3145727] (req 2662400->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d596 expref: 29 pid: 1398 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746147196.676470:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f087800 00000100:00100000:0.0:1746147196.676488:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1580 00000100:00100000:0.0:1746147196.676495:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967309923840:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147196.678634:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.678745:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.679121:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309924096 00000100:00100000:1.0:1746147196.679129:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309924096 00000100:00100000:1.0:1746147196.679173:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18671 00000100:00100000:1.0:1746147196.679181:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967309924096:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147196.679199:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147196.679218:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b81600/0x313993942505fe9b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d5c0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147196.679272:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311286144:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147196.679334:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa150840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147196.680010:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.682822:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311286144:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147196.682857:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b81600/0x313993942505fe9b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5c0 expref: 13 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147196.682877:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b81600/0x313993942505fe9b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5c0 expref: 13 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147196.682896:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81600, rc 0) 00000100:00100000:0.0:1746147196.682912:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967309923840:12345-192.168.204.25@tcp:4:cat.0 Request processed in 6415us (6651us total) trans 21474842363 rc 0/0 00000100:00100000:1.0:1746147196.682930:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967309924096:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3738us (4293us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147196.682937:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18671 00000100:00100000:0.0:1746147196.682937:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1580 00002000:00100000:0.0:1746147196.682948:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2662400->3145727) req@ffff88009f087800 x1830967309923840/t21474842363(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:572/0 lens 488/448 e 0 to 0 dl 1746147207 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147196.682957:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087800 with x1830967309923840 ext(2662400->3145727) 00010000:00010000:0.0:1746147196.682965:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x313993942505fe71 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2662400->3145727] (req 2662400->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d596 expref: 31 pid: 1398 timeout: 834 lvb_type: 0 00010000:00010000:0.0:1746147196.683001:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x313993942505fe71 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2662400->3145727] (req 2662400->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d596 expref: 31 pid: 1398 timeout: 834 lvb_type: 0 00002000:00010000:0.0:1746147196.683014:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f087800 00000100:00100000:0.0:1746147196.684593:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.685978:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.686002:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309924608 00000100:00100000:0.0:1746147196.686006:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309924608 00002000:00100000:0.0:1746147196.686037:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x98:0x0] (2424832->2428927) req@ffff88009689ad80 x1830967309924608/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:572/0 lens 488/0 e 0 to 0 dl 1746147207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147196.686046:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689ad80 with x1830967309924608 ext(2424832->2428927) 00002000:00010000:0.0:1746147196.686050:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009689ad80 00000100:00100000:0.0:1746147196.686064:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6819 00000100:00100000:0.0:1746147196.686070:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967309924608:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147196.686207:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967309924608:12345-192.168.204.25@tcp:3:cat.0 Request processed in 136us (230us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147196.686213:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6819 00002000:00100000:0.0:1746147196.686219:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x98:0x0] (2424832->2428927) req@ffff88009689ad80 x1830967309924608/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:572/0 lens 488/4536 e 0 to 0 dl 1746147207 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147196.686226:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689ad80 with x1830967309924608 ext(2424832->2428927) 00002000:00010000:0.0:1746147196.686229:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009689ad80 00000100:00100000:0.0:1746147196.690395:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.698909:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.698958:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.699391:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309925120 00000100:00100000:1.0:1746147196.699395:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309925120 00000100:00100000:1.0:1746147196.699439:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18673 00000100:00100000:1.0:1746147196.699447:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2001:x1830967309925120:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147196.699466:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147196.699487:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b81600/0x313993942505fea9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d5d5 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147196.699643:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311286656:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147196.699714:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa150840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147196.707890:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311286656:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147196.707935:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b81600/0x313993942505fea9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5d5 expref: 8 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147196.707950:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096b81600/0x313993942505fea9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5d5 expref: 8 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147196.707987:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81600, rc 0) 00000100:00100000:1.0:1746147196.708040:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2001:x1830967309925120:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8592us (9079us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147196.708049:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18673 00000100:00100000:0.0:1746147196.709537:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.728971:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.734313:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.741741:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.750619:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.750672:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.750793:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309926144 00000100:00100000:1.0:1746147196.750803:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309926144 00002000:00100000:1.0:1746147196.750848:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880093146d80 x1830967309926144/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:572/0 lens 488/0 e 0 to 0 dl 1746147207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147196.750859:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093146d80 with x1830967309926144 ext(3145728->4194303) 00002000:00010000:1.0:1746147196.750864:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093146d80 00000100:00100000:1.0:1746147196.750892:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309926272 00000100:00100000:1.0:1746147196.750894:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309926272 00002000:00100000:1.0:1746147196.750908:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff880093146680 x1830967309926272/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:572/0 lens 488/0 e 0 to 0 dl 1746147207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147196.750914:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093146680 with x1830967309926272 ext(3145728->4194303) 00002000:00010000:1.0:1746147196.750925:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093146680 00000100:00100000:1.0:1746147196.750943:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6823 00000100:00100000:1.0:1746147196.750948:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967309926272:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:0.0:1746147196.766574:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147196.769442:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967309926272:12345-192.168.204.25@tcp:3:cat.0 Request processed in 18480us (18756us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147196.769455:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6823 00002000:00100000:0.0:1746147196.769468:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff880093146680 x1830967309926272/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:572/0 lens 488/440 e 0 to 0 dl 1746147207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147196.769478:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093146680 with x1830967309926272 ext(3145728->4194303) 00002000:00010000:0.0:1746147196.769484:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093146680 00000100:00100000:0.0:1746147196.810048:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.822021:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.828786:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.831547:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.838177:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.842131:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.847120:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.848014:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309927808 00000100:00100000:0.0:1746147196.848017:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309927808 00010000:00010000:0.0:1746147196.848034:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x313993942505fa7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d32e expref: 25 pid: 1136 timeout: 834 lvb_type: 1 00000100:00100000:0.0:1746147196.848050:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8440 00000100:00100000:0.0:1746147196.848055:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967309927808:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147196.848061:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147196.848070:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x313993942505fa7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d32e expref: 25 pid: 1136 timeout: 834 lvb_type: 1 00010000:00010000:0.0:1746147196.848078:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x313993942505fa7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d32e expref: 25 pid: 1136 timeout: 834 lvb_type: 1 00010000:00010000:0.0:1746147196.848115:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x313993942505fa7a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d32e expref: 25 pid: 1136 timeout: 834 lvb_type: 1 00010000:00010000:0.0:1746147196.848132:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147196.848155:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967309927808:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 99us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147196.848161:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8440 00000100:00100000:0.0:1746147196.850527:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.854974:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.916352:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.917330:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.917627:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18679 00000100:00100000:1.0:1746147196.917636:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2002:x1830967309928448:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147196.917645:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147196.917656:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d43000/0x313993942505fee8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d5ff expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147196.917706:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311288192:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147196.917801:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa150840 going to sleep for 11 seconds 00002000:00010000:1.0:1746147196.930397:0:1853:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime: 1746147194 -> 1746147196 00002000:00010000:1.0:1746147196.930405:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime: 1746147194 -> 1746147196 00002000:00010000:1.0:1746147196.930408:0:1853:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime: 1746147194 -> 1746147196 00000100:00100000:1.0:1746147196.930432:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098821c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311288192:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147196.930465:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d43000/0x313993942505fee8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5ff expref: 25 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147196.930478:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d43000/0x313993942505fee8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5ff expref: 25 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147196.934543:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43000, rc 0) 00000100:00100000:1.0:1746147196.934656:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2002:x1830967309928448:12345-192.168.204.25@tcp:101:cat.0 Request processed in 17015us (17322us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147196.934666:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18679 00000100:00100000:0.0:1746147196.948240:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.948277:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.948958:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.956412:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.956506:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309928960 00000100:00100000:1.0:1746147196.956514:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309928960 00002000:00100000:1.0:1746147196.956556:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x93:0x0] (1003520->1048575) req@ffff8801349a2300 x1830967309928960/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:572/0 lens 488/0 e 0 to 0 dl 1746147207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147196.956564:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2300 with x1830967309928960 ext(1003520->1048575) 00010000:00010000:1.0:1746147196.956571:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800990c7c00/0x313993942505fed3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5ea expref: 14 pid: 1398 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746147196.956587:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800990c7c00/0x313993942505fed3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5ea expref: 14 pid: 1398 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746147196.956593:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801349a2300 00000100:00100000:1.0:1746147196.956620:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1582 00000100:00100000:1.0:1746147196.956626:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967309928960:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147196.958031:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.961409:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967309928960:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 4774us (4989us total) trans 21474842365 rc 0/0 00000100:00100000:1.0:1746147196.961420:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1582 00002000:00100000:1.0:1746147196.961431:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x93:0x0] (1003520->1048575) req@ffff8801349a2300 x1830967309928960/t21474842365(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:572/0 lens 488/448 e 0 to 0 dl 1746147207 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147196.961440:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2300 with x1830967309928960 ext(1003520->1048575) 00010000:00010000:1.0:1746147196.961449:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800990c7c00/0x313993942505fed3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5ea expref: 17 pid: 1398 timeout: 834 lvb_type: 0 00010000:00010000:1.0:1746147196.961462:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800990c7c00/0x313993942505fed3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5ea expref: 17 pid: 1398 timeout: 834 lvb_type: 0 00002000:00010000:1.0:1746147196.961468:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801349a2300 00000100:00100000:0.0:1746147196.971461:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.985228:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.986121:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309929472 00000100:00100000:1.0:1746147196.986131:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309929472 00002000:00100000:1.0:1746147196.986178:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88012dbc3800 x1830967309929472/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:572/0 lens 488/0 e 0 to 0 dl 1746147207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147196.986188:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc3800 with x1830967309929472 ext(0->1048575) 00002000:00010000:1.0:1746147196.986195:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbc3800 00000100:00100000:1.0:1746147196.986228:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6827 00000100:00100000:1.0:1746147196.986235:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967309929472:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147196.987481:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147196.988696:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147196.990024:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6828 00000100:00100000:1.0:1746147196.990038:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967309929728:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147197.001878:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967309929472:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 15632us (16649us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147197.001891:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6827 00002000:00100000:1.0:1746147197.001902:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88012dbc3800 x1830967309929472/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:572/0 lens 488/440 e 0 to 0 dl 1746147207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147197.001910:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc3800 with x1830967309929472 ext(0->1048575) 00002000:00010000:1.0:1746147197.001929:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbc3800 00000100:00100000:1.0:1746147197.012072:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967309929728:12345-192.168.204.25@tcp:3:cat.0 Request processed in 22025us (24584us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147197.012085:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6828 00002000:00100000:1.0:1746147197.012122:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880129f56a00 x1830967309929728/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:572/0 lens 488/440 e 0 to 0 dl 1746147207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147197.012131:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f56a00 with x1830967309929728 ext(0->1048575) 00002000:00010000:1.0:1746147197.012136:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f56a00 00000100:00100000:0.0:1746147197.021444:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.029217:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.029306:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309930368 00000100:00100000:1.0:1746147197.029314:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309930368 00002000:00100000:1.0:1746147197.029368:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88009258ea00 x1830967309930368/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:573/0 lens 488/0 e 0 to 0 dl 1746147208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147197.029378:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258ea00 with x1830967309930368 ext(2097152->3145727) 00002000:00010000:1.0:1746147197.029385:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258ea00 00000100:00100000:1.0:1746147197.029418:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6830 00000100:00100000:1.0:1746147197.029427:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967309930368:12345-192.168.204.25@tcp:3:cat.0 00000100:00080000:0.0:1746147197.030252:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147197.036899:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:1.0:1746147197.037241:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147197.041168:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967309930368:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11730us (11949us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147197.041181:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6830 00002000:00100000:0.0:1746147197.041193:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88009258ea00 x1830967309930368/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:573/0 lens 488/440 e 0 to 0 dl 1746147208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147197.041203:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258ea00 with x1830967309930368 ext(2097152->3145727) 00002000:00010000:0.0:1746147197.041208:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258ea00 00000100:00100000:0.0:1746147197.044522:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.053521:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.053947:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.065263:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967309930880:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 11112us (11301us total) trans 17179875000 rc 0/0 00000100:00100000:0.0:1746147197.065278:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1584 00002000:00100000:0.0:1746147197.065291:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3583999) req@ffff88009258fb80 x1830967309930880/t17179875000(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:573/0 lens 504/448 e 0 to 0 dl 1746147208 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147197.065300:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258fb80 with x1830967309930880 ext(2097152->3583999) 00010000:00010000:0.0:1746147197.065310:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096b81e00/0x313993942505fe86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2428927) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5ab expref: 27 pid: 17600 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746147197.065326:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096b81e00/0x313993942505fe86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2428927) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5ab expref: 27 pid: 17600 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746147197.065334:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009258fb80 00000100:00100000:1.0:1746147197.065637:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.065674:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309931136 00000100:00100000:0.0:1746147197.065683:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309931136 00002000:00100000:0.0:1746147197.065714:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880098821c00 x1830967309931136/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:573/0 lens 488/0 e 0 to 0 dl 1746147208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147197.065720:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098821c00 with x1830967309931136 ext(1048576->2097151) 00002000:00010000:0.0:1746147197.065723:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098821c00 00000100:00100000:0.0:1746147197.065741:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6831 00000100:00100000:0.0:1746147197.065747:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967309931136:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147197.076989:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.077238:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967309931136:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 11489us (11601us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147197.077249:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6831 00002000:00100000:1.0:1746147197.077259:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880098821c00 x1830967309931136/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:573/0 lens 488/440 e 0 to 0 dl 1746147208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147197.077270:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098821c00 with x1830967309931136 ext(1048576->2097151) 00002000:00010000:1.0:1746147197.077274:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098821c00 00000100:00100000:0.0:1746147197.089695:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.089764:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309931520 00000100:00100000:1.0:1746147197.089774:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309931520 00002000:00100000:1.0:1746147197.089817:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff880132124700 x1830967309931520/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:573/0 lens 488/0 e 0 to 0 dl 1746147208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147197.089826:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132124700 with x1830967309931520 ext(2097152->4194303) 00002000:00010000:1.0:1746147197.089832:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132124700 00000100:00100000:1.0:1746147197.089868:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6832 00000100:00100000:1.0:1746147197.089874:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967309931520:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147197.091158:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.112064:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.112157:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.112391:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967309931520:12345-192.168.204.25@tcp:3:cat.0 Request processed in 22516us (22707us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147197.112400:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6832 00002000:00100000:1.0:1746147197.112409:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff880132124700 x1830967309931520/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:573/0 lens 488/440 e 0 to 0 dl 1746147208 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147197.112416:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132124700 with x1830967309931520 ext(2097152->4194303) 00002000:00010000:1.0:1746147197.112420:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132124700 00000100:00100000:1.0:1746147197.112433:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309932288 00000100:00100000:1.0:1746147197.112435:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309932288 00002000:00100000:1.0:1746147197.112455:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff880097d75c00 x1830967309932288/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:573/0 lens 488/0 e 0 to 0 dl 1746147208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147197.112461:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d75c00 with x1830967309932288 ext(2097152->4194303) 00002000:00010000:1.0:1746147197.112464:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d75c00 00000100:00100000:1.0:1746147197.112483:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6834 00000100:00100000:1.0:1746147197.112490:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967309932288:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147197.128581:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.128663:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.128687:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.128855:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967309932288:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 16365us (16697us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746147197.128865:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6834 00002000:00100000:0.0:1746147197.128875:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff880097d75c00 x1830967309932288/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:573/0 lens 488/440 e 0 to 0 dl 1746147208 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147197.128885:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d75c00 with x1830967309932288 ext(2097152->4194303) 00002000:00010000:0.0:1746147197.128890:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d75c00 00000100:00100000:1.0:1746147197.129962:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8446 00000100:00100000:1.0:1746147197.129969:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967309932672:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.129975:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.129983:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009844aa00/0x313993942505feef lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d606 expref: 16 pid: 1398 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746147197.129992:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009844aa00/0x313993942505feef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d606 expref: 16 pid: 1398 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746147197.130002:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.130003:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.130008:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38dc00/0x313993942505ff20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [4034560->18446744073709551615] (req 4034560->4141055) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d637 expref: 32 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.130019:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38dc00/0x313993942505ff20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [4034560->18446744073709551615] (req 4034560->4141055) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d637 expref: 32 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.130044:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38dc00/0x313993942505ff20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [4034560->18446744073709551615] (req 4034560->4141055) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d637 expref: 32 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.130055:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311289600:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147197.130113:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa150840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147197.133690:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.133839:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098820e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311289600:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147197.133863:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.133927:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967309932672:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3957us (5236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.133938:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8446 00000100:00100000:0.0:1746147197.134152:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.134202:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309933056 00000100:00100000:0.0:1746147197.134209:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309933056 00002000:00100000:0.0:1746147197.134242:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (4034560->4038655) req@ffff880134b6ce00 x1830967309933056/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:573/0 lens 488/0 e 0 to 0 dl 1746147208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147197.134250:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b6ce00 with x1830967309933056 ext(4034560->4038655) 00002000:00010000:0.0:1746147197.134254:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b6ce00 00000100:00100000:0.0:1746147197.134271:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6835 00000100:00100000:0.0:1746147197.134277:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967309933056:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147197.134376:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967309933056:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 99us (224us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147197.134382:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6835 00002000:00100000:0.0:1746147197.134387:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (4034560->4038655) req@ffff880134b6ce00 x1830967309933056/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:573/0 lens 488/4536 e 0 to 0 dl 1746147208 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147197.134394:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b6ce00 with x1830967309933056 ext(4034560->4038655) 00002000:00010000:0.0:1746147197.134396:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b6ce00 00000100:00100000:0.0:1746147197.147986:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.154628:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.157260:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.158086:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309933696 00000100:00100000:1.0:1746147197.158134:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309933696 00002000:00100000:1.0:1746147197.158181:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (4034560->4141055) req@ffff880134b6f800 x1830967309933696/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:573/0 lens 488/0 e 0 to 0 dl 1746147208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147197.158191:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b6f800 with x1830967309933696 ext(4034560->4141055) 00010000:00010000:1.0:1746147197.158201:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f38dc00/0x313993942505ff20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [4034560->18446744073709551615] (req 4034560->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d637 expref: 32 pid: 1398 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.158216:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f38dc00/0x313993942505ff20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [4034560->18446744073709551615] (req 4034560->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d637 expref: 32 pid: 1398 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746147197.158228:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b6f800 00000100:00100000:1.0:1746147197.158263:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1586 00000100:00100000:1.0:1746147197.158270:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967309933696:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147197.178829:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967309933696:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 20547us (21566us total) trans 21474842366 rc 0/0 00000100:00100000:0.0:1746147197.178843:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1586 00002000:00100000:0.0:1746147197.178856:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (4034560->4141055) req@ffff880134b6f800 x1830967309933696/t21474842366(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:573/0 lens 488/448 e 0 to 0 dl 1746147208 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147197.178867:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b6f800 with x1830967309933696 ext(4034560->4141055) 00010000:00010000:0.0:1746147197.178878:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f38dc00/0x313993942505ff20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [4034560->18446744073709551615] (req 4034560->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d637 expref: 34 pid: 1398 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746147197.178895:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f38dc00/0x313993942505ff20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [4034560->18446744073709551615] (req 4034560->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d637 expref: 34 pid: 1398 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746147197.178903:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b6f800 00000100:00100000:0.0:1746147197.180283:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.180422:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309933824 00000100:00100000:1.0:1746147197.180431:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309933824 00010000:00010000:1.0:1746147197.180466:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38dc00/0x313993942505ff20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [4034560->18446744073709551615] (req 4034560->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d637 expref: 34 pid: 1398 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.180606:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8447 00000100:00100000:1.0:1746147197.180614:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967309933824:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.180629:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147197.180644:0:7225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147196 -> 1746147197 00002000:00010000:1.0:1746147197.180647:0:7225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147196 -> 1746147197 00010000:00010000:1.0:1746147197.180652:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f38dc00/0x313993942505ff20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [4034560->18446744073709551615] (req 4034560->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d637 expref: 34 pid: 1398 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.180663:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f38dc00/0x313993942505ff20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [4034560->18446744073709551615] (req 4034560->4141055) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d637 expref: 34 pid: 1398 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.180685:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38dc00/0x313993942505ff20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [4034560->18446744073709551615] (req 4034560->4141055) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d637 expref: 34 pid: 1398 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.180712:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.180714:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.180723:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d400/0x313993942505ff2e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d645 expref: 15 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.180731:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38d400/0x313993942505ff2e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d645 expref: 15 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.180737:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.180738:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.180741:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38de00/0x313993942505ff35 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d64c expref: 33 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.180746:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38de00/0x313993942505ff35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d64c expref: 33 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.180772:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38de00/0x313993942505ff35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d64c expref: 33 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.180782:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311289856:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147197.180869:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38d400/0x313993942505ff2e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d645 expref: 15 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.180877:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311289984:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147197.180891:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa150840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147197.183863:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098820e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311289856:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147197.185376:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.186955:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.188200:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098820380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311289984:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147197.188227:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.188263:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967309933824:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7650us (7988us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.188273:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8447 00000100:00100000:1.0:1746147197.210984:0:8099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309934464 00000100:00100000:1.0:1746147197.210993:0:8099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309934464 00000100:00100000:1.0:1746147197.211043:0:8099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 231 00000100:00100000:1.0:1746147197.211050:0:8099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2003:x1830967309934464:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1746147197.211236:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967309934080:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 25306us (25867us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147197.211244:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6836 00002000:00100000:0.0:1746147197.211250:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880134b6ea00 x1830967309934080/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:573/0 lens 488/440 e 0 to 0 dl 1746147208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147197.211258:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b6ea00 with x1830967309934080 ext(3145728->4194303) 00002000:00010000:0.0:1746147197.211261:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b6ea00 00000100:00080000:0.0:1746147197.211630:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1746147197.211967:0:8099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2003:x1830967309934464:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 915us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.211973:0:8099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 231 00000100:00100000:0.0:1746147197.212412:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.213366:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:1.0:1746147197.213630:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1746147197.215038:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.215104:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:1.0:1746147197.215377:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1746147197.215380:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746147197.224708:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.228810:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.233028:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.233746:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.233837:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309935616 00000100:00100000:1.0:1746147197.233843:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309935616 00010000:00010000:1.0:1746147197.233871:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e3e600/0x313993942505fe94 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5b9 expref: 33 pid: 1136 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.233903:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309935744 00000100:00100000:1.0:1746147197.233905:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309935744 00010000:00010000:1.0:1746147197.233924:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38d400/0x313993942505ff2e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d645 expref: 17 pid: 1398 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.233938:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8448 00000100:00100000:1.0:1746147197.233944:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967309935616:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.233954:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.233974:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e3e600/0x313993942505fe94 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5b9 expref: 33 pid: 1136 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.233985:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e3e600/0x313993942505fe94 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5b9 expref: 33 pid: 1136 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.234007:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e3e600/0x313993942505fe94 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5b9 expref: 33 pid: 1136 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.234027:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.234048:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967309935616:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 104us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.234054:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8448 00000100:00100000:1.0:1746147197.234066:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8449 00000100:00100000:1.0:1746147197.234070:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2003:x1830967309935744:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.234076:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.234083:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f38d400/0x313993942505ff2e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d645 expref: 17 pid: 1398 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.234107:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f38d400/0x313993942505ff2e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d645 expref: 17 pid: 1398 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.234118:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d400/0x313993942505ff2e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d645 expref: 17 pid: 1398 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.234125:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.234141:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2003:x1830967309935744:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 70us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.234147:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8449 00000100:00100000:0.0:1746147197.238440:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.242253:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.244151:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.253931:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309936384 00000100:00100000:0.0:1746147197.253942:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309936384 00002000:00100000:0.0:1746147197.253988:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2940928->2945023) req@ffff88009f087100 x1830967309936384/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:573/0 lens 488/0 e 0 to 0 dl 1746147208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147197.253997:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087100 with x1830967309936384 ext(2940928->2945023) 00010000:00010000:0.0:1746147197.254006:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x313993942505ff3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d653 expref: 16 pid: 1136 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746147197.254020:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x313993942505ff3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d653 expref: 16 pid: 1136 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746147197.254027:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f087100 00000100:00100000:0.0:1746147197.254059:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1587 00000100:00100000:0.0:1746147197.254067:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967309936384:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147197.254280:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967309936384:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 213us (493us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147197.254286:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1587 00002000:00100000:0.0:1746147197.254292:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2940928->2945023) req@ffff88009f087100 x1830967309936384/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:573/0 lens 488/4536 e 0 to 0 dl 1746147208 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147197.254299:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087100 with x1830967309936384 ext(2940928->2945023) 00010000:00010000:0.0:1746147197.254304:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x313993942505ff3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d653 expref: 16 pid: 1136 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746147197.254312:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x313993942505ff3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d653 expref: 16 pid: 1136 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746147197.254317:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f087100 00000100:00100000:0.0:1746147197.259269:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.276410:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.279285:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.319249:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.324271:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.328284:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.335427:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.341571:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.360740:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.365330:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:1.0:1746147197.367962:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147197.368110:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309938304 00000100:00100000:0.0:1746147197.368116:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309938304 00000100:00100000:0.0:1746147197.368148:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 5999 00000100:00100000:0.0:1746147197.368154:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+45:30748:x1830967309938304:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746147197.368695:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+46:30748:x1830967309938304:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 540us (638us total) trans 8589937047 rc 0/0 00000100:00100000:0.0:1746147197.368701:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 5999 00000100:00100000:0.0:1746147197.370084:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.370747:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.372107:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8454 00000100:00100000:1.0:1746147197.372117:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2000:x1830967309938688:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.372133:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.372139:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x313993942505fe40 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d56c expref: 51 pid: 7238 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.372150:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x313993942505fe40 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d56c expref: 51 pid: 7238 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.372170:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x313993942505fe40 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d56c expref: 51 pid: 7238 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.372198:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.372204:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505ff6d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372212:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505ff6d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372216:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505ff6d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372221:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.372265:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2000:x1830967309938688:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 150us (2185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.372275:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8454 00000100:00100000:1.0:1746147197.372292:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8455 00000100:00100000:1.0:1746147197.372296:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+46:2001:x1830967309938816:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.372302:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.372305:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7e00/0x313993942505fec5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5e3 expref: 46 pid: 7238 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.372313:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7e00/0x313993942505fec5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5e3 expref: 46 pid: 7238 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.372323:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7e00/0x313993942505fec5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d5e3 expref: 46 pid: 7238 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.372332:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.372335:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505ff6d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372340:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505ff6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372347:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505ff6d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372366:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.372380:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+45:2001:x1830967309938816:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 83us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.372385:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8455 00010000:00010000:1.0:1746147197.372402:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505ff6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372409:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505ff6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147197.372458:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:1.0:1746147197.372462:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147197.372478:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505ff6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372487:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505ff6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372499:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505ff5f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372505:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505ff5f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372510:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505ff5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372516:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505ff5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372521:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d48600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147197.372525:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505ff5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372531:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505ff5f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372538:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147197.372540:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147197.372543:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505ff5f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372548:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505ff5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372557:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x313993942505ff66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372561:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x313993942505ff66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372565:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x313993942505ff66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372569:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d49400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147197.372571:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x313993942505ff66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372575:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x313993942505ff66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372581:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f00c400) 00010000:00010000:1.0:1746147197.372583:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147197.372585:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x313993942505ff66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372589:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x313993942505ff66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.372619:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48c00/0x313993942505ff58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d66f expref: 20 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.372630:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505ff6d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d66f expref: 19 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.372640:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.372642:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147197.372644:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49600, rc 0) 00000100:00100000:1.0:1746147197.372667:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2404:x1830967309938048:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 11698us (11940us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.372674:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16207 00000100:00100000:0.0:1746147197.375176:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.375844:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.375868:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309938944 00000100:00100000:0.0:1746147197.375875:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309938944 00000100:00100000:0.0:1746147197.376244:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309939072 00000100:00100000:0.0:1746147197.376248:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309939072 00000100:00100000:0.0:1746147197.376274:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18695 00000100:00100000:0.0:1746147197.376282:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967309938944:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147197.376300:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147197.376320:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d6c00/0x313993942505ff74 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d676 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.376342:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.377149:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.377155:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d6c00/0x313993942505ff74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d676 expref: 11 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.377167:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800932d6c00/0x313993942505ff74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d676 expref: 11 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.377175:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d6c00, rc 0) 00000100:00100000:0.0:1746147197.377195:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967309938944:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 914us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.377201:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18695 00000100:00100000:0.0:1746147197.377209:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309939328 00000100:00100000:0.0:1746147197.377211:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309939328 00000100:00080000:1.0:1746147197.379166:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147197.384080:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.384624:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309939584 00000100:00100000:1.0:1746147197.384633:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309939584 00000100:00100000:1.0:1746147197.384680:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16208 00000100:00100000:1.0:1746147197.384689:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2404:x1830967309939584:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147197.384709:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147197.384729:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f200/0x313993942505ff90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d692 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.384835:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x313993942505ff97 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.384849:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505ff6d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d66f expref: 20 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.384857:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x313993942505ff97 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.384890:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505ff6d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d66f expref: 20 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.384901:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505ff6d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d66f expref: 20 pid: 7238 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.384923:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311291648:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147197.385006:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1503c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147197.387687:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311291648:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147197.387712:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x313993942505ff97 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147197.388377:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.388556:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309939712 00000100:00100000:1.0:1746147197.388562:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309939712 00010000:00010000:1.0:1746147197.388591:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505ff6d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d66f expref: 21 pid: 7238 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.389205:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8456 00000100:00100000:1.0:1746147197.389215:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967309939712:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.389228:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.389235:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505ff6d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d66f expref: 21 pid: 7238 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.389246:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505ff6d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d66f expref: 21 pid: 7238 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.389268:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x313993942505ff6d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d66f expref: 21 pid: 7238 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.389285:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.389290:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x313993942505ff97 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.389302:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x313993942505ff97 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.389309:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x313993942505ff97 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.389326:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.389374:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967309939712:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 161us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.389381:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8456 00010000:00010000:1.0:1746147197.389402:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x313993942505ff97 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.389408:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x313993942505ff97 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147197.389426:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147197.389553:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f200/0x313993942505ff90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d692 expref: 21 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.389566:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x313993942505ff97 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d692 expref: 20 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.389571:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.389574:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147197.389576:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a1fa00, rc 0) 00000100:00100000:1.0:1746147197.389597:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2404:x1830967309939584:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4910us (5526us total) trans 8589937048 rc 0/0 00000100:00100000:1.0:1746147197.389603:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16208 00000100:00100000:0.0:1746147197.391630:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.391726:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309939840 00000100:00100000:1.0:1746147197.391733:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309939840 00000100:00100000:1.0:1746147197.391769:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16209 00000100:00100000:1.0:1746147197.391775:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2404:x1830967309939840:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147197.391795:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147197.391813:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fc00/0x313993942505ffa5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d699 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.391895:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x313993942505ffac lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.391917:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x313993942505ff97 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d692 expref: 21 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.391924:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x313993942505ffac lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.391952:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x313993942505ff97 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d692 expref: 21 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.391963:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x313993942505ff97 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d692 expref: 21 pid: 7238 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.391974:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311291776:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147197.393302:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ec10b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147197.397901:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311291776:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147197.397940:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x313993942505ffac lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147197.399998:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147197.401155:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x313993942505ffac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.401163:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x313993942505ffac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147197.401216:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:1.0:1746147197.401220:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147197.401239:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x313993942505ffac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.401270:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fc00/0x313993942505ffa5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d699 expref: 21 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.401490:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x313993942505ffac lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d699 expref: 20 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.401497:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.401500:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147197.401502:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a1e800, rc 0) 00000100:00100000:1.0:1746147197.401538:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2404:x1830967309939840:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 9762us (9914us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.401545:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16209 00000100:00100000:0.0:1746147197.403640:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.410610:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.410693:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309940352 00000100:00100000:1.0:1746147197.410703:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309940352 00000100:00100000:1.0:1746147197.410749:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16210 00000100:00100000:1.0:1746147197.410756:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2404:x1830967309940352:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147197.410777:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147197.410797:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e600/0x313993942505ffba lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d6a7 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.410918:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f800/0x313993942505ffc1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.410936:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f800/0x313993942505ffc1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.410947:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f800/0x313993942505ffc1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147197.410959:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147197.411064:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e600/0x313993942505ffba lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6a7 expref: 23 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.411118:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f800/0x313993942505ffc1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6a7 expref: 22 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.411126:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.411129:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147197.411131:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a1f800, rc 0) 00000100:00100000:1.0:1746147197.411177:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2404:x1830967309940352:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 421us (580us total) trans 8589937049 rc 0/0 00000100:00100000:1.0:1746147197.411184:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16210 00000100:00100000:0.0:1746147197.413231:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.413265:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.413280:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.413294:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.413315:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309940480 00000100:00100000:0.0:1746147197.413321:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309940480 00000100:00100000:0.0:1746147197.413368:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309940608 00000100:00100000:0.0:1746147197.413371:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309940608 00000100:00100000:0.0:1746147197.413384:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309940736 00000100:00100000:0.0:1746147197.413386:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309940736 00000100:00100000:0.0:1746147197.413395:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309940864 00000100:00100000:0.0:1746147197.413397:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309940864 00000100:00100000:0.0:1746147197.413410:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18700 00000100:00100000:0.0:1746147197.413416:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967309940480:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147197.413455:0:1398:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009844b200/0x313993942505ffcf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.413472:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f966200/0x313993942505fefd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d614 expref: 31 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.413480:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932d6c00/0x313993942505ff74 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d676 expref: 12 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.413488:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x313993942505ff04 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d61b expref: 16 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.413494:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.413496:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.413498:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009844b200/0x313993942505ffcf lrc: 6/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.413534:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x313993942505ff04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d61b expref: 16 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.413546:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x313993942505ff04 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d61b expref: 16 pid: 1136 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746147197.413560:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d6ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311292032:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147197.413640:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800932d6c00/0x313993942505ff74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d676 expref: 12 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.413648:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800932d6c00/0x313993942505ff74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d676 expref: 12 pid: 1398 timeout: 835 lvb_type: 1 00000100:00100000:0.0:1746147197.413656:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311292160:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147197.413678:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f966200/0x313993942505fefd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d614 expref: 31 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.413685:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f966200/0x313993942505fefd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d614 expref: 31 pid: 1136 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746147197.413693:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311292288:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147197.413708:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147197.413736:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.413784:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.413800:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309940992 00000100:00100000:0.0:1746147197.413802:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309940992 00000100:00100000:0.0:1746147197.413816:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309941120 00000100:00100000:0.0:1746147197.413817:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309941120 00000100:00100000:0.0:1746147197.413827:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18701 00000100:00100000:0.0:1746147197.413832:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967309940608:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147197.413857:0:9584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x313993942505ffd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.413868:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b537ac00/0x313993942505ff0b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d622 expref: 26 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.413874:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x313993942505ff7b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d67d expref: 11 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.413881:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ff5c00/0x313993942505ff27 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d63e expref: 8 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.413886:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.413888:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.413890:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x313993942505ffd6 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.413915:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097ff5c00/0x313993942505ff27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d63e expref: 8 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.413923:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097ff5c00/0x313993942505ff27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d63e expref: 8 pid: 17600 timeout: 835 lvb_type: 1 00000100:00100000:0.0:1746147197.413934:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d6c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311292416:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147197.413960:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x313993942505ff7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d67d expref: 11 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.413971:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x313993942505ff7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d67d expref: 11 pid: 1136 timeout: 835 lvb_type: 1 00000100:00100000:0.0:1746147197.413978:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311292544:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147197.413995:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b537ac00/0x313993942505ff0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d622 expref: 26 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.414001:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b537ac00/0x313993942505ff0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d622 expref: 26 pid: 1398 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746147197.414008:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311292672:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147197.414017:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147197.414031:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18702 00000100:00100000:0.0:1746147197.414035:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967309940736:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147197.414050:0:13695:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092562e00/0x313993942505ffdd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.414059:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x313993942505f900 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d24e expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.414066:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e260800/0x313993942505f954 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d28d expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.414075:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x313993942505f915 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d263 expref: 8 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.414081:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.414082:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.414085:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092562e00/0x313993942505ffdd lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.414133:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x313993942505f915 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d263 expref: 8 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.414141:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x313993942505f915 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d263 expref: 8 pid: 9584 timeout: 835 lvb_type: 1 00000100:00100000:0.0:1746147197.414148:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311292800:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147197.414182:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e260800/0x313993942505f954 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d28d expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.414190:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e260800/0x313993942505f954 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d28d expref: 11 pid: 1854 timeout: 835 lvb_type: 1 00000100:00100000:0.0:1746147197.414197:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311292928:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147197.414218:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x313993942505f900 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d24e expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.414225:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x313993942505f900 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d24e expref: 26 pid: 1854 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746147197.414236:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311293056:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147197.414249:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147197.421482:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.421518:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.421623:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d6c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311292416:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147197.421723:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.421742:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.421767:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311292544:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147197.421791:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311292672:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147197.421816:0:9584:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x313993942505ffd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147197.421853:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311292800:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147197.421878:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311292928:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147197.421927:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311293056:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147197.421942:0:13695:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092562e00/0x313993942505ffdd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.422022:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309941248 00000100:00100000:1.0:1746147197.422029:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309941248 00010000:00010000:1.0:1746147197.422064:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d6c00/0x313993942505ff74 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d676 expref: 14 pid: 1398 timeout: 835 lvb_type: 1 00000100:00100000:1.0:1746147197.422085:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309941376 00000100:00100000:1.0:1746147197.422114:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309941376 00010000:00010000:1.0:1746147197.422126:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x313993942505ff04 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d61b expref: 17 pid: 1136 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.422138:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309941632 00000100:00100000:1.0:1746147197.422140:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309941632 00010000:00010000:1.0:1746147197.422149:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff5c00/0x313993942505ff27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d63e expref: 9 pid: 17600 timeout: 835 lvb_type: 1 00000100:00100000:1.0:1746147197.422156:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309941504 00000100:00100000:1.0:1746147197.422158:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309941504 00010000:00010000:1.0:1746147197.422167:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f966200/0x313993942505fefd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d614 expref: 32 pid: 1136 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.422177:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8458 00000100:00100000:1.0:1746147197.422184:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967309941248:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.422196:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.422216:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800932d6c00/0x313993942505ff74 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d676 expref: 14 pid: 1398 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746147197.422225:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800932d6c00/0x313993942505ff74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d676 expref: 14 pid: 1398 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746147197.422249:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.422288:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967309941248:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 104us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.422294:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8458 00000100:00100000:1.0:1746147197.422308:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8459 00000100:00100000:1.0:1746147197.422313:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aa328450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967309941376:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.422319:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.422325:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x313993942505ff04 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d61b expref: 17 pid: 1136 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.422333:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x313993942505ff04 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d61b expref: 17 pid: 1136 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.422343:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.422357:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aa328450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967309941376:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 44us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.422361:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8459 00000100:00100000:1.0:1746147197.422392:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8460 00000100:00100000:1.0:1746147197.422397:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967309941632:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.422404:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.422415:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ff5c00/0x313993942505ff27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d63e expref: 9 pid: 17600 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746147197.422424:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ff5c00/0x313993942505ff27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d63e expref: 9 pid: 17600 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746147197.422436:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ff5c00/0x313993942505ff27 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d63e expref: 9 pid: 17600 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746147197.422450:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.422464:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967309941632:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 67us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.422472:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8460 00000100:00100000:1.0:1746147197.422481:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8461 00000100:00100000:1.0:1746147197.422485:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967309941504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.422490:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.422496:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f966200/0x313993942505fefd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d614 expref: 32 pid: 1136 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.422504:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f966200/0x313993942505fefd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d614 expref: 32 pid: 1136 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.422514:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.422516:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.422521:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009844b200/0x313993942505ffcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.422528:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009844b200/0x313993942505ffcf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.422541:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.422553:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967309941504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 68us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.422558:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8461 00010000:00010000:1.0:1746147197.422584:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x313993942505ff04 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d61b expref: 16 pid: 1136 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.422592:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d6ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311292032:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147197.422601:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d6c00/0x313993942505ff74 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d676 expref: 13 pid: 1398 timeout: 835 lvb_type: 1 00000100:00100000:1.0:1746147197.422608:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311292160:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147197.422616:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f966200/0x313993942505fefd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d614 expref: 31 pid: 1136 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.422623:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311292288:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147197.422635:0:1398:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009844b200/0x313993942505ffcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.422642:0:1398:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009844b200/0x313993942505ffcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.422649:0:1398:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009844b200/0x313993942505ffcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.422664:0:1398:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009844b200/0x313993942505ffcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.422671:0:1398:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009844b200/0x313993942505ffcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.422677:0:1398:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009844b200/0x313993942505ffcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.422688:0:1398:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844b200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147197.422692:0:1398:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009844b200/0x313993942505ffcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.422699:0:1398:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009844b200/0x313993942505ffcf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.422707:0:1398:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009844b200/0x313993942505ffcf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.422713:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009844b200/0x313993942505ffcf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.422751:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967309940480:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 9335us (9529us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.422758:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18700 00000100:00100000:0.0:1746147197.426497:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.426535:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.426555:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.426569:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.426600:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.426661:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309941888 00000100:00100000:1.0:1746147197.426670:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309941888 00010000:00010000:1.0:1746147197.426707:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b537ac00/0x313993942505ff0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d622 expref: 27 pid: 1398 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.426732:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309942144 00000100:00100000:1.0:1746147197.426734:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309942144 00010000:00010000:1.0:1746147197.426745:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x313993942505f915 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d263 expref: 8 pid: 9584 timeout: 835 lvb_type: 1 00000100:00100000:1.0:1746147197.426753:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309941760 00000100:00100000:1.0:1746147197.426755:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309941760 00010000:00010000:1.0:1746147197.426764:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x313993942505ff7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d67d expref: 12 pid: 1136 timeout: 835 lvb_type: 1 00000100:00100000:1.0:1746147197.426771:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309942016 00000100:00100000:1.0:1746147197.426773:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309942016 00010000:00010000:1.0:1746147197.426779:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e260800/0x313993942505f954 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d28d expref: 13 pid: 1854 timeout: 835 lvb_type: 1 00000100:00100000:1.0:1746147197.426786:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309942272 00000100:00100000:1.0:1746147197.426787:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309942272 00010000:00010000:1.0:1746147197.426795:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x313993942505f900 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d24e expref: 28 pid: 1854 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.426804:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8462 00000100:00100000:1.0:1746147197.426811:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094730000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967309941888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.426825:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.426843:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b537ac00/0x313993942505ff0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d622 expref: 28 pid: 1398 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.426853:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b537ac00/0x313993942505ff0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d622 expref: 28 pid: 1398 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.426876:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b537ac00/0x313993942505ff0b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d622 expref: 28 pid: 1398 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.426896:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.426965:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094730000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967309941888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 154us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.426972:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8462 00000100:00100000:1.0:1746147197.426986:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8463 00000100:00100000:1.0:1746147197.426990:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967309942144:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.426996:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.427004:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x313993942505f915 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d263 expref: 8 pid: 9584 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746147197.427011:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x313993942505f915 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d263 expref: 8 pid: 9584 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746147197.427022:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1c00/0x313993942505f915 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d263 expref: 8 pid: 9584 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746147197.427029:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.427043:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2000:x1830967309942144:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 53us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.427047:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8463 00000100:00100000:1.0:1746147197.427056:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8464 00000100:00100000:1.0:1746147197.427060:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094731f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967309941760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.427066:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.427072:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x313993942505ff7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d67d expref: 13 pid: 1136 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746147197.427080:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x313993942505ff7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d67d expref: 13 pid: 1136 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746147197.427117:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x313993942505ff7b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d67d expref: 13 pid: 1136 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746147197.427124:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.427126:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.427130:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x313993942505ffd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.427138:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x313993942505ffd6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.427159:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.427172:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094731f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967309941760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 112us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.427177:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8464 00000100:00100000:1.0:1746147197.427187:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8465 00000100:00100000:1.0:1746147197.427191:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967309942016:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.427197:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.427202:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e260800/0x313993942505f954 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d28d expref: 11 pid: 1854 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746147197.427208:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e260800/0x313993942505f954 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d28d expref: 11 pid: 1854 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746147197.427217:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e260800/0x313993942505f954 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d28d expref: 11 pid: 1854 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746147197.427230:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.427242:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967309942016:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 51us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.427248:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8465 00000100:00100000:1.0:1746147197.427256:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8466 00000100:00100000:1.0:1746147197.427261:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aa328050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967309942272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.427266:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.427271:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x313993942505f900 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d24e expref: 26 pid: 1854 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.427278:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x313993942505f900 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d24e expref: 26 pid: 1854 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.427288:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800990c6400/0x313993942505f900 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d24e expref: 26 pid: 1854 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.427297:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.427298:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.427301:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092562e00/0x313993942505ffdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.427306:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092562e00/0x313993942505ffdd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.427318:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.427333:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aa328050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967309942272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 72us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.427338:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8466 00010000:00010000:0.0:1746147197.427762:0:13695:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092562e00/0x313993942505ffdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.427771:0:13695:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092562e00/0x313993942505ffdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.427787:0:13695:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092562e00/0x313993942505ffdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.427795:0:13695:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092562e00/0x313993942505ffdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.427801:0:13695:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092562e00/0x313993942505ffdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.427808:0:13695:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092562e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147197.427811:0:13695:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092562e00/0x313993942505ffdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.427818:0:13695:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092562e00/0x313993942505ffdd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.427829:0:13695:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092562e00/0x313993942505ffdd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.427835:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092562e00/0x313993942505ffdd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147197.427898:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967309940736:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 13860us (14615us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.427914:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18702 00010000:00010000:0.0:1746147197.427936:0:9584:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x313993942505ffd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.427944:0:9584:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x313993942505ffd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.427954:0:9584:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x313993942505ffd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.427960:0:9584:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x313993942505ffd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.427966:0:9584:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x313993942505ffd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.427971:0:9584:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092563400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147197.427973:0:9584:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x313993942505ffd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.427979:0:9584:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x313993942505ffd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.427987:0:9584:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x313993942505ffd6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.427993:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092563400/0x313993942505ffd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147197.428021:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967309940608:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 14188us (14754us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.428026:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18701 00000100:00100000:0.0:1746147197.436883:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.436921:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.436937:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.436965:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.436986:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309942912 00000100:00100000:0.0:1746147197.436993:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309942912 00002000:00100000:0.0:1746147197.437029:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x98:0x0] (3493888->4042751) req@ffff8801312ee300 x1830967309942912/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:573/0 lens 488/0 e 0 to 0 dl 1746147208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147197.437038:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ee300 with x1830967309942912 ext(3493888->4042751) 00010000:00010000:0.0:1746147197.437044:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009844ba00/0x313993942505ff51 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d668 expref: 25 pid: 1136 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746147197.437054:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009844ba00/0x313993942505ff51 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d668 expref: 25 pid: 1136 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746147197.437060:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801312ee300 00000100:00100000:0.0:1746147197.437073:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1589 00000100:00100000:0.0:1746147197.437079:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967309942912:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147197.440303:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.441495:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309942656 00000100:00100000:1.0:1746147197.441506:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309942656 00010000:00010000:1.0:1746147197.441541:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x313993942505ff82 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d684 expref: 11 pid: 10340 timeout: 835 lvb_type: 1 00000100:00100000:1.0:1746147197.441575:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8470 00000100:00100000:1.0:1746147197.441583:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967309942656:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.441596:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.441614:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x313993942505ff82 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d684 expref: 11 pid: 10340 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746147197.441625:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x313993942505ff82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d684 expref: 11 pid: 10340 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746147197.441649:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x313993942505ff82 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d684 expref: 11 pid: 10340 timeout: 835 lvb_type: 1 00010000:00010000:1.0:1746147197.441683:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.441685:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.441691:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d48000/0x313993942505ffeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.441700:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d48000/0x313993942505ffeb lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.441728:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.441767:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967309942656:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 185us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.441774:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8470 00000100:00100000:0.0:1746147197.442970:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.443431:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309943040 00000100:00100000:1.0:1746147197.443438:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309943040 00010000:00010000:1.0:1746147197.443463:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7ee400/0x313993942505fb30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3a5 expref: 30 pid: 10340 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.443497:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8471 00000100:00100000:1.0:1746147197.443503:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967309943040:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.443514:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.443529:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7ee400/0x313993942505fb30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3a5 expref: 30 pid: 10340 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.443540:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7ee400/0x313993942505fb30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3a5 expref: 30 pid: 10340 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.443556:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7ee400/0x313993942505fb30 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d3a5 expref: 30 pid: 10340 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.443568:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.443569:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.443572:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ff5000/0x313993942505ffe4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.443585:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff5000/0x313993942505ffe4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.443614:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.443638:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967309943040:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 136us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.443644:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8471 00000100:00100000:0.0:1746147197.443990:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967309942912:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 6910us (7023us total) trans 17179875001 rc 0/0 00000100:00100000:0.0:1746147197.443998:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1589 00002000:00100000:0.0:1746147197.444006:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x98:0x0] (3493888->4042751) req@ffff8801312ee300 x1830967309942912/t17179875001(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:573/0 lens 488/448 e 0 to 0 dl 1746147208 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147197.444014:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ee300 with x1830967309942912 ext(3493888->4042751) 00010000:00010000:0.0:1746147197.444021:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009844ba00/0x313993942505ff51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d668 expref: 27 pid: 1136 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746147197.444031:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009844ba00/0x313993942505ff51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d668 expref: 27 pid: 1136 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746147197.444036:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801312ee300 00000100:00100000:0.0:1746147197.447889:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.452539:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.458365:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.458659:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.458865:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.458996:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.459509:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6000 00000100:00100000:1.0:1746147197.459518:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909c6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:8487:x1830967309943680:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147197.459707:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909c6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:8487:x1830967309943680:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 190us (1342us total) trans 8589937050 rc 0/0 00000100:00100000:1.0:1746147197.459713:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6000 00000100:00100000:1.0:1746147197.459754:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6001 00000100:00100000:1.0:1746147197.459758:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+45:26824:x1830967309943936:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147197.459807:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+46:26824:x1830967309943936:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 49us (1148us total) trans 8589937051 rc 0/0 00000100:00100000:1.0:1746147197.459813:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6001 00000100:00100000:1.0:1746147197.459826:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309944192 00000100:00100000:1.0:1746147197.459828:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309944192 00010000:00010000:1.0:1746147197.459838:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e200/0x313993942505f59c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d03a expref: 46 pid: 16099 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.459852:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8473 00000100:00100000:1.0:1746147197.459857:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2002:x1830967309944064:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.459865:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.459871:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x313993942505f5a3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d041 expref: 51 pid: 9138 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.459880:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x313993942505f5a3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d041 expref: 51 pid: 9138 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.459900:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x313993942505f5a3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d041 expref: 51 pid: 9138 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.459923:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.459928:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505fff9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147197.459937:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.459950:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2002:x1830967309944064:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 93us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.459955:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8473 00000100:00100000:1.0:1746147197.459984:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8474 00000100:00100000:1.0:1746147197.459988:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+46:2002:x1830967309944192:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.459993:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.459996:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e200/0x313993942505f59c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d03a expref: 46 pid: 16099 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.460004:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e200/0x313993942505f59c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d03a expref: 46 pid: 16099 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.460015:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e200/0x313993942505f59c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d03a expref: 46 pid: 16099 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.460022:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.460025:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505fff9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147197.460030:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.460042:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+45:2002:x1830967309944192:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 53us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.460047:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8474 00000100:00100000:0.0:1746147197.461039:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.461062:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.461171:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309944448 00000100:00100000:1.0:1746147197.461174:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309944448 00010000:00010000:1.0:1746147197.461191:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1600/0x313993942505f890 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d201 expref: 50 pid: 16099 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.461391:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309944320 00000100:00100000:1.0:1746147197.461394:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309944320 00010000:00010000:1.0:1746147197.461404:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093709400/0x313993942505fac0 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d358 expref: 45 pid: 6215 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746147197.461530:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8476 00000100:00100000:0.0:1746147197.461535:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+45:2000:x1830967309944320:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147197.461541:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147197.461545:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093709400/0x313993942505fac0 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d358 expref: 45 pid: 6215 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746147197.461553:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093709400/0x313993942505fac0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d358 expref: 45 pid: 6215 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746147197.461562:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147197.461565:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505fff9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147197.461569:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147197.462243:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+45:2000:x1830967309944320:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 707us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.462248:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8476 00000100:00100000:1.0:1746147197.467652:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309944576 00000100:00100000:1.0:1746147197.467661:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309944576 00010000:00010000:1.0:1746147197.467697:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093730e00/0x313993942505f660 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d0bf expref: 44 pid: 9138 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.467734:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8477 00000100:00100000:1.0:1746147197.467741:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+44:2002:x1830967309944576:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.467753:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.467760:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093730e00/0x313993942505f660 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d0bf expref: 44 pid: 9138 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.467776:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093730e00/0x313993942505f660 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d0bf expref: 44 pid: 9138 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.467796:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093730e00/0x313993942505f660 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d0bf expref: 44 pid: 9138 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.467820:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.467826:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505fff9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147197.467834:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.467873:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+43:2002:x1830967309944576:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 133us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.467879:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8477 00000100:00100000:0.0:1746147197.468242:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309944704 00000100:00100000:0.0:1746147197.468247:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309944704 00010000:00010000:0.0:1746147197.468261:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x313993942505f675 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d0c6 expref: 49 pid: 9138 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746147197.468277:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8478 00000100:00100000:0.0:1746147197.468282:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2003:x1830967309944704:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147197.468289:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147197.468292:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x313993942505f675 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d0c6 expref: 49 pid: 9138 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746147197.468300:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x313993942505f675 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d0c6 expref: 49 pid: 9138 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746147197.468312:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x313993942505f675 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d0c6 expref: 49 pid: 9138 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746147197.468327:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147197.468330:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505fff9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147197.468337:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505fff9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147197.468343:0:4349:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505fff9 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147197.468360:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147197.468377:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2003:x1830967309944704:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 95us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.468383:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8478 00000100:00100000:0.0:1746147197.472335:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311294720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147197.472360:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147197.472387:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311295232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147197.472404:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147197.472413:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311295744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147197.472426:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147197.472436:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746147197.472439:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311295104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147197.472450:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147197.472459:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311295616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147197.472469:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147197.472487:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311294720 00000100:00100000:0.0:1746147197.472490:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311294720 00000100:00100000:0.0:1746147197.472505:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311295232 00000100:00100000:0.0:1746147197.472507:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311295232 00000100:00100000:0.0:1746147197.472515:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311295744 00000100:00100000:0.0:1746147197.472516:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311295744 00000100:00100000:0.0:1746147197.472522:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311295104 00000100:00100000:0.0:1746147197.472523:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311295104 00000100:00100000:0.0:1746147197.472528:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311295616 00000100:00100000:0.0:1746147197.472530:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311295616 00000100:00100000:0.0:1746147197.472537:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18710 00000100:00100000:0.0:1746147197.472541:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3765:x1830967311294720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147197.472600:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967311294720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (239us total) trans 21474842372 rc 0/0 00000100:00100000:0.0:1746147197.472605:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18710 00000100:00100000:0.0:1746147197.472613:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18711 00000100:00100000:0.0:1746147197.472617:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3765:x1830967311295232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147197.472655:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967311295232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 37us (250us total) trans 21474842373 rc 0/0 00000100:00100000:0.0:1746147197.472660:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18711 00000100:00100000:0.0:1746147197.472806:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18712 00000100:00100000:0.0:1746147197.472810:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3765:x1830967311295744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147197.472851:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967311295744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 40us (423us total) trans 21474842374 rc 0/0 00000100:00100000:0.0:1746147197.472856:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18712 00000100:00100000:0.0:1746147197.472863:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18713 00000100:00100000:0.0:1746147197.472867:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3765:x1830967311295104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147197.472894:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147197.472897:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147197.472899:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147197.472901:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147197.472915:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:0.0:1746147197.472930:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967311295104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (479us total) trans 21474842375 rc 0/0 00000100:00100000:0.0:1746147197.472934:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18713 00000100:00100000:0.0:1746147197.472942:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18714 00000100:00100000:0.0:1746147197.472946:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3765:x1830967311295616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147197.472981:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:0.0:1746147197.472983:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147197.472985:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147197.472986:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147197.472988:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:0.0:1746147197.473005:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967311295616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (535us total) trans 21474842376 rc 0/0 00000100:00100000:0.0:1746147197.473010:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18714 00000004:00080000:0.0:1746147197.473033:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca13480/2, rc 0, transno 21474842375 00000100:00100000:0.0:1746147197.473036:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311295104:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147197.473041:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094525c00/2, rc 0, transno 21474842376 00000100:00100000:0.0:1746147197.473043:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311295616:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147197.473048:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093147480/2, rc 0, transno 21474842372 00000100:00100000:0.0:1746147197.473051:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311294720:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147197.473056:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbc3480/2, rc 0, transno 21474842373 00000100:00100000:0.0:1746147197.473058:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311295232:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147197.473064:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099155c00/2, rc 0, transno 21474842374 00000100:00100000:0.0:1746147197.473066:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311295744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147197.473155:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311296256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147197.473178:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147197.473200:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311296768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147197.473214:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147197.473223:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746147197.473226:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311296128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147197.473236:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147197.473242:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311296640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147197.473252:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147197.473265:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311296256 00000100:00100000:0.0:1746147197.473268:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311296256 00000100:00100000:0.0:1746147197.473280:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311296768 00000100:00100000:0.0:1746147197.473282:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311296768 00000100:00100000:0.0:1746147197.473288:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311296128 00000100:00100000:0.0:1746147197.473289:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311296128 00000100:00100000:0.0:1746147197.473294:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311296640 00000100:00100000:0.0:1746147197.473296:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311296640 00000100:00100000:0.0:1746147197.473303:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18715 00000100:00100000:0.0:1746147197.473306:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3765:x1830967311296256:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147197.473364:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147197.473366:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147197.473368:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147197.473370:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147197.473372:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746147197.473392:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3765:x1830967311296256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (214us total) trans 17179875002 rc 0/0 00000100:00100000:0.0:1746147197.473397:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18715 00000100:00100000:0.0:1746147197.473405:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18716 00000100:00100000:0.0:1746147197.473409:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3765:x1830967311296768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147197.473455:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3765:x1830967311296768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (240us total) trans 17179875003 rc 0/0 00000100:00100000:0.0:1746147197.473460:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18716 00000100:00100000:0.0:1746147197.473467:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18717 00000100:00100000:0.0:1746147197.473471:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3765:x1830967311296128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147197.473517:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3765:x1830967311296128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (279us total) trans 17179875004 rc 0/0 00000100:00100000:0.0:1746147197.473522:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18717 00000100:00100000:0.0:1746147197.473529:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18718 00000100:00100000:0.0:1746147197.473533:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3765:x1830967311296640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147197.473575:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3765:x1830967311296640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (321us total) trans 17179875005 rc 0/0 00000100:00100000:0.0:1746147197.473580:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18718 00000100:00100000:0.0:1746147197.473596:0:3765:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874984 gen 2 00000004:00080000:0.0:1746147197.473599:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e59180, transno 17179874911 00000004:00080000:0.0:1746147197.473604:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e5aa00, transno 17179874912 00000004:00080000:0.0:1746147197.473607:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5576680, transno 17179874913 00000004:00080000:0.0:1746147197.473609:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5577480, transno 17179874914 00000004:00080000:0.0:1746147197.473611:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e59c00, transno 17179874915 00000004:00080000:0.0:1746147197.473613:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e5a680, transno 17179874916 00000004:00080000:0.0:1746147197.473615:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5574a80, transno 17179874917 00000004:00080000:0.0:1746147197.473618:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e59880, transno 17179874918 00000004:00080000:0.0:1746147197.473621:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e502300, transno 17179874925 00000004:00080000:0.0:1746147197.473623:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4396300, transno 17179874926 00000004:00080000:0.0:1746147197.473625:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e500e00, transno 17179874927 00000004:00080000:0.0:1746147197.473627:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4394e00, transno 17179874928 00000004:00080000:0.0:1746147197.473630:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e502a00, transno 17179874929 00000004:00080000:0.0:1746147197.473632:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4397800, transno 17179874930 00000004:00080000:0.0:1746147197.473633:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4397480, transno 17179874931 00000004:00080000:0.0:1746147197.473635:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4394a80, transno 17179874932 00000004:00080000:0.0:1746147197.473642:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c3ca80, transno 17179874937 00000004:00080000:0.0:1746147197.473644:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013232ca80, transno 17179874938 00000004:00080000:0.0:1746147197.473647:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fa680, transno 17179874939 00000004:00080000:0.0:1746147197.473649:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013232ed80, transno 17179874940 00000004:00080000:0.0:1746147197.473651:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f8000, transno 17179874941 00000004:00080000:0.0:1746147197.473653:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c3ed80, transno 17179874942 00000004:00080000:0.0:1746147197.473655:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fb480, transno 17179874943 00000004:00080000:0.0:1746147197.473657:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e484380, transno 17179874944 00000004:00080000:0.0:1746147197.473659:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099150e00, transno 17179874945 00000004:00080000:0.0:1746147197.473662:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099152a00, transno 17179874946 00000004:00080000:0.0:1746147197.473664:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099150000, transno 17179874947 00000004:00080000:0.0:1746147197.473666:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099153100, transno 17179874948 00000004:00080000:0.0:1746147197.473668:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099153480, transno 17179874949 00000004:00080000:0.0:1746147197.473671:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099150a80, transno 17179874950 00000004:00080000:0.0:1746147197.473673:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099150700, transno 17179874951 00000004:00080000:0.0:1746147197.473675:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099152300, transno 17179874952 00000004:00080000:0.0:1746147197.473678:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094187480, transno 17179874957 00000004:00080000:0.0:1746147197.473680:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094186300, transno 17179874958 00000004:00080000:0.0:1746147197.473683:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f54a80, transno 17179874959 00000004:00080000:0.0:1746147197.473685:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f55f80, transno 17179874960 00000004:00080000:0.0:1746147197.473688:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094187b80, transno 17179874961 00000004:00080000:0.0:1746147197.473691:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f54380, transno 17179874962 00000004:00080000:0.0:1746147197.473693:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094184a80, transno 17179874963 00000004:00080000:0.0:1746147197.473695:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094184380, transno 17179874964 00000004:00080000:0.0:1746147197.473698:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f57b80, transno 17179874969 00000004:00080000:0.0:1746147197.473701:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013232c380, transno 17179874970 00000004:00080000:0.0:1746147197.473703:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4395180, transno 17179874971 00000004:00080000:0.0:1746147197.473706:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e487480, transno 17179874972 00000004:00080000:0.0:1746147197.473708:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013232f800, transno 17179874973 00000004:00080000:0.0:1746147197.473711:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e487b80, transno 17179874974 00000004:00080000:0.0:1746147197.473713:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4397b80, transno 17179874975 00000004:00080000:0.0:1746147197.473715:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013232ea00, transno 17179874976 00000004:00080000:0.0:1746147197.473717:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fb800, transno 17179874977 00000004:00080000:0.0:1746147197.473720:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fa300, transno 17179874978 00000004:00080000:0.0:1746147197.473722:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f8a80, transno 17179874979 00000004:00080000:0.0:1746147197.473724:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fb100, transno 17179874980 00000004:00080000:0.0:1746147197.473726:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f9f80, transno 17179874981 00000004:00080000:0.0:1746147197.473729:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fad80, transno 17179874982 00000004:00080000:0.0:1746147197.473731:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f9c00, transno 17179874983 00000004:00080000:0.0:1746147197.473733:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f9880, transno 17179874984 00000100:00100000:0.0:1746147197.473739:0:3765:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880098c73b80 x1830967311296128/t17179875004(17179875004) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147213 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746147197.473747:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c73b80/2, rc 0, transno 17179875004 00000100:00100000:0.0:1746147197.473751:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311296128:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147197.473760:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c73480/2, rc 0, transno 17179875005 00000100:00100000:0.0:1746147197.473762:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311296640:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147197.473767:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c70e00/2, rc 0, transno 17179875002 00000100:00100000:0.0:1746147197.473770:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311296256:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147197.473774:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096cf8700/2, rc 0, transno 17179875003 00000100:00100000:0.0:1746147197.473777:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311296768:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147197.474160:0:8112:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 56 done 00000100:00100000:0.0:1746147197.474239:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147197.474329:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505fff9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147197.474338:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505fff9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147197.474345:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505fff9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147197.474351:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d48600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147197.474355:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505fff9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147197.474361:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505fff9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147197.474376:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.474380:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147197.474383:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505fff9 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147197.474389:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942505fff9 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00000100:00100000:1.0:1746147197.475484:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311296512 00000100:00100000:1.0:1746147197.475490:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311296512 00000100:00100000:1.0:1746147197.475576:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311296384 00000100:00100000:1.0:1746147197.475578:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311296384 00000100:00100000:1.0:1746147197.475588:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18719 00000100:00100000:1.0:1746147197.475594:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3767:x1830967311296000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147197.475709:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3767:x1830967311296000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 115us (1220us total) trans 17179875006 rc 0/0 00000100:00100000:1.0:1746147197.475715:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18719 00000100:00100000:1.0:1746147197.475725:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18720 00000100:00100000:1.0:1746147197.475729:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3767:x1830967311296512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147197.475764:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:1.0:1746147197.475767:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:1.0:1746147197.475769:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147197.475771:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:1.0:1746147197.475772:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:1.0:1746147197.475786:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3767:x1830967311296512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (1256us total) trans 17179875007 rc 0/0 00000100:00100000:1.0:1746147197.475791:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18720 00000100:00100000:1.0:1746147197.475798:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18721 00000100:00100000:1.0:1746147197.475802:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3767:x1830967311296384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147197.475842:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3767:x1830967311296384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 39us (1267us total) trans 17179875008 rc 0/0 00000100:00100000:1.0:1746147197.475847:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18721 00000100:00100000:1.0:1746147197.483309:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309944960 00000100:00100000:1.0:1746147197.483321:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309944960 00000100:00100000:1.0:1746147197.483378:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16213 00000100:00100000:1.0:1746147197.483387:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2404:x1830967309944960:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147197.483406:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147197.483426:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x3139939425060007 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d6b5 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.483517:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x313993942506000e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.483746:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x313993942506000e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.483759:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x313993942506000e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147197.483786:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:1.0:1746147197.483789:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147197.483804:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x313993942506000e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.483826:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fa00/0x3139939425060007 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6b5 expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.484391:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x313993942506000e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6b5 expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.484405:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.484408:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147197.484411:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a1e800, rc 0) 00000100:00100000:1.0:1746147197.485034:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2404:x1830967309944960:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1645us (2803us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.485042:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16213 00000100:00100000:0.0:1746147197.489260:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.489289:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.489313:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.489335:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309945088 00000100:00100000:0.0:1746147197.489344:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309945088 00000100:00100000:0.0:1746147197.489393:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309945216 00000100:00100000:0.0:1746147197.489395:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309945216 00000100:00100000:0.0:1746147197.489407:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309945472 00000100:00100000:0.0:1746147197.489409:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309945472 00000100:00100000:0.0:1746147197.489424:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18723 00000100:00100000:0.0:1746147197.489430:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967309945088:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147197.489448:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147197.489468:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d90800/0x3139939425060015 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d6bc expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147197.489491:0:13695:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x93:0x0] initial LVB size: 1048576, mtime: 0x6814177c, atime: 0x6814177c, ctime: 0x6814177c, blocks: 0x7e8 00010000:00010000:0.0:1746147197.489511:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.489513:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.489522:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d90800/0x3139939425060015 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6bc expref: 10 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.489537:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d90800/0x3139939425060015 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6bc expref: 10 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.489547:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d90800, rc 0) 00000100:00100000:0.0:1746147197.489587:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967309945088:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 156us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.489593:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18723 00000100:00100000:0.0:1746147197.489608:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18724 00000100:00100000:0.0:1746147197.489612:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2000:x1830967309945216:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147197.489618:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147197.489629:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d91e00/0x313993942506001c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d6c3 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147197.489643:0:13695:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x96:0x0] initial LVB size: 2097152, mtime: 0x6814177c, atime: 0x6814177c, ctime: 0x6814177c, blocks: 0x808 00010000:00010000:0.0:1746147197.489650:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.489652:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.489655:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d91e00/0x313993942506001c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6c3 expref: 8 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.489665:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d91e00/0x313993942506001c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6c3 expref: 8 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.489671:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d91e00, rc 0) 00000100:00100000:0.0:1746147197.489683:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967309945216:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 71us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.489688:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18724 00000100:00100000:0.0:1746147197.489696:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18725 00000100:00100000:0.0:1746147197.489700:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967309945472:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147197.489705:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147197.489711:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d91a00/0x3139939425060023 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d6d1 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147197.489721:0:13695:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6814177b, atime: 0x6814177b, ctime: 0x6814177b, blocks: 0x808 00010000:00010000:0.0:1746147197.489728:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.489729:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.489732:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d91a00/0x3139939425060023 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6d1 expref: 10 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.489741:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d91a00/0x3139939425060023 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6d1 expref: 10 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.489747:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d91a00, rc 0) 00000100:00100000:0.0:1746147197.489756:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967309945472:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 56us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.489761:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18725 00000100:00100000:0.0:1746147197.489782:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.489792:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309945728 00000100:00100000:0.0:1746147197.489794:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309945728 00000100:00100000:0.0:1746147197.489805:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18726 00000100:00100000:0.0:1746147197.489809:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967309945728:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147197.489814:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147197.489821:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d91200/0x313993942506002a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d6df expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147197.489830:0:13695:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x98:0x0] initial LVB size: 4194304, mtime: 0x6814177d, atime: 0x6814177c, ctime: 0x6814177d, blocks: 0x1008 00010000:00010000:0.0:1746147197.489837:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.489838:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.489842:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d91200/0x313993942506002a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6df expref: 9 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.489850:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d91200/0x313993942506002a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6df expref: 9 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.489857:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d91200, rc 0) 00000100:00100000:0.0:1746147197.489867:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967309945728:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 58us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.489872:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18726 00000100:00100000:0.0:1746147197.489924:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.489933:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309945344 00000100:00100000:0.0:1746147197.489935:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309945344 00000100:00100000:0.0:1746147197.489947:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18727 00000100:00100000:0.0:1746147197.489951:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967309945344:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147197.489956:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147197.489963:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x3139939425060031 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d6ca expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147197.489972:0:13695:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x97:0x0] initial LVB size: 2097152, mtime: 0x6814177a, atime: 0x6814177a, ctime: 0x6814177a, blocks: 0x800 00010000:00010000:0.0:1746147197.489978:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.489980:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.489983:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x3139939425060031 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6ca expref: 10 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.489991:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x3139939425060031 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6ca expref: 10 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.490003:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d90e00, rc 0) 00000100:00100000:0.0:1746147197.490013:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967309945344:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 62us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.490018:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18727 00000100:00100000:0.0:1746147197.490128:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.490138:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309945600 00000100:00100000:0.0:1746147197.490141:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309945600 00000100:00100000:0.0:1746147197.490154:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18728 00000100:00100000:0.0:1746147197.490158:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967309945600:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147197.490164:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147197.490172:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d91400/0x3139939425060038 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d6d8 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147197.490181:0:13695:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4886560, mtime: 0x6814177d, atime: 0x6814177c, ctime: 0x6814177d, blocks: 0x1558 00010000:00010000:0.0:1746147197.490199:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.490200:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.490204:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d91400/0x3139939425060038 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6d8 expref: 11 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.490212:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d91400/0x3139939425060038 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6d8 expref: 11 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147197.490219:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d91400, rc 0) 00000100:00100000:0.0:1746147197.490232:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967309945600:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 73us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.490240:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18728 00000100:00100000:0.0:1746147197.493389:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.493423:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.493450:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309945856 00000100:00100000:0.0:1746147197.493450:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.493460:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309945856 00000100:00100000:0.0:1746147197.494450:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.494456:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309946112 00000100:00100000:1.0:1746147197.494460:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309946112 00000100:00100000:0.0:1746147197.494465:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.494479:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309946368 00000100:00100000:1.0:1746147197.494481:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309946368 00000100:00100000:0.0:1746147197.494491:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.494497:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309945984 00000100:00100000:1.0:1746147197.494499:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309945984 00000100:00100000:0.0:1746147197.494508:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309946240 00000100:00100000:1.0:1746147197.494511:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309946496 00000100:00100000:0.0:1746147197.494511:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309946240 00000100:00100000:1.0:1746147197.494512:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309946496 00000100:00100000:1.0:1746147197.494527:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18729 00000100:00100000:1.0:1746147197.494534:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967309945856:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147197.494644:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967309945856:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 110us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.494696:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18730 00000100:00100000:0.0:1746147197.494705:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967309946112:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147197.494712:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18729 00000100:00100000:1.0:1746147197.494727:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18731 00000100:00100000:1.0:1746147197.494730:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967309946368:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147197.494746:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967309946112:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 42us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.494751:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18730 00000100:00100000:1.0:1746147197.494754:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967309946368:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 24us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.494759:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18731 00000100:00100000:0.0:1746147197.494762:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18732 00000100:00100000:1.0:1746147197.494766:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18733 00000100:00100000:0.0:1746147197.494766:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309945984:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147197.494769:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309946496:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147197.494790:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309945984:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 24us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.494791:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309946496:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 21us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.494795:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18732 00000100:00100000:1.0:1746147197.494797:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18733 00000100:00100000:0.0:1746147197.494802:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18734 00000100:00100000:0.0:1746147197.494806:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309946240:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147197.494835:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309946240:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.494840:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18734 00000100:00100000:0.0:1746147197.497080:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.497147:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.497162:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.497173:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.497184:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.497207:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.497664:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18738 00000100:00100000:1.0:1746147197.497673:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18739 00000100:00100000:1.0:1746147197.497678:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967309947008:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147197.497985:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309947008:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 303us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.497991:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18739 00000100:00100000:1.0:1746147197.498013:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967309946752:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147197.498049:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967309946752:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 379us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.498055:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18738 00000100:00100000:0.0:1746147197.500249:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.500298:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309947392 00000100:00100000:1.0:1746147197.500305:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309947392 00000100:00100000:1.0:1746147197.500350:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18741 00000100:00100000:1.0:1746147197.500357:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967309947392:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:1.0:1746147197.500550:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147197.500554:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147197.500556:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147197.500558:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147197.500560:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746147197.500605:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967309947392:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 248us (364us total) trans 17179875010 rc 0/0 00000100:00100000:1.0:1746147197.500611:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18741 00000100:00100000:0.0:1746147197.503682:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.503781:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309947520 00000100:00100000:1.0:1746147197.503789:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309947520 00000100:00100000:1.0:1746147197.503839:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18742 00000100:00100000:1.0:1746147197.503846:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013232ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967309947520:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:1.0:1746147197.504052:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147197.504055:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147197.504058:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147197.504060:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147197.504062:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:1.0:1746147197.504510:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013232ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967309947520:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 663us (836us total) trans 21474842377 rc 0/0 00000100:00100000:1.0:1746147197.504517:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18742 00000100:00100000:0.0:1746147197.511868:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.511920:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.511949:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.511965:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.512008:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.512083:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309948032 00000100:00100000:1.0:1746147197.512120:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309948032 00000100:00100000:1.0:1746147197.512892:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6844 00000100:00100000:1.0:1746147197.512898:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013232ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967309948416:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147197.512922:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425060046 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.512929:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.512930:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.512932:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425060046 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.512945:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425060046 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.513659:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6845 00000100:00100000:1.0:1746147197.513667:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967309948800:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147197.513683:0:9589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880096d48c00/0x313993942506004d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.513690:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.513691:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.513694:0:9589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d48c00/0x313993942506004d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.513701:0:9589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d48c00/0x313993942506004d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147197.513924:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6846 00000100:00100000:0.0:1746147197.513934:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013232ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967309948032:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147197.513952:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880096d90200/0x3139939425060054 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.513959:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.513960:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.513963:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d90200/0x3139939425060054 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.513971:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d90200/0x3139939425060054 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.516209:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309949056 00000100:00100000:1.0:1746147197.516217:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309949056 00000100:00100000:1.0:1746147197.516264:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6847 00000100:00100000:1.0:1746147197.516271:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967309949056:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147197.516292:0:13302:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880096d48000/0x3139939425060062 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.516302:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.516303:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.516307:0:13302:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d48000/0x3139939425060062 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.516320:0:13302:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d48000/0x3139939425060062 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147197.518180:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.518219:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.519673:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6849 00000100:00100000:1.0:1746147197.519680:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967309949568:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147197.519705:0:29479:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880096d49e00/0x3139939425060070 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.519718:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.519720:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.519725:0:29479:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d49e00/0x3139939425060070 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.519735:0:29479:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d49e00/0x3139939425060070 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.528429:0:29477:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425060046 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.528447:0:29477:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425060046 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.528455:0:29477:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425060046 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.528461:0:29477:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d49400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147197.528464:0:29477:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425060046 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.528471:0:29477:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425060046 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.528487:0:29477:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425060046 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.528492:0:29477:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x3139939425060046 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.528560:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013232ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967309948416:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 15657us (16589us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147197.528570:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6844 00010000:00010000:1.0:1746147197.534361:0:9589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880096d48c00/0x313993942506004d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.534377:0:9589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096d48c00/0x313993942506004d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.534385:0:9589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096d48c00/0x313993942506004d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.534393:0:9589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d48c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147197.534397:0:9589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d48c00/0x313993942506004d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.534405:0:9589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d48c00/0x313993942506004d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.534429:0:9589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096d48c00/0x313993942506004d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.534435:0:9589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d48c00/0x313993942506004d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.534527:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967309948800:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 20855us (22512us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147197.534537:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6845 00010000:00010000:0.0:1746147197.562355:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009844a600/0x3139939425060069 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.562373:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009844a600/0x3139939425060069 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.562381:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009844a600/0x3139939425060069 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.562388:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844a600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147197.562392:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009844a600/0x3139939425060069 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.562401:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009844a600/0x3139939425060069 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.562419:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009844a600/0x3139939425060069 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.562426:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009844a600/0x3139939425060069 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147197.563299:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967309949440:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 43617us (45116us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147197.563309:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6848 00010000:00010000:1.0:1746147197.564572:0:29479:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880096d49e00/0x3139939425060070 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.564584:0:29479:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096d49e00/0x3139939425060070 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.564591:0:29479:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096d49e00/0x3139939425060070 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.564597:0:29479:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d49e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147197.564601:0:29479:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d49e00/0x3139939425060070 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.564608:0:29479:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d49e00/0x3139939425060070 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.564623:0:29479:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096d49e00/0x3139939425060070 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.564634:0:29479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d49e00/0x3139939425060070 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.564703:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967309949568:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 45020us (46480us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147197.564712:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6849 00000100:00100000:0.0:1746147197.572582:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.572729:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309949824 00000100:00100000:1.0:1746147197.572739:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309949824 00000100:00100000:1.0:1746147197.572802:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16214 00000100:00100000:1.0:1746147197.572811:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2404:x1830967309949824:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:1.0:1746147197.572864:0:7238:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.572891:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x313993942506000e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6b5 expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.572921:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.572926:0:7238:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147197.572973:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425060077 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.572985:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425060077 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.572993:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425060077 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00010000:1.0:1746147197.573118:0:7238:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800909fb800 reply state ffff880097d21000 transno 8589937053 ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425060077 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.573131:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425060077 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.573136:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.573138:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746147197.573140:0:7238:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746147197.573214:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2404:x1830967309949824:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 403us (641us total) trans 8589937053 rc 0/0 00000100:00100000:1.0:1746147197.573220:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16214 00000100:00100000:0.0:1746147197.575555:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.575720:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.576009:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.576121:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.576405:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.576568:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309950080 00000100:00100000:1.0:1746147197.576578:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309950080 00000100:00100000:1.0:1746147197.576592:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309950336 00000100:00100000:1.0:1746147197.576595:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309950336 00000100:00100000:1.0:1746147197.576637:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309950592 00000100:00100000:1.0:1746147197.576640:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309950592 00000100:00100000:1.0:1746147197.576653:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309949952 00000100:00100000:1.0:1746147197.576655:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309949952 00000100:00100000:1.0:1746147197.576672:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18743 00000100:00100000:1.0:1746147197.576680:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2003:x1830967309950336:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147197.576816:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147197.576819:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147195 -> 1746147197 00002000:00010000:1.0:1746147197.576822:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147195 -> 1746147197 00002000:00010000:1.0:1746147197.576824:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147195 -> 1746147197 00002000:00010000:1.0:1746147197.576826:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147197.576868:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967309950336:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 189us (1147us total) trans 21474842378 rc 0/0 00000100:00100000:1.0:1746147197.576875:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18743 00000100:00100000:1.0:1746147197.576889:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18744 00000100:00100000:1.0:1746147197.576894:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967309950592:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147197.576967:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147197.576970:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.576972:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147196 -> 1746147197 00002000:00010000:1.0:1746147197.576973:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.576975:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746147197.576992:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2003:x1830967309950592:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 97us (983us total) trans 17179875011 rc 0/0 00000100:00100000:1.0:1746147197.576997:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18744 00000100:00100000:1.0:1746147197.577006:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18745 00000100:00100000:1.0:1746147197.577011:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2003:x1830967309949952:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147197.577048:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147197.577051:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147196 -> 1746147197 00002000:00010000:1.0:1746147197.577052:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147196 -> 1746147197 00002000:00010000:1.0:1746147197.577054:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147196 -> 1746147197 00002000:00010000:1.0:1746147197.577056:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:1.0:1746147197.577072:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967309949952:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 60us (985us total) trans 21474842379 rc 0/0 00000100:00100000:1.0:1746147197.577078:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18745 00000100:00100000:1.0:1746147197.577125:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18746 00000100:00100000:1.0:1746147197.577130:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967309950080:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147197.577172:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147197.577174:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147196 -> 1746147197 00002000:00010000:1.0:1746147197.577176:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147196 -> 1746147197 00002000:00010000:1.0:1746147197.577179:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147196 -> 1746147197 00002000:00010000:1.0:1746147197.577180:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147197.577197:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2003:x1830967309950080:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 67us (1651us total) trans 17179875012 rc 0/0 00000100:00100000:1.0:1746147197.577202:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18746 00000100:00100000:0.0:1746147197.577393:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.580312:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.580702:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309950848 00000100:00100000:1.0:1746147197.580711:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309950848 00000100:00100000:1.0:1746147197.581413:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6002 00000100:00100000:1.0:1746147197.581421:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2404:x1830967309950848:12345-192.168.204.25@tcp:35:lfs.0 00000004:00010000:1.0:1746147197.581479:0:7241:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x30:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f800/0x313993942505ffc1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6a7 expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.581527:0:7241:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3a00/0x313993942506007e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7241 initiator: MDT0 00010000:00010000:1.0:1746147197.581538:0:7241:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425060000 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6ae expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.581544:0:7241:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3a00/0x313993942506007e lrc: 4/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7241 initiator: MDT0 00010000:00010000:1.0:1746147197.581573:0:7241:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425060000 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6ae expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.581583:0:7241:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425060000 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6ae expref: 10 pid: 7237 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.581597:0:7241:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7241:1830967311296896:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147197.581682:0:7241:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009908dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147197.584582:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.585190:0:7241:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7241:1830967311296896:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147197.585218:0:7241:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3a00/0x313993942506007e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7241 initiator: MDT0 00010000:00010000:1.0:1746147197.585968:0:7241:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3a00/0x313993942506007e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7241 initiator: MDT0 00010000:00010000:1.0:1746147197.585975:0:7241:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3a00/0x313993942506007e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7241 initiator: MDT0 00000040:00080000:1.0:1746147197.586265:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1090, 88 off103760 00000004:00080000:1.0:1746147197.586271:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 735576180743ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147197.586308:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1108, 88 off105344 00000004:00080000:1.0:1746147197.586312:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 735576222325ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147197.586324:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1109, 88 off105432 00000004:00080000:1.0:1746147197.586326:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 735576236833ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147197.586333:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1091, 88 off103848 00000004:00080000:1.0:1746147197.586338:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 735576248078ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147197.586356:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1092, 88 off103936 00000004:00080000:1.0:1746147197.586359:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 735576269865ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147197.586368:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1110, 88 off105520 00000004:00080000:1.0:1746147197.586371:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 735576281490ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147197.586379:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1111, 88 off105608 00000004:00080000:1.0:1746147197.586381:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 735576291968ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147197.586389:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1112, 88 off105696 00000004:00080000:1.0:1746147197.586391:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 735576301923ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147197.586399:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1093, 88 off104024 00000004:00080000:1.0:1746147197.586402:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 735576312121ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147197.586409:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1113, 88 off105784 00000004:00080000:1.0:1746147197.586412:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 735576322581ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147197.586419:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1094, 88 off104112 00000004:00080000:1.0:1746147197.586422:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 735576332448ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147197.586429:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1114, 88 off105872 00000004:00080000:1.0:1746147197.586431:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 735576341725ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147197.586438:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1095, 88 off104200 00000004:00080000:1.0:1746147197.586440:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 735576350693ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147197.586447:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1096, 88 off104288 00000004:00080000:1.0:1746147197.586449:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 735576359770ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147197.586456:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1097, 88 off104376 00000004:00080000:1.0:1746147197.586458:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 735576368981ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147197.586465:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1098, 88 off104464 00000004:00080000:1.0:1746147197.586468:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 735576378446ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147197.586476:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1115, 88 off105960 00000004:00080000:1.0:1746147197.586478:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 735576388730ns, next at 694367916532ns, rc = 0 00010000:00010000:1.0:1746147197.589835:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425060077 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.589847:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425060077 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.589854:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425060077 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.589859:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982a3200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147197.589863:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425060077 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.589869:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425060077 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.589889:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.589892:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147197.589895:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425060077 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.589909:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3200/0x3139939425060077 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00000004:00010000:1.0:1746147197.589959:0:7241:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800909f9c00 reply state ffff88009a96a800 transno 8589937054 ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3a00/0x313993942506007e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7241 initiator: MDT0 00010000:00010000:1.0:1746147197.589969:0:7241:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3a00/0x313993942506007e lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7241 initiator: MDT0 00010000:00010000:1.0:1746147197.589976:0:7241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.589977:0:7241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746147197.589980:0:7241:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746147197.589986:0:7241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.589987:0:7241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147197.589994:0:7241:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f800/0x313993942505ffc1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6a7 expref: 7 pid: 7238 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147197.590043:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311297408:0@lo:2:osp-syn-1-0.0 00010000:00080000:1.0:1746147197.590079:0:7241:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746147197.590104:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2404:x1830967309950848:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 8668us (9784us total) trans 8589937054 rc 0/0 00000100:00100000:0.0:1746147197.590105:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147197.590115:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6002 00000100:00100000:0.0:1746147197.590132:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311297920:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746147197.590137:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3a00/0x313993942506007e lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7241 initiator: MDT0 00010000:00010000:1.0:1746147197.590142:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3a00/0x313993942506007e lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7241 initiator: MDT0 00000100:00100000:0.0:1746147197.590145:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746147197.590151:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3a00/0x313993942506007e lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7241 initiator: MDT0 00010000:00010000:1.0:1746147197.590155:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982a3a00 already unused, calling callback (ffffffffa0efd690) 00000100:00100000:0.0:1746147197.590157:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00010000:00010000:1.0:1746147197.590158:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3a00/0x313993942506007e lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7241 initiator: MDT0 00000100:00100000:0.0:1746147197.590161:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311297280:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746147197.590162:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3a00/0x313993942506007e lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7241 initiator: MDT0 00010000:00010000:1.0:1746147197.590168:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.590170:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147197.590171:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3a00/0x313993942506007e lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7241 initiator: MDT0 00000100:00100000:0.0:1746147197.590171:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746147197.590175:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982a3a00/0x313993942506007e lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7241 initiator: MDT0 00000100:00100000:0.0:1746147197.590179:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311297792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147197.590188:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147197.590189:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311297408 00000100:00100000:1.0:1746147197.590195:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311297408 00000100:00100000:0.0:1746147197.590204:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311297920 00000100:00100000:0.0:1746147197.590207:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311297920 00000100:00100000:1.0:1746147197.590218:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311297280 00000100:00100000:1.0:1746147197.590220:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311297280 00000100:00100000:0.0:1746147197.590227:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311297792 00000100:00100000:0.0:1746147197.590229:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311297792 00000100:00100000:1.0:1746147197.590231:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18749 00000100:00100000:1.0:1746147197.590236:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3765:x1830967311297408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147197.590241:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18750 00000100:00100000:0.0:1746147197.590245:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3765:x1830967311297920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147197.590342:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147197.590345:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.590347:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.590349:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.590351:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746147197.590365:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3765:x1830967311297920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (218us total) trans 17179875015 rc 0/0 00000100:00100000:1.0:1746147197.590371:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3765:x1830967311297408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 136us (282us total) trans 17179875014 rc 0/0 00000100:00100000:0.0:1746147197.590371:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18750 00000100:00100000:1.0:1746147197.590377:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18749 00000100:00100000:1.0:1746147197.590386:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18751 00000100:00100000:1.0:1746147197.590390:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3765:x1830967311297792:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147197.590399:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909f9f80/2, rc 0, transno 17179875014 00000100:00100000:0.0:1746147197.590403:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311297408:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147197.590410:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098858e00/2, rc 0, transno 17179875015 00000100:00100000:0.0:1746147197.590413:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311297920:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147197.590424:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:1.0:1746147197.590426:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:1.0:1746147197.590428:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147197.590430:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:1.0:1746147197.590431:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:1.0:1746147197.590446:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3765:x1830967311297792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (257us total) trans 17179875016 rc 0/0 00000100:00100000:1.0:1746147197.590450:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18751 00000100:00100000:1.0:1746147197.590473:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18752 00000100:00100000:1.0:1746147197.590477:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3765:x1830967311297280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147197.590512:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147197.590514:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.590516:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.590518:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.590520:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746147197.590536:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3765:x1830967311297280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (364us total) trans 17179875017 rc 0/0 00000100:00100000:1.0:1746147197.590540:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18752 00000100:00100000:1.0:1746147197.590547:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311297024 00000100:00100000:1.0:1746147197.590549:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311297024 00000100:00100000:1.0:1746147197.590557:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311297536 00000100:00100000:1.0:1746147197.590559:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311297536 00000100:00100000:1.0:1746147197.591598:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311298048 00000100:00100000:1.0:1746147197.591604:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311298048 00000100:00100000:1.0:1746147197.591636:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311297152 00000100:00100000:1.0:1746147197.591638:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311297152 00000100:00100000:1.0:1746147197.591646:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311298176 00000100:00100000:1.0:1746147197.591648:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311298176 00000100:00100000:1.0:1746147197.591657:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18753 00000100:00100000:1.0:1746147197.591662:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3766:x1830967311297024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147197.591728:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147197.591731:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.591732:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.591734:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.591736:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147197.591759:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3766:x1830967311297024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (1275us total) trans 17179875018 rc 0/0 00000100:00100000:1.0:1746147197.591765:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18753 00000100:00100000:1.0:1746147197.591775:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311298688 00000100:00100000:1.0:1746147197.591778:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311298688 00000100:00100000:1.0:1746147197.591785:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311298560 00000100:00100000:1.0:1746147197.591787:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311298560 00000100:00100000:1.0:1746147197.591794:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311298304 00000100:00100000:1.0:1746147197.591795:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311298304 00000100:00100000:1.0:1746147197.591802:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311298432 00000100:00100000:1.0:1746147197.591803:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311298432 00000100:00100000:1.0:1746147197.591810:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311298944 00000100:00100000:1.0:1746147197.591812:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311298944 00000100:00100000:1.0:1746147197.591832:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18755 00000100:00100000:1.0:1746147197.591837:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3766:x1830967311298048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147197.591894:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3766:x1830967311298048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (1359us total) trans 17179875019 rc 0/0 00000100:00100000:1.0:1746147197.591914:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18755 00000100:00100000:1.0:1746147197.591923:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311297664 00000100:00100000:1.0:1746147197.591935:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311297664 00000100:00100000:1.0:1746147197.591945:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18756 00000100:00100000:1.0:1746147197.591949:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3766:x1830967311297152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147197.592016:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147197.592019:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.592020:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.592022:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.592024:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:1.0:1746147197.592045:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3766:x1830967311297152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (1477us total) trans 21474842381 rc 0/0 00000100:00100000:1.0:1746147197.592050:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18756 00000100:00100000:1.0:1746147197.592060:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18759 00000100:00100000:1.0:1746147197.592064:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3767:x1830967311298560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147197.592134:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3767:x1830967311298560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (438us total) trans 21474842384 rc 0/0 00000100:00100000:1.0:1746147197.592140:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18759 00000100:00100000:1.0:1746147197.592148:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18761 00000100:00100000:1.0:1746147197.592153:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3764:x1830967311298432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147197.592190:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746147197.592192:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147197.592194:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147197.592196:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147197.592198:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:1.0:1746147197.592215:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3764:x1830967311298432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (448us total) trans 21474842386 rc 0/0 00000100:00100000:1.0:1746147197.592220:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18761 00000100:00100000:1.0:1746147197.592228:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18763 00000100:00100000:1.0:1746147197.592232:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3764:x1830967311298944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147197.592273:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:1.0:1746147197.592275:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147197.592276:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147197.592278:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147197.592280:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:1.0:1746147197.592296:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3764:x1830967311298944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (511us total) trans 21474842388 rc 0/0 00000100:00100000:1.0:1746147197.592301:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18763 00000004:00080000:0.0:1746147197.593297:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909fb100/2, rc 0, transno 17179875017 00000100:00100000:0.0:1746147197.593302:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311297280:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147197.593310:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098858000/2, rc 0, transno 17179875016 00000100:00100000:0.0:1746147197.593312:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311297792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147197.598384:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.603428:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.603632:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309951360 00000100:00100000:1.0:1746147197.603641:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309951360 00000100:00100000:1.0:1746147197.603700:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6003 00000100:00100000:1.0:1746147197.603708:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2404:x1830967309951360:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:1.0:1746147197.603936:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2404:x1830967309951360:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 227us (518us total) trans 8589937055 rc 0/0 00000100:00100000:1.0:1746147197.603943:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6003 00000100:00100000:0.0:1746147197.628312:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.628627:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309951616 00000100:00100000:1.0:1746147197.628637:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309951616 00000100:00100000:1.0:1746147197.628699:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16216 00000100:00100000:1.0:1746147197.628707:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2414:x1830967309951616:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147197.628732:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147197.628752:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x313993942506008c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d6ed expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.628831:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425060093 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.628844:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425060093 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.628855:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425060093 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.628868:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x313993942506009a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.628873:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x313993942506009a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.628879:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x313993942506009a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.628998:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x31399394250600a1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.629006:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x31399394250600a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.629012:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x31399394250600a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147197.629020:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147197.629131:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425060093 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.629137:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425060093 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.629147:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425060093 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.629157:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425060093 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.629163:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d99400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147197.629167:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425060093 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.629173:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425060093 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.629184:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147197.629187:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147197.629191:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425060093 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.629196:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425060093 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.629221:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x313993942506009a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.629226:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x313993942506009a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.629231:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x313993942506009a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.629235:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d99600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147197.629237:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x313993942506009a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.629245:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x313993942506009a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.629250:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d4c7f00) 00010000:00010000:1.0:1746147197.629252:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147197.629254:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x313993942506009a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.629259:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x313993942506009a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147197.629306:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x313993942506008c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6ed expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.629317:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x31399394250600a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6ed expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.629324:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.629325:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147197.629328:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99c00, rc 0) 00000100:00100000:1.0:1746147197.631755:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2414:x1830967309951616:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3036us (3442us total) trans 8589937056 rc 0/0 00000100:00100000:1.0:1746147197.631766:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16216 00000100:00100000:0.0:1746147197.635038:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.635952:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.639206:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.639390:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.639456:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309952384 00000100:00100000:0.0:1746147197.639462:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309952384 00010000:00010000:0.0:1746147197.639495:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x31399394250600a1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6ed expref: 11 pid: 7238 timeout: 835 lvb_type: 0 00000100:00100000:0.0:1746147197.639521:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8480 00000100:00100000:0.0:1746147197.639528:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2002:x1830967309952384:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147197.639540:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147197.639545:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x31399394250600a1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6ed expref: 11 pid: 7238 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746147197.639556:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x31399394250600a1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6ed expref: 11 pid: 7238 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746147197.639577:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147197.639582:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250600bd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147197.639590:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250600bd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147197.639595:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250600bd lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147197.639612:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147197.639643:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2002:x1830967309952384:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 115us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.639649:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8480 00000100:00100000:0.0:1746147197.642239:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.642339:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309952640 00000100:00100000:1.0:1746147197.642352:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309952640 00002000:00100000:1.0:1746147197.642387:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff8801349a0a80 x1830967309952640/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:573/0 lens 488/0 e 0 to 0 dl 1746147208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147197.642396:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a0a80 with x1830967309952640 ext(0->1048575) 00002000:00010000:1.0:1746147197.642402:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a0a80 00000100:00100000:1.0:1746147197.642425:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6850 00000100:00100000:1.0:1746147197.642431:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967309952640:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147197.649238:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.653066:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.653319:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.658648:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.658715:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.659945:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8482 00000100:00100000:1.0:1746147197.659951:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2001:x1830967309953408:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.659958:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.659961:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7000/0x3139939425060085 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6e6 expref: 8 pid: 7237 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.659971:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7000/0x3139939425060085 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6e6 expref: 8 pid: 7237 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.660086:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7000/0x3139939425060085 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6e6 expref: 8 pid: 7237 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.660672:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147197.660676:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.660729:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2001:x1830967309953408:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 778us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.660736:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8482 00000100:00100000:0.0:1746147197.661675:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.661754:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309953664 00000100:00100000:1.0:1746147197.661759:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309953664 00000100:00100000:1.0:1746147197.661795:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18768 00000100:00100000:1.0:1746147197.661800:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2414:x1830967309953664:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147197.661815:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147197.661829:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x3139939425060126 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d71e expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.661849:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.661851:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.661857:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x3139939425060126 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d71e expref: 8 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.661870:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x3139939425060126 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d71e expref: 8 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.661879:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982a3200, rc 0) 00000100:00100000:1.0:1746147197.661910:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2414:x1830967309953664:12345-192.168.204.25@tcp:101:cat.0 Request processed in 98us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.661915:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18768 00000100:00100000:0.0:1746147197.664444:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16222 00000100:00100000:0.0:1746147197.664451:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2414:x1830967309953920:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147197.664462:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147197.664467:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80600/0x3139939425060134 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d72c expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.664487:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80600/0x3139939425060134 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d72c expref: 11 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.664496:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80600/0x3139939425060134 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d72c expref: 11 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.664523:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147197.664525:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147197.664527:0:7237:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506012d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d725 expref: 32 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.664532:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80600, rc 0) 00000100:00100000:0.0:1746147197.664678:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2414:x1830967309953920:12345-192.168.204.25@tcp:101:cat.0 Request processed in 226us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147197.664683:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16222 00000001:00080000:0.0:1746147197.665871:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937060 is committed 00000004:00080000:0.0:1746147197.665880:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1102 committed 00000004:00080000:0.0:1746147197.666301:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1089 committed 00000004:00080000:0.0:1746147197.666330:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1088 committed 00000004:00080000:0.0:1746147197.666333:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1087 committed 00000004:00080000:0.0:1746147197.666335:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1086 committed 00000004:00080000:0.0:1746147197.666336:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1101 committed 00000004:00080000:0.0:1746147197.666338:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1085 committed 00000004:00080000:0.0:1746147197.666340:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1100 committed 00000004:00080000:0.0:1746147197.666341:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1084 committed 00000004:00080000:0.0:1746147197.666343:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1099 committed 00000004:00080000:0.0:1746147197.666344:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1098 committed 00000004:00080000:0.0:1746147197.666346:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1097 committed 00000004:00080000:0.0:1746147197.666347:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1083 committed 00000004:00080000:0.0:1746147197.666348:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1082 committed 00000004:00080000:0.0:1746147197.666350:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1096 committed 00000004:00080000:0.0:1746147197.666351:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1095 committed 00000004:00080000:0.0:1746147197.666352:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1081 committed 00000001:00080000:0.0:1746147197.666358:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937058 is committed 00000001:00080000:0.0:1746147197.666368:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937055 is committed 00000100:00100000:0.0:1746147197.666994:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311299712 00000100:00100000:0.0:1746147197.666999:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311299712 00000100:00100000:0.0:1746147197.667023:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311300736 00000100:00100000:0.0:1746147197.667025:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311300736 00000100:00100000:0.0:1746147197.667104:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311301248 00000100:00100000:0.0:1746147197.667106:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311301248 00000100:00100000:0.0:1746147197.667117:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311300480 00000100:00100000:0.0:1746147197.667118:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311300480 00000100:00100000:0.0:1746147197.667126:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311299840 00000100:00100000:0.0:1746147197.667127:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311299840 00000100:00100000:0.0:1746147197.667136:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18769 00000100:00100000:0.0:1746147197.667141:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3764:x1830967311299712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147197.667217:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18771 00000100:00100000:1.0:1746147197.667227:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18772 00000100:00100000:1.0:1746147197.667232:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3766:x1830967311299968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147197.667287:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18773 00000100:00100000:1.0:1746147197.667291:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3764:x1830967311301248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147197.667358:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3764:x1830967311301248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (433us total) trans 21474842390 rc 0/0 00000100:00100000:1.0:1746147197.667364:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18773 00000100:00100000:1.0:1746147197.667372:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18775 00000100:00100000:1.0:1746147197.667376:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3764:x1830967311299840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147197.667406:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147197.667408:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.667411:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.667413:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.667415:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746147197.667429:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3764:x1830967311299840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (473us total) trans 17179875025 rc 0/0 00000100:00100000:1.0:1746147197.667433:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18775 00002000:00010000:1.0:1746147197.667455:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147197.667457:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147197.667459:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147197.667460:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147197.667462:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746147197.667473:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3766:x1830967311299968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 243us (578us total) trans 17179875023 rc 0/0 00000100:00100000:1.0:1746147197.667478:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18772 00000100:00100000:1.0:1746147197.667487:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3764:x1830967311300736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147197.667523:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147197.667525:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.667527:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.667528:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147197.667530:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147197.667544:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3764:x1830967311300736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 322us (658us total) trans 21474842391 rc 0/0 00000100:00100000:1.0:1746147197.667548:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18771 00002000:00010000:0.0:1746147197.667606:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147197.667608:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147197 -> 1746147197 00002000:00010000:0.0:1746147197.667610:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147197 -> 1746147197 00002000:00010000:0.0:1746147197.667612:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147197 -> 1746147197 00002000:00010000:0.0:1746147197.667613:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746147197.667631:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3764:x1830967311299712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 491us (819us total) trans 17179875026 rc 0/0 00000100:00100000:0.0:1746147197.667636:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18769 00000100:00100000:0.0:1746147197.670001:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.675073:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.675526:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309954176 00000100:00100000:1.0:1746147197.675535:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309954176 00000100:00100000:1.0:1746147197.675613:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6005 00000100:00100000:1.0:1746147197.675626:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909c6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2416:x1830967309954176:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:1.0:1746147197.676053:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909c6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2416:x1830967309954176:12345-192.168.204.25@tcp:49:cat.0 Request processed in 428us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.676060:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6005 00000100:00100000:0.0:1746147197.680299:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.686755:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309954816 00000100:00100000:0.0:1746147197.686761:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309954816 00002000:00100000:0.0:1746147197.686796:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880094526a00 x1830967309954816/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:573/0 lens 488/0 e 0 to 0 dl 1746147208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147197.686806:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094526a00 with x1830967309954816 ext(0->1048575) 00002000:00010000:0.0:1746147197.686812:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094526a00 00000100:00100000:0.0:1746147197.686833:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6852 00000100:00100000:0.0:1746147197.686840:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967309954816:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147197.699580:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.700631:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967309954816:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 13789us (14267us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147197.700641:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6852 00002000:00100000:1.0:1746147197.700650:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880094526a00 x1830967309954816/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:573/0 lens 488/440 e 0 to 0 dl 1746147208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147197.700659:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094526a00 with x1830967309954816 ext(0->1048575) 00002000:00010000:1.0:1746147197.700663:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094526a00 00000100:00100000:0.0:1746147197.702595:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.708969:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.709159:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309955328 00000100:00100000:1.0:1746147197.709168:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309955328 00002000:00100000:1.0:1746147197.709216:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (4169728->4173823) req@ffff8800a5574a80 x1830967309955328/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:573/0 lens 488/0 e 0 to 0 dl 1746147208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147197.709227:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5574a80 with x1830967309955328 ext(4169728->4173823) 00002000:00010000:1.0:1746147197.709233:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5574a80 00000100:00100000:1.0:1746147197.709800:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6853 00000100:00100000:1.0:1746147197.709809:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967309955328:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147197.710545:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967309955328:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 734us (1584us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147197.710552:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6853 00002000:00100000:1.0:1746147197.710559:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (4169728->4173823) req@ffff8800a5574a80 x1830967309955328/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:573/0 lens 488/4536 e 0 to 0 dl 1746147208 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147197.710572:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5574a80 with x1830967309955328 ext(4169728->4173823) 00002000:00010000:1.0:1746147197.710576:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5574a80 00000100:00100000:0.0:1746147197.711177:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.717221:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.718929:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.731776:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.735007:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309956352 00000100:00100000:0.0:1746147197.735012:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309956352 00000100:00100000:0.0:1746147197.735043:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18790 00000100:00100000:0.0:1746147197.735049:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2414:x1830967309956352:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147197.735061:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147197.735071:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425060157 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d74f expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.735086:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.735101:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147197.735106:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425060157 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d74f expref: 17 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.735116:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425060157 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d74f expref: 17 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147197.735124:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fe000, rc 0) 00000100:00100000:1.0:1746147197.748232:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.748285:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.748356:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309956736 00000100:00100000:0.0:1746147197.748368:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309956736 00002000:00100000:0.0:1746147197.748468:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (4448256->4452351) req@ffff880099010000 x1830967309956736/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:573/0 lens 488/0 e 0 to 0 dl 1746147208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147197.748478:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099010000 with x1830967309956736 ext(4448256->4452351) 00002000:00010000:0.0:1746147197.748483:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099010000 00000100:00100000:0.0:1746147197.748514:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309956864 00000100:00100000:0.0:1746147197.748517:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309956864 00002000:00100000:0.0:1746147197.748530:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099010380 x1830967309956864/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:573/0 lens 488/0 e 0 to 0 dl 1746147208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147197.748536:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099010380 with x1830967309956864 ext(1048576->2097151) 00002000:00010000:0.0:1746147197.748539:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099010380 00000100:00100000:0.0:1746147197.748553:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6857 00000100:00100000:0.0:1746147197.748559:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2003:x1830967309956864:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147197.752558:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.756342:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.756568:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309957248 00000100:00100000:1.0:1746147197.756576:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309957248 00000100:00100000:1.0:1746147197.756626:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6006 00000100:00100000:1.0:1746147197.756634:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2412:x1830967309957248:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147197.759294:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2412:x1830967309957248:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 2651us (2963us total) trans 8589937061 rc 0/0 00000100:00100000:1.0:1746147197.759305:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6006 00000100:00100000:0.0:1746147197.766324:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147197.772285:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147197.776792:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.779326:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.779499:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309957760 00000100:00100000:1.0:1746147197.779506:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309957760 00000100:00100000:1.0:1746147197.779540:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18793 00000100:00100000:1.0:1746147197.779546:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967309957760:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147197.779554:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147197.779566:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x313993942506016c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d764 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.779593:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311302656:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147197.779636:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147197.781840:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.786445:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311302656:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147197.786474:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x313993942506016c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d764 expref: 10 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147197.786486:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x313993942506016c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d764 expref: 10 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147197.786514:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33400, rc 0) 00000100:00100000:1.0:1746147197.786548:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967309957760:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7001us (7232us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147197.786555:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18793 00000100:00100000:0.0:1746147197.792143:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.792218:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309958016 00000100:00100000:1.0:1746147197.792231:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309958016 00000100:00100000:1.0:1746147197.792398:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18795 00000100:00100000:1.0:1746147197.792407:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2414:x1830967309958016:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147197.792428:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147197.792447:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x313993942506017a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d772 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.792478:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7a00/0x3139939425060149 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4452351) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d741 expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.792487:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147197.792489:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147197.792492:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x313993942506017a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d772 expref: 18 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.792526:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e7a00/0x3139939425060149 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4452351) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d741 expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.792542:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958e7a00/0x3139939425060149 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4452351) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d741 expref: 31 pid: 9585 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.792556:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311302784:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147197.793625:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147197.794705:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.800740:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.800780:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309958400 00000100:00100000:0.0:1746147197.800789:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309958400 00002000:00100000:0.0:1746147197.800833:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4452351) req@ffff8801322e9f80 x1830967309958400/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:573/0 lens 488/0 e 0 to 0 dl 1746147208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147197.800849:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801322e9f80 with x1830967309958400 ext(4194304->4452351) 00010000:00010000:0.0:1746147197.800859:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7a00/0x3139939425060149 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4452351) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d741 expref: 34 pid: 9585 timeout: 835 lvb_type: 0 00010000:00010000:0.0:1746147197.800873:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800958e7a00/0x3139939425060149 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4452351) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d741 expref: 34 pid: 9585 timeout: 835 lvb_type: 0 00002000:00010000:0.0:1746147197.800880:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801322e9f80 00000100:00100000:0.0:1746147197.800917:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1590 00000100:00100000:0.0:1746147197.800925:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967309958400:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147197.819622:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.826542:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.827846:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.841292:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.849429:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.849581:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.850402:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.850456:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309959296 00000100:00100000:1.0:1746147197.850460:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309959296 00010000:00010000:1.0:1746147197.850479:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425060173 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d76b expref: 34 pid: 1398 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.850506:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8486 00000100:00100000:1.0:1746147197.850512:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967309959296:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.850521:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.850538:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425060173 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d76b expref: 34 pid: 1398 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.850547:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425060173 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d76b expref: 34 pid: 1398 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.850657:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099055a00/0x3139939425060173 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d76b expref: 34 pid: 1398 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.850982:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.851235:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967309959296:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 488us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.851244:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8486 00000100:00100000:0.0:1746147197.853134:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.853203:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.853802:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309959680 00000100:00100000:1.0:1746147197.853805:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309959680 00010000:00010000:1.0:1746147197.853823:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425060157 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d74f expref: 19 pid: 9586 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.853840:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8488 00000100:00100000:1.0:1746147197.853846:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2002:x1830967309959680:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.853857:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.853875:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425060157 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d74f expref: 19 pid: 9586 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.853883:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425060157 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d74f expref: 19 pid: 9586 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.853914:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe000/0x3139939425060157 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d74f expref: 19 pid: 9586 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.853926:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.853928:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147197.853934:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7a00/0x3139939425060188 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d780 expref: 18 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.853941:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e7a00/0x3139939425060188 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d780 expref: 18 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147197.853977:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e7a00/0x3139939425060188 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d780 expref: 18 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147197.853989:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311303552:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147197.854042:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147197.856920:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.856949:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311303552:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147197.856970:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.856994:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967309959680:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3148us (3790us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.857012:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8488 00000100:00100000:0.0:1746147197.877011:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.899197:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.900196:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309960704 00000100:00100000:1.0:1746147197.900206:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309960704 00010000:00010000:1.0:1746147197.900244:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x313993942506017a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d772 expref: 19 pid: 13695 timeout: 835 lvb_type: 0 00000100:00100000:1.0:1746147197.900288:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8489 00000100:00100000:1.0:1746147197.900296:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2000:x1830967309960704:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147197.900308:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147197.900326:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x313993942506017a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d772 expref: 19 pid: 13695 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.900338:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x313993942506017a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d772 expref: 19 pid: 13695 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.900367:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x313993942506017a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d772 expref: 19 pid: 13695 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.900397:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147197.900441:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967309960704:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 146us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147197.900446:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8489 00000100:00100000:0.0:1746147197.918152:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.920361:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.927992:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.930225:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.931375:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.943110:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967309961600:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11213us (11714us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147197.943118:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6864 00002000:00100000:0.0:1746147197.943125:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3145727) req@ffff8801312eed80 x1830967309961600/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:573/0 lens 488/440 e 0 to 0 dl 1746147208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147197.943133:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312eed80 with x1830967309961600 ext(2097152->3145727) 00002000:00010000:0.0:1746147197.943137:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312eed80 00000100:00100000:0.0:1746147197.951322:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.951356:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.951670:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309961984 00000100:00100000:1.0:1746147197.951681:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309961984 00002000:00100000:1.0:1746147197.951726:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8801322e9f80 x1830967309961984/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:573/0 lens 488/0 e 0 to 0 dl 1746147208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147197.951737:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801322e9f80 with x1830967309961984 ext(3145728->4194303) 00002000:00010000:1.0:1746147197.951743:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801322e9f80 00000100:00100000:1.0:1746147197.951770:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309962112 00000100:00100000:1.0:1746147197.951773:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309962112 00002000:00100000:1.0:1746147197.951789:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff8801322eb100 x1830967309962112/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:573/0 lens 488/0 e 0 to 0 dl 1746147208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147197.951795:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801322eb100 with x1830967309962112 ext(3145728->4194303) 00002000:00010000:1.0:1746147197.951798:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801322eb100 00000100:00100000:1.0:1746147197.951811:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6865 00000100:00100000:1.0:1746147197.951817:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967309961984:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147197.953650:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.973881:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147197.976774:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967309961984:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 24952us (25458us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147197.976789:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6865 00002000:00100000:1.0:1746147197.976799:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8801322e9f80 x1830967309961984/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:573/0 lens 488/440 e 0 to 0 dl 1746147208 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147197.976808:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801322e9f80 with x1830967309961984 ext(3145728->4194303) 00010000:00010000:1.0:1746147197.976814:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f239e00/0x3139939425060196 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2367487) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d78e expref: 18 pid: 13695 timeout: 835 lvb_type: 0 00010000:00010000:1.0:1746147197.976827:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f239e00/0x3139939425060196 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2367487) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d78e expref: 18 pid: 13695 timeout: 835 lvb_type: 0 00002000:00010000:1.0:1746147197.976834:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801322e9f80 00000100:00100000:0.0:1746147197.986703:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147197.998048:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.004223:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.014923:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.017482:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.022777:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:1.0:1746147198.023563:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147198.025901:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.025939:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.026481:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6869 00000100:00100000:1.0:1746147198.026488:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967309964160:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147198.030509:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.030706:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:1.0:1746147198.034783:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147198.046478:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.046547:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.046698:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18806 00000100:00100000:1.0:1746147198.046706:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967309964800:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147198.046714:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147198.046721:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098226800/0x31399394250601ea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d7c6 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147198.046746:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311304960:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147198.046784:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147198.047612:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147198.047733:0:13695:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff8801312eea00 x1830967311304960) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800958e7a00/0x3139939425060188 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1314816->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d780 expref: 23 pid: 13695 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.047759:0:13695:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958e7a00/0x3139939425060188 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1314816->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d780 expref: 24 pid: 13695 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746147198.047780:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311304960:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147198.047797:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.047799:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.047806:0:13695:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x31399394250601dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1564672->1982463) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7b8 expref: 35 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.047815:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x31399394250601dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1564672->1982463) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7b8 expref: 35 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.047836:0:13695:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x31399394250601dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1564672->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7b8 expref: 35 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147198.047844:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311305088:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147198.048523:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147198.050853:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.051664:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311305088:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147198.051703:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098226800/0x31399394250601ea lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7c6 expref: 22 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147198.051721:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098226800/0x31399394250601ea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7c6 expref: 22 pid: 13695 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147198.051753:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147198.051854:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098226800, rc 0) 00000100:00100000:0.0:1746147198.051948:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967309964800:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5242us (5400us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147198.051955:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18806 00000100:00100000:1.0:1746147198.056451:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.056517:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309965568 00000100:00100000:0.0:1746147198.056525:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309965568 00000100:00100000:0.0:1746147198.056564:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18807 00000100:00100000:0.0:1746147198.056570:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967309965568:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147198.056584:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147198.056602:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091dcec00/0x31399394250601f1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d7cd expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147198.056658:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311305216:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147198.056724:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147198.059425:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.060809:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311305216:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147198.060845:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091dcec00/0x31399394250601f1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7cd expref: 22 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147198.060862:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091dcec00/0x31399394250601f1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7cd expref: 22 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147198.060876:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091dcec00, rc 0) 00000100:00100000:1.0:1746147198.061518:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967309965568:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4946us (5077us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147198.061526:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18807 00000100:00100000:0.0:1746147198.064641:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.064690:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309966080 00000100:00100000:1.0:1746147198.064699:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309966080 00000100:00100000:1.0:1746147198.064749:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309966336 00000100:00100000:1.0:1746147198.064751:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309966336 00000100:00100000:1.0:1746147198.064766:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6007 00000100:00100000:1.0:1746147198.064773:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2416:x1830967309966080:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147198.064978:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2416:x1830967309966080:12345-192.168.204.25@tcp:35:cat.0 Request processed in 205us (583us total) trans 8589937063 rc 0/0 00000100:00100000:1.0:1746147198.064985:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6007 00000100:00100000:1.0:1746147198.064998:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6008 00000100:00100000:1.0:1746147198.065003:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2419:x1830967309966336:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147198.065057:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2419:x1830967309966336:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 53us (415us total) trans 8589937064 rc 0/0 00000100:00100000:1.0:1746147198.065062:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6008 00000100:00100000:0.0:1746147198.068581:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:1.0:1746147198.069767:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147198.126975:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.134956:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.146079:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.146442:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309967232 00000100:00100000:1.0:1746147198.146452:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309967232 00000100:00100000:1.0:1746147198.146511:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18808 00000100:00100000:1.0:1746147198.146519:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2425:x1830967309967232:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147198.146538:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147198.146559:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x313993942506021b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d7db expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.146590:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd800/0x31399394250601a4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d79c expref: 33 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.146599:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094009800/0x31399394250601d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7b1 expref: 22 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.146605:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.146607:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.146610:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x313993942506021b lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3211264->3289087] (req 3211264->3289087) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7db expref: 22 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.146641:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094009800/0x31399394250601d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7b1 expref: 22 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.146653:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094009800/0x31399394250601d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7b1 expref: 22 pid: 1398 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746147198.146670:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311305344:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147198.148635:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd800/0x31399394250601a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d79c expref: 33 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.148656:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd800/0x31399394250601a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d79c expref: 33 pid: 1398 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746147198.148668:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311305472:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147198.148742:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147198.148768:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311305344:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147198.149917:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.150437:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311305472:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147198.150461:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x313993942506021b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3211264->3289087] (req 3211264->3289087) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7db expref: 21 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.150472:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098226a00, rc 0) 00000100:00100000:1.0:1746147198.150495:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2425:x1830967309967232:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3978us (4426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.150502:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18808 00000100:00100000:0.0:1746147198.152307:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.159615:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.163972:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.194332:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.196835:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.196861:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309968512 00000100:00100000:0.0:1746147198.196866:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309968512 00000100:00100000:0.0:1746147198.202052:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.202377:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.202398:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.202438:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.202469:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309969024 00000100:00100000:0.0:1746147198.202478:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309969024 00000100:00100000:0.0:1746147198.202514:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309968896 00000100:00100000:0.0:1746147198.202516:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309968896 00000100:00100000:0.0:1746147198.202537:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18809 00000100:00100000:0.0:1746147198.202545:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967309969024:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147198.202563:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147198.202582:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a31c00/0x3139939425060268 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d7f7 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147198.202634:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094524e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311305728:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147198.202713:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147198.202729:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18810 00000100:00100000:0.0:1746147198.202734:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967309968896:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147198.202741:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147198.202748:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x313993942506026f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d7f0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147198.202776:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094525880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311305856:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147198.202795:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147198.205371:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094525880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311305856:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147198.205389:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x313993942506026f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7f0 expref: 22 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147198.205397:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x313993942506026f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7f0 expref: 22 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147198.205414:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a30400, rc 0) 00000100:00100000:1.0:1746147198.205585:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967309968896:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2849us (3145us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147198.205591:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18810 00000100:00100000:0.0:1746147198.216115:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.230600:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.230878:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309969664 00000100:00100000:1.0:1746147198.230896:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309969664 00000100:00100000:1.0:1746147198.231333:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18811 00000100:00100000:1.0:1746147198.231342:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2430:x1830967309969664:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147198.231361:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147198.231381:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098227800/0x3139939425060276 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d7fe expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.231408:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x313993942506021b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3211264->3289087) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7db expref: 20 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.231415:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147198.231417:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147198.231420:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098227800/0x3139939425060276 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7fe expref: 34 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.231446:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x313993942506021b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3211264->3289087) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7db expref: 20 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.231456:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x313993942506021b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3211264->3289087) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7db expref: 20 pid: 13695 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746147198.231467:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311305984:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147198.231551:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147198.235923:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.235975:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.236256:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311305984:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147198.236286:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098227800/0x3139939425060276 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7fe expref: 34 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.236300:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098227800, rc 0) 00000100:00100000:1.0:1746147198.236352:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2430:x1830967309969664:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5011us (5762us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.236359:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18811 00000100:00100000:1.0:1746147198.236379:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309969792 00000100:00100000:1.0:1746147198.236381:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309969792 00000100:00100000:1.0:1746147198.236404:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18812 00000100:00100000:1.0:1746147198.236409:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2433:x1830967309969792:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147198.236417:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147198.236431:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942506027d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d805 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.236449:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x31399394250601dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7b8 expref: 33 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.236455:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147198.236457:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147198.236460:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942506027d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d805 expref: 24 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.236481:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x31399394250601dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1982463) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7b8 expref: 33 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.236490:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x31399394250601dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1982463) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7b8 expref: 33 pid: 1398 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746147198.236501:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311306112:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147198.236563:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147198.240415:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311306112:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147198.240444:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942506027d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d805 expref: 24 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.240462:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098226200, rc 0) 00000100:00100000:1.0:1746147198.240506:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2433:x1830967309969792:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4095us (4618us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.240514:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18812 00000100:00100000:1.0:1746147198.248473:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309970176 00000100:00100000:1.0:1746147198.248484:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309970176 00010000:00010000:1.0:1746147198.248521:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x313993942506021b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3211264->3289087) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7db expref: 24 pid: 13695 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746147198.248553:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8496 00000100:00100000:1.0:1746147198.248560:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2001:x1830967309970176:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147198.248574:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147198.248595:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x313993942506021b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3211264->3289087) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7db expref: 24 pid: 13695 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.248606:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x313993942506021b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3211264->3289087) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7db expref: 24 pid: 13695 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.248636:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x313993942506021b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3211264->3289087) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7db expref: 24 pid: 13695 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.248656:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.248658:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.248665:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098227800/0x3139939425060276 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7fe expref: 35 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.248674:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098227800/0x3139939425060276 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7fe expref: 35 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.248704:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098227800/0x3139939425060276 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7fe expref: 35 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147198.248715:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311306240:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147198.248785:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147198.252783:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311306240:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147198.252802:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147198.253279:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2001:x1830967309970176:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4717us (4954us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.253289:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8496 00000100:00100000:0.0:1746147198.256557:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.256669:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309970304 00000100:00100000:1.0:1746147198.256677:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309970304 00010000:00010000:1.0:1746147198.256712:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x31399394250601dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7b8 expref: 36 pid: 1398 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746147198.256977:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8497 00000100:00100000:1.0:1746147198.256985:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967309970304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147198.256999:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147198.257016:0:7225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147197 -> 1746147198 00002000:00010000:1.0:1746147198.257019:0:7225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147197 -> 1746147198 00010000:00010000:1.0:1746147198.257025:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x31399394250601dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7b8 expref: 36 pid: 1398 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.257038:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x31399394250601dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->1982463) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7b8 expref: 36 pid: 1398 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.257060:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7c00/0x31399394250601dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->1982463) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7b8 expref: 36 pid: 1398 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.257116:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.257118:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.257126:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942506027d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d805 expref: 22 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.257134:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942506027d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d805 expref: 22 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.257165:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942506027d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d805 expref: 22 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147198.257181:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311306368:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147198.257260:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147198.261782:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311306368:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147198.261803:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147198.261855:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967309970304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4869us (5308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.261865:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8497 00000100:00100000:0.0:1746147198.262961:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.266913:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.291406:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.291682:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309970944 00000100:00100000:1.0:1746147198.291694:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309970944 00000100:00100000:1.0:1746147198.291757:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18813 00000100:00100000:1.0:1746147198.291765:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967309970944:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147198.291787:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147198.291809:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f03ca00/0x3139939425060284 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d80c expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.291836:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.291838:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.291848:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03ca00/0x3139939425060284 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d80c expref: 36 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147198.291861:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f03ca00/0x3139939425060284 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d80c expref: 36 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147198.291870:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03ca00, rc 0) 00000100:00100000:1.0:1746147198.291932:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967309970944:12345-192.168.204.25@tcp:101:cat.0 Request processed in 167us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.291938:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18813 00000100:00100000:0.0:1746147198.293084:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.297562:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.298800:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309971584 00000100:00100000:0.0:1746147198.298805:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309971584 00000100:00100000:0.0:1746147198.298842:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16227 00000100:00100000:0.0:1746147198.298849:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2435:x1830967309971584:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147198.298865:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147198.298899:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1200/0x3139939425060292 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d81a expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147198.298980:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0000/0x3139939425060299 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.298995:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0000/0x3139939425060299 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299007:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0000/0x3139939425060299 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299020:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250602a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299025:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250602a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299030:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250602a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299169:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1600/0x31399394250602a7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299178:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1600/0x31399394250602a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299184:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1600/0x31399394250602a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:0.0:1746147198.299191:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147198.299271:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0000/0x3139939425060299 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299278:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0000/0x3139939425060299 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299283:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0000/0x3139939425060299 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299289:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0000/0x3139939425060299 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299295:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800993b0000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147198.299299:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0000/0x3139939425060299 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299306:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0000/0x3139939425060299 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299317:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147198.299319:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147198.299323:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0000/0x3139939425060299 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299329:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0000/0x3139939425060299 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299355:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250602a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299360:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250602a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299365:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250602a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299369:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800993b0a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147198.299371:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250602a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299375:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250602a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299380:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f2c5a00) 00010000:00010000:0.0:1746147198.299381:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147198.299383:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250602a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299387:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0a00/0x31399394250602a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147198.299421:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1200/0x3139939425060292 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d81a expref: 37 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147198.299431:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1600/0x31399394250602a7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d81a expref: 36 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147198.299437:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147198.299439:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147198.299441:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1600, rc 0) 00000100:00100000:0.0:1746147198.299470:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2435:x1830967309971584:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 622us (1269us total) trans 8589937070 rc 0/0 00000100:00100000:0.0:1746147198.299477:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16227 00000100:00100000:0.0:1746147198.304758:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.308041:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.308137:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309971968 00000100:00100000:1.0:1746147198.308144:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309971968 00000100:00100000:1.0:1746147198.308207:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 954 00000100:00100000:1.0:1746147198.308215:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967309971968:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147198.308229:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147198.308257:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1600/0x31399394250602a7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d81a expref: 36 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.308280:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147198.308285:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147198.308327:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967309971968:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 114us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.308334:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 954 00000100:00100000:1.0:1746147198.321984:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.322520:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.322598:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309972352 00000100:00100000:0.0:1746147198.322602:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309972352 00000100:00100000:0.0:1746147198.322961:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18815 00000100:00100000:0.0:1746147198.322968:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2435:x1830967309972352:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147198.322987:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147198.323005:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b1200/0x31399394250602b5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d821 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147198.323036:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091f28600/0x313993942506018f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d787 expref: 9 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147198.323045:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134ae9c00/0x313993942506019d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d795 expref: 32 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147198.323052:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147198.323054:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147198.323057:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1200/0x31399394250602b5 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2666496->2940927] (req 2666496->2940927) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d821 expref: 32 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147198.323085:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134ae9c00/0x313993942506019d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d795 expref: 32 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147198.323113:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134ae9c00/0x313993942506019d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d795 expref: 32 pid: 13695 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746147198.323124:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099013100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311306496:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147198.323192:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091f28600/0x313993942506018f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d787 expref: 9 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147198.323199:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091f28600/0x313993942506018f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d787 expref: 9 pid: 13695 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746147198.323206:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099013800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311306624:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147198.323224:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147198.326852:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.327288:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.332779:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.337053:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.341529:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.341582:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.357451:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.380555:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.388202:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.392474:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.394302:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.396007:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.434451:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.439042:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.439160:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.439192:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.439231:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.439272:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309975808 00000100:00100000:0.0:1746147198.439281:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309975808 00010000:00010000:0.0:1746147198.439319:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f972e00/0x3139939425060142 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d73a expref: 12 pid: 1398 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746147198.439347:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309975680 00000100:00100000:0.0:1746147198.439349:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309975680 00010000:00010000:0.0:1746147198.439360:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e7800/0x313993942506015e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d756 expref: 32 pid: 9586 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746147198.439372:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309975936 00000100:00100000:0.0:1746147198.439373:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309975936 00010000:00010000:0.0:1746147198.439382:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x3139939425060031 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6ca expref: 13 pid: 13695 timeout: 836 lvb_type: 1 00000100:00100000:0.0:1746147198.439397:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8501 00000100:00100000:0.0:1746147198.439404:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2002:x1830967309975808:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147198.439416:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147198.439438:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f972e00/0x3139939425060142 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d73a expref: 12 pid: 1398 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746147198.439449:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f972e00/0x3139939425060142 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d73a expref: 12 pid: 1398 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746147198.439474:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147198.439516:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2002:x1830967309975808:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 112us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147198.439522:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8501 00000100:00100000:0.0:1746147198.439542:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8502 00000100:00100000:0.0:1746147198.439547:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967309975680:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147198.439554:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147198.439560:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958e7800/0x313993942506015e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d756 expref: 32 pid: 9586 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746147198.439568:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958e7800/0x313993942506015e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d756 expref: 32 pid: 9586 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746147198.439577:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147198.439589:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967309975680:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 42us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147198.439594:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8502 00000100:00100000:0.0:1746147198.439602:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8503 00000100:00100000:0.0:1746147198.439607:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967309975936:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147198.439612:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147198.439618:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x3139939425060031 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6ca expref: 13 pid: 13695 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746147198.439627:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x3139939425060031 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6ca expref: 13 pid: 13695 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746147198.439638:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147198.439640:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147198.439647:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x31399394250602e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1499136->2031615) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d836 expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147198.439655:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x31399394250602e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1499136->2031615) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d836 expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147198.439687:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x31399394250602e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1499136->2031615) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d836 expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147198.439699:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311307520:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147198.440658:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147198.444195:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.445158:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.449189:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.449220:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.449242:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.449267:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.449291:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309976448 00000100:00100000:0.0:1746147198.449298:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309976448 00000100:00100000:0.0:1746147198.449336:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309976576 00000100:00100000:0.0:1746147198.449339:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309976576 00000100:00100000:0.0:1746147198.449360:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309976704 00000100:00100000:0.0:1746147198.449362:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309976704 00000100:00100000:0.0:1746147198.449371:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309976832 00000100:00100000:0.0:1746147198.449373:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309976832 00000100:00100000:0.0:1746147198.449398:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18818 00000100:00100000:0.0:1746147198.449406:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967309976448:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147198.449425:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147198.449444:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f03da00/0x3139939425060309 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d844 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147198.449495:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311307776:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147198.449896:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18821 00000100:00100000:1.0:1746147198.449905:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967309976832:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147198.449911:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147198.449919:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097035800/0x313993942506031e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d859 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.449929:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.449931:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.449935:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097035800/0x313993942506031e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d859 expref: 15 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147198.449945:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097035800/0x313993942506031e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d859 expref: 15 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147198.449952:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097035800, rc 0) 00000100:00100000:0.0:1746147198.450160:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147198.450236:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967309976832:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 333us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.450241:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18821 00000100:00080000:1.0:1746147198.450259:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147198.451581:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.451661:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309977088 00000100:00100000:1.0:1746147198.451668:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309977088 00002000:00100000:1.0:1746147198.451818:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (2027520->2031615) req@ffff880099151180 x1830967309977088/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:574/0 lens 488/0 e 0 to 0 dl 1746147209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147198.451829:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151180 with x1830967309977088 ext(2027520->2031615) 00002000:00010000:1.0:1746147198.451834:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099151180 00000100:00100000:1.0:1746147198.451865:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6885 00000100:00100000:1.0:1746147198.451872:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2003:x1830967309977088:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147198.452014:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2003:x1830967309977088:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 141us (437us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147198.452019:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6885 00002000:00100000:1.0:1746147198.452024:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (2027520->2031615) req@ffff880099151180 x1830967309977088/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:574/0 lens 488/4536 e 0 to 0 dl 1746147209 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147198.452030:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151180 with x1830967309977088 ext(2027520->2031615) 00002000:00010000:1.0:1746147198.452034:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099151180 00000100:00100000:0.0:1746147198.456867:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.456984:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.472626:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.472690:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.472711:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309977984 00000100:00100000:0.0:1746147198.472715:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309977984 00000100:00100000:0.0:1746147198.476409:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.481723:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.482718:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.485802:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.493854:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.496732:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.538084:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.546428:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.546480:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.549078:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.549648:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8508 00000100:00100000:1.0:1746147198.549656:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2000:x1830967309979392:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147198.549661:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147198.549670:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5565600/0x31399394250600af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6f4 expref: 24 pid: 1398 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.549784:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5565600/0x31399394250600af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6f4 expref: 24 pid: 1398 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.549810:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5565600/0x31399394250600af lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6f4 expref: 24 pid: 1398 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.549827:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147198.550186:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967309979392:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 528us (3702us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.550192:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8508 00000100:00100000:0.0:1746147198.559993:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.563356:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.569428:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.570847:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.570943:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.571514:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309980416 00000100:00100000:1.0:1746147198.571517:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309980416 00000100:00100000:1.0:1746147198.571534:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18826 00000100:00100000:1.0:1746147198.571539:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967309980416:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147198.571544:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147198.571552:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x31399394250603b8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d89f expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.571561:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.571563:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.571568:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x31399394250603b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d89f expref: 36 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147198.571580:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x31399394250603b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d89f expref: 36 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147198.571588:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097034600, rc 0) 00000100:00100000:1.0:1746147198.572390:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967309980416:12345-192.168.204.25@tcp:101:cat.0 Request processed in 848us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.572397:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18826 00000100:00100000:0.0:1746147198.579628:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.585016:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.587757:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.587798:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.590513:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8511 00000100:00100000:1.0:1746147198.590525:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967309981056:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147198.590541:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147198.590562:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d91e00/0x313993942506001c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6c3 expref: 13 pid: 13695 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746147198.590574:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d91e00/0x313993942506001c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6c3 expref: 13 pid: 13695 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746147198.590598:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d91e00/0x313993942506001c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d6c3 expref: 13 pid: 13695 timeout: 836 lvb_type: 1 00010000:00010000:1.0:1746147198.590627:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147198.590689:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967309981056:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 166us (2942us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.590696:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8511 00000100:00100000:1.0:1746147198.590714:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8512 00000100:00100000:1.0:1746147198.590718:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967309980928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147198.590726:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147198.590733:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958e6800/0x3139939425060150 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d748 expref: 33 pid: 1398 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.590742:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958e6800/0x3139939425060150 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d748 expref: 33 pid: 1398 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.590754:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e6800/0x3139939425060150 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d748 expref: 33 pid: 1398 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.590762:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.590764:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.590771:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250603aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d891 expref: 32 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.590778:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250603aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d891 expref: 32 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.590809:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250603aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d891 expref: 32 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147198.590820:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ece00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311309312:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147198.590870:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147198.597238:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.598743:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ece00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311309312:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147198.598767:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147198.598796:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967309980928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8077us (10997us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.598804:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8512 00000100:00100000:0.0:1746147198.607237:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.610639:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.610707:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309981824 00000100:00100000:1.0:1746147198.610716:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309981824 00002000:00100000:1.0:1746147198.610761:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1265664->2097151) req@ffff880134b6ce00 x1830967309981824/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:574/0 lens 488/0 e 0 to 0 dl 1746147209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147198.610772:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b6ce00 with x1830967309981824 ext(1265664->2097151) 00002000:00010000:1.0:1746147198.610777:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b6ce00 00000100:00100000:1.0:1746147198.610804:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6889 00000100:00100000:1.0:1746147198.610811:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967309981824:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147198.623027:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967309981824:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12204us (12386us total) trans 0 rc 831488/831488 00000100:00100000:1.0:1746147198.623042:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6889 00002000:00100000:1.0:1746147198.623054:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1265664->2097151) req@ffff880134b6ce00 x1830967309981824/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:574/0 lens 488/440 e 0 to 0 dl 1746147209 ref 1 fl Complete:/200/0 rc 831488/831488 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147198.623063:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b6ce00 with x1830967309981824 ext(1265664->2097151) 00002000:00010000:1.0:1746147198.623069:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b6ce00 00000100:00100000:1.0:1746147198.627007:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.629709:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.634206:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.634237:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.634260:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.634298:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.634396:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309982720 00000100:00100000:1.0:1746147198.634405:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309982720 00002000:00100000:1.0:1746147198.634449:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1499136->2031615) req@ffff8800975a7800 x1830967309982720/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:574/0 lens 488/0 e 0 to 0 dl 1746147209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147198.634459:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a7800 with x1830967309982720 ext(1499136->2031615) 00010000:00010000:1.0:1746147198.634468:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x31399394250602e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d836 expref: 9 pid: 9585 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.634483:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x31399394250602e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d836 expref: 9 pid: 9585 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746147198.634490:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800975a7800 00000100:00100000:1.0:1746147198.634508:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1600 00000100:00100000:1.0:1746147198.634515:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967309982720:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147198.645527:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.645577:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309983104 00000100:00100000:1.0:1746147198.645586:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309983104 00010000:00010000:1.0:1746147198.645621:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x31399394250602e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d836 expref: 11 pid: 9585 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746147198.645742:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8513 00000100:00100000:1.0:1746147198.645750:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2000:x1830967309983104:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147198.645764:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147198.645782:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x31399394250602e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d836 expref: 11 pid: 9585 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.645794:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x31399394250602e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->2031615) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d836 expref: 11 pid: 9585 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.645819:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x31399394250602e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->2031615) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d836 expref: 11 pid: 9585 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.645856:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.645858:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.645868:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250603f7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8b4 expref: 32 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.645877:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250603f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8b4 expref: 32 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.645941:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250603f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8b4 expref: 32 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147198.645953:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311309952:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147198.646034:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147198.651567:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311309952:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147198.651591:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147198.651604:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.651639:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967309983104:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5890us (6121us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.651649:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8513 00000100:00100000:0.0:1746147198.654421:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.659297:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.659385:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.659500:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e6e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311310080:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147198.659532:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093730400/0x3139939425060413 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8d0 expref: 24 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.659550:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093730400, rc 0) 00000100:00100000:1.0:1746147198.659602:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2453:x1830967309983232:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7870us (7997us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.659611:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18831 00000100:00100000:0.0:1746147198.660049:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6890 00000100:00100000:0.0:1746147198.660057:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967309983744:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147198.678444:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967309983744:12345-192.168.204.25@tcp:3:cat.0 Request processed in 18387us (19157us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147198.678453:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6890 00002000:00100000:1.0:1746147198.678459:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800975a6d80 x1830967309983744/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:574/0 lens 488/440 e 0 to 0 dl 1746147209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147198.678466:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a6d80 with x1830967309983744 ext(1048576->2097151) 00002000:00010000:1.0:1746147198.678470:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800975a6d80 00000100:00100000:0.0:1746147198.700827:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.702845:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309984000 00000100:00100000:1.0:1746147198.702858:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309984000 00010000:00010000:1.0:1746147198.702910:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a20400/0x3139939425060380 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 688128->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d883 expref: 38 pid: 9586 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746147198.702957:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8514 00000100:00100000:1.0:1746147198.702965:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967309984000:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147198.702980:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147198.703010:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a20400/0x3139939425060380 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 688128->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d883 expref: 38 pid: 9586 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.703023:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a20400/0x3139939425060380 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 688128->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d883 expref: 38 pid: 9586 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.703045:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a20400/0x3139939425060380 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 688128->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d883 expref: 38 pid: 9586 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.703082:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.703084:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.703128:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093730400/0x3139939425060413 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8d0 expref: 23 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.703136:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093730400/0x3139939425060413 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8d0 expref: 23 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.703169:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093730400/0x3139939425060413 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8d0 expref: 23 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147198.703181:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311310208:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147198.703274:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147198.703502:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.706363:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311310208:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147198.706392:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147198.706442:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967309984000:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3476us (5625us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.706452:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8514 00000100:00100000:0.0:1746147198.712928:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.714263:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309984512 00000100:00100000:1.0:1746147198.714273:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309984512 00002000:00100000:1.0:1746147198.714321:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff8800975a5180 x1830967309984512/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:574/0 lens 488/0 e 0 to 0 dl 1746147209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147198.714331:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a5180 with x1830967309984512 ext(0->1048575) 00002000:00010000:1.0:1746147198.714337:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800975a5180 00000100:00100000:1.0:1746147198.714374:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6893 00000100:00100000:1.0:1746147198.714382:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2003:x1830967309984512:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147198.736487:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2003:x1830967309984512:12345-192.168.204.25@tcp:3:cat.0 Request processed in 22094us (23558us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147198.736500:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6893 00002000:00100000:1.0:1746147198.736512:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff8800975a5180 x1830967309984512/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:574/0 lens 488/440 e 0 to 0 dl 1746147209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147198.736521:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a5180 with x1830967309984512 ext(0->1048575) 00002000:00010000:1.0:1746147198.736527:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800975a5180 00000100:00100000:0.0:1746147198.742330:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.742756:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309984640 00000100:00100000:1.0:1746147198.742766:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309984640 00000100:00100000:1.0:1746147198.742826:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18832 00000100:00100000:1.0:1746147198.742834:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967309984640:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147198.742853:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147198.742873:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801312e7400/0x313993942506041a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d8d7 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.742906:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.742909:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.742918:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e7400/0x313993942506041a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8d7 expref: 38 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147198.742933:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801312e7400/0x313993942506041a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8d7 expref: 38 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147198.742944:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e7400, rc 0) 00000100:00100000:1.0:1746147198.743057:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967309984640:12345-192.168.204.25@tcp:101:cat.0 Request processed in 223us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.743064:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18832 00000100:00100000:0.0:1746147198.746199:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.747787:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.747898:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309984768 00000100:00100000:1.0:1746147198.747908:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309984768 00000100:00100000:1.0:1746147198.747963:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309984896 00000100:00100000:1.0:1746147198.747966:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309984896 00000100:00100000:1.0:1746147198.747981:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18833 00000100:00100000:1.0:1746147198.747989:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2450:x1830967309984768:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147198.748007:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147198.748024:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x3139939425060421 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d8de expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.748052:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250603aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d891 expref: 32 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.748059:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147198.748061:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147198.748064:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x3139939425060421 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1699840->2097151] (req 1699840->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8de expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.748109:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250603aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d891 expref: 32 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.748122:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250603aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d891 expref: 32 pid: 9586 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746147198.748135:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311310336:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147198.748214:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147198.751822:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.751836:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311310336:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147198.751868:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x3139939425060421 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1699840->2097151] (req 1699840->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8de expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.751896:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e7200, rc 0) 00000100:00100000:1.0:1746147198.751954:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2450:x1830967309984768:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3965us (5764us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.751962:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18833 00000100:00100000:0.0:1746147198.753410:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.769648:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309985408 00000100:00100000:1.0:1746147198.769657:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309985408 00010000:00010000:1.0:1746147198.769697:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250603aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d891 expref: 35 pid: 9586 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746147198.769985:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8515 00000100:00100000:1.0:1746147198.769993:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967309985408:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147198.770009:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147198.770028:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250603aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d891 expref: 35 pid: 9586 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.770040:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250603aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d891 expref: 35 pid: 9586 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.770061:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250603aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d891 expref: 35 pid: 9586 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.770104:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.770107:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.770115:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x3139939425060421 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8de expref: 11 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.770122:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x3139939425060421 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8de expref: 11 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.770154:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x3139939425060421 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8de expref: 11 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.770164:0:7225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x3139939425060421 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8de expref: 11 pid: 1398 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746147198.770175:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311310592:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147198.771698:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00010000:00010000:1.0:1746147198.773208:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147198.774277:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.774287:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311310592:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147198.774319:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147198.774498:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967309985408:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4504us (5033us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.774509:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8515 00000100:00100000:0.0:1746147198.781191:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.781255:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.781510:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309985920 00000100:00100000:1.0:1746147198.781520:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309985920 00000100:00100000:1.0:1746147198.781582:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18835 00000100:00100000:1.0:1746147198.781591:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2450:x1830967309985920:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147198.781611:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147198.781631:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x313993942506042f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d8ec expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.781662:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250603f7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8b4 expref: 33 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.781670:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.781671:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.781675:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x313993942506042f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->1396735] (req 1048576->1396735) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8ec expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.781708:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250603f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8b4 expref: 33 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.781718:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250603f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8b4 expref: 33 pid: 9586 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746147198.781730:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311310720:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147198.781812:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147198.784827:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311310720:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147198.784867:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x313993942506042f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->1396735] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8ec expref: 15 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.784897:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e6000, rc 0) 00000100:00100000:1.0:1746147198.784955:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2450:x1830967309985920:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3363us (3775us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.784963:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18835 00000100:00100000:0.0:1746147198.788065:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.788392:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309986176 00000100:00100000:1.0:1746147198.788401:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309986176 00010000:00010000:1.0:1746147198.788434:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250603f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8b4 expref: 34 pid: 9586 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746147198.788460:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8516 00000100:00100000:1.0:1746147198.788468:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967309986176:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147198.788481:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147198.788501:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250603f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8b4 expref: 34 pid: 9586 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.788511:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250603f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8b4 expref: 34 pid: 9586 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.788538:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x31399394250603f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8b4 expref: 34 pid: 9586 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.788570:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.788572:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.788580:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x313993942506042f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8ec expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.788589:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x313993942506042f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8ec expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.788621:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x313993942506042f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8ec expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147198.788633:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311310848:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147198.788714:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147198.791021:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.796900:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309986560 00000100:00100000:0.0:1746147198.796910:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309986560 00002000:00100000:0.0:1746147198.796963:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x97:0x0] (1392640->1396735) req@ffff8800769ad880 x1830967309986560/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:574/0 lens 488/0 e 0 to 0 dl 1746147209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147198.796974:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ad880 with x1830967309986560 ext(1392640->1396735) 00002000:00010000:0.0:1746147198.796980:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769ad880 00000100:00100000:0.0:1746147198.797889:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769afb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311310976:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147198.797911:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147198.797943:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967309986304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5495us (6931us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147198.797951:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8517 00000100:00100000:0.0:1746147198.799476:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.799496:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309986816 00000100:00100000:0.0:1746147198.799501:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309986816 00002000:00100000:0.0:1746147198.799531:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880093147800 x1830967309986816/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:574/0 lens 488/0 e 0 to 0 dl 1746147209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147198.799541:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093147800 with x1830967309986816 ext(1048576->2097151) 00002000:00010000:0.0:1746147198.799546:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093147800 00000100:00100000:0.0:1746147198.799572:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6895 00000100:00100000:0.0:1746147198.799579:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2003:x1830967309986816:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147198.802267:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309987072 00000100:00100000:1.0:1746147198.802277:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309987072 00000100:00100000:1.0:1746147198.802325:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6019 00000100:00100000:1.0:1746147198.802333:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2450:x1830967309987072:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147198.803380:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2450:x1830967309987072:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 1043us (1341us total) trans 8589937085 rc 0/0 00000100:00100000:1.0:1746147198.803388:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6019 00000100:00100000:0.0:1746147198.810222:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2003:x1830967309986816:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 10507us (10616us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147198.810236:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6895 00002000:00100000:0.0:1746147198.810250:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880093147800 x1830967309986816/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:574/0 lens 488/440 e 0 to 0 dl 1746147209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147198.810260:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093147800 with x1830967309986816 ext(1048576->2097151) 00002000:00010000:0.0:1746147198.810266:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093147800 00000100:00100000:0.0:1746147198.819472:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.852385:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.856015:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.856047:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.856080:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309987712 00000100:00100000:1.0:1746147198.856103:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309987712 00010000:00010000:1.0:1746147198.856141:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x313993942506039c lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d88a expref: 44 pid: 7239 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746147198.856179:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309987968 00000100:00100000:1.0:1746147198.856181:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309987968 00010000:00010000:1.0:1746147198.856192:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x3139939425060364 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d86e expref: 9 pid: 7239 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746147198.856207:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8518 00000100:00100000:1.0:1746147198.856214:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967309987712:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147198.856228:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147198.856233:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x313993942506039c lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d88a expref: 44 pid: 7239 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.856243:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x313993942506039c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d88a expref: 44 pid: 7239 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.856267:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147198.856273:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a000/0x313993942506043d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147198.856283:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a000/0x313993942506043d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147198.856288:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147198.856329:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967309987712:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 115us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.856336:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8518 00000100:00100000:1.0:1746147198.856354:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8519 00000100:00100000:1.0:1746147198.856359:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967309987968:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147198.856365:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147198.856368:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x3139939425060364 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d86e expref: 9 pid: 7239 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.856376:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x3139939425060364 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d86e expref: 9 pid: 7239 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746147198.857221:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.857236:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309987840 00000100:00100000:0.0:1746147198.857239:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309987840 00010000:00010000:0.0:1746147198.857253:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20e00/0x31399394250603d4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8a6 expref: 22 pid: 7239 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.857591:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x3139939425060364 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d86e expref: 9 pid: 7239 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746147198.857684:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8520 00000100:00100000:0.0:1746147198.857691:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967309987840:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147198.857698:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147198.857702:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20e00/0x31399394250603d4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8a6 expref: 22 pid: 7239 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746147198.857711:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20e00/0x31399394250603d4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8a6 expref: 22 pid: 7239 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746147198.857723:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20e00/0x31399394250603d4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8a6 expref: 22 pid: 7239 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746147198.857734:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147198.857737:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a000/0x313993942506043d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147198.857745:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a000/0x313993942506043d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147198.857750:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a000/0x313993942506043d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147198.857763:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147198.857783:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967309987840:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 93us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147198.857789:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8520 00010000:00010000:1.0:1746147198.857875:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147198.857888:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147198.857906:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967309987968:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1547us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.857915:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8519 00000100:00100000:0.0:1746147198.887941:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.888527:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309988096 00000100:00100000:1.0:1746147198.888538:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309988096 00000100:00100000:1.0:1746147198.888697:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18836 00000100:00100000:1.0:1746147198.888706:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2459:x1830967309988096:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147198.888725:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147198.888743:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801312e6c00/0x313993942506044b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d8fa expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.888771:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098227800/0x3139939425060276 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7fe expref: 39 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.888780:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425060317 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d852 expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147198.888786:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x313993942506028b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d813 expref: 23 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.888791:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.888792:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.888795:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e6c00/0x313993942506044b lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3330048->3780607] (req 3330048->3780607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8fa expref: 39 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.888823:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x313993942506028b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d813 expref: 23 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.888833:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x313993942506028b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d813 expref: 23 pid: 9585 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746147198.888845:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311311488:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147198.889476:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425060317 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d852 expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147198.889484:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425060317 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d852 expref: 13 pid: 9585 timeout: 836 lvb_type: 1 00000100:00100000:1.0:1746147198.889493:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311311616:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147198.890460:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098227800/0x3139939425060276 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7fe expref: 39 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.890470:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098227800/0x3139939425060276 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7fe expref: 39 pid: 1398 timeout: 836 lvb_type: 0 00000100:00100000:1.0:1746147198.890481:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311311744:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147198.891107:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56589c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147198.891134:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311311488:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147198.897839:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.898464:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311311616:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147198.898478:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311311744:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147198.898514:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801312e6c00/0x313993942506044b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3330048->3780607] (req 3330048->3780607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8fa expref: 39 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.898534:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e6c00, rc 0) 00000100:00100000:1.0:1746147198.898577:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2459:x1830967309988096:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 9872us (10647us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.898584:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18836 00000100:00100000:0.0:1746147198.901054:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.903643:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.904078:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309988352 00000100:00100000:0.0:1746147198.904117:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309988352 00010000:00010000:0.0:1746147198.904155:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x313993942506028b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d813 expref: 24 pid: 9585 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746147198.904184:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309988480 00000100:00100000:0.0:1746147198.904187:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309988480 00010000:00010000:0.0:1746147198.904198:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098227800/0x3139939425060276 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7fe expref: 39 pid: 1398 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746147198.904571:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8522 00000100:00100000:0.0:1746147198.904580:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2001:x1830967309988352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147198.904608:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8523 00000100:00100000:1.0:1746147198.904613:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967309988480:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147198.904620:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147198.904641:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098227800/0x3139939425060276 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7fe expref: 39 pid: 1398 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.904652:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098227800/0x3139939425060276 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7fe expref: 39 pid: 1398 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.904675:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098227800/0x3139939425060276 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7fe expref: 39 pid: 1398 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.904694:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147198.904739:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967309988480:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 126us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.904746:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8523 00010000:00010000:0.0:1746147198.904860:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147198.904869:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x313993942506028b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d813 expref: 24 pid: 9585 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746147198.904889:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x313993942506028b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d813 expref: 24 pid: 9585 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746147198.904902:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x313993942506028b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d813 expref: 24 pid: 9585 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746147198.904919:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147198.904921:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147198.904928:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801312e6c00/0x313993942506044b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3330048->3780607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8fa expref: 37 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147198.904936:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e6c00/0x313993942506044b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3330048->3780607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8fa expref: 37 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147198.904971:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801312e6c00/0x313993942506044b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3330048->3780607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8fa expref: 37 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147198.904988:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311311872:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147198.905457:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147198.907598:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311311872:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147198.907620:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147198.907661:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2001:x1830967309988352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3081us (6615us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147198.907672:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8522 00000100:00100000:0.0:1746147198.908718:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.914274:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.928156:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.931689:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.931747:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309989376 00000100:00100000:1.0:1746147198.931758:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309989376 00000100:00100000:1.0:1746147198.931813:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6020 00000100:00100000:1.0:1746147198.931821:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:16261:x1830967309989376:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147198.932162:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:16261:x1830967309989376:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 341us (474us total) trans 8589937087 rc 0/0 00000100:00100000:1.0:1746147198.932168:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6020 00000100:00100000:0.0:1746147198.934707:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.938039:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.938080:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.938127:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309989632 00000100:00100000:1.0:1746147198.938135:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309989632 00000100:00100000:0.0:1746147198.938154:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.938268:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309989888 00000100:00100000:1.0:1746147198.938272:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309989888 00000100:00100000:1.0:1746147198.938295:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309989760 00000100:00100000:1.0:1746147198.938297:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309989760 00000100:00100000:1.0:1746147198.938311:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18837 00000100:00100000:1.0:1746147198.938318:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2002:x1830967309989632:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147198.938337:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147198.938356:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x313993942506046e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d908 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147198.938380:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.938382:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147198.938392:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x313993942506046e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d908 expref: 14 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147198.938407:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x313993942506046e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d908 expref: 14 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147198.938418:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e7200, rc 0) 00000100:00100000:1.0:1746147198.938460:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2002:x1830967309989632:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 142us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147198.939169:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18837 00000100:00100000:0.0:1746147198.939971:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.952212:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.959262:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.966247:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.978167:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.979278:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.982825:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.985595:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.986543:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746147198.986557:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967311314176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746147198.986596:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1746147198.986886:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147198.987166:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967311314176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1746147198.992126:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.992163:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.992191:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.992282:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.992312:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.992329:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309992704 00000100:00100000:1.0:1746147198.992333:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309992704 00002000:00100000:1.0:1746147198.992367:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1396735) req@ffff8801312eca80 x1830967309992704/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:574/0 lens 488/0 e 0 to 0 dl 1746147209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147198.992376:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312eca80 with x1830967309992704 ext(1048576->1396735) 00010000:00010000:1.0:1746147198.992383:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x313993942506042f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8ec expref: 15 pid: 1398 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.992393:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x313993942506042f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8ec expref: 15 pid: 1398 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746147198.992399:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801312eca80 00000100:00100000:1.0:1746147198.993056:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309992576 00000100:00100000:1.0:1746147198.993059:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309992576 00000100:00100000:0.0:1746147198.993060:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1605 00000100:00100000:0.0:1746147198.993067:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2003:x1830967309992704:12345-192.168.204.25@tcp:4:cat.0 00002000:00100000:1.0:1746147198.993075:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3330048->3780607) req@ffff8801312ed180 x1830967309992576/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:574/0 lens 488/0 e 0 to 0 dl 1746147209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147198.993082:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ed180 with x1830967309992576 ext(3330048->3780607) 00010000:00010000:1.0:1746147198.993086:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801312e6c00/0x313993942506044b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3330048->3780607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8fa expref: 36 pid: 1398 timeout: 836 lvb_type: 0 00010000:00010000:1.0:1746147198.993116:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801312e6c00/0x313993942506044b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3330048->3780607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8fa expref: 36 pid: 1398 timeout: 836 lvb_type: 0 00002000:00010000:1.0:1746147198.993122:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801312ed180 00000100:00100000:0.0:1746147198.993200:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.993217:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309992960 00000100:00100000:0.0:1746147198.993220:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309992960 00010000:00010000:0.0:1746147198.993233:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x31399394250602bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d828 expref: 15 pid: 13695 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746147198.993248:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8531 00000100:00100000:0.0:1746147198.993253:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2002:x1830967309992960:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147198.993259:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147198.993267:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x31399394250602bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d828 expref: 15 pid: 13695 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746147198.993275:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x31399394250602bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d828 expref: 15 pid: 13695 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746147198.993287:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c200/0x31399394250602bc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d828 expref: 15 pid: 13695 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746147198.993305:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147198.993319:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2002:x1830967309992960:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 66us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147198.993324:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8531 00000100:00100000:0.0:1746147198.993399:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.993414:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309992832 00000100:00100000:0.0:1746147198.993417:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309992832 00010000:00010000:0.0:1746147198.993428:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097035800/0x313993942506031e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d859 expref: 14 pid: 13695 timeout: 836 lvb_type: 1 00000100:00100000:0.0:1746147198.993448:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8532 00000100:00100000:0.0:1746147198.993453:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2002:x1830967309992832:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147198.993458:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147198.993472:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097035800/0x313993942506031e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d859 expref: 14 pid: 13695 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746147198.993479:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097035800/0x313993942506031e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d859 expref: 14 pid: 13695 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746147198.993490:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097035800/0x313993942506031e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d859 expref: 14 pid: 13695 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746147198.993499:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147198.993513:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2002:x1830967309992832:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 60us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147198.993518:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8532 00000100:00100000:0.0:1746147198.993555:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.993565:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309992448 00000100:00100000:0.0:1746147198.993568:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309992448 00010000:00010000:0.0:1746147198.993577:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x313993942506046e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d908 expref: 16 pid: 13695 timeout: 836 lvb_type: 1 00000100:00100000:1.0:1746147198.993628:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1606 00000100:00100000:1.0:1746147198.993635:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967309992576:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147198.993650:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8533 00000100:00100000:0.0:1746147198.993656:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967309992448:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147198.993665:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147198.993672:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x313993942506046e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d908 expref: 16 pid: 13695 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746147198.993681:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x313993942506046e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d908 expref: 16 pid: 13695 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746147198.993691:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801312e7200/0x313993942506046e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d908 expref: 16 pid: 13695 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746147198.993701:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147198.993713:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967309992448:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 58us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147198.993718:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8533 00000100:00100000:1.0:1746147198.993765:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147198.993783:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309992320 00000100:00100000:0.0:1746147198.993786:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309992320 00010000:00010000:0.0:1746147198.993796:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942506027d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d805 expref: 23 pid: 13695 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746147198.993809:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8534 00000100:00100000:0.0:1746147198.993813:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2001:x1830967309992320:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147198.993819:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147198.993825:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942506027d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d805 expref: 23 pid: 13695 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746147198.993832:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942506027d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d805 expref: 23 pid: 13695 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746147198.993845:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098226200/0x313993942506027d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d805 expref: 23 pid: 13695 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746147198.993853:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147198.993854:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147198.993857:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x31399394250604c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147198.993863:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x31399394250604c2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147198.993910:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147198.993958:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147198.994436:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147198.994452:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2001:x1830967309992320:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 638us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147198.994457:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8534 00000100:00100000:0.0:1746147198.994499:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309993216 00000100:00100000:0.0:1746147198.994502:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309993216 00010000:00010000:0.0:1746147198.994513:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x31399394250603b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d89f expref: 33 pid: 17600 timeout: 836 lvb_type: 1 00000100:00100000:0.0:1746147198.994810:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8536 00000100:00100000:0.0:1746147198.994815:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967309993216:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147198.994821:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147198.994829:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x31399394250603b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d89f expref: 33 pid: 17600 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746147198.994842:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x31399394250603b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d89f expref: 33 pid: 17600 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746147198.994852:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097034600/0x31399394250603b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d89f expref: 33 pid: 17600 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746147198.994860:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147198.994861:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147198.994863:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009400b000/0x31399394250604de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147198.994869:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009400b000/0x31399394250604de lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147198.994891:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147198.994902:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967309993216:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 87us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147198.994907:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8536 00000100:00100000:0.0:1746147199.003340:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2003:x1830967309992704:12345-192.168.204.25@tcp:4:cat.0 Request processed in 10258us (11042us total) trans 17179875035 rc 0/0 00000100:00100000:0.0:1746147199.003355:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1605 00002000:00100000:0.0:1746147199.003369:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1396735) req@ffff8801312eca80 x1830967309992704/t17179875035(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:574/0 lens 488/448 e 0 to 0 dl 1746147209 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147199.003379:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312eca80 with x1830967309992704 ext(1048576->1396735) 00010000:00010000:0.0:1746147199.003390:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x313993942506042f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8ec expref: 14 pid: 1398 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746147199.003404:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x313993942506042f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8ec expref: 14 pid: 1398 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746147199.003411:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801312eca80 00000100:00100000:0.0:1746147199.005083:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967309992576:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 11438us (12760us total) trans 21474842405 rc 0/0 00000100:00100000:0.0:1746147199.005114:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1606 00002000:00100000:0.0:1746147199.005124:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3330048->3780607) req@ffff8801312ed180 x1830967309992576/t21474842405(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:574/0 lens 488/448 e 0 to 0 dl 1746147209 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147199.005133:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ed180 with x1830967309992576 ext(3330048->3780607) 00010000:00010000:0.0:1746147199.005143:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801312e6c00/0x313993942506044b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3330048->3780607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8fa expref: 38 pid: 1398 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746147199.005154:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801312e6c00/0x313993942506044b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3330048->3780607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8fa expref: 38 pid: 1398 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746147199.005160:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801312ed180 00000100:00100000:0.0:1746147199.007159:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147199.007231:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:1.0:1746147199.007414:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147199.009745:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147199.009811:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309993728 00000100:00100000:1.0:1746147199.009816:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309993728 00000100:00100000:1.0:1746147199.009936:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16242 00000100:00100000:1.0:1746147199.009943:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2462:x1830967309993728:12345-192.168.204.25@tcp:36:mirror_io.0 00010000:00010000:1.0:1746147199.009988:0:7237:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147199.010011:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250604b4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d932 expref: 12 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147199.010512:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147199.010517:0:7237:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147199.010545:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x31399394250604e5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147199.010559:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ae8800/0x31399394250601c0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7a3 expref: 42 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147199.010571:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc400/0x313993942506020d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7d4 expref: 20 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147199.010577:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0600/0x3139939425060118 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d710 expref: 42 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147199.010582:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506012d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d725 expref: 42 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147199.010587:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80600/0x3139939425060134 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d72c expref: 20 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147199.010593:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21e00/0x31399394250603e9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8ad expref: 20 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147199.010599:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x31399394250604e5 lrc: 9/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147199.010626:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21e00/0x31399394250603e9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8ad expref: 20 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147199.010636:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a21e00/0x31399394250603e9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d8ad expref: 20 pid: 7237 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746147199.010650:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311314304:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147199.011079:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80600/0x3139939425060134 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d72c expref: 20 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147199.011104:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80600/0x3139939425060134 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d72c expref: 20 pid: 7237 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746147199.011112:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311314432:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147199.011151:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506012d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d725 expref: 42 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147199.011159:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506012d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d725 expref: 42 pid: 6215 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746147199.011165:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311314560:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147199.011187:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0600/0x3139939425060118 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d710 expref: 42 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147199.011193:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0600/0x3139939425060118 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d710 expref: 42 pid: 16099 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746147199.011201:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311314688:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147199.011221:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc400/0x313993942506020d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7d4 expref: 20 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147199.011227:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc400/0x313993942506020d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7d4 expref: 20 pid: 16099 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746147199.011234:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311314816:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147199.011256:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134ae8800/0x31399394250601c0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7a3 expref: 42 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147199.011263:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ae8800/0x31399394250601c0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7a3 expref: 42 pid: 16099 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746147199.011270:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311314944:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147199.011284:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147199.013793:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147199.013841:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147199.013863:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309994112 00000100:00100000:0.0:1746147199.013865:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309994112 00010000:00010000:0.0:1746147199.013895:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80600/0x3139939425060134 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d72c expref: 22 pid: 7237 timeout: 837 lvb_type: 0 00000100:00100000:0.0:1746147199.013916:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8539 00000100:00100000:0.0:1746147199.013922:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2003:x1830967309994112:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147199.013933:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147199.013938:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80600/0x3139939425060134 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d72c expref: 22 pid: 7237 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746147199.013948:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80600/0x3139939425060134 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d72c expref: 22 pid: 7237 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746147199.013972:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147199.013976:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x31399394250604e5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147199.013986:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147199.013991:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311314304:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147199.014000:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80600/0x3139939425060134 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d72c expref: 22 pid: 7237 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746147199.014012:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311314432:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147199.014015:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2003:x1830967309994112:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 94us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147199.014019:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311314560:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147199.014022:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8539 00000100:00100000:1.0:1746147199.014024:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311314688:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147199.014359:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147199.014390:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309994240 00000100:00100000:1.0:1746147199.014393:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309994240 00000100:00100000:0.0:1746147199.014403:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147199.014413:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309994368 00000100:00100000:0.0:1746147199.014416:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309994368 00010000:00010000:1.0:1746147199.014426:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506012d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d725 expref: 44 pid: 6215 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746147199.014426:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0600/0x3139939425060118 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d710 expref: 44 pid: 16099 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746147199.014442:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8540 00000100:00100000:1.0:1746147199.014447:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2003:x1830967309994240:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147199.014447:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8541 00000100:00100000:0.0:1746147199.014451:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967309994368:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147199.014454:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147199.014457:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506012d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d725 expref: 44 pid: 6215 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746147199.014458:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147199.014460:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0600/0x3139939425060118 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d710 expref: 44 pid: 16099 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746147199.014468:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0600/0x3139939425060118 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d710 expref: 44 pid: 16099 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746147199.014479:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0600/0x3139939425060118 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d710 expref: 44 pid: 16099 timeout: 837 lvb_type: 0 00010000:00010000:0.0:1746147199.014491:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147199.014494:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x31399394250604e5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147199.014499:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147199.014513:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967309994368:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 62us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147199.014519:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8541 00010000:00010000:1.0:1746147199.014689:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506012d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d725 expref: 42 pid: 6215 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746147199.014834:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506012d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d725 expref: 42 pid: 6215 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746147199.014844:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147199.014847:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x31399394250604e5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147199.014852:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147199.015071:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2003:x1830967309994240:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 622us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147199.015077:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8540 00000100:00100000:1.0:1746147199.015117:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311314816:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147199.015124:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311314944:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147199.015156:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x31399394250604e5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147199.015166:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147199.015185:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309994496 00000100:00100000:1.0:1746147199.015187:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309994496 00000100:00100000:0.0:1746147199.015195:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147199.015197:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc400/0x313993942506020d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7d4 expref: 21 pid: 16099 timeout: 837 lvb_type: 0 00000100:00100000:0.0:1746147199.015205:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309994624 00000100:00100000:0.0:1746147199.015207:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309994624 00010000:00010000:0.0:1746147199.015216:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ae8800/0x31399394250601c0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7a3 expref: 41 pid: 16099 timeout: 837 lvb_type: 0 00000100:00100000:1.0:1746147199.015221:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8542 00000100:00100000:1.0:1746147199.015225:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967309994496:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147199.015236:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147199.015239:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc400/0x313993942506020d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7d4 expref: 21 pid: 16099 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746147199.015247:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc400/0x313993942506020d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7d4 expref: 21 pid: 16099 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746147199.015257:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc400/0x313993942506020d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d7d4 expref: 21 pid: 16099 timeout: 837 lvb_type: 0 00010000:00010000:1.0:1746147199.015269:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147199.015272:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x31399394250604e5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147199.015277:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147199.015292:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967309994496:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 66us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147199.015297:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8542 00010000:00010000:0.0:1746147199.019076:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x31399394250604e5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147199.019083:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x31399394250604e5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000040:00080000:0.0:1746147199.020221:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1108, 88 off105344 00000004:00080000:0.0:1746147199.020230:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 737010139274ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147199.020270:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1125, 88 off106848 00000004:00080000:0.0:1746147199.020275:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 737010185388ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147199.020298:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1126, 88 off106936 00000004:00080000:0.0:1746147199.020301:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 737010211455ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147199.020310:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1109, 88 off105432 00000004:00080000:0.0:1746147199.020313:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 737010223711ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147199.020322:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1110, 88 off105520 00000004:00080000:0.0:1746147199.020325:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 737010235118ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147199.020333:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1127, 88 off107024 00000004:00080000:0.0:1746147199.020336:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 737010246144ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147199.020342:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1128, 88 off107112 00000004:00080000:0.0:1746147199.020345:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 737010255661ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147199.020352:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1129, 88 off107200 00000004:00080000:0.0:1746147199.020355:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 737010265165ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147199.020362:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1111, 88 off105608 00000004:00080000:0.0:1746147199.020364:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 737010274918ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147199.020372:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1130, 88 off107288 00000004:00080000:0.0:1746147199.020374:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 737010284608ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147199.020389:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1112, 88 off105696 00000004:00080000:0.0:1746147199.020391:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 737010301930ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147199.020398:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1131, 88 off107376 00000004:00080000:0.0:1746147199.020401:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 737010311286ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147199.020418:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1113, 88 off105784 00000004:00080000:0.0:1746147199.020421:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 737010331726ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147199.020440:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1114, 88 off105872 00000004:00080000:0.0:1746147199.020442:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 737010353101ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147199.020450:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1115, 88 off105960 00000004:00080000:0.0:1746147199.020452:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 737010362884ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147199.020458:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1116, 88 off106048 00000004:00080000:0.0:1746147199.020460:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 737010370965ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147199.020467:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1132, 88 off107464 00000004:00080000:0.0:1746147199.020469:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 737010379753ns, next at 694367916532ns, rc = 0 00000100:00100000:0.0:1746147199.023922:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e6e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311315072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147199.023947:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147199.023964:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311315584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147199.023978:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147199.023991:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746147199.023995:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e6e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311315456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147199.024009:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147199.024021:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e6e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311315968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147199.024033:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:1.0:1746147199.024119:0:7237:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098823800 reply state ffff8800988a2c00 transno 8589937091 ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x31399394250604e5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147199.024145:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x31399394250604e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147199.024153:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147199.024156:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746147199.024160:0:7237:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746147199.024230:0:7237:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746147199.024241:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2462:x1830967309993728:12345-192.168.204.25@tcp:36:mirror_io.0 Request processed in 14297us (14500us total) trans 8589937091 rc 0/0 00000100:00100000:1.0:1746147199.024250:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16242 00010000:00010000:1.0:1746147199.024275:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x31399394250604e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147199.024281:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x31399394250604e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147199.024287:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x31399394250604e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147199.024292:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e6e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147199.024296:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x31399394250604e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147199.024302:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x31399394250604e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147199.024310:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147199.024312:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147199.024313:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x31399394250604e5 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147199.024318:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x31399394250604e5 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00000004:00080000:0.0:1746147199.025144:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e6e1880/2, rc 0, transno 21474842410 00000100:00100000:0.0:1746147199.025166:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e6e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311315072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147199.025184:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311315968 00000100:00100000:0.0:1746147199.025187:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311315968 00000100:00100000:0.0:1746147199.025204:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18853 00000100:00100000:0.0:1746147199.025208:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3765:x1830967311315456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147199.025217:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746147199.025227:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311316096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147199.025252:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746147199.025259:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147199.025262:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147199.025264:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147199.025266:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147199.025267:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:0.0:1746147199.025292:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3765:x1830967311315456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (1281us total) trans 21474842412 rc 0/0 00000100:00100000:0.0:1746147199.025297:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18853 00000100:00100000:0.0:1746147199.025307:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18854 00000100:00100000:0.0:1746147199.025312:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3765:x1830967311315968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147199.025369:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:0.0:1746147199.025371:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147199.025373:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147199.025375:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147199.025376:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:0.0:1746147199.025396:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+43:3765:x1830967311315968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (1362us total) trans 21474842414 rc 0/0 00000100:00100000:0.0:1746147199.025401:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18854 00000100:00100000:1.0:1746147199.025456:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311316480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147199.025479:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147199.025498:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ec380/2, rc 0, transno 21474842413 00000100:00100000:0.0:1746147199.025501:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311316480 00000100:00100000:1.0:1746147199.025502:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311316096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147199.025504:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311316480 00000100:00100000:1.0:1746147199.025509:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311316992:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147199.025522:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147199.025525:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18856 00000100:00100000:0.0:1746147199.025529:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3764:x1830967311316480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147199.025533:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746147199.025537:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311316608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147199.025552:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147199.025561:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311317120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147199.025574:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147199.025588:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311316992 00000100:00100000:1.0:1746147199.025591:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311316992 00000100:00100000:1.0:1746147199.025603:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311316608 00000100:00100000:1.0:1746147199.025605:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311316608 00000100:00100000:0.0:1746147199.025610:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3764:x1830967311316480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (129us total) trans 17179875036 rc 0/0 00000100:00100000:1.0:1746147199.025612:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311317120 00000100:00100000:1.0:1746147199.025614:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311317120 00000100:00100000:0.0:1746147199.025615:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18856 00000100:00100000:1.0:1746147199.025623:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18857 00000100:00100000:0.0:1746147199.025626:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18858 00000100:00100000:1.0:1746147199.025628:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3764:x1830967311316992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147199.025631:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3764:x1830967311316608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147199.025669:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147199.025672:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147199.025673:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147199.025675:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147199.025677:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746147199.025684:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3764:x1830967311316992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (160us total) trans 17179875038 rc 0/0 00000100:00100000:1.0:1746147199.025689:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18857 00000100:00100000:0.0:1746147199.025693:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3764:x1830967311316608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (140us total) trans 17179875037 rc 0/0 00000100:00100000:0.0:1746147199.025698:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18858 00000100:00100000:1.0:1746147199.025723:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18859 00000100:00100000:1.0:1746147199.025729:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3764:x1830967311317120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147199.025779:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+33:3764:x1830967311317120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (203us total) trans 17179875039 rc 0/0 00000100:00100000:1.0:1746147199.025785:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18859 00000100:00100000:0.0:1746147199.025795:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311316352:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147199.025806:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909f9880/2, rc 0, transno 17179875037 00000100:00100000:1.0:1746147199.025810:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311316608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147199.025815:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147199.025817:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099154a80/2, rc 0, transno 17179875039 00000100:00100000:1.0:1746147199.025820:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311317120:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147199.025825:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099155880/2, rc 0, transno 17179875038 00000100:00100000:1.0:1746147199.025828:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311316992:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147199.025833:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909f9c00/2, rc 0, transno 17179875036 00000100:00100000:1.0:1746147199.025836:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311316480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147199.025845:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311316352 00000100:00100000:1.0:1746147199.025847:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311316352 00000100:00100000:1.0:1746147199.025859:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18860 00000100:00100000:1.0:1746147199.025863:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+33:3767:x1830967311316352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147199.025925:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3767:x1830967311316352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (109us total) trans 17179875040 rc 0/0 00000100:00100000:1.0:1746147199.025930:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18860 00000004:00080000:1.0:1746147199.025948:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e6e2680/2, rc 0, transno 21474842412 00000100:00100000:1.0:1746147199.025950:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e6e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311315456:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147199.025956:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e6e0700/2, rc 0, transno 21474842414 00000100:00100000:1.0:1746147199.025959:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e6e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311315968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147199.026219:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311316864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147199.026241:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147199.026260:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909fa680/2, rc 0, transno 17179875040 00000100:00100000:0.0:1746147199.026263:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311316352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147199.026274:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311316864 00000100:00100000:0.0:1746147199.026277:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311316864 00000100:00100000:0.0:1746147199.026292:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18862 00000100:00100000:0.0:1746147199.026297:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3766:x1830967311316736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147199.026355:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3766:x1830967311316736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (158us total) trans 17179875042 rc 0/0 00000100:00100000:0.0:1746147199.026361:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18862 00000004:00080000:1.0:1746147199.026438:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e6e1180/2, rc 0, transno 21474842411 00000100:00100000:1.0:1746147199.026441:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311315584:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147199.026708:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099154380/2, rc 0, transno 17179875043 00000100:00100000:0.0:1746147199.026712:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311316864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147199.026792:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309994880 00000100:00100000:1.0:1746147199.026795:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309994880 00000100:00100000:1.0:1746147199.026816:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16243 00000100:00100000:1.0:1746147199.026821:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2462:x1830967309994880:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147199.026837:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147199.026853:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb2600/0x31399394250604ec lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d939 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147199.027405:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb2600/0x31399394250604ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d939 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147199.027424:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb2600/0x31399394250604ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d939 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147199.027440:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147199.027442:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147199.027446:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098eb2600, rc 0) 00000100:00100000:1.0:1746147199.027485:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2462:x1830967309994880:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 663us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147199.027490:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16243 00000100:00100000:0.0:1746147199.029336:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147199.029398:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309995008 00000100:00100000:1.0:1746147199.029404:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309995008 00000100:00100000:1.0:1746147199.029550:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16244 00000100:00100000:1.0:1746147199.029559:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2462:x1830967309995008:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147199.029576:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147199.029594:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7e600/0x31399394250604f3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d940 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147199.029678:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c43a00/0x31399394250604fa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147199.029691:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c43a00/0x31399394250604fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147199.029701:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c43a00/0x31399394250604fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:1.0:1746147199.029729:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:1.0:1746147199.029732:0:7237:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147199.029748:0:7237:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c43a00/0x31399394250604fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147199.029771:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7e600/0x31399394250604f3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d940 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147199.029785:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c43a00/0x31399394250604fa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d940 expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147199.029793:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147199.029796:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147199.029798:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c43a00, rc 0) 00000100:00100000:1.0:1746147199.033329:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2462:x1830967309995008:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 3758us (3987us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147199.033340:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16244 00000100:00100000:0.0:1746147199.038029:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147199.038071:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147199.041126:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147199.041161:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147199.041385:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147199.041415:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147199.041581:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18868 00000100:00100000:0.0:1746147199.041589:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967309995648:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147199.041595:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147199.041603:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800940c5c00/0x313993942506051d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d963 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147199.041614:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4886560, mtime: 0x6814177e, atime: 0x6814177d, ctime: 0x6814177e, blocks: 0x1558 00010000:00010000:0.0:1746147199.041634:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147199.041635:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147199.041640:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800940c5c00/0x313993942506051d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d963 expref: 15 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147199.041649:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800940c5c00/0x313993942506051d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d963 expref: 15 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147199.041656:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940c5c00, rc 0) 00000100:00100000:0.0:1746147199.041677:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967309995648:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 90us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147199.041682:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18868 00010000:00010000:1.0:1746147199.777267:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147200.046338:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.046436:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.046466:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.046559:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.046668:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.047463:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.047536:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309996160 00000100:00100000:0.0:1746147200.047539:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309996160 00000100:00100000:1.0:1746147200.047662:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309996416 00000100:00100000:1.0:1746147200.047665:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309996416 00000100:00100000:0.0:1746147200.047990:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18874 00000100:00100000:0.0:1746147200.047995:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967309996160:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:0.0:1746147200.048026:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967309996160:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 31us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147200.048030:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18874 00000100:00080000:1.0:1746147200.048146:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147200.052046:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.052081:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.052124:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.052528:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.052543:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.052721:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.052849:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18877 00000100:00100000:1.0:1746147200.052864:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967309997056:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:0.0:1746147200.052963:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309997184 00000100:00100000:0.0:1746147200.052966:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309997184 00000100:00100000:0.0:1746147200.052984:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18878 00000100:00100000:0.0:1746147200.052989:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967309997312:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:1.0:1746147200.053868:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967309997056:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 1012us (1785us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147200.053876:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18877 00000100:00100000:1.0:1746147200.053889:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18881 00000100:00100000:1.0:1746147200.053894:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967309997184:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:1.0:1746147200.053931:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967309997184:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 36us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147200.053936:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18881 00000100:00100000:0.0:1746147200.054470:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967309997312:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 1478us (2343us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147200.054475:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18878 00000100:00100000:0.0:1746147200.061466:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.066871:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.074305:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.074347:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.074389:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.074586:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309997824 00000100:00100000:1.0:1746147200.074596:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309997824 00000100:00100000:1.0:1746147200.074649:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309998080 00000100:00100000:1.0:1746147200.074652:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309998080 00000100:00100000:1.0:1746147200.074671:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309998336 00000100:00100000:1.0:1746147200.074673:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309998336 00000100:00100000:1.0:1746147200.074689:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6899 00000100:00100000:1.0:1746147200.074697:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967309997824:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:1.0:1746147200.074740:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x313993942506052b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.074756:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.074758:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.074763:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x313993942506052b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.074781:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x313993942506052b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147200.076820:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6900 00000100:00100000:1.0:1746147200.076839:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967309998080:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:1.0:1746147200.076886:0:13302:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425060532 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.076899:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.076902:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.076906:0:13302:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425060532 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.076919:0:13302:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425060532 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147200.082555:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309998592 00000100:00100000:0.0:1746147200.082572:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309998592 00000100:00100000:0.0:1746147200.082656:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6902 00000100:00100000:0.0:1746147200.082665:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967309998592:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:0.0:1746147200.082703:0:29479:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012da0e800/0x3139939425060540 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.082719:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147200.082720:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147200.082725:0:29479:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0e800/0x3139939425060540 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.082737:0:29479:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0e800/0x3139939425060540 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147200.084715:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6904 00000100:00100000:1.0:1746147200.084722:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967309999104:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:1.0:1746147200.084739:0:9589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x313993942506054e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.084747:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.084748:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.084751:0:9589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x313993942506054e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.084759:0:9589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x313993942506054e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147200.086719:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309999616 00000100:00100000:1.0:1746147200.086724:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309999616 00000100:00100000:1.0:1746147200.086775:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6906 00000100:00100000:1.0:1746147200.086782:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967309999616:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:1.0:1746147200.086807:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x313993942506055c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.086816:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.086817:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.086821:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x313993942506055c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.086828:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x313993942506055c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.095547:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x313993942506052b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.095567:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x313993942506052b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.095775:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x313993942506052b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.095783:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ff5800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147200.095787:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x313993942506052b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.095797:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x313993942506052b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.095817:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x313993942506052b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.095827:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x313993942506052b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147200.095934:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2001:x1830967309997824:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 21230us (21633us total) trans 0 rc 1032192/1032192 00000100:00100000:1.0:1746147200.095950:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6899 00010000:00010000:1.0:1746147200.106514:0:13302:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425060532 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.106531:0:13302:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425060532 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.106540:0:13302:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425060532 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.106547:0:13302:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095052400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147200.106551:0:13302:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425060532 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.106559:0:13302:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425060532 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.106577:0:13302:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425060532 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.106583:0:13302:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425060532 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147200.106667:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967309998080:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 29832us (32313us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147200.106677:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6900 00010000:00010000:1.0:1746147200.130347:0:9589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x313993942506054e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.130364:0:9589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x313993942506054e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.130372:0:9589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x313993942506054e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.130379:0:9589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009822a000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147200.130383:0:9589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x313993942506054e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.130390:0:9589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x313993942506054e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.130409:0:9589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x313993942506054e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.130415:0:9589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x313993942506054e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147200.130524:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967309999104:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 45797us (46250us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147200.130539:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6904 00010000:00010000:1.0:1746147200.136010:0:29477:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x313993942506055c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.136028:0:29477:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x313993942506055c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.136036:0:29477:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x313993942506055c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.136042:0:29477:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009822a600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147200.136047:0:29477:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x313993942506055c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.136055:0:29477:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x313993942506055c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.136074:0:29477:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x313993942506055c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.136080:0:29477:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x313993942506055c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147200.136175:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967309999616:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 49387us (49526us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147200.136186:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6906 00000100:00100000:1.0:1746147200.143172:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967309999744 00000100:00100000:1.0:1746147200.143182:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967309999744 00000100:00100000:1.0:1746147200.143247:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 957 00000100:00100000:1.0:1746147200.143256:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f79050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2462:x1830967309999744:12345-192.168.204.25@tcp:103:mirror_io.0 00010000:00010000:1.0:1746147200.143271:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147200.143297:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400be00/0x31399394250604a6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d92b expref: 9 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.143326:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147200.143330:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147200.143546:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f79050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2462:x1830967309999744:12345-192.168.204.25@tcp:103:mirror_io.0 Request processed in 290us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147200.143552:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 957 00000100:00100000:0.0:1746147200.145455:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.147556:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.162322:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.162437:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310000512 00000100:00100000:1.0:1746147200.162448:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310000512 00000100:00100000:1.0:1746147200.162529:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16245 00000100:00100000:1.0:1746147200.162537:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2474:x1830967310000512:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147200.162562:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147200.162584:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a600/0x3139939425060563 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d971 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.162661:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x313993942506056a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162673:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x313993942506056a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162685:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x313993942506056a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162696:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b400/0x3139939425060571 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162701:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b400/0x3139939425060571 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162705:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b400/0x3139939425060571 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162800:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425060578 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162809:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425060578 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162815:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425060578 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:1.0:1746147200.162822:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147200.162897:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x313993942506056a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162903:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x313993942506056a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162908:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x313993942506056a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162912:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x313993942506056a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162917:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009822a000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147200.162920:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x313993942506056a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162925:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x313993942506056a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162938:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147200.162941:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147200.162944:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x313993942506056a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162949:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a000/0x313993942506056a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162963:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b400/0x3139939425060571 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162966:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b400/0x3139939425060571 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162970:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b400/0x3139939425060571 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162974:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009822b400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147200.162976:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b400/0x3139939425060571 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162979:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b400/0x3139939425060571 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162984:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d4c7700) 00010000:00010000:1.0:1746147200.162985:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147200.162987:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b400/0x3139939425060571 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.162990:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b400/0x3139939425060571 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.163021:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822a600/0x3139939425060563 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d971 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.163033:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425060578 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d971 expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.163038:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147200.163040:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147200.163042:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822b800, rc 0) 00000100:00100000:1.0:1746147200.163305:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2474:x1830967310000512:12345-192.168.204.25@tcp:101:cat.0 Request processed in 768us (993us total) trans 8589937094 rc 0/0 00000100:00100000:1.0:1746147200.163311:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16245 00000100:00100000:0.0:1746147200.166270:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.170974:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.171141:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310000768 00000100:00100000:1.0:1746147200.171150:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310000768 00000100:00100000:1.0:1746147200.171897:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310001792 00000100:00100000:1.0:1746147200.171900:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310001792 00000100:00100000:1.0:1746147200.171933:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16246 00000100:00100000:1.0:1746147200.171940:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2469:x1830967310000768:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147200.171965:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147200.171984:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x313993942506058d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d978 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.172107:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ac00/0x3139939425060594 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.172122:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c43a00/0x31399394250604fa lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d940 expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.172128:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425060578 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d971 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.172138:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ac00/0x3139939425060594 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.172169:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425060578 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d971 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.172180:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425060578 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d971 expref: 10 pid: 7237 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746147200.172191:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b6ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311317248:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147200.172275:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c43a00/0x31399394250604fa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d940 expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.172283:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c43a00/0x31399394250604fa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d940 expref: 9 pid: 7237 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746147200.172291:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b6ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311317376:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147200.172308:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147200.172338:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.172404:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.172417:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.172435:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310001152 00000100:00100000:1.0:1746147200.172438:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310001152 00000100:00100000:0.0:1746147200.172862:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16247 00000100:00100000:0.0:1746147200.172871:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2472:x1830967310001792:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147200.172884:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147200.172892:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x31399394250605a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d9a9 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.172930:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x31399394250605a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.172939:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x31399394250605a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.172948:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x31399394250605a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.172961:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x31399394250605b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.172966:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x31399394250605b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.172971:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x31399394250605b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.173056:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x31399394250605b7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.173063:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x31399394250605b7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.173069:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x31399394250605b7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:0.0:1746147200.173077:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147200.173166:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x31399394250605a9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.173172:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x31399394250605a9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.173177:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x31399394250605a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.173182:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x31399394250605a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.173188:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009256ea00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147200.173191:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x31399394250605a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.173198:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x31399394250605a9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.173207:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147200.173210:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147200.173213:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x31399394250605a9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.173217:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x31399394250605a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.173234:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x31399394250605b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.173239:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x31399394250605b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.173244:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x31399394250605b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.173247:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009256e600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147200.173250:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x31399394250605b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.173254:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x31399394250605b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.173260:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012b447c00) 00010000:00010000:0.0:1746147200.173262:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746147200.175065:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310001408 00000100:00100000:1.0:1746147200.175073:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310001408 00000100:00100000:1.0:1746147200.175114:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18886 00000100:00100000:1.0:1746147200.175122:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2002:x1830967310001152:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147200.175137:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147200.175153:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbeec00/0x31399394250605c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d98d expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.175172:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.175174:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.175180:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbeec00/0x31399394250605c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d98d expref: 16 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.175192:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbeec00/0x31399394250605c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d98d expref: 16 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.175203:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbeec00, rc 0) 00000100:00100000:1.0:1746147200.175246:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967310001152:12345-192.168.204.25@tcp:101:cat.0 Request processed in 125us (2907us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147200.175252:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18886 00000100:00100000:1.0:1746147200.175268:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18887 00000100:00100000:1.0:1746147200.175273:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2002:x1830967310001408:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147200.175279:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147200.175289:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x31399394250605cc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d99b expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.175299:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.175301:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.175304:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x31399394250605cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d99b expref: 24 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.175312:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x31399394250605cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d99b expref: 24 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.175319:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbef000, rc 0) 00000100:00100000:1.0:1746147200.175332:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2002:x1830967310001408:12345-192.168.204.25@tcp:101:cat.0 Request processed in 59us (2914us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147200.175337:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18887 00000100:00100000:1.0:1746147200.175427:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147200.175567:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x31399394250605b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.175577:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x31399394250605b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147200.175631:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f800/0x31399394250605a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9a9 expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.175640:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x31399394250605b7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9a9 expref: 28 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.175647:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147200.175649:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147200.175652:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256ec00, rc 0) 00000100:00100000:0.0:1746147200.175669:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2472:x1830967310001792:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2800us (4311us total) trans 8589937095 rc 0/0 00000100:00100000:0.0:1746147200.175675:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16247 00000100:00100000:0.0:1746147200.182507:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.189483:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.201253:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.201310:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.201351:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.201385:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.201407:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.201427:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.201474:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.201510:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310003328 00000100:00100000:0.0:1746147200.201521:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310003328 00000100:00100000:0.0:1746147200.201582:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 958 00000100:00100000:0.0:1746147200.201593:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310003328:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147200.201611:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147200.201641:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a400/0x3139939425060604 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9b7 expref: 30 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.201663:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147200.201669:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147200.201721:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310003328:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 129us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147200.201729:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 958 00000100:00100000:1.0:1746147200.205470:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.209377:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310004096 00000100:00100000:1.0:1746147200.209387:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310004096 00002000:00100000:1.0:1746147200.209433:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880094524380 x1830967310004096/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:576/0 lens 488/0 e 0 to 0 dl 1746147211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147200.209443:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094524380 with x1830967310004096 ext(1048576->2097151) 00002000:00010000:1.0:1746147200.209449:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094524380 00000100:00100000:1.0:1746147200.209477:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6907 00000100:00100000:1.0:1746147200.209486:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967310004096:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147200.211275:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310004352 00000100:00100000:0.0:1746147200.211281:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310004352 00002000:00100000:0.0:1746147200.211307:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880094526a00 x1830967310004352/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:576/0 lens 488/0 e 0 to 0 dl 1746147211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147200.211315:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094526a00 with x1830967310004352 ext(1048576->2097151) 00002000:00010000:0.0:1746147200.211319:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094526a00 00000100:00100000:0.0:1746147200.211336:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6909 00000100:00100000:0.0:1746147200.211341:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310004352:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147200.216501:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.216567:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310004096:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 7080us (7885us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147200.216579:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6907 00002000:00100000:1.0:1746147200.216591:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880094524380 x1830967310004096/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:576/0 lens 488/440 e 0 to 0 dl 1746147211 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147200.216600:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094524380 with x1830967310004096 ext(1048576->2097151) 00002000:00010000:1.0:1746147200.216606:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094524380 00000100:00100000:0.0:1746147200.217141:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.217155:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310004736 00000100:00100000:0.0:1746147200.217161:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310004736 00010000:00010000:0.0:1746147200.217184:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb2600/0x31399394250604ec lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d939 expref: 9 pid: 7237 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746147200.217214:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310004864 00000100:00100000:0.0:1746147200.217216:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310004864 00010000:00010000:0.0:1746147200.217226:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x31399394250605b7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9a9 expref: 29 pid: 7238 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746147200.217245:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8547 00000100:00100000:0.0:1746147200.217251:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310004736:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147200.217263:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147200.217269:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb2600/0x31399394250604ec lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d939 expref: 9 pid: 7237 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746147200.217279:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb2600/0x31399394250604ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d939 expref: 9 pid: 7237 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746147200.217301:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098eb2600/0x31399394250604ec lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d939 expref: 9 pid: 7237 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746147200.217322:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147200.217327:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0e0600/0x3139939425060643 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147200.217335:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0e0600/0x3139939425060643 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147200.217340:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147200.217357:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967310004736:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 106us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147200.217363:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8547 00000100:00100000:0.0:1746147200.217374:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8548 00000100:00100000:0.0:1746147200.217379:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310004864:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147200.217385:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147200.217389:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x31399394250605b7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9a9 expref: 29 pid: 7238 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746147200.217397:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x31399394250605b7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9a9 expref: 29 pid: 7238 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746147200.217408:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ec00/0x31399394250605b7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9a9 expref: 29 pid: 7238 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746147200.217416:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147200.217419:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0e0600/0x3139939425060643 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147200.217425:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0e0600/0x3139939425060643 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147200.217431:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0e0600/0x3139939425060643 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147200.217446:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147200.217461:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310004864:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 81us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147200.217466:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8548 00000100:00100000:0.0:1746147200.217508:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.217554:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310004992 00000100:00100000:0.0:1746147200.217557:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310004992 00000100:00100000:0.0:1746147200.217583:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16251 00000100:00100000:0.0:1746147200.217589:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2475:x1830967310004992:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147200.217607:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147200.217618:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x313993942506064a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d9ef expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.217661:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0e0600/0x3139939425060643 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147200.217668:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x313993942506064a lrc: 4/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9ef expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.217679:0:7238:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0e0600/0x3139939425060643 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147200.217686:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x313993942506064a lrc: 3/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9ef expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.217694:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147200.217697:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147200.217699:0:7238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x313993942506064a lrc: 3/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9ef expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.217704:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256ea00, rc 0) 00000100:00100000:0.0:1746147200.217720:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2475:x1830967310004992:12345-192.168.204.25@tcp:101:cat.0 Request processed in 132us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147200.217725:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16251 00000100:00100000:1.0:1746147200.221545:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311318016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147200.221587:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147200.221618:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311318528:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147200.221632:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147200.221647:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746147200.221651:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311317888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147200.221663:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147200.221671:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311318400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147200.221682:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147200.221697:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311318144:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147200.221709:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147200.221718:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311318656:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147200.221729:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147200.221738:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746147200.221741:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311318272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147200.221754:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147200.221762:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311318784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147200.221772:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147200.221799:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311318016 00000100:00100000:1.0:1746147200.221805:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311318016 00000100:00100000:1.0:1746147200.221834:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311318528 00000100:00100000:1.0:1746147200.221836:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311318528 00000100:00100000:1.0:1746147200.221844:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311317888 00000100:00100000:1.0:1746147200.221846:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311317888 00000100:00100000:1.0:1746147200.221864:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311318400 00000100:00100000:1.0:1746147200.221866:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311318400 00000100:00100000:1.0:1746147200.221875:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311318144 00000100:00100000:1.0:1746147200.221877:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311318144 00000100:00100000:1.0:1746147200.221884:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311318656 00000100:00100000:1.0:1746147200.221885:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311318656 00000100:00100000:1.0:1746147200.221892:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311318272 00000100:00100000:1.0:1746147200.221893:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311318272 00000100:00100000:1.0:1746147200.221899:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311318784 00000100:00100000:1.0:1746147200.221901:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311318784 00000100:00100000:1.0:1746147200.221911:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18896 00000100:00100000:1.0:1746147200.221917:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3767:x1830967311318016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147200.222029:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147200.222032:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147198 -> 1746147198 00002000:00010000:1.0:1746147200.222034:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147198 -> 1746147198 00002000:00010000:1.0:1746147200.222037:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147200.222039:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147200.222064:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3767:x1830967311318016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 147us (477us total) trans 21474842416 rc 0/0 00000100:00100000:1.0:1746147200.222069:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18896 00000100:00100000:1.0:1746147200.222081:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18897 00000100:00100000:1.0:1746147200.222085:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3767:x1830967311318528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147200.222155:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3767:x1830967311318528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (522us total) trans 21474842417 rc 0/0 00000100:00100000:1.0:1746147200.222161:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18897 00000100:00100000:1.0:1746147200.222169:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18898 00000100:00100000:1.0:1746147200.222172:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3767:x1830967311317888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147200.222201:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147200.222204:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147198 -> 1746147198 00002000:00010000:1.0:1746147200.222206:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147198 -> 1746147198 00002000:00010000:1.0:1746147200.222208:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147198 -> 1746147198 00002000:00010000:1.0:1746147200.222210:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:1.0:1746147200.222223:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3767:x1830967311317888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (560us total) trans 21474842418 rc 0/0 00000100:00100000:1.0:1746147200.222228:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18898 00000100:00100000:1.0:1746147200.222235:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18899 00000100:00100000:1.0:1746147200.222239:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3767:x1830967311318400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147200.222278:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3767:x1830967311318400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 38us (594us total) trans 21474842419 rc 0/0 00000100:00100000:1.0:1746147200.222283:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18899 00000100:00100000:1.0:1746147200.222290:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18900 00000100:00100000:1.0:1746147200.222294:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3764:x1830967311318144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147200.222323:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:1.0:1746147200.222325:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147198 -> 1746147198 00002000:00010000:1.0:1746147200.222327:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147197 -> 1746147197 00002000:00010000:1.0:1746147200.222329:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147198 -> 1746147198 00002000:00010000:1.0:1746147200.222331:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:1.0:1746147200.222346:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3764:x1830967311318144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (636us total) trans 21474842420 rc 0/0 00000100:00100000:1.0:1746147200.222351:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18900 00000100:00100000:1.0:1746147200.222358:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18901 00000100:00100000:1.0:1746147200.222362:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3764:x1830967311318656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147200.222391:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147200.222393:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147200.222395:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147200.222397:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147200.222399:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:1.0:1746147200.222413:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3764:x1830967311318656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (683us total) trans 21474842421 rc 0/0 00000100:00100000:1.0:1746147200.222418:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18901 00000100:00100000:1.0:1746147200.222442:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18902 00000100:00100000:1.0:1746147200.222446:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3764:x1830967311318272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147200.222475:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746147200.222478:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147200.222479:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147200.222481:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147200.222483:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:1.0:1746147200.222496:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3764:x1830967311318272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (741us total) trans 21474842422 rc 0/0 00000100:00100000:1.0:1746147200.222500:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18902 00000100:00100000:1.0:1746147200.222520:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18903 00000100:00100000:1.0:1746147200.222524:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3764:x1830967311318784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147200.222554:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:1.0:1746147200.222556:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147200.222558:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147200.222560:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147200.222562:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:1.0:1746147200.222575:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3764:x1830967311318784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (802us total) trans 21474842423 rc 0/0 00000100:00100000:1.0:1746147200.222579:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18903 00000004:00080000:1.0:1746147200.222619:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009988b100/2, rc 0, transno 21474842422 00000100:00100000:1.0:1746147200.222626:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311318272:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147200.222633:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009988b800/2, rc 0, transno 21474842423 00000100:00100000:1.0:1746147200.222635:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311318784:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147200.222641:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009988b480/2, rc 0, transno 21474842420 00000100:00100000:1.0:1746147200.222643:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311318144:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147200.222648:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099888a80/2, rc 0, transno 21474842421 00000100:00100000:1.0:1746147200.222651:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311318656:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147200.222661:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b6ea00/2, rc 0, transno 21474842418 00000100:00100000:1.0:1746147200.222664:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311317888:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147200.222669:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009988aa00/2, rc 0, transno 21474842419 00000100:00100000:1.0:1746147200.222671:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311318400:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147200.222677:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b6ed80/2, rc 0, transno 21474842416 00000100:00100000:1.0:1746147200.222679:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311318016:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147200.222684:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099889880/2, rc 0, transno 21474842417 00000100:00100000:1.0:1746147200.222687:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311318528:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147200.222721:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746147200.222726:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311318912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147200.222742:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147200.222757:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311318912 00000100:00100000:1.0:1746147200.222760:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311318912 00000100:00100000:1.0:1746147200.222773:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18904 00000100:00100000:1.0:1746147200.222777:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3767:x1830967311318912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147200.222828:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3767:x1830967311318912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (85us total) trans 21474842424 rc 0/0 00000100:00100000:1.0:1746147200.222836:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18904 00000004:00080000:1.0:1746147200.222864:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099888000/2, rc 0, transno 21474842424 00000100:00100000:1.0:1746147200.222867:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311318912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147200.224664:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311319296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147200.224692:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147200.224827:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311319808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147200.224844:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147200.225248:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746147200.225248:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311319296 00000100:00100000:1.0:1746147200.225253:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311319168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147200.225253:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311319296 00000100:00100000:1.0:1746147200.225269:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147200.225276:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311319168 00000100:00100000:0.0:1746147200.225278:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311319168 00000100:00100000:1.0:1746147200.225281:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311319680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147200.225288:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18910 00000100:00100000:1.0:1746147200.225292:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147200.225292:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:3765:x1830967311319296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147200.225334:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147200.225337:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147198 -> 1746147198 00002000:00010000:0.0:1746147200.225339:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147197 -> 1746147197 00002000:00010000:0.0:1746147200.225341:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147198 -> 1746147198 00002000:00010000:0.0:1746147200.225343:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746147200.225360:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3765:x1830967311319296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (668us total) trans 17179875050 rc 0/0 00000100:00100000:0.0:1746147200.225365:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18910 00000004:00080000:1.0:1746147200.225410:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e484380/2, rc 0, transno 17179875050 00000100:00100000:1.0:1746147200.225415:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311319296:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147200.225423:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d6ce00/2, rc 0, transno 17179875049 00000100:00100000:1.0:1746147200.225426:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311319808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147200.225439:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18912 00000100:00100000:1.0:1746147200.225446:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3765:x1830967311319680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147200.225494:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:1.0:1746147200.225497:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:1.0:1746147200.225499:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147200.225501:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:1.0:1746147200.225503:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:1.0:1746147200.225522:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3765:x1830967311319680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (229us total) trans 17179875052 rc 0/0 00000100:00100000:1.0:1746147200.225528:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18912 00000004:00080000:1.0:1746147200.225546:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e487b80/2, rc 0, transno 17179875051 00000100:00100000:1.0:1746147200.225549:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311319168:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147200.225554:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e484a80/2, rc 0, transno 17179875052 00000100:00100000:1.0:1746147200.225557:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311319680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147200.234923:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.234979:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.236234:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2003:x1830967310004352:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 24889us (25026us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147200.236242:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6909 00002000:00100000:1.0:1746147200.236291:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880094526a00 x1830967310004352/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:576/0 lens 488/440 e 0 to 0 dl 1746147211 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147200.236301:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094526a00 with x1830967310004352 ext(1048576->2097151) 00002000:00010000:1.0:1746147200.236305:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094526a00 00000100:00100000:0.0:1746147200.237906:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2002:x1830967310004608:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 26548us (26639us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147200.237915:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6910 00002000:00100000:0.0:1746147200.237922:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880094525880 x1830967310004608/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:576/0 lens 488/440 e 0 to 0 dl 1746147211 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147200.237931:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094525880 with x1830967310004608 ext(1048576->2097151) 00002000:00010000:0.0:1746147200.237936:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094525880 00000100:00100000:0.0:1746147200.241891:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310005504 00000100:00100000:0.0:1746147200.241901:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310005504 00000100:00100000:0.0:1746147200.241957:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18913 00000100:00100000:0.0:1746147200.241965:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2472:x1830967310005504:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147200.241984:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147200.242006:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425060658 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7d9fd expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.242036:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c10e00/0x3139939425060524 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d96a expref: 14 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147200.242049:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095052a00/0x3139939425060635 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9e1 expref: 36 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147200.242057:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x31399394250605da lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9a2 expref: 15 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147200.242063:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147200.242065:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147200.242068:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425060658 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2424832->2949119] (req 2424832->2949119) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9fd expref: 36 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.242114:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x31399394250605da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9a2 expref: 15 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147200.242126:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x31399394250605da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9a2 expref: 15 pid: 12225 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746147200.242138:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311320064:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147200.242226:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095052a00/0x3139939425060635 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9e1 expref: 36 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147200.242234:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095052a00/0x3139939425060635 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9e1 expref: 36 pid: 13695 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746147200.242242:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311320192:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147200.242268:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098c10e00/0x3139939425060524 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d96a expref: 14 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147200.242276:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098c10e00/0x3139939425060524 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d96a expref: 14 pid: 10340 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746147200.242284:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311320320:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147200.242298:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147200.244631:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.244694:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.244713:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.244769:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310005760 00000100:00100000:1.0:1746147200.244776:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310005760 00010000:00010000:1.0:1746147200.244803:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095052a00/0x3139939425060635 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9e1 expref: 36 pid: 13695 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746147200.244836:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310006016 00000100:00100000:1.0:1746147200.244838:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310006016 00010000:00010000:1.0:1746147200.244849:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098c10e00/0x3139939425060524 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d96a expref: 15 pid: 10340 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746147200.244875:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8549 00000100:00100000:1.0:1746147200.244881:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967310005888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147200.244893:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147200.244914:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x31399394250605da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9a2 expref: 16 pid: 12225 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746147200.244926:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x31399394250605da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9a2 expref: 16 pid: 12225 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746147200.244931:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8550 00000100:00100000:0.0:1746147200.244937:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967310005760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147200.244944:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147200.244947:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x31399394250605da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9a2 expref: 16 pid: 12225 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147200.244953:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095052a00/0x3139939425060635 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9e1 expref: 36 pid: 13695 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147200.244962:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095052a00/0x3139939425060635 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9e1 expref: 36 pid: 13695 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746147200.244974:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147200.244981:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095052a00/0x3139939425060635 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9e1 expref: 36 pid: 13695 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147200.244995:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147200.244996:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2001:x1830967310005888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 115us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147200.245001:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8549 00000100:00100000:0.0:1746147200.245009:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967310005760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 73us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147200.245014:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8551 00000100:00100000:1.0:1746147200.245019:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967310006016:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147200.245019:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8550 00010000:00010000:1.0:1746147200.245024:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147200.245030:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098c10e00/0x3139939425060524 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d96a expref: 15 pid: 10340 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746147200.245038:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098c10e00/0x3139939425060524 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d96a expref: 15 pid: 10340 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746147200.245048:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c10e00/0x3139939425060524 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d96a expref: 15 pid: 10340 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746147200.245060:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.245062:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.245069:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425060658 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2949119) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9fd expref: 34 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.245077:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425060658 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2949119) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9fd expref: 34 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.245123:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425060658 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2949119) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9fd expref: 34 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147200.245135:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311320448:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147200.245234:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147200.249950:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311320448:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147200.249979:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147200.250063:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967310006016:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5041us (5347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147200.250074:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8551 00000100:00100000:0.0:1746147200.252318:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.253077:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.254584:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6911 00000100:00100000:1.0:1746147200.254596:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967310006272:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147200.254735:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967310006272:12345-192.168.204.25@tcp:3:cat.0 Request processed in 141us (2424us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147200.254742:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6911 00002000:00100000:1.0:1746147200.254750:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (2424832->2428927) req@ffff880091d6d180 x1830967310006272/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:576/0 lens 488/4536 e 0 to 0 dl 1746147211 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147200.254760:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d6d180 with x1830967310006272 ext(2424832->2428927) 00002000:00010000:1.0:1746147200.254765:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d6d180 00000100:00100000:0.0:1746147200.256115:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.259126:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.259272:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310007040 00000100:00100000:1.0:1746147200.259280:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310007040 00002000:00100000:1.0:1746147200.259320:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880091d6c000 x1830967310007040/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:576/0 lens 488/0 e 0 to 0 dl 1746147211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147200.259331:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d6c000 with x1830967310007040 ext(1048576->2097151) 00002000:00010000:1.0:1746147200.259337:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d6c000 00000100:00100000:1.0:1746147200.259366:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6912 00000100:00100000:1.0:1746147200.259373:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967310007040:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147200.262156:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.262314:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.263645:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310007168 00000100:00100000:1.0:1746147200.263654:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310007168 00002000:00100000:1.0:1746147200.263700:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880091d6c380 x1830967310007168/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:576/0 lens 488/0 e 0 to 0 dl 1746147211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147200.263708:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d6c380 with x1830967310007168 ext(1048576->2097151) 00002000:00010000:1.0:1746147200.263713:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d6c380 00000100:00100000:1.0:1746147200.263812:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310007296 00000100:00100000:1.0:1746147200.263815:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310007296 00002000:00100000:1.0:1746147200.263827:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880091d6e300 x1830967310007296/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:576/0 lens 488/0 e 0 to 0 dl 1746147211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147200.263833:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d6e300 with x1830967310007296 ext(1048576->2097151) 00002000:00010000:1.0:1746147200.263836:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d6e300 00000100:00100000:0.0:1746147200.264862:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.264915:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.266195:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.267599:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310007680 00000100:00100000:1.0:1746147200.267603:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310007680 00010000:00010000:1.0:1746147200.267627:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c11c00/0x3139939425060501 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d947 expref: 16 pid: 1136 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746147200.267650:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310007552 00000100:00100000:1.0:1746147200.267653:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310007552 00010000:00010000:1.0:1746147200.267662:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x3139939425060586 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d97f expref: 25 pid: 12225 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746147200.267676:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8552 00000100:00100000:1.0:1746147200.267681:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310007680:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147200.267689:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147200.267704:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c11c00/0x3139939425060501 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d947 expref: 16 pid: 1136 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746147200.267714:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c11c00/0x3139939425060501 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d947 expref: 16 pid: 1136 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746147200.267736:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c11c00/0x3139939425060501 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d947 expref: 16 pid: 1136 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746147200.267754:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147200.267771:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310007680:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 91us (2921us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147200.267777:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8552 00000100:00100000:1.0:1746147200.267787:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8553 00000100:00100000:1.0:1746147200.267791:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2001:x1830967310007552:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147200.267798:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147200.267804:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x3139939425060586 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d97f expref: 25 pid: 12225 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746147200.267812:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x3139939425060586 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d97f expref: 25 pid: 12225 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746147200.267822:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009371d800/0x3139939425060586 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d97f expref: 25 pid: 12225 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746147200.267831:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147200.267843:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2001:x1830967310007552:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 51us (2928us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147200.267848:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8553 00000100:00100000:0.0:1746147200.274025:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.274149:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.277312:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967310007040:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17928us (18184us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147200.277324:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6912 00002000:00100000:1.0:1746147200.277334:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880091d6c000 x1830967310007040/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:576/0 lens 488/440 e 0 to 0 dl 1746147211 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147200.277344:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d6c000 with x1830967310007040 ext(1048576->2097151) 00002000:00010000:1.0:1746147200.277350:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d6c000 00000100:00100000:0.0:1746147200.285454:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.285668:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.286589:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310008704 00000100:00100000:1.0:1746147200.286593:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310008704 00002000:00100000:1.0:1746147200.286621:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099157480 x1830967310008704/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:576/0 lens 488/0 e 0 to 0 dl 1746147211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147200.286631:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099157480 with x1830967310008704 ext(1048576->2097151) 00002000:00010000:1.0:1746147200.286635:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099157480 00000100:00100000:1.0:1746147200.286648:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6918 00000100:00100000:1.0:1746147200.286653:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2001:x1830967310008704:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147200.293571:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.297117:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.308659:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2001:x1830967310008704:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 21993us (23210us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147200.308672:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6918 00002000:00100000:1.0:1746147200.308685:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099157480 x1830967310008704/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:576/0 lens 488/440 e 0 to 0 dl 1746147211 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147200.308695:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099157480 with x1830967310008704 ext(1048576->2097151) 00002000:00010000:1.0:1746147200.308701:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099157480 00000100:00100000:0.0:1746147200.316954:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.322564:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.322736:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.322757:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.322767:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.322950:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310010240 00000100:00100000:1.0:1746147200.322953:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310010240 00002000:00100000:1.0:1746147200.322983:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88012ca12a00 x1830967310010240/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:576/0 lens 488/0 e 0 to 0 dl 1746147211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147200.322991:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca12a00 with x1830967310010240 ext(2097152->4194303) 00002000:00010000:1.0:1746147200.322995:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ca12a00 00000100:00100000:1.0:1746147200.323011:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310010496 00000100:00100000:1.0:1746147200.323014:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310010496 00002000:00100000:1.0:1746147200.323026:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88012ca10700 x1830967310010496/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:576/0 lens 504/0 e 0 to 0 dl 1746147211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147200.323032:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca10700 with x1830967310010496 ext(2097152->4194303) 00002000:00010000:1.0:1746147200.323035:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca10700 00000100:00100000:1.0:1746147200.323045:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6920 00000100:00100000:1.0:1746147200.323049:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2002:x1830967310010240:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147200.323059:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.323077:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310009728 00000100:00100000:0.0:1746147200.323080:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310009728 00010000:00010000:0.0:1746147200.323122:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009371da00/0x313993942506059b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d986 expref: 18 pid: 12225 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746147200.323144:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310009984 00000100:00100000:0.0:1746147200.323146:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310009984 00010000:00010000:0.0:1746147200.323154:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095053400/0x3139939425060619 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9c5 expref: 36 pid: 13695 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746147200.323166:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8555 00000100:00100000:0.0:1746147200.323170:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310009728:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147200.323177:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147200.323190:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009371da00/0x313993942506059b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d986 expref: 18 pid: 12225 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147200.323199:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009371da00/0x313993942506059b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d986 expref: 18 pid: 12225 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147200.323216:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009371da00/0x313993942506059b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d986 expref: 18 pid: 12225 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147200.323230:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147200.323245:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2003:x1830967310009728:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 75us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147200.323250:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8555 00000100:00100000:0.0:1746147200.323259:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8556 00000100:00100000:0.0:1746147200.323262:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310009984:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147200.323267:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147200.323272:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095053400/0x3139939425060619 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9c5 expref: 36 pid: 13695 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147200.323278:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095053400/0x3139939425060619 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9c5 expref: 36 pid: 13695 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147200.323287:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095053400/0x3139939425060619 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9c5 expref: 36 pid: 13695 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147200.323294:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147200.323305:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967310009984:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 42us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147200.323309:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8556 00000100:00100000:0.0:1746147200.323383:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.323402:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310010112 00000100:00100000:0.0:1746147200.323405:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310010112 00010000:00010000:0.0:1746147200.323416:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425060508 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d94e expref: 14 pid: 1398 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746147200.323430:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8557 00000100:00100000:0.0:1746147200.323434:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310010112:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147200.323472:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147200.323480:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425060508 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d94e expref: 14 pid: 1398 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147200.323488:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425060508 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d94e expref: 14 pid: 1398 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147200.323508:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425060508 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d94e expref: 14 pid: 1398 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147200.323517:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147200.323519:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147200.323525:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae000/0x3139939425060666 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da0b expref: 16 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.323532:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae000/0x3139939425060666 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da0b expref: 16 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.323552:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae000/0x3139939425060666 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da0b expref: 16 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147200.323559:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca10a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311321600:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147200.323593:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147200.332293:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca10a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311321600:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147200.332306:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147200.332348:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310010112:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8912us (8962us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147200.332358:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8557 00000100:00100000:0.0:1746147200.333706:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.344296:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.358253:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.358313:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.360127:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.368041:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.370176:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.381050:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.381083:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.381135:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.381433:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18922 00000100:00100000:0.0:1746147200.381440:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967310012160:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147200.381446:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147200.381455:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e260c00/0x3139939425060697 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7da3c expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147200.381477:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311322368:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147200.381499:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147200.382336:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.382468:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310012288 00000100:00100000:1.0:1746147200.382474:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310012288 00010000:00010000:1.0:1746147200.382502:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425060658 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2949119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9fd expref: 40 pid: 9584 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746147200.382539:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8558 00000100:00100000:1.0:1746147200.382546:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967310012288:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147200.382557:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147200.382577:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425060658 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2424832->2949119) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9fd expref: 40 pid: 9584 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746147200.382590:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425060658 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2424832->2949119) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9fd expref: 40 pid: 9584 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746147200.382613:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.382615:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.382623:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425060682 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da27 expref: 15 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.382636:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425060682 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da27 expref: 15 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.382663:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425060682 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da27 expref: 15 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147200.382674:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311322496:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147200.382742:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56580c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147200.384457:0:12225:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff880091d6fb80 x1830967311322368) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425060658 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2424832->2949119) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9fd expref: 39 pid: 9584 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746147200.384575:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425060658 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2424832->2949119) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9fd expref: 39 pid: 9584 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746147200.384602:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311322368:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147200.384622:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e260c00/0x3139939425060697 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da3c expref: 38 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.384631:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e260c00/0x3139939425060697 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da3c expref: 38 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.384707:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260c00, rc 0) 00000100:00100000:1.0:1746147200.384728:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967310012160:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3287us (3591us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147200.384738:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18922 00000100:00100000:1.0:1746147200.385532:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311322496:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147200.385544:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147200.385768:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967310012288:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3220us (3434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147200.385776:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8558 00000100:00100000:0.0:1746147200.387710:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.387742:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.387778:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.388119:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18925 00000100:00100000:1.0:1746147200.388128:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967310012672:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147200.388136:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147200.388144:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250606ac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7da51 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.388157:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.388158:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.388167:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250606ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da51 expref: 38 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.388190:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250606ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da51 expref: 38 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.388200:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbefa00, rc 0) 00000100:00100000:1.0:1746147200.388909:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967310012672:12345-192.168.204.25@tcp:101:cat.0 Request processed in 782us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147200.388916:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18925 00000100:00100000:0.0:1746147200.391378:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.391459:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.405195:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.423296:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.437740:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147200.441796:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147200.527277:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.533238:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.533294:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.534685:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.536764:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310014720 00000100:00100000:1.0:1746147200.536778:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310014720 00000100:00100000:1.0:1746147200.536859:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16254 00000100:00100000:1.0:1746147200.536868:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2484:x1830967310014720:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147200.536896:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147200.536917:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cca00/0x31399394250606e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7da6d expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.537013:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc800/0x31399394250606eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.537721:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc800/0x31399394250606eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.537734:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc800/0x31399394250606eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.537749:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc000/0x31399394250606f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.537756:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc000/0x31399394250606f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.537761:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc000/0x31399394250606f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.537877:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250606f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.537887:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250606f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.537894:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250606f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:1.0:1746147200.537906:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147200.537990:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc800/0x31399394250606eb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.537998:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc800/0x31399394250606eb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.538004:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc800/0x31399394250606eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.538009:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc800/0x31399394250606eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.538015:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a55cc800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147200.538019:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc800/0x31399394250606eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.538026:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc800/0x31399394250606eb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.538036:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147200.538040:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147200.538044:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc800/0x31399394250606eb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.538048:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc800/0x31399394250606eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.538060:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc000/0x31399394250606f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.538065:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc000/0x31399394250606f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.538072:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc000/0x31399394250606f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.538076:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a55cc000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147200.538078:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc000/0x31399394250606f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.538082:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc000/0x31399394250606f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.538086:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d4c7500) 00010000:00010000:1.0:1746147200.538105:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147200.538108:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc000/0x31399394250606f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.538112:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc000/0x31399394250606f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.538151:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cca00/0x31399394250606e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da6d expref: 34 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.538161:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250606f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da6d expref: 33 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.538168:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147200.538169:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147200.538171:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844a600, rc 0) 00000100:00100000:1.0:1746147200.538195:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2484:x1830967310014720:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1329us (3511us total) trans 8589937103 rc 0/0 00000100:00100000:1.0:1746147200.538201:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16254 00000100:00100000:0.0:1746147200.542640:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.543356:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310014848 00000100:00100000:1.0:1746147200.543367:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310014848 00000100:00100000:1.0:1746147200.543431:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 960 00000100:00100000:1.0:1746147200.543439:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967310014848:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147200.543454:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147200.543481:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250606f9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da6d expref: 33 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.543498:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147200.543502:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147200.543559:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967310014848:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 120us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147200.543565:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 960 00000100:00100000:0.0:1746147200.571560:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.571629:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310015232 00000100:00100000:1.0:1746147200.571634:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310015232 00000100:00100000:1.0:1746147200.571674:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16255 00000100:00100000:1.0:1746147200.571679:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2488:x1830967310015232:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147200.571696:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147200.571713:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x313993942506070e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7da7b expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.571781:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425060715 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.571794:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425060715 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.571804:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425060715 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.571819:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942506071c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.571824:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942506071c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.571829:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942506071c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.571934:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844be00/0x3139939425060723 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.571944:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844be00/0x3139939425060723 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.571950:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844be00/0x3139939425060723 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:1.0:1746147200.571957:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147200.572028:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425060715 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.572034:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425060715 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.572040:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425060715 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.572045:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425060715 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.572051:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844b400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147200.572055:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425060715 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.572061:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425060715 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.572072:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147200.572074:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147200.572078:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425060715 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.572082:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b400/0x3139939425060715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.572118:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942506071c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.572124:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942506071c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.572128:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942506071c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.572132:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844ae00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147200.572134:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942506071c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.572139:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942506071c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.572145:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d4c7200) 00010000:00010000:1.0:1746147200.572147:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147200.572149:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942506071c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.572153:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942506071c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.572188:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x313993942506070e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da7b expref: 13 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.572199:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844be00/0x3139939425060723 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da7b expref: 12 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.572205:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147200.572206:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147200.572209:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844be00, rc 0) 00000100:00100000:1.0:1746147200.572254:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2488:x1830967310015232:12345-192.168.204.25@tcp:101:cat.0 Request processed in 574us (695us total) trans 8589937104 rc 0/0 00000100:00100000:1.0:1746147200.572261:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16255 00000100:00100000:0.0:1746147200.575055:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000001:00080000:1.0:1746147200.585950:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842425 is committed 00000001:00080000:1.0:1746147200.585968:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842424 is committed 00000001:00080000:1.0:1746147200.586017:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842415 is committed 00000001:00080000:1.0:1746147200.586037:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842405 is committed 00000100:00100000:0.0:1746147200.602269:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310015616 00000100:00100000:0.0:1746147200.602280:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310015616 00000100:00100000:0.0:1746147200.602485:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18930 00000100:00100000:0.0:1746147200.602494:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2488:x1830967310015616:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147200.602511:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147200.602526:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a1f800/0x3139939425060738 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7da89 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.603869:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147200.603879:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a1f800/0x3139939425060738 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da89 expref: 10 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.603894:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a1f800/0x3139939425060738 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da89 expref: 10 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.603905:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a1f800, rc 0) 00000100:00100000:0.0:1746147200.603973:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2488:x1830967310015616:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1477us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147200.603981:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18930 00000100:00100000:1.0:1746147200.604171:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.609544:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.609613:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.611885:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.618544:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310017024 00000100:00100000:0.0:1746147200.618553:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310017024 00002000:00100000:0.0:1746147200.618598:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff8800769aea00 x1830967310017024/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:576/0 lens 488/0 e 0 to 0 dl 1746147211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147200.618619:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769aea00 with x1830967310017024 ext(0->1048575) 00002000:00010000:0.0:1746147200.618625:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769aea00 00000100:00100000:0.0:1746147200.618658:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310017152 00000100:00100000:0.0:1746147200.618661:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310017152 00002000:00100000:0.0:1746147200.618673:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x96:0x0] (1314816->2097151) req@ffff8800769ae680 x1830967310017152/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:576/0 lens 488/0 e 0 to 0 dl 1746147211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147200.618681:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ae680 with x1830967310017152 ext(1314816->2097151) 00002000:00010000:0.0:1746147200.618684:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769ae680 00000100:00100000:0.0:1746147200.618701:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6930 00000100:00100000:0.0:1746147200.618705:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967310017152:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147200.639033:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.639080:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.639194:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310017280 00000100:00100000:1.0:1746147200.639204:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310017280 00000100:00100000:1.0:1746147200.639582:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310017408 00000100:00100000:1.0:1746147200.639585:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310017408 00000100:00100000:1.0:1746147200.640219:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18932 00000100:00100000:1.0:1746147200.640225:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2484:x1830967310017408:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147200.640233:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147200.640244:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425060769 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7da9e expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.640262:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0afc00/0x3139939425060707 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da74 expref: 23 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.640270:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a1f800/0x3139939425060738 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da89 expref: 7 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.640275:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.640276:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147200.640278:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425060769 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [53248->581631] (req 53248->581631) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da9e expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.640297:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a1f800/0x3139939425060738 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da89 expref: 7 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.640305:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a1f800/0x3139939425060738 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da89 expref: 7 pid: 9584 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746147200.640313:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5574e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311323904:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147200.640756:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0afc00/0x3139939425060707 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da74 expref: 23 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.640765:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0afc00/0x3139939425060707 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da74 expref: 23 pid: 9584 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746147200.640773:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5574a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311324032:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147200.640790:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56589c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147200.647894:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.647960:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.647995:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147200.648449:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a1f800/0x3139939425060738 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da89 expref: 8 pid: 9584 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746147200.648466:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5574e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311323904:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147200.648474:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0afc00/0x3139939425060707 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da74 expref: 23 pid: 9584 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746147200.648481:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5574a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311324032:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147200.648501:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425060769 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 53248->581631) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da9e expref: 22 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.648508:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b64ae00, rc 0) 00000100:00100000:1.0:1746147200.648529:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2484:x1830967310017408:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8304us (9447us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147200.648534:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18932 00000100:00100000:0.0:1746147200.654879:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.655365:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.655509:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.655737:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310018048 00000100:00100000:1.0:1746147200.655742:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310018048 00000100:00100000:1.0:1746147200.655783:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18933 00000100:00100000:1.0:1746147200.655792:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310018048:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147200.655811:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147200.655830:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b64a200/0x3139939425060770 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7daac expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147200.655893:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5574a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311324288:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147200.655966:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56589c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147200.659897:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5574a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311324288:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147200.659929:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b64a200/0x3139939425060770 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daac expref: 19 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.659940:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b64a200/0x3139939425060770 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daac expref: 19 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.659969:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b64a200, rc 0) 00000100:00100000:1.0:1746147200.660015:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310018048:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4224us (4650us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147200.660024:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18933 00000100:00100000:1.0:1746147200.663436:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.663509:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.666274:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.666305:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.669459:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.669537:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.677077:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.695827:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.695947:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.707568:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.708222:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.708243:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310020352 00000100:00100000:0.0:1746147200.708249:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310020352 00010000:00010000:0.0:1746147200.708280:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009400ba00/0x3139939425060516 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d955 expref: 13 pid: 17600 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746147200.708300:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310020480 00000100:00100000:0.0:1746147200.708301:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310020480 00010000:00010000:0.0:1746147200.708310:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbeec00/0x31399394250605c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d98d expref: 19 pid: 13695 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746147200.708335:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8563 00000100:00100000:0.0:1746147200.708343:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310020352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147200.708355:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147200.708367:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8564 00010000:00010000:0.0:1746147200.708375:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009400ba00/0x3139939425060516 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d955 expref: 13 pid: 17600 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746147200.708376:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2000:x1830967310020480:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147200.708383:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147200.708384:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009400ba00/0x3139939425060516 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d955 expref: 13 pid: 17600 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746147200.708394:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbeec00/0x31399394250605c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d98d expref: 19 pid: 13695 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147200.708406:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009400ba00/0x3139939425060516 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d955 expref: 13 pid: 17600 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746147200.708410:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbeec00/0x31399394250605c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d98d expref: 19 pid: 13695 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746147200.708424:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbeec00/0x31399394250605c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d98d expref: 19 pid: 13695 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147200.709085:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147200.709150:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310020352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 807us (1593us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147200.709157:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8563 00000100:00100000:0.0:1746147200.709232:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.709248:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310020608 00000100:00100000:0.0:1746147200.709252:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310020608 00010000:00010000:0.0:1746147200.709266:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x3139939425060620 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9cc expref: 39 pid: 13695 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746147200.710302:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8565 00000100:00100000:0.0:1746147200.710314:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2002:x1830967310020608:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147200.710333:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147200.710354:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x3139939425060620 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9cc expref: 39 pid: 13695 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147200.710367:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x3139939425060620 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9cc expref: 39 pid: 13695 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147200.710389:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x3139939425060620 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9cc expref: 39 pid: 13695 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147200.710404:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147200.710406:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147200.710413:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060793 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1544192->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dac8 expref: 18 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.710421:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060793 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1544192->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dac8 expref: 18 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.710456:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060793 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1544192->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dac8 expref: 18 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147200.710468:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801322e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311325312:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147200.710544:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c86c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147200.711688:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147200.711746:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310020480:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3367us (3520us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147200.711756:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8564 00000100:00100000:0.0:1746147200.717372:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801322e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311325312:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147200.717389:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147200.717424:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967310020608:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7114us (8192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147200.717433:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8565 00000100:00100000:0.0:1746147200.728532:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.731308:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.733032:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310020992 00000100:00100000:0.0:1746147200.733043:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310020992 00000100:00100000:0.0:1746147200.733119:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18940 00000100:00100000:0.0:1746147200.733127:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967310020992:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147200.733141:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147200.733157:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d49e00/0x31399394250607a1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dacf expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147200.733206:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801322e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311325824:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147200.733285:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147200.736193:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.736227:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.736367:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310021376 00000100:00100000:1.0:1746147200.736374:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310021376 00010000:00010000:1.0:1746147200.736408:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095053a00/0x3139939425060627 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9d3 expref: 22 pid: 13695 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746147200.738119:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310021248 00000100:00100000:1.0:1746147200.738127:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310021248 00010000:00010000:1.0:1746147200.738153:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x31399394250605d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d994 expref: 9 pid: 12225 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746147200.741373:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00010000:1.0:1746147200.742304:0:12225:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime: 1746147198 -> 1746147200 00002000:00010000:1.0:1746147200.742308:0:12225:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime: 1746147198 -> 1746147200 00002000:00010000:1.0:1746147200.742310:0:12225:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime: 1746147198 -> 1746147200 00000100:00100000:1.0:1746147200.742323:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801322e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311325824:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147200.742344:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d49e00/0x31399394250607a1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dacf expref: 37 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.742352:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d49e00/0x31399394250607a1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dacf expref: 37 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.742374:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49e00, rc 0) 00000100:00100000:1.0:1746147200.744586:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967310020992:12345-192.168.204.25@tcp:101:cat.0 Request processed in 11451us (13270us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147200.744598:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18940 00000100:00100000:0.0:1746147200.745537:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311325952:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147200.745559:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147200.745595:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f78050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2003:x1830967310021504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3846us (4221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147200.745604:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8568 00000100:00100000:0.0:1746147200.748521:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.749661:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.750287:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310021888 00000100:00100000:1.0:1746147200.750291:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310021888 00000100:00100000:1.0:1746147200.750331:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18941 00000100:00100000:1.0:1746147200.750337:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967310021888:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147200.750378:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147200.750853:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147200.750864:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009504e600/0x31399394250607af lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dadd expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147200.750891:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311326208:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147200.750915:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56589c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147200.753857:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311326208:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147200.753877:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009504e600/0x31399394250607af lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dadd expref: 37 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.753887:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009504e600/0x31399394250607af lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dadd expref: 37 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.753907:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504e600, rc 0) 00000100:00100000:1.0:1746147200.754084:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967310021888:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3746us (4422us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147200.754105:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18941 00000100:00100000:0.0:1746147200.757656:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.757698:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.757781:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310022144 00000100:00100000:1.0:1746147200.757791:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310022144 00000100:00100000:1.0:1746147200.757835:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310022272 00000100:00100000:1.0:1746147200.757837:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310022272 00000100:00100000:1.0:1746147200.757877:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18943 00000100:00100000:1.0:1746147200.757885:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967310022144:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147200.757904:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147200.757923:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009504e000/0x31399394250607b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7daeb expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147200.757986:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311326336:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147200.758063:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56589c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147200.761786:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311326336:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147200.761808:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009504e000/0x31399394250607b6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daeb expref: 37 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.761818:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009504e000/0x31399394250607b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daeb expref: 37 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.761831:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504e000, rc 0) 00000100:00100000:1.0:1746147200.761867:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967310022144:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3982us (4221us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147200.761873:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18943 00000100:00100000:0.0:1746147200.767588:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147200.779044:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147200.872325:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.876203:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.879346:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.880723:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310023168 00000100:00100000:1.0:1746147200.880730:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310023168 00000100:00100000:1.0:1746147200.880768:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16258 00000100:00100000:1.0:1746147200.880773:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2497:x1830967310023168:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147200.880785:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147200.880803:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f000/0x31399394250607e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7db00 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.880872:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x31399394250607e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.880885:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x31399394250607e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.880896:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x31399394250607e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.880905:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x31399394250607ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.880910:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x31399394250607ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.880915:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x31399394250607ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.880990:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e000/0x31399394250607f5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.880999:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e000/0x31399394250607f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.881005:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e000/0x31399394250607f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:1.0:1746147200.881012:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147200.881055:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x31399394250607e7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.881061:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x31399394250607e7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.881067:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x31399394250607e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.881073:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x31399394250607e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.881078:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009504fa00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147200.881081:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x31399394250607e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.881100:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x31399394250607e7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.881110:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147200.881113:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147200.881116:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x31399394250607e7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.881120:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x31399394250607e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.881134:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x31399394250607ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.881138:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x31399394250607ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.881142:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x31399394250607ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.881145:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009504f800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147200.881147:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x31399394250607ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.881155:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x31399394250607ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.881160:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8801369dd800) 00010000:00010000:1.0:1746147200.881162:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147200.881163:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x31399394250607ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.881167:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x31399394250607ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.881189:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f000/0x31399394250607e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db00 expref: 19 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.881198:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e000/0x31399394250607f5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db00 expref: 18 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.881203:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147200.881205:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147200.881208:0:7239:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x31399394250607d9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.881213:0:7239:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x31399394250607d9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.881218:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504e000, rc 0) 00000100:00100000:1.0:1746147200.881606:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2497:x1830967310023168:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 831us (2261us total) trans 8589937111 rc 0/0 00000100:00100000:1.0:1746147200.881612:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16258 00000100:00100000:0.0:1746147200.923332:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.923381:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.923398:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310023296 00000100:00100000:0.0:1746147200.923410:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.923412:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310023296 00000100:00100000:0.0:1746147200.923446:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310023552 00000100:00100000:0.0:1746147200.923449:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310023552 00000100:00100000:1.0:1746147200.923461:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310023680 00000100:00100000:1.0:1746147200.923463:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310023680 00000100:00100000:0.0:1746147200.923473:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16259 00010000:00010000:1.0:1746147200.923476:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ac00/0x3139939425060594 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d978 expref: 20 pid: 7237 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746147200.923481:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2501:x1830967310023552:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147200.923495:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8569 00010000:00010000:0.0:1746147200.923499:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147200.923501:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310023680:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147200.923512:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147200.923515:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x3139939425060803 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7db07 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.923518:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ac00/0x3139939425060594 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d978 expref: 20 pid: 7237 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746147200.923530:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ac00/0x3139939425060594 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d978 expref: 21 pid: 7237 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746147200.923548:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822ac00/0x3139939425060594 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d978 expref: 21 pid: 7237 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746147200.923564:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147200.923569:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x31399394250607d9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147200.923577:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942506080a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.923580:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x31399394250607d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.923586:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x31399394250607d9 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147200.923586:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942506080a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147200.923595:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942506080a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147200.923602:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48c00/0x3139939425060811 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.923604:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147200.923608:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48c00/0x3139939425060811 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147200.923612:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48c00/0x3139939425060811 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:1.0:1746147200.923645:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310023680:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 143us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147200.923656:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8569 00000100:00100000:1.0:1746147200.923671:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 962 00000100:00100000:1.0:1746147200.923676:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2003:x1830967310023296:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147200.923685:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147200.923693:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e000/0x31399394250607f5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db00 expref: 19 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.923698:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49200/0x3139939425060818 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.923701:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147200.923704:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147200.923705:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49200/0x3139939425060818 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147200.923710:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49200/0x3139939425060818 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:1.0:1746147200.923717:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310023296:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 41us (395us total) trans 0 rc 0/0 00000004:00200000:0.0:1746147200.923717:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000100:00100000:1.0:1746147200.923723:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 962 00010000:00010000:0.0:1746147200.923793:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942506080a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147200.923799:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942506080a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147200.923811:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942506080a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147200.923816:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942506080a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147200.923821:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d48600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147200.923824:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x31399394250607d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147200.923824:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942506080a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147200.923830:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942506080a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.923831:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x31399394250607d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147200.923836:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147200.923847:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147200.923850:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942506080a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147200.923858:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48600/0x313993942506080a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00000004:00200000:1.0:1746147200.923864:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:1.0:1746147200.923868:0:7237:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1746147200.923868:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48c00/0x3139939425060811 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147200.923873:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48c00/0x3139939425060811 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147200.923877:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48c00/0x3139939425060811 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147200.923880:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d48c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147200.923882:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48c00/0x3139939425060811 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00000004:00010000:1.0:1746147200.923884:0:7237:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x31399394250607d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147200.923886:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48c00/0x3139939425060811 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147200.923892:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8801369dd800) 00010000:00010000:1.0:1746147200.923893:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x31399394250607d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147200.923894:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147200.923896:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48c00/0x3139939425060811 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.923900:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250607cb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147200.923900:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48c00/0x3139939425060811 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147200.923905:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250607cb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.923910:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250607cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.923915:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250607cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.923919:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147200.923922:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250607cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147200.923926:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49e00/0x3139939425060803 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db07 expref: 19 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.923927:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250607cb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.923934:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147200.923935:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49200/0x3139939425060818 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db07 expref: 18 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.923936:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147200.923939:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250607cb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.923943:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250607cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147200.923945:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147200.923947:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147200.923949:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49200, rc 0) 00000100:00100000:0.0:1746147200.923969:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2501:x1830967310023552:12345-192.168.204.25@tcp:101:cat.0 Request processed in 490us (588us total) trans 8589937112 rc 0/0 00000100:00100000:0.0:1746147200.923974:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16259 00010000:00010000:1.0:1746147200.924438:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250607d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.924445:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250607d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.924449:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250607d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.924453:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147200.924456:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250607d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.924469:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250607d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.924476:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8801369dd800) 00010000:00010000:1.0:1746147200.924478:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147200.924480:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250607d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.924485:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250607d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.924510:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x31399394250607c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daf9 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.924520:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x31399394250607d9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daf9 expref: 7 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.924525:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147200.924527:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147200.924529:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7400, rc 0) 00000100:00100000:1.0:1746147200.924566:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2495:x1830967310022656:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 52055us (52247us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147200.924571:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16257 00000100:00100000:0.0:1746147200.928655:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.929384:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310023808 00000100:00100000:1.0:1746147200.929395:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310023808 00000100:00100000:1.0:1746147200.929515:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18945 00000100:00100000:1.0:1746147200.929525:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2002:x1830967310023808:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147200.929545:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147200.929566:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009504e600/0x3139939425060826 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7db0e expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147200.929624:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311326720:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147200.929711:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147200.933197:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.933219:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.933242:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.933257:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.933272:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.933379:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311326720:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147200.933412:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009504e600/0x3139939425060826 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db0e expref: 8 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.933430:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009504e600/0x3139939425060826 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db0e expref: 8 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.933443:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504e600, rc 0) 00000100:00100000:1.0:1746147200.933470:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18947 00000100:00100000:1.0:1746147200.933476:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967310024192:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147200.933489:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147200.933499:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x3139939425060834 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7db23 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147200.933524:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311326976:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147200.933565:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18948 00000100:00100000:0.0:1746147200.933574:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967310024448:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147200.933581:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147200.933590:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x313993942506083b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7db31 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.933601:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147200.933603:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147200.933612:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x313993942506083b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db31 expref: 16 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147200.933626:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x313993942506083b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db31 expref: 17 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147200.933635:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49c00, rc 0) 00000100:00100000:0.0:1746147200.933654:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967310024448:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 82us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147200.933660:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18948 00000100:00100000:1.0:1746147200.933739:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147200.933996:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2002:x1830967310023808:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4472us (5350us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147200.934002:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18945 00000100:00100000:0.0:1746147200.936913:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.937042:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310024704 00000100:00100000:1.0:1746147200.937050:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310024704 00000100:00100000:1.0:1746147200.937121:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16260 00000100:00100000:1.0:1746147200.937130:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2502:x1830967310024704:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147200.937154:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147200.937173:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x3139939425060850 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7db38 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.937251:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425060857 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.937264:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425060857 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.937274:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425060857 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.937286:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x313993942506085e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.937293:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x313993942506085e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.937297:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x313993942506085e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.937399:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425060865 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.937410:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425060865 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.937417:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425060865 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:1.0:1746147200.937426:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000100:00100000:0.0:1746147200.938719:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310024832 00000100:00100000:0.0:1746147200.938724:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310024832 00000100:00100000:0.0:1746147200.938771:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18951 00000100:00100000:0.0:1746147200.938778:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2501:x1830967310024832:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147200.938790:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147200.938808:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d48000/0x3139939425060873 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7db3f expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.938831:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425060769 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 53248->581631) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da9e expref: 20 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.938848:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147200.938850:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147200.938854:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d48000/0x3139939425060873 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db3f expref: 8 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.938885:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425060769 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 53248->581631) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da9e expref: 20 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.938898:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425060769 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 53248->581631) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da9e expref: 20 pid: 12201 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746147200.938909:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311327232:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147200.938988:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c86c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147200.939237:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425060857 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.939244:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425060857 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.939250:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425060857 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.939255:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425060857 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.939262:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009504f800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147200.939266:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425060857 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.939272:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425060857 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.939284:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147200.939287:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147200.939291:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425060857 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.939295:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504f800/0x3139939425060857 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.939306:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x313993942506085e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.939314:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x313993942506085e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.939319:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x313993942506085e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.939322:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009504fa00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147200.939324:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x313993942506085e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.939329:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x313993942506085e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.939334:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098006800) 00010000:00010000:1.0:1746147200.939336:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147200.939338:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x313993942506085e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.939343:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504fa00/0x313993942506085e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.939387:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009504e400/0x3139939425060850 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db38 expref: 37 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.939399:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425060865 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db38 expref: 36 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.939405:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147200.939406:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147200.939409:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fe000, rc 0) 00000100:00100000:1.0:1746147200.939739:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2502:x1830967310024704:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2608us (2832us total) trans 8589937113 rc 0/0 00000100:00100000:1.0:1746147200.939747:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16260 00000100:00100000:0.0:1746147200.941690:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311327232:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147200.941707:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d48000/0x3139939425060873 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db3f expref: 8 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.941720:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d48000, rc 0) 00000100:00100000:1.0:1746147200.941848:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311326976:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147200.941868:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x3139939425060834 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db23 expref: 15 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.941877:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x3139939425060834 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db23 expref: 15 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147200.941885:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504f400, rc 0) 00000100:00100000:0.0:1746147200.942716:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2501:x1830967310024832:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3937us (4057us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147200.942721:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18951 00000100:00100000:1.0:1746147200.942726:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967310024192:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 9250us (9505us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147200.942731:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18947 00000100:00100000:0.0:1746147200.942934:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310024960 00000100:00100000:0.0:1746147200.942941:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310024960 00002000:00100000:0.0:1746147200.942978:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x93:0x0] (53248->581631) req@ffff880094525180 x1830967310024960/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:576/0 lens 488/0 e 0 to 0 dl 1746147211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147200.942988:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094525180 with x1830967310024960 ext(53248->581631) 00010000:00010000:0.0:1746147200.942995:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425060769 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 53248->581631) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da9e expref: 21 pid: 12201 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746147200.943009:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425060769 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 53248->581631) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da9e expref: 21 pid: 12201 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746147200.943015:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094525180 00000100:00100000:0.0:1746147200.944368:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1611 00000100:00100000:0.0:1746147200.944381:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310024960:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147200.945273:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.945348:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310025216 00000100:00100000:1.0:1746147200.945356:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310025216 00000100:00100000:1.0:1746147200.945398:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16261 00000100:00100000:1.0:1746147200.945404:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2495:x1830967310025216:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147200.945417:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147200.945437:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fec00/0x313993942506087a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7db46 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.945542:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425060881 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.945558:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49200/0x3139939425060818 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db07 expref: 17 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.945565:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x31399394250607d9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daf9 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.945573:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425060865 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db38 expref: 35 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.945580:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425060881 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147200.945612:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425060865 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db38 expref: 35 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.945622:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe000/0x3139939425060865 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db38 expref: 35 pid: 7237 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746147200.945635:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311327360:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147200.947865:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x31399394250607d9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daf9 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.947880:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x31399394250607d9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daf9 expref: 8 pid: 7237 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746147200.947894:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311327488:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147200.948907:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49200/0x3139939425060818 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db07 expref: 17 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147200.948923:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49200/0x3139939425060818 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db07 expref: 17 pid: 7239 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746147200.948936:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311327616:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147200.948992:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147200.953232:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.953282:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.960444:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967310024960:12345-192.168.204.25@tcp:4:cat.0 Request processed in 16053us (17640us total) trans 21474842426 rc 0/0 00000100:00100000:0.0:1746147200.960457:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1611 00002000:00100000:0.0:1746147200.960473:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x93:0x0] (53248->581631) req@ffff880094525180 x1830967310024960/t21474842426(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:576/0 lens 488/448 e 0 to 0 dl 1746147211 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147200.960482:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094525180 with x1830967310024960 ext(53248->581631) 00010000:00010000:0.0:1746147200.960493:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425060769 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 53248->581631) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da9e expref: 23 pid: 12201 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746147200.960507:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b64ae00/0x3139939425060769 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 53248->581631) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da9e expref: 23 pid: 12201 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746147200.960515:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094525180 00000100:00100000:0.0:1746147200.960829:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310025472 00000100:00100000:0.0:1746147200.960845:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310025472 00010000:00010000:0.0:1746147200.960871:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x31399394250607d9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daf9 expref: 9 pid: 7237 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746147200.960903:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8572 00000100:00100000:0.0:1746147200.960909:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310025472:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147200.960923:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147200.960929:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x31399394250607d9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daf9 expref: 9 pid: 7237 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746147200.960939:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x31399394250607d9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daf9 expref: 9 pid: 7237 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746147200.960961:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7400/0x31399394250607d9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daf9 expref: 9 pid: 7237 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746147200.960984:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147200.960991:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425060881 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147200.961001:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425060881 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147200.961008:0:4349:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425060881 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147200.961028:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147200.961053:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967310025472:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 144us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147200.961059:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8572 00000100:00100000:0.0:1746147200.963726:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.963776:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.983391:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.986921:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.993675:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.993716:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.994062:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310026368 00000100:00100000:1.0:1746147200.994071:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310026368 00000100:00100000:0.0:1746147200.994147:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.994154:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310026624 00000100:00100000:1.0:1746147200.994156:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310026624 00000100:00100000:0.0:1746147200.994178:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.994512:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310026496 00000100:00100000:1.0:1746147200.994515:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310026496 00000100:00100000:1.0:1746147200.994538:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18952 00000100:00100000:1.0:1746147200.994547:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2003:x1830967310026368:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:1.0:1746147200.994572:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18954 00000100:00100000:1.0:1746147200.994577:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967310026496:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147200.994591:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147200.994614:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506089d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7db5b expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147200.994664:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311328000:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147200.994712:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147200.994719:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x31399394250608ab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7db54 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147200.994730:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147200.994732:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147200.994741:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00010000:00010000:0.0:1746147200.994741:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x31399394250608ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db54 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147200.994754:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d49400/0x31399394250608ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db54 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147200.994765:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49400, rc 0) 00000100:00100000:0.0:1746147200.994990:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310026368:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 444us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147200.994995:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18952 00000100:00100000:1.0:1746147200.998424:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147200.998462:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147200.998765:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310027776 00000100:00100000:0.0:1746147200.998769:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310027776 00000100:00100000:0.0:1746147200.998798:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18955 00000100:00100000:0.0:1746147200.998804:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2497:x1830967310027776:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147200.998814:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.000268:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d9b800/0x31399394250608d5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7db70 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.000291:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425060682 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da27 expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.000300:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x313993942506083b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db31 expref: 15 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.000308:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250606ac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da51 expref: 35 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.000314:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.000317:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.000320:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d9b800/0x31399394250608d5 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2375680->3145727] (req 2375680->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db70 expref: 23 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.000352:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250606ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da51 expref: 35 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.000365:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250606ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da51 expref: 35 pid: 12225 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746147201.000378:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db15180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311328256:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147201.000456:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x313993942506083b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db31 expref: 15 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.000465:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x313993942506083b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db31 expref: 15 pid: 17600 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746147201.000473:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db17100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311328384:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147201.000498:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425060682 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da27 expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.000506:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425060682 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da27 expref: 23 pid: 12201 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746147201.000519:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db15880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311328512:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147201.000535:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147201.003993:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.004028:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311328000:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147201.004063:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506089d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db5b expref: 15 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.004077:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506089d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db5b expref: 15 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.004120:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e5c6e00, rc 0) 00000100:00100000:1.0:1746147201.004150:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310027904 00000100:00100000:1.0:1746147201.004156:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310027904 00000100:00100000:1.0:1746147201.004201:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18956 00000100:00100000:1.0:1746147201.004208:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2502:x1830967310027904:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147201.004222:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147201.004234:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d98200/0x31399394250608dc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7db77 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.004257:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f380800/0x3139939425060762 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da97 expref: 37 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.004265:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x3139939425060842 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db1c expref: 14 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.004272:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f381400/0x313993942506077e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daba expref: 23 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.004278:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.004280:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.004283:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d98200/0x31399394250608dc lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [1908736->2097151] (req 1908736->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db77 expref: 37 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.004309:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f381400/0x313993942506077e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daba expref: 23 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.004322:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f381400/0x313993942506077e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daba expref: 23 pid: 9584 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746147201.004333:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311328640:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147201.004867:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x3139939425060842 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db1c expref: 14 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.004876:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x3139939425060842 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db1c expref: 14 pid: 1398 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746147201.004883:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f084700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311328768:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147201.004909:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f380800/0x3139939425060762 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da97 expref: 37 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.004917:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f380800/0x3139939425060762 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da97 expref: 37 pid: 9584 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746147201.004925:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f084380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311328896:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147201.005429:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147201.005456:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967310026496:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 10878us (11309us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147201.005462:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18954 00000100:00100000:0.0:1746147201.011573:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.012064:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.012174:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2002:x1830967310027136:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14023us (14158us total) trans 0 rc 495616/495616 00000100:00100000:0.0:1746147201.012182:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6939 00002000:00100000:0.0:1746147201.012190:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1544191) req@ffff880094524a80 x1830967310027136/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:576/0 lens 488/440 e 0 to 0 dl 1746147211 ref 1 fl Complete:/200/0 rc 495616/495616 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147201.012198:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094524a80 with x1830967310027136 ext(1048576->1544191) 00002000:00010000:0.0:1746147201.012203:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094524a80 00000100:00100000:1.0:1746147201.012266:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310028032 00000100:00100000:1.0:1746147201.012273:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310028032 00010000:00010000:1.0:1746147201.012307:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x313993942506083b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db31 expref: 14 pid: 17600 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746147201.012520:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310028160 00000100:00100000:1.0:1746147201.012524:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310028160 00010000:00010000:1.0:1746147201.012538:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425060682 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da27 expref: 19 pid: 12201 timeout: 838 lvb_type: 0 00000100:00080000:0.0:1746147201.013150:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147201.013188:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.013208:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.013455:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310028288 00000100:00100000:1.0:1746147201.013459:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310028288 00010000:00010000:1.0:1746147201.013475:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250606ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da51 expref: 38 pid: 12225 timeout: 838 lvb_type: 1 00000100:00100000:1.0:1746147201.013492:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8577 00000100:00100000:1.0:1746147201.013496:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967310028288:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147201.013503:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147201.013513:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250606ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da51 expref: 38 pid: 12225 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746147201.013524:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250606ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da51 expref: 38 pid: 12225 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746147201.013537:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250606ac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da51 expref: 38 pid: 12225 timeout: 838 lvb_type: 1 00010000:00010000:1.0:1746147201.013546:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.013548:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.013555:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d9b800/0x31399394250608d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2375680->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db70 expref: 17 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.013563:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d9b800/0x31399394250608d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2375680->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db70 expref: 17 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.013590:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d9b800/0x31399394250608d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2375680->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db70 expref: 17 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147201.013601:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311329024:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147201.013653:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147201.013679:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311328640:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147201.013687:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311328768:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147201.013695:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311328896:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147201.013716:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d98200/0x31399394250608dc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [1908736->2097151] (req 1908736->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db77 expref: 37 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.013724:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d98200, rc 0) 00000100:00100000:1.0:1746147201.013741:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2502:x1830967310027904:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 9533us (9758us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.013747:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18956 00000100:00100000:0.0:1746147201.014539:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.014600:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.014648:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310028928 00000100:00100000:1.0:1746147201.014651:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310028928 00000100:00100000:1.0:1746147201.014670:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310029056 00000100:00100000:1.0:1746147201.014672:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310029056 00000100:00100000:1.0:1746147201.014684:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18957 00000100:00100000:1.0:1746147201.014689:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2002:x1830967310028928:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147201.014697:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147201.014707:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db80400/0x31399394250608f1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7db85 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.014718:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.014720:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.014725:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db80400/0x31399394250608f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db85 expref: 23 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.014737:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db80400/0x31399394250608f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db85 expref: 23 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.014744:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80400, rc 0) 00000100:00100000:1.0:1746147201.014761:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967310028928:12345-192.168.204.25@tcp:101:cat.0 Request processed in 72us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.014766:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18957 00000100:00100000:1.0:1746147201.014775:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18958 00000100:00100000:1.0:1746147201.014779:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967310029056:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147201.014785:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147201.014791:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x31399394250608f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7db8c expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.014802:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.014807:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x31399394250608f8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db8c expref: 38 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.014820:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x31399394250608f8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db8c expref: 38 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.014826:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80a00, rc 0) 00000100:00100000:1.0:1746147201.014849:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967310029056:12345-192.168.204.25@tcp:101:cat.0 Request processed in 69us (248us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147201.014854:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18958 00000100:00080000:1.0:1746147201.014866:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147201.015550:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311329024:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147201.015561:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147201.015578:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967310028288:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2081us (2368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.015586:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8577 00000100:00100000:0.0:1746147201.015785:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.015796:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.015825:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.015856:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.015871:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310028672 00000100:00100000:0.0:1746147201.015874:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310028672 00010000:00010000:0.0:1746147201.015886:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f381400/0x313993942506077e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daba expref: 19 pid: 9584 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746147201.015902:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310028800 00000100:00100000:0.0:1746147201.015904:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310028800 00010000:00010000:0.0:1746147201.015915:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x3139939425060842 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db1c expref: 13 pid: 1398 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746147201.015926:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8578 00000100:00100000:0.0:1746147201.015930:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2000:x1830967310028672:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147201.015937:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147201.015951:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88008f381400/0x313993942506077e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daba expref: 19 pid: 9584 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147201.015958:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f381400/0x313993942506077e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daba expref: 19 pid: 9584 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147201.015970:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f381400/0x313993942506077e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7daba expref: 19 pid: 9584 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147201.015983:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147201.016000:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310028672:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 69us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.016005:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8578 00000100:00100000:0.0:1746147201.016016:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8579 00000100:00100000:0.0:1746147201.016020:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310028800:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147201.016026:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147201.016032:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x3139939425060842 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db1c expref: 13 pid: 1398 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147201.016040:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x3139939425060842 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db1c expref: 13 pid: 1398 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147201.016051:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x3139939425060842 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db1c expref: 13 pid: 1398 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746147201.016063:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147201.016076:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310028800:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 56us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.016081:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8579 00000100:00100000:0.0:1746147201.016116:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18961 00000100:00100000:0.0:1746147201.016120:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967310029440:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147201.016126:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.016133:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f15f800/0x313993942506090d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dba1 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147201.016155:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db15c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311329408:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147201.016176:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147201.016195:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.016748:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.017658:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310029824 00000100:00100000:1.0:1746147201.017662:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310029824 00010000:00010000:1.0:1746147201.017678:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f380800/0x3139939425060762 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da97 expref: 38 pid: 9584 timeout: 838 lvb_type: 0 00000100:00100000:1.0:1746147201.017695:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8580 00000100:00100000:1.0:1746147201.017700:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310029824:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147201.017707:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147201.017715:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88008f380800/0x3139939425060762 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da97 expref: 38 pid: 9584 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746147201.017732:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f380800/0x3139939425060762 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da97 expref: 38 pid: 9584 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746147201.017748:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f380800/0x3139939425060762 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da97 expref: 38 pid: 9584 timeout: 838 lvb_type: 0 00010000:00010000:1.0:1746147201.017758:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.017760:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.017766:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d98200/0x31399394250608dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1908736->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db77 expref: 37 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.017774:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d98200/0x31399394250608dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1908736->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db77 expref: 37 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.017795:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091d98200/0x31399394250608dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1908736->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db77 expref: 37 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.017805:0:4349:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d98200/0x31399394250608dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1908736->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db77 expref: 37 pid: 9585 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746147201.017814:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311329536:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147201.017869:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147201.018814:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.019907:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.020111:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db15c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311329408:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147201.020135:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f15f800/0x313993942506090d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dba1 expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.020149:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f15f800/0x313993942506090d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dba1 expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.020160:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f15f800, rc 0) 00000100:00100000:1.0:1746147201.020193:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967310029440:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4072us (4395us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147201.020198:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18961 00000100:00100000:1.0:1746147201.020211:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310030208 00000100:00100000:1.0:1746147201.020214:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310030208 00000100:00100000:1.0:1746147201.020232:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18962 00000100:00100000:1.0:1746147201.020238:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967310030208:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147201.020249:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147201.020261:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d99200/0x3139939425060914 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dba8 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147201.020298:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f084380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311329664:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147201.020343:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147201.021368:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311329536:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147201.021381:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147201.021400:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310029824:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3700us (5204us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.021408:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8580 00000100:00100000:0.0:1746147201.021666:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.029596:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.029664:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.031667:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.035017:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3764:1830967311329920:0@lo:400:kworker.0 00000100:00100000:1.0:1746147201.035113:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147201.035256:0:8099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311329920 00000100:00100000:1.0:1746147201.035263:0:8099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311329920 00000100:00100000:1.0:1746147201.035305:0:8099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1746147201.035312:0:8099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3764:x1830967311329920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147201.035353:0:8099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3764:x1830967311329920:12345-0@lo:400:kworker.0 Request processed in 41us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.035359:0:8099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1746147201.035396:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3764:1830967311329920:0@lo:400:kworker.0 00000100:00100000:1.0:1746147201.036697:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967311330048:0@lo:400:kworker.0 00000100:00100000:0.0:1746147201.036697:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311330304:0@lo:400:kworker.0 00000100:00100000:1.0:1746147201.036733:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147201.036735:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147201.037695:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3765:1830967311330560:0@lo:400:kworker.0 00000100:00100000:1.0:1746147201.037719:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147201.037736:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311331072:0@lo:400:kworker.0 00000100:00100000:1.0:1746147201.037753:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147201.037767:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1746147201.037771:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967311330432:0@lo:400:kworker.0 00000100:00100000:1.0:1746147201.037788:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147201.037799:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3765:1830967311330944:0@lo:400:kworker.0 00000100:00100000:1.0:1746147201.037814:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147201.037816:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3767:1830967311330816:0@lo:400:kworker.0 00000100:00100000:1.0:1746147201.037826:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3765:1830967311331456:0@lo:400:kworker.0 00000100:00100000:0.0:1746147201.037848:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147201.037870:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311330560 00000100:00100000:1.0:1746147201.037874:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311330560 00000100:00100000:0.0:1746147201.037874:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311331328:0@lo:400:kworker.0 00000100:00100000:0.0:1746147201.037896:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147201.037906:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311330944 00000100:00100000:1.0:1746147201.037909:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311330944 00000100:00100000:1.0:1746147201.037923:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311330816 00000100:00100000:0.0:1746147201.037924:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311330304 00000100:00100000:1.0:1746147201.037925:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311330816 00000100:00100000:0.0:1746147201.037927:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311330304 00000100:00100000:1.0:1746147201.037940:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1746147201.037945:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3765:x1830967311330560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147201.037971:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3765:x1830967311330560:12345-0@lo:400:kworker.0 Request processed in 26us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.037976:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1746147201.037987:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311330176 00000100:00100000:1.0:1746147201.037989:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311330176 00000100:00100000:1.0:1746147201.037997:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:1.0:1746147201.038001:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3765:x1830967311330944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147201.038019:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3765:x1830967311330944:12345-0@lo:400:kworker.0 Request processed in 18us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.038023:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:1.0:1746147201.038029:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311330688 00000100:00100000:1.0:1746147201.038031:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311330688 00000100:00100000:1.0:1746147201.038040:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:1.0:1746147201.038043:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3767:x1830967311330816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147201.038065:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3767:x1830967311330816:12345-0@lo:400:kworker.0 Request processed in 21us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.038070:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:1.0:1746147201.038078:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:1.0:1746147201.038081:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3766:x1830967311330688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147201.038119:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3766:x1830967311330688:12345-0@lo:400:kworker.0 Request processed in 37us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.038124:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00080000:1.0:1746147201.038138:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746147201.038142:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1746147201.038143:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147201.038154:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147201.038178:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3765:1830967311330560:0@lo:400:kworker.0 00000100:00100000:1.0:1746147201.038186:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311331072:0@lo:400:kworker.0 00000100:00100000:1.0:1746147201.038205:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3765:1830967311330944:0@lo:400:kworker.0 00000100:00100000:0.0:1746147201.039107:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311330432 00000100:00100000:0.0:1746147201.039111:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311330432 00000100:00100000:0.0:1746147201.039128:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311331328 00000100:00100000:0.0:1746147201.039130:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311331328 00000100:00100000:1.0:1746147201.039141:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3765:1830967311331456:0@lo:400:kworker.0 00000100:00100000:0.0:1746147201.039147:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311331200 00000100:00100000:0.0:1746147201.039149:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311331200 00000100:00080000:1.0:1746147201.039154:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746147201.039156:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147201.039164:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:0.0:1746147201.039168:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311330304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147201.039552:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967311330048:0@lo:400:kworker.0 00000100:00100000:0.0:1746147201.040113:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311330304:12345-0@lo:400:kworker.0 Request processed in 944us (3377us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.040119:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:0.0:1746147201.040150:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311330304:0@lo:400:kworker.0 00000100:00100000:0.0:1746147201.040162:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3767:1830967311330816:0@lo:400:kworker.0 00000100:00100000:0.0:1746147201.040170:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311331328:0@lo:400:kworker.0 00000100:00100000:0.0:1746147201.040242:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.040298:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.040310:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310031360 00000100:00100000:0.0:1746147201.040314:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310031360 00000100:00100000:0.0:1746147201.040336:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18964 00000100:00100000:0.0:1746147201.040340:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2497:x1830967310031360:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147201.040350:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.040372:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbec600/0x3139939425060922 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dbb6 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.040427:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800940c5c00/0x313993942506051d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d963 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.040436:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095052e00/0x313993942506062e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9da expref: 24 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.040442:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x31399394250605cc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d99b expref: 9 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.040447:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.040448:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.040452:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbec600/0x3139939425060922 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->3219455] (req 3145728->3219455) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbb6 expref: 9 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.040477:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x31399394250605cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d99b expref: 9 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.040487:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x31399394250605cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d99b expref: 9 pid: 13695 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746147201.040496:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098859180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311331584:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147201.040548:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095052e00/0x313993942506062e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9da expref: 24 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.040554:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095052e00/0x313993942506062e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9da expref: 24 pid: 13695 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746147201.040563:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098859500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311331712:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147201.040580:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800940c5c00/0x313993942506051d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d963 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.040586:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800940c5c00/0x313993942506051d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d963 expref: 9 pid: 1854 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746147201.040593:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009885a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311331840:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147201.040602:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147201.040624:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310031232 00000100:00100000:0.0:1746147201.040626:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310031232 00000004:00080000:1.0:1746147201.041213:0:8110:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 16 in progress, 0 in flight, 29 done 00000004:00080000:1.0:1746147201.041280:0:8110:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 16 done 00000100:00100000:1.0:1746147201.041302:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967311330432:0@lo:400:kworker.0 00002000:00100000:0.0:1746147201.041392:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x97:0x0] (1544192->2097151) req@ffff880098859880 x1830967310031232/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:577/0 lens 488/0 e 0 to 0 dl 1746147212 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147201.041402:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098859880 with x1830967310031232 ext(1544192->2097151) 00010000:00010000:0.0:1746147201.041409:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060793 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dac8 expref: 18 pid: 9584 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746147201.041418:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060793 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dac8 expref: 18 pid: 9584 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746147201.041425:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098859880 00000100:00100000:0.0:1746147201.042461:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1614 00000100:00100000:0.0:1746147201.042470:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310031232:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147201.053028:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098859180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311331584:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147201.053072:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098859500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311331712:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147201.053124:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009885a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311331840:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147201.053162:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbec600/0x3139939425060922 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->3219455] (req 3145728->3219455) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbb6 expref: 9 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.053180:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbec600, rc 0) 00000100:00100000:0.0:1746147201.053223:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2497:x1830967310031360:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 12880us (12923us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.053231:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18964 00000100:00100000:0.0:1746147201.056930:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.056982:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.057013:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310031488 00000100:00100000:1.0:1746147201.057023:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310031488 00010000:00010000:1.0:1746147201.057063:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800940c5c00/0x313993942506051d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d963 expref: 10 pid: 1854 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746147201.057131:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8581 00000100:00100000:1.0:1746147201.057139:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310031488:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147201.057152:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147201.057173:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800940c5c00/0x313993942506051d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d963 expref: 10 pid: 1854 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746147201.057188:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800940c5c00/0x313993942506051d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d963 expref: 10 pid: 1854 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746147201.057216:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800940c5c00/0x313993942506051d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d963 expref: 10 pid: 1854 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746147201.057235:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147201.057271:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310031488:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 132us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.057277:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8581 00000100:00100000:0.0:1746147201.059584:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2003:x1830967310031232:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 17103us (19330us total) trans 17179875056 rc 0/0 00000100:00100000:0.0:1746147201.059595:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1614 00002000:00100000:0.0:1746147201.059606:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x97:0x0] (1544192->2097151) req@ffff880098859880 x1830967310031232/t17179875056(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:577/0 lens 488/448 e 0 to 0 dl 1746147212 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147201.059615:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098859880 with x1830967310031232 ext(1544192->2097151) 00010000:00010000:0.0:1746147201.059625:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060793 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dac8 expref: 20 pid: 9584 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746147201.059636:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060793 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dac8 expref: 20 pid: 9584 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746147201.059647:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098859880 00000100:00100000:0.0:1746147201.062970:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.063010:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.066871:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746147201.066889:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311332352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746147201.066929:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147201.067521:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311332352:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746147201.068245:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310032000 00000100:00100000:0.0:1746147201.068249:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310032000 00000100:00100000:0.0:1746147201.068288:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18965 00000100:00100000:0.0:1746147201.068293:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2505:x1830967310032000:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147201.068304:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.068320:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d9bc00/0x3139939425060929 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dbbd expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.068340:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.068341:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.068349:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d9bc00/0x3139939425060929 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbbd expref: 38 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.068362:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d9bc00/0x3139939425060929 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbbd expref: 38 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.068370:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9bc00, rc 0) 00000100:00100000:0.0:1746147201.068405:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2505:x1830967310032000:12345-192.168.204.25@tcp:101:cat.0 Request processed in 112us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.068410:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18965 00000100:00100000:0.0:1746147201.068427:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310032256 00000100:00100000:0.0:1746147201.068430:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310032256 00002000:00100000:0.0:1746147201.068451:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880099154700 x1830967310032256/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:577/0 lens 488/0 e 0 to 0 dl 1746147212 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147201.068460:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099154700 with x1830967310032256 ext(1048576->2097151) 00002000:00010000:0.0:1746147201.068464:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099154700 00000100:00100000:0.0:1746147201.068483:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6943 00000100:00100000:0.0:1746147201.068487:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2002:x1830967310032256:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147201.072754:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.072811:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.076600:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2002:x1830967310032256:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 8097us (9967us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147201.076615:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6943 00002000:00100000:1.0:1746147201.076631:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880099154700 x1830967310032256/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:577/0 lens 488/440 e 0 to 0 dl 1746147212 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147201.076642:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099154700 with x1830967310032256 ext(1048576->2097151) 00002000:00010000:1.0:1746147201.076649:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099154700 00000100:00100000:0.0:1746147201.080322:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.080432:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.081391:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310032896 00000100:00100000:1.0:1746147201.081395:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310032896 00002000:00100000:1.0:1746147201.081426:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88009885b100 x1830967310032896/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:577/0 lens 488/0 e 0 to 0 dl 1746147212 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147201.081437:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885b100 with x1830967310032896 ext(1048576->2097151) 00002000:00010000:1.0:1746147201.081443:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009885b100 00000100:00100000:1.0:1746147201.081468:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6945 00000100:00100000:1.0:1746147201.081473:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310032896:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147201.083249:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.085046:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310033280 00000100:00100000:1.0:1746147201.085055:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310033280 00000100:00100000:1.0:1746147201.085265:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18966 00000100:00100000:1.0:1746147201.085275:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2501:x1830967310033280:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147201.085293:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147201.085312:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936b6c00/0x3139939425060930 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dbc4 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.085344:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e260e00/0x313993942506091b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbaf expref: 39 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.085352:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147201.085354:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147201.085357:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936b6c00/0x3139939425060930 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbc4 expref: 20 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.085393:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e260e00/0x313993942506091b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbaf expref: 39 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.085404:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e260e00/0x313993942506091b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbaf expref: 39 pid: 9584 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746147201.085416:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f086300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311332608:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147201.085507:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147201.090733:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.093814:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310032896:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12338us (13510us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147201.093822:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6945 00002000:00100000:1.0:1746147201.093827:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88009885b100 x1830967310032896/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:577/0 lens 488/440 e 0 to 0 dl 1746147212 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147201.093857:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885b100 with x1830967310032896 ext(1048576->2097151) 00002000:00010000:1.0:1746147201.093861:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009885b100 00000100:00100000:1.0:1746147201.093903:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f086300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311332608:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147201.093925:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800936b6c00/0x3139939425060930 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbc4 expref: 20 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.093938:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936b6c00, rc 0) 00000100:00100000:1.0:1746147201.093960:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2501:x1830967310033280:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8688us (10718us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.093966:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18966 00000100:00100000:0.0:1746147201.099260:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.099324:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.099684:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310033792 00000100:00100000:1.0:1746147201.099695:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310033792 00002000:00100000:1.0:1746147201.099744:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1368063) req@ffff880098858380 x1830967310033792/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:577/0 lens 488/0 e 0 to 0 dl 1746147212 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147201.099754:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098858380 with x1830967310033792 ext(1048576->1368063) 00010000:00010000:1.0:1746147201.099763:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e260e00/0x313993942506091b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbaf expref: 38 pid: 9584 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.099777:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e260e00/0x313993942506091b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbaf expref: 38 pid: 9584 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746147201.099790:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098858380 00000100:00100000:1.0:1746147201.099818:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1616 00000100:00080000:1.0:1746147201.100258:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147201.100269:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310033792:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147201.115236:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.123859:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310034432 00000100:00100000:0.0:1746147201.123870:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310034432 00000100:00100000:0.0:1746147201.123930:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18967 00000100:00100000:0.0:1746147201.123938:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2505:x1830967310034432:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147201.123958:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.123978:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e260200/0x3139939425060937 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dbcb expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.124007:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147201.124013:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e260200/0x3139939425060937 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbcb expref: 43 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.124025:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e260200/0x3139939425060937 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbcb expref: 43 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.124035:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260200, rc 0) 00000100:00100000:0.0:1746147201.124084:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2505:x1830967310034432:12345-192.168.204.25@tcp:101:cat.0 Request processed in 147us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.124118:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18967 00000100:00100000:1.0:1746147201.129672:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311332736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746147201.129723:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147201.129783:0:12153:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311332736 00000100:00100000:0.0:1746147201.129791:0:12153:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311332736 00000100:00100000:0.0:1746147201.129848:0:12153:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:0.0:1746147201.129856:0:12153:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3767:x1830967311332736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746147201.129878:0:12153:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 270336 granted 1312183360 pending 552960 free 3905277952 avail 3666694144 00000100:00100000:0.0:1746147201.129915:0:12153:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3767:x1830967311332736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.129920:0:12153:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1746147201.130006:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311332736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147201.133758:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311332864 00000100:00100000:0.0:1746147201.133766:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311332864 00000100:00100000:1.0:1746147201.133962:0:12153:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1746147201.133972:0:12153:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+45:3764:x1830967311332864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746147201.133993:0:12153:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1716224 granted 1147180096 pending 5533696 free 3911233536 avail 3679711232 00000100:00100000:1.0:1746147201.134032:0:12153:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+45:3764:x1830967311332864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.134037:0:12153:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1746147201.136224:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.144320:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.144375:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.173245:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.176218:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.176268:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.179052:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.179069:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310035840 00000100:00100000:0.0:1746147201.179074:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310035840 00002000:00100000:0.0:1746147201.179118:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1294335) req@ffff880098c73800 x1830967310035840/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:577/0 lens 488/0 e 0 to 0 dl 1746147212 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147201.179132:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c73800 with x1830967310035840 ext(1048576->1294335) 00010000:00010000:0.0:1746147201.179139:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800932d6400/0x313993942506079a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dad6 expref: 10 pid: 9584 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746147201.179151:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800932d6400/0x313993942506079a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dad6 expref: 10 pid: 9584 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746147201.179157:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098c73800 00000100:00100000:0.0:1746147201.179181:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1618 00000100:00100000:0.0:1746147201.179187:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310035840:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147201.188602:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310035840:12345-192.168.204.25@tcp:4:cat.0 Request processed in 9404us (9540us total) trans 21474842427 rc 0/0 00000100:00100000:1.0:1746147201.188615:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1618 00002000:00100000:1.0:1746147201.188627:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1294335) req@ffff880098c73800 x1830967310035840/t21474842427(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:577/0 lens 488/448 e 0 to 0 dl 1746147212 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147201.188637:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c73800 with x1830967310035840 ext(1048576->1294335) 00010000:00010000:1.0:1746147201.188647:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800932d6400/0x313993942506079a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dad6 expref: 12 pid: 9584 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.188666:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800932d6400/0x313993942506079a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dad6 expref: 12 pid: 9584 timeout: 839 lvb_type: 0 00002000:00010000:1.0:1746147201.188673:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098c73800 00000100:00100000:0.0:1746147201.199908:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.208773:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.217500:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.221012:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18969 00000100:00100000:1.0:1746147201.221053:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310036352:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147201.221080:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147201.221115:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x3139939425060945 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dbd9 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.221142:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.221144:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.221153:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x3139939425060945 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbd9 expref: 10 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.221169:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x3139939425060945 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbd9 expref: 10 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.221181:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0da00, rc 0) 00000100:00100000:1.0:1746147201.221247:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310036352:12345-192.168.204.25@tcp:101:cat.0 Request processed in 223us (3759us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.221506:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18969 00000100:00100000:0.0:1746147201.226238:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.226706:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.226821:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.242775:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.246081:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.246726:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.260327:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.265805:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.278002:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.283435:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310038016 00000100:00100000:0.0:1746147201.283443:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310038016 00002000:00100000:0.0:1746147201.283489:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (2375680->3145727) req@ffff880099155c00 x1830967310038016/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:577/0 lens 488/0 e 0 to 0 dl 1746147212 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147201.283505:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099155c00 with x1830967310038016 ext(2375680->3145727) 00010000:00010000:0.0:1746147201.283516:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d9b800/0x31399394250608d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2375680->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db70 expref: 20 pid: 1136 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746147201.283532:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d9b800/0x31399394250608d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2375680->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db70 expref: 20 pid: 1136 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746147201.283539:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099155c00 00000100:00100000:0.0:1746147201.283568:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1620 00000100:00100000:0.0:1746147201.283575:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310038016:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147201.316245:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.324985:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.333578:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.343660:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.343959:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.359534:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.378206:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.388058:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.388318:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.388411:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.388444:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310040832 00000100:00100000:0.0:1746147201.388451:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310040832 00000100:00100000:0.0:1746147201.389932:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 963 00000100:00100000:0.0:1746147201.389941:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310040832:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147201.389950:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147201.389970:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73c00/0x31399394250609bc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc11 expref: 22 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.389991:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147201.389995:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147201.390015:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967310040832:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 77us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.390020:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 963 00000100:00100000:0.0:1746147201.396545:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.396609:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.396638:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.396676:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310041216 00000100:00100000:0.0:1746147201.396684:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310041216 00000100:00100000:0.0:1746147201.411865:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.413397:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310041600 00000100:00100000:1.0:1746147201.413409:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310041600 00002000:00100000:1.0:1746147201.413458:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800984d4000 x1830967310041600/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:577/0 lens 488/0 e 0 to 0 dl 1746147212 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147201.413468:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d4000 with x1830967310041600 ext(1048576->2097151) 00002000:00010000:1.0:1746147201.413475:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d4000 00000100:00100000:1.0:1746147201.413502:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6956 00000100:00100000:1.0:1746147201.413510:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967310041600:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147201.425037:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.425517:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2002:x1830967310041600:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12001us (13656us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147201.425530:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6956 00002000:00100000:1.0:1746147201.425542:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800984d4000 x1830967310041600/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:577/0 lens 488/440 e 0 to 0 dl 1746147212 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147201.425551:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d4000 with x1830967310041600 ext(1048576->2097151) 00002000:00010000:1.0:1746147201.425557:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d4000 00000100:00100000:0.0:1746147201.432932:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.432966:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.433024:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310041984 00000100:00100000:1.0:1746147201.433034:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310041984 00002000:00100000:1.0:1746147201.433085:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800984d5880 x1830967310041984/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:577/0 lens 488/0 e 0 to 0 dl 1746147212 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147201.433140:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d5880 with x1830967310041984 ext(3145728->4194303) 00002000:00010000:1.0:1746147201.433145:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d5880 00000100:00100000:1.0:1746147201.433181:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6957 00000100:00100000:1.0:1746147201.433189:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310041984:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147201.441060:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310041984:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7858us (8121us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147201.441074:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6957 00002000:00100000:1.0:1746147201.441112:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800984d5880 x1830967310041984/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:577/0 lens 488/440 e 0 to 0 dl 1746147212 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147201.441123:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d5880 with x1830967310041984 ext(3145728->4194303) 00002000:00010000:1.0:1746147201.441129:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d5880 00000100:00100000:0.0:1746147201.443456:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.443548:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310042240 00000100:00100000:1.0:1746147201.443558:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310042240 00000100:00100000:1.0:1746147201.443619:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18978 00000100:00100000:1.0:1746147201.443628:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2513:x1830967310042240:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147201.443647:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147201.443668:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0d800/0x31399394250609df lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dc2d expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.443701:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936b6c00/0x3139939425060930 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbc4 expref: 21 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.443710:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e260200/0x3139939425060937 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbcb expref: 42 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.443717:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.443719:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.443722:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0d800/0x31399394250609df lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1417216->2097151] (req 1417216->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc2d expref: 42 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.443754:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e260200/0x3139939425060937 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbcb expref: 42 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.443771:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e260200/0x3139939425060937 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbcb expref: 42 pid: 13695 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746147201.443783:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311335168:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147201.443886:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800936b6c00/0x3139939425060930 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbc4 expref: 21 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.443894:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800936b6c00/0x3139939425060930 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbc4 expref: 21 pid: 13695 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746147201.443903:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311335296:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147201.443922:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147201.450336:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.450385:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.450474:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.451504:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311335168:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147201.451517:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311335296:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147201.451544:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0d800/0x31399394250609df lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1417216->2097151] (req 1417216->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc2d expref: 43 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.451560:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0d800, rc 0) 00000100:00100000:1.0:1746147201.451606:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2513:x1830967310042240:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7979us (8159us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.451614:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18978 00000100:00100000:0.0:1746147201.451846:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.451864:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310043008 00000100:00100000:0.0:1746147201.451867:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310043008 00002000:00100000:0.0:1746147201.451887:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009258c380 x1830967310043008/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:577/0 lens 488/0 e 0 to 0 dl 1746147212 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147201.451895:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258c380 with x1830967310043008 ext(2097152->4194303) 00002000:00010000:0.0:1746147201.451899:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258c380 00000100:00100000:0.0:1746147201.451912:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6959 00000100:00100000:0.0:1746147201.451918:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2003:x1830967310043008:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147201.478301:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.483501:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.485261:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310043904 00000100:00100000:1.0:1746147201.485272:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310043904 00000100:00100000:1.0:1746147201.485328:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18979 00000100:00100000:1.0:1746147201.485336:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2513:x1830967310043904:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147201.485352:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147201.485366:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x31399394250609e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dc34 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.485390:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x313993942506093e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbd2 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.485397:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x3139939425060945 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbd9 expref: 13 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.485403:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.485405:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.485408:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x31399394250609e6 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->1077247] (req 1048576->1077247) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc34 expref: 25 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.485434:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x3139939425060945 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbd9 expref: 13 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.485444:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x3139939425060945 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbd9 expref: 13 pid: 13695 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746147201.485454:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311335552:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147201.485563:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x313993942506093e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbd2 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.485575:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x313993942506093e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbd2 expref: 25 pid: 9586 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746147201.485583:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311335680:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147201.485601:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147201.492545:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.492570:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311335552:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147201.492582:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311335680:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147201.492588:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147201.492607:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x31399394250609e6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->1077247] (req 1048576->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc34 expref: 25 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.492629:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0de00, rc 0) 00000100:00100000:1.0:1746147201.492672:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2513:x1830967310043904:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7337us (9179us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.492680:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18979 00000100:00100000:1.0:1746147201.492711:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310044160 00000100:00100000:1.0:1746147201.492716:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310044160 00010000:00010000:1.0:1746147201.492737:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x3139939425060945 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbd9 expref: 14 pid: 13695 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746147201.492771:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310044032 00000100:00100000:1.0:1746147201.492773:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310044032 00010000:00010000:1.0:1746147201.492783:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x313993942506093e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbd2 expref: 25 pid: 9586 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746147201.492798:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8597 00000100:00100000:1.0:1746147201.492803:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2002:x1830967310044160:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147201.492814:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147201.492845:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x3139939425060945 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbd9 expref: 14 pid: 13695 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746147201.492855:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x3139939425060945 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbd9 expref: 14 pid: 13695 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746147201.492873:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x3139939425060945 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbd9 expref: 14 pid: 13695 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746147201.492887:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147201.492903:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2002:x1830967310044160:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 100us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.492908:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8597 00000100:00100000:1.0:1746147201.492918:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8598 00000100:00100000:1.0:1746147201.492922:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310044032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147201.492928:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147201.492935:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x313993942506093e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbd2 expref: 25 pid: 9586 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.492944:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x313993942506093e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbd2 expref: 25 pid: 9586 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.492954:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x313993942506093e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbd2 expref: 25 pid: 9586 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.492967:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.492969:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.492974:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x31399394250609e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc34 expref: 24 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.492981:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x31399394250609e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc34 expref: 24 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.493003:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x31399394250609e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc34 expref: 24 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147201.493014:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311335808:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147201.493063:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147201.496032:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.497391:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311335808:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147201.497405:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147201.497441:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310044032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4518us (4852us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.497448:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8598 00000100:00100000:0.0:1746147201.502362:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.502465:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310044544 00000100:00100000:1.0:1746147201.502474:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310044544 00000100:00100000:1.0:1746147201.502526:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18980 00000100:00100000:1.0:1746147201.502534:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2003:x1830967310044544:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147201.502548:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147201.502563:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x31399394250609ed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dc3b expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147201.502619:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311335936:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147201.506071:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.506184:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658d80 going to sleep for 11 seconds 00002000:00010000:1.0:1746147201.506217:0:9584:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime: 1746147200 -> 1746147201 00000100:00100000:1.0:1746147201.506234:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311335936:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147201.506258:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x31399394250609ed lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc3b expref: 22 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.506272:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x31399394250609ed lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc3b expref: 22 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.506288:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c800, rc 0) 00000100:00100000:1.0:1746147201.506325:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2003:x1830967310044544:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3792us (3970us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147201.506333:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18980 00000100:00100000:1.0:1746147201.506354:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310044672 00000100:00100000:1.0:1746147201.506358:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310044672 00000100:00100000:1.0:1746147201.506384:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18981 00000100:00100000:1.0:1746147201.506390:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2003:x1830967310044672:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147201.506402:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147201.506414:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x31399394250609f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dc42 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147201.506449:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311336064:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147201.506492:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658d80 going to sleep for 11 seconds 00002000:00010000:1.0:1746147201.511164:0:9584:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746147200 -> 1746147201 00002000:00010000:1.0:1746147201.511178:0:9584:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746147200 -> 1746147201 00000100:00100000:1.0:1746147201.511199:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311336064:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147201.511226:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x31399394250609f4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc42 expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.511242:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x31399394250609f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc42 expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.511269:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c200, rc 0) 00000100:00100000:1.0:1746147201.511314:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2003:x1830967310044672:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4922us (5249us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147201.511322:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18981 00000100:00100000:0.0:1746147201.517918:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.531552:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.531607:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.531712:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310045056 00000100:00100000:1.0:1746147201.531722:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310045056 00000100:00100000:1.0:1746147201.531773:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310045184 00000100:00100000:1.0:1746147201.531776:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310045184 00000100:00100000:1.0:1746147201.531794:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18982 00000100:00100000:1.0:1746147201.531801:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967310045056:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147201.531817:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147201.531843:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0c000/0x31399394250609fb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dc49 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147201.531893:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311336192:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147201.531965:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147201.534482:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311336192:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147201.534502:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c000/0x31399394250609fb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc49 expref: 22 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.534512:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c000/0x31399394250609fb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc49 expref: 22 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.534544:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c000, rc 0) 00000100:00100000:1.0:1746147201.534660:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967310045056:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2858us (3114us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147201.534668:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18982 00000100:00100000:0.0:1746147201.538612:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310045312 00000100:00100000:0.0:1746147201.538620:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310045312 00000100:00100000:0.0:1746147201.538670:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18984 00000100:00100000:0.0:1746147201.538680:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967310045312:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147201.538695:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.538710:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x3139939425060a09 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dc57 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147201.538753:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311336448:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147201.538838:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147201.539306:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310045440 00000100:00100000:1.0:1746147201.539311:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310045440 00000100:00100000:1.0:1746147201.539342:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18985 00000100:00100000:1.0:1746147201.539348:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310045440:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147201.539356:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147201.539366:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425060a10 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dc5e expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147201.539391:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311336576:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147201.539435:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147201.542678:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311336576:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147201.542707:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425060a10 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc5e expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.542720:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0d600/0x3139939425060a10 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc5e expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.542741:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0d600, rc 0) 00000100:00100000:1.0:1746147201.542783:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310045440:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3435us (3825us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147201.542791:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18985 00000100:00100000:0.0:1746147201.552274:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.554931:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310046080 00000100:00100000:0.0:1746147201.554936:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310046080 00000100:00100000:0.0:1746147201.555544:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6041 00000100:00100000:0.0:1746147201.555551:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2516:x1830967310046080:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:0.0:1746147201.555667:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2516:x1830967310046080:12345-192.168.204.25@tcp:35:cat.0 Request processed in 117us (867us total) trans 8589937126 rc 0/0 00000100:00100000:0.0:1746147201.555673:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6041 00000100:00100000:0.0:1746147201.559220:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.559387:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310046208 00000100:00100000:1.0:1746147201.559396:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310046208 00010000:00010000:1.0:1746147201.559430:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098226e00/0x3139939425060992 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc03 expref: 41 pid: 7237 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746147201.559469:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8599 00000100:00100000:1.0:1746147201.559476:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967310046208:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147201.559492:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147201.559497:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098226e00/0x3139939425060992 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc03 expref: 41 pid: 7237 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.559508:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098226e00/0x3139939425060992 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc03 expref: 41 pid: 7237 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.559528:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098226e00/0x3139939425060992 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc03 expref: 41 pid: 7237 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.559541:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147201.559545:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x3139939425060a2c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147201.559553:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x3139939425060a2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147201.559563:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x3139939425060a2c lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147201.559593:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147201.559627:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967310046208:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 152us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.559633:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8599 00000100:00100000:0.0:1746147201.568006:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.568043:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.568071:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.568118:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.568144:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.568165:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310046336 00000100:00100000:0.0:1746147201.568172:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310046336 00000100:00100000:0.0:1746147201.568205:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310046464 00000100:00100000:0.0:1746147201.568207:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310046464 00000100:00100000:0.0:1746147201.568216:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310046592 00000100:00100000:0.0:1746147201.568218:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310046592 00000100:00100000:0.0:1746147201.568228:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310046720 00000100:00100000:0.0:1746147201.568229:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310046720 00000100:00100000:0.0:1746147201.568237:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310046848 00000100:00100000:0.0:1746147201.568239:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310046848 00000100:00100000:0.0:1746147201.568250:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18986 00000100:00100000:0.0:1746147201.568257:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967310046336:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147201.568273:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.568287:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d94400/0x3139939425060a33 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dc6c expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.568306:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.568308:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.568315:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94400/0x3139939425060a33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc6c expref: 15 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.568332:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d94400/0x3139939425060a33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc6c expref: 15 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.568343:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94400, rc 0) 00000100:00100000:0.0:1746147201.568380:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967310046336:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 123us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.568385:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18986 00000100:00100000:0.0:1746147201.568398:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18987 00000100:00100000:0.0:1746147201.568402:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967310046464:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147201.568408:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.568413:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d94200/0x3139939425060a3a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dc73 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147201.568447:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132127100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311336832:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147201.568496:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147201.568516:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18988 00000100:00100000:0.0:1746147201.568522:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2003:x1830967310046592:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147201.568529:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.568537:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425060a41 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dc7a expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147201.568558:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132125500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311336960:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147201.568576:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147201.568590:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18989 00000100:00100000:0.0:1746147201.568595:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2003:x1830967310046720:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147201.568600:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.568605:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425060a48 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dc81 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.568614:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.568616:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.568620:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425060a48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc81 expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.568629:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425060a48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc81 expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.568635:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57c00, rc 0) 00000100:00100000:0.0:1746147201.568651:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310046720:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 56us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.568655:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18989 00000100:00100000:0.0:1746147201.568665:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18990 00000100:00100000:0.0:1746147201.568670:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967310046848:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147201.568675:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.568681:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425060a4f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dc88 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.568689:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.568690:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.568694:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425060a4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc88 expref: 16 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.568702:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425060a4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc88 expref: 16 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.568708:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57400, rc 0) 00000100:00100000:0.0:1746147201.568723:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2003:x1830967310046848:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 53us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.568728:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18990 00000100:00100000:1.0:1746147201.574060:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132125500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311336960:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147201.574117:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425060a41 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc7a expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.574129:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425060a41 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc7a expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.574141:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57200, rc 0) 00000100:00100000:1.0:1746147201.574182:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2003:x1830967310046592:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 5659us (6109us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147201.574189:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18988 00000100:00100000:0.0:1746147201.579435:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.584451:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.587967:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.595032:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310047616 00000100:00100000:0.0:1746147201.595040:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310047616 00000100:00100000:0.0:1746147201.595077:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16271 00000100:00100000:0.0:1746147201.595083:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2520:x1830967310047616:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147201.595193:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.595208:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x3139939425060a80 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dc9d expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.595253:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x3139939425060a80 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc9d expref: 12 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.595264:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x3139939425060a80 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc9d expref: 12 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.595277:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147201.595280:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147201.595283:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56a00, rc 0) 00000100:00100000:0.0:1746147201.595328:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2520:x1830967310047616:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 244us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.595334:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16271 00000100:00100000:0.0:1746147201.606684:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.606722:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.606748:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.606890:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.606902:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310047744 00000100:00100000:0.0:1746147201.606907:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.606911:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310047744 00000100:00100000:0.0:1746147201.606931:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.606956:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310047872 00000100:00100000:1.0:1746147201.606959:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310047872 00000100:00100000:1.0:1746147201.606971:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310048128 00000100:00100000:1.0:1746147201.606973:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310048128 00000100:00100000:1.0:1746147201.606998:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310048384 00000100:00100000:1.0:1746147201.607001:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310048384 00000100:00100000:1.0:1746147201.607018:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18993 00000100:00100000:1.0:1746147201.607024:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310048000:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147201.607045:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c000/0x3139939425060a8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.607059:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0d800/0x31399394250609df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc2d expref: 40 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.607066:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147201.607068:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147201.607071:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c000/0x3139939425060a8e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.607112:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0d800/0x31399394250609df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc2d expref: 40 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.607124:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0d800/0x31399394250609df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc2d expref: 40 pid: 9584 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746147201.607136:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311337216:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147201.607208:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18994 00000100:00100000:0.0:1746147201.607214:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310048128:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147201.607234:0:12201:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425060a9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.607243:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x31399394250609e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc34 expref: 23 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.607249:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147201.607250:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147201.607252:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425060a9c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.607266:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x31399394250609e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc34 expref: 23 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.607279:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da0de00/0x31399394250609e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc34 expref: 23 pid: 9584 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746147201.607292:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132124a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311337600:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147201.607386:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147201.607402:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18995 00000100:00100000:1.0:1746147201.607409:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310048256:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147201.607424:0:10340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425060aa3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.607433:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x31399394250609ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc18 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.607444:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425060a48 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc81 expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.607450:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a73c00/0x31399394250609d8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc26 expref: 12 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.607455:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.607456:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.607458:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425060aa3 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.607473:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a73c00/0x31399394250609d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc26 expref: 12 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.607480:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a73c00/0x31399394250609d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc26 expref: 12 pid: 13695 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746147201.607488:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311337728:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147201.607567:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147201.607582:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18996 00000100:00100000:0.0:1746147201.607588:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310048384:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147201.607602:0:17600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x3139939425060aaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.607611:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098227800/0x3139939425060961 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbf5 expref: 40 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.607618:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425060a4f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc88 expref: 16 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.607624:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098226000/0x31399394250609d1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc1f expref: 20 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.607628:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.607630:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.607631:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x3139939425060aaa lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.607645:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098226000/0x31399394250609d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc1f expref: 20 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.607653:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098226000/0x31399394250609d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc1f expref: 20 pid: 9586 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746147201.607661:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132126680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311338368:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147201.607681:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425060a4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc88 expref: 16 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.607688:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425060a4f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc88 expref: 16 pid: 12201 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746147201.607695:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132125880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311338496:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147201.607711:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098227800/0x3139939425060961 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbf5 expref: 40 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.607717:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098227800/0x3139939425060961 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbf5 expref: 40 pid: 9586 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746147201.607724:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132125c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311338624:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147201.607736:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8780 going to sleep for 11 seconds 00010000:00010000:1.0:1746147201.607794:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425060a48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc81 expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.607801:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425060a48 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc81 expref: 12 pid: 12201 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746147201.607809:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f084700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311338752:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147201.607841:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x31399394250609ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc18 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.607849:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x31399394250609ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc18 expref: 23 pid: 9586 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746147201.607856:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311338880:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147201.607870:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147201.624484:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.624572:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.624595:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310049664 00000100:00100000:0.0:1746147201.624602:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310049664 00000100:00100000:0.0:1746147201.624638:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310050432 00000100:00100000:0.0:1746147201.624640:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310050432 00000100:00100000:0.0:1746147201.624654:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16272 00000100:00100000:0.0:1746147201.624661:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2525:x1830967310049664:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147201.624682:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.624697:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94c00/0x3139939425060ab1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dca4 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.624762:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x3139939425060ab8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.624773:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x3139939425060ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.624782:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x3139939425060ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.624794:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007923c000/0x3139939425060abf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.624800:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007923c000/0x3139939425060abf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.624805:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007923c000/0x3139939425060abf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:1.0:1746147201.625073:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16273 00000100:00100000:1.0:1746147201.625082:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2526:x1830967310050432:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147201.625116:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147201.625124:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d400/0x3139939425060ac6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dcab expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.625155:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x3139939425060acd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.625162:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x3139939425060acd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.625169:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x3139939425060acd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.625176:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d000/0x3139939425060ad4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.625180:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d000/0x3139939425060ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.625185:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d000/0x3139939425060ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.625255:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c000/0x3139939425060adb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.625264:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715c00/0x3139939425060a72 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc96 expref: 11 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.625269:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c000/0x3139939425060adb lrc: 4/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.625294:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093715c00/0x3139939425060a72 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc96 expref: 11 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.625304:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715c00/0x3139939425060a72 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc96 expref: 11 pid: 7237 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746147201.625314:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311339008:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147201.625377:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746147201.625396:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093731e00/0x3139939425060ae2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.625403:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093731e00/0x3139939425060ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00000100:00100000:1.0:1746147201.625405:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311337216:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147201.625408:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093731e00/0x3139939425060ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:0.0:1746147201.625416:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147201.625420:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012da0c000/0x3139939425060a8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.625464:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093731e00/0x3139939425060ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.625472:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093731e00/0x3139939425060ae2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.625478:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093731e00/0x3139939425060ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.625482:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093731e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147201.625485:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093731e00/0x3139939425060ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00000100:00100000:1.0:1746147201.625711:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132124a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311337600:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147201.625722:0:12201:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425060a9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.626032:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093731e00/0x3139939425060ae2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.626040:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147201.626043:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147201.626045:0:7237:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c000/0x3139939425060adb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147201.626517:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093731e00/0x3139939425060ae2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.626522:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093731e00/0x3139939425060ae2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00000100:00100000:1.0:1746147201.626556:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.626569:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310049024 00000100:00100000:1.0:1746147201.626572:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310049024 00010000:00010000:1.0:1746147201.626584:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db80400/0x31399394250608f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db85 expref: 26 pid: 9585 timeout: 839 lvb_type: 1 00010000:00010000:0.0:1746147201.628285:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x3139939425060ab8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.628291:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x3139939425060ab8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.628296:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x3139939425060ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.628301:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x3139939425060ab8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.628306:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d94800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147201.628310:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x3139939425060ab8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.628314:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x3139939425060ab8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.628323:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147201.628325:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147201.628328:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x3139939425060ab8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.628332:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x3139939425060ab8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.628339:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007923c000/0x3139939425060abf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.628344:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007923c000/0x3139939425060abf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.628348:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007923c000/0x3139939425060abf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.628352:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007923c000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147201.628353:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007923c000/0x3139939425060abf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.628357:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007923c000/0x3139939425060abf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.628361:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d4c7500) 00010000:00010000:0.0:1746147201.628362:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147201.628365:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007923c000/0x3139939425060abf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.628369:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007923c000/0x3139939425060abf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147201.628498:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94c00/0x3139939425060ab1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dca4 expref: 42 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.628504:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94c00/0x3139939425060ab1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dca4 expref: 42 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.628512:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94c00, rc 0) 00000100:00100000:0.0:1746147201.628537:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2525:x1830967310049664:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3877us (4060us total) trans 8589937129 rc 301/301 00000100:00100000:0.0:1746147201.628543:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16272 00000100:00100000:0.0:1746147201.628641:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.630164:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310049152 00000100:00100000:1.0:1746147201.630172:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310049152 00010000:00010000:1.0:1746147201.630196:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94400/0x3139939425060a33 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc6c expref: 17 pid: 1398 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746147201.630215:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8604 00000100:00100000:1.0:1746147201.630219:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310049152:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147201.630228:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147201.630241:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d94400/0x3139939425060a33 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc6c expref: 17 pid: 1398 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746147201.630249:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d94400/0x3139939425060a33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc6c expref: 17 pid: 1398 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746147201.630263:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147201.630289:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310049152:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 69us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.630293:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8604 00000100:00100000:1.0:1746147201.630393:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.630406:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310049280 00000100:00100000:1.0:1746147201.630408:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310049280 00010000:00010000:1.0:1746147201.630419:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d48000/0x3139939425060873 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db3f expref: 13 pid: 12225 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746147201.630437:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8605 00000100:00100000:1.0:1746147201.630441:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310049280:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147201.630448:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147201.630457:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d48000/0x3139939425060873 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db3f expref: 13 pid: 12225 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.630465:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d48000/0x3139939425060873 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db3f expref: 13 pid: 12225 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.630475:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.630477:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.630481:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425060a87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.630488:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092542600/0x3139939425060a87 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.630501:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147201.630514:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310049280:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.630519:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8605 00000100:00100000:1.0:1746147201.630589:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.630597:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310049408 00000100:00100000:1.0:1746147201.630599:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310049408 00010000:00010000:1.0:1746147201.630607:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425060a4f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc88 expref: 17 pid: 12201 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746147201.630623:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8606 00000100:00100000:1.0:1746147201.630627:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310049408:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147201.630632:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147201.630638:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425060a4f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc88 expref: 17 pid: 12201 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746147201.630645:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425060a4f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc88 expref: 17 pid: 12201 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746147201.630653:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147201.630664:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310049408:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 37us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.630669:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8606 00000100:00100000:1.0:1746147201.634106:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.634149:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.634166:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.634180:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.634197:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310049792 00000100:00100000:1.0:1746147201.634202:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310049792 00010000:00010000:1.0:1746147201.634227:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e260c00/0x31399394250608ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db93 expref: 21 pid: 13695 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746147201.634247:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310050048 00000100:00100000:1.0:1746147201.634249:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310050048 00010000:00010000:1.0:1746147201.634260:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425060a48 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc81 expref: 11 pid: 12201 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746147201.634278:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310049920 00000100:00100000:1.0:1746147201.634280:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310049920 00010000:00010000:1.0:1746147201.634290:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098227800/0x3139939425060961 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbf5 expref: 42 pid: 9586 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746147201.634299:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310050176 00000100:00100000:1.0:1746147201.634300:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310050176 00010000:00010000:1.0:1746147201.634309:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a73c00/0x31399394250609d8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc26 expref: 12 pid: 13695 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746147201.634318:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8607 00000100:00100000:1.0:1746147201.634325:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310049792:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147201.634336:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147201.634353:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e260c00/0x31399394250608ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db93 expref: 21 pid: 13695 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.634366:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e260c00/0x31399394250608ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db93 expref: 21 pid: 13695 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.634383:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e260c00/0x31399394250608ff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7db93 expref: 21 pid: 13695 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.634399:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.634401:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.634404:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x3139939425060a95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.634415:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x3139939425060a95 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.634430:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147201.634465:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2002:x1830967310049792:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 140us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.634471:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8607 00000100:00100000:1.0:1746147201.634487:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8608 00000100:00100000:1.0:1746147201.634491:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310050048:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147201.634498:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147201.634509:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425060a48 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc81 expref: 11 pid: 12201 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746147201.634517:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425060a48 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc81 expref: 11 pid: 12201 timeout: 839 lvb_type: 1 00010000:00010000:1.0:1746147201.634529:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147201.634545:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310050048:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 53us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.634550:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8608 00000100:00100000:1.0:1746147201.634581:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8609 00000100:00100000:1.0:1746147201.634587:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967310049920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147201.634592:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147201.634601:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098227800/0x3139939425060961 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbf5 expref: 42 pid: 9586 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.634608:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098227800/0x3139939425060961 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbf5 expref: 42 pid: 9586 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.634618:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098227800/0x3139939425060961 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dbf5 expref: 42 pid: 9586 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.634625:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147201.635961:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967310049920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1368us (1788us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.635968:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8609 00010000:00010000:0.0:1746147201.638027:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a73c00/0x31399394250609d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc26 expref: 11 pid: 13695 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746147201.638043:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311337728:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147201.638053:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425060a48 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc81 expref: 10 pid: 12201 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746147201.638061:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311338752:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147201.638994:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.639011:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310050560 00000100:00100000:1.0:1746147201.639015:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310050560 00010000:00010000:1.0:1746147201.639046:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x31399394250609ca lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc18 expref: 27 pid: 9586 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746147201.639066:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8611 00000100:00100000:1.0:1746147201.639072:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310050560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147201.639083:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147201.639113:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x31399394250609ca lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc18 expref: 27 pid: 9586 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.639122:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x31399394250609ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc18 expref: 27 pid: 9586 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.639146:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.639147:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.639151:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425060aa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.639158:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425060aa3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.639172:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147201.639195:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310050560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 123us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.639201:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8611 00000100:00100000:1.0:1746147201.639247:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311339008:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147201.639262:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c000/0x3139939425060adb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:1.0:1746147201.639293:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.639303:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310050688 00000100:00100000:1.0:1746147201.639306:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310050688 00010000:00010000:1.0:1746147201.639317:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093715c00/0x3139939425060a72 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc96 expref: 12 pid: 7237 timeout: 839 lvb_type: 0 00000100:00100000:1.0:1746147201.639331:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8612 00000100:00100000:1.0:1746147201.639335:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310050688:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147201.639342:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147201.639346:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093715c00/0x3139939425060a72 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc96 expref: 12 pid: 7237 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.639352:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093715c00/0x3139939425060a72 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc96 expref: 12 pid: 7237 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.639364:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715c00/0x3139939425060a72 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc96 expref: 12 pid: 7237 timeout: 839 lvb_type: 0 00010000:00010000:1.0:1746147201.639373:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147201.639377:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c000/0x3139939425060adb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639383:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c000/0x3139939425060adb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639388:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c000/0x3139939425060adb lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639409:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147201.639423:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310050688:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 87us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.639427:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8612 00010000:00010000:1.0:1746147201.639439:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c000/0x3139939425060adb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639443:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c000/0x3139939425060adb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147201.639457:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147201.639523:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c000/0x3139939425060adb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639529:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c000/0x3139939425060adb lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639534:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c000/0x3139939425060adb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639539:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f03c000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147201.639542:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c000/0x3139939425060adb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639547:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c000/0x3139939425060adb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639554:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147201.639556:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147201.639558:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c000/0x3139939425060adb lrc: 2/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639562:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c000/0x3139939425060adb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639575:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x3139939425060acd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639579:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x3139939425060acd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639584:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x3139939425060acd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639588:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x3139939425060acd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639592:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f03d600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147201.639594:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x3139939425060acd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639601:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x3139939425060acd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639607:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147201.639608:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147201.639610:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x3139939425060acd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639614:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d600/0x3139939425060acd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639620:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d000/0x3139939425060ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639625:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d000/0x3139939425060ad4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639629:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d000/0x3139939425060ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639632:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f03d000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147201.639635:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d000/0x3139939425060ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639639:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d000/0x3139939425060ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639643:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d4c7500) 00010000:00010000:1.0:1746147201.639645:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147201.639647:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d000/0x3139939425060ad4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639650:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d000/0x3139939425060ad4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147201.639686:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d400/0x3139939425060ac6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcab expref: 25 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.639692:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03d400/0x3139939425060ac6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcab expref: 25 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.639698:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03d400, rc 0) 00000100:00100000:1.0:1746147201.639712:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2526:x1830967310050432:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 14633us (15140us total) trans 8589937130 rc 301/301 00000100:00100000:1.0:1746147201.639717:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16273 00000100:00100000:1.0:1746147201.639746:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.639816:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.639838:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310051328 00000100:00100000:1.0:1746147201.639840:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310051328 00000100:00100000:1.0:1746147201.639855:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 18998 00000100:00100000:1.0:1746147201.639859:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310051328:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147201.639865:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147201.639871:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425060afe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dcc7 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147201.639897:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db14000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311339136:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147201.639931:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746147201.640163:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x31399394250609ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc18 expref: 26 pid: 9586 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746147201.640176:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311338880:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147201.640195:0:10340:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425060aa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.640201:0:10340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425060aa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.640206:0:10340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425060aa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.640218:0:10340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425060aa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.640224:0:10340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425060aa3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.640652:0:10340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425060aa3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.640657:0:10340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0dc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147201.640659:0:10340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425060aa3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.640665:0:10340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425060aa3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.640678:0:10340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425060aa3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.640683:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425060aa3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147201.640716:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310048256:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 33307us (33807us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.640722:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18995 00000100:00100000:1.0:1746147201.642030:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.642049:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310050944 00000100:00100000:1.0:1746147201.642054:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310050944 00000100:00100000:1.0:1746147201.642079:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19000 00000100:00100000:1.0:1746147201.642086:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310050944:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147201.642111:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147201.642122:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f03d800/0x3139939425060b0c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dcb2 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147201.642136:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x93:0x0] initial LVB size: 1048576, mtime: 0x68141780, atime: 0x68141780, ctime: 0x68141780, blocks: 0x7e8 00010000:00010000:1.0:1746147201.642148:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.642149:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.642154:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03d800/0x3139939425060b0c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcb2 expref: 27 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.642165:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f03d800/0x3139939425060b0c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcb2 expref: 27 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.642172:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03d800, rc 0) 00000100:00100000:1.0:1746147201.642211:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310050944:12345-192.168.204.25@tcp:101:cat.0 Request processed in 125us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.642217:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19000 00000100:00100000:1.0:1746147201.642247:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.642258:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310051200 00000100:00100000:1.0:1746147201.642261:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310051200 00000100:00100000:1.0:1746147201.642283:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19001 00000100:00100000:1.0:1746147201.642288:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967310051200:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147201.642294:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147201.642301:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f03dc00/0x3139939425060b13 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dcc0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147201.642335:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f087100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311339264:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147201.642369:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147201.644627:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.646283:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f087100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311339264:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147201.646304:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f03dc00/0x3139939425060b13 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcc0 expref: 44 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.646312:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f03dc00/0x3139939425060b13 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcc0 expref: 44 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.646320:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03dc00, rc 0) 00000100:00100000:1.0:1746147201.646346:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967310051200:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4058us (4099us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147201.646352:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19001 00010000:00010000:0.0:1746147201.646396:0:12201:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425060a9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.646404:0:12201:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425060a9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.646421:0:12201:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425060a9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.646428:0:12201:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425060a9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.646434:0:12201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425060a9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.646440:0:12201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a57200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147201.646444:0:12201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425060a9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.646450:0:12201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425060a9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.646458:0:12201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425060a9c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.646463:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a57200/0x3139939425060a9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147201.646500:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2001:x1830967310048128:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 39285us (39609us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.646504:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18994 00000100:00100000:0.0:1746147201.648327:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147201.649150:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012da0c000/0x3139939425060a8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.649156:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0c000/0x3139939425060a8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.649170:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c000/0x3139939425060a8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.649175:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c000/0x3139939425060a8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.649185:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012da0c000/0x3139939425060a8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.649190:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0c000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147201.649193:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012da0c000/0x3139939425060a8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.649199:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012da0c000/0x3139939425060a8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.649208:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012da0c000/0x3139939425060a8e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.649214:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c000/0x3139939425060a8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147201.649252:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310048000:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 42228us (42502us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.649258:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 18993 00000100:00100000:0.0:1746147201.654041:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.654302:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310052224 00000100:00100000:0.0:1746147201.654306:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310052224 00002000:00100000:0.0:1746147201.654324:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff8800975a4a80 x1830967310052224/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:577/0 lens 488/0 e 0 to 0 dl 1746147212 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147201.654331:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a4a80 with x1830967310052224 ext(0->1048575) 00002000:00010000:0.0:1746147201.654334:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800975a4a80 00000100:00100000:0.0:1746147201.654355:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6965 00000100:00100000:0.0:1746147201.654361:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310052224:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147201.664437:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310052608 00000100:00100000:1.0:1746147201.664446:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310052608 00000100:00100000:1.0:1746147201.664490:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16274 00000100:00100000:1.0:1746147201.664497:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2520:x1830967310052608:12345-192.168.204.25@tcp:36:mirror_io.0 00010000:00010000:1.0:1746147201.664536:0:7238:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147201.664557:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x3139939425060a80 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dc9d expref: 11 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.664571:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147201.664574:0:7238:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147201.664600:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2520:x1830967310052608:12345-192.168.204.25@tcp:36:mirror_io.0 Request processed in 104us (1879us total) trans 0 rc -116/-116 00000100:00100000:1.0:1746147201.664605:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16274 00000100:00100000:0.0:1746147201.677083:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.686340:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.686409:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310052992 00000100:00100000:1.0:1746147201.686418:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310052992 00000100:00100000:0.0:1746147201.686986:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19003 00000100:00100000:0.0:1746147201.686996:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2525:x1830967310052992:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147201.687010:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.687031:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425060b21 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dcdc expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147201.687050:0:12201:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x97:0x0] initial LVB size: 2097152, mtime: 0x68141781, atime: 0x68141780, ctime: 0x68141781, blocks: 0x800 00010000:00010000:0.0:1746147201.687067:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.687069:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.687076:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425060b21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcdc expref: 43 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.687459:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425060b21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcdc expref: 43 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.687469:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093730600, rc 0) 00000100:00100000:1.0:1746147201.687561:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2525:x1830967310052992:12345-192.168.204.25@tcp:101:cat.0 Request processed in 566us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.687567:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19003 00000100:00100000:0.0:1746147201.688026:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.689375:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.689491:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310053376 00000100:00100000:1.0:1746147201.689495:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310053376 00000100:00100000:1.0:1746147201.689524:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19004 00000100:00100000:1.0:1746147201.689529:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2526:x1830967310053376:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147201.689537:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147201.689549:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f212a00/0x3139939425060b28 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dce3 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.689714:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x3139939425060b1a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcce expref: 24 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.689721:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.689722:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147201.689725:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011f212a00/0x3139939425060b28 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2637824->3088383] (req 2637824->3088383) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dce3 expref: 12 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.689752:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x3139939425060b1a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcce expref: 24 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147201.689762:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093714200/0x3139939425060b1a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcce expref: 24 pid: 1853 timeout: 839 lvb_type: 1 00000100:00100000:1.0:1746147201.689772:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f086a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311339392:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147201.689816:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147201.697204:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.707583:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f086a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311339392:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147201.707613:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f212a00/0x3139939425060b28 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2637824->3088383] (req 2637824->3088383) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dce3 expref: 12 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147201.707629:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f212a00, rc 0) 00000100:00100000:1.0:1746147201.707693:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2526:x1830967310053376:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 18163us (18317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147201.707701:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19004 00000100:00100000:0.0:1746147201.708200:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.708261:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.727834:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.732639:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.741006:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.750593:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.760590:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.762504:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.762539:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.762564:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.762586:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.762599:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.762614:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310055296 00000100:00100000:0.0:1746147201.762619:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310055296 00000100:00100000:0.0:1746147201.762645:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310055552 00000100:00100000:0.0:1746147201.762647:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310055552 00000100:00100000:0.0:1746147201.762658:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310055936 00000100:00100000:0.0:1746147201.762659:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310055936 00000100:00100000:0.0:1746147201.762669:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310055808 00000100:00100000:0.0:1746147201.762671:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310055808 00000100:00100000:0.0:1746147201.762681:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310055424 00000100:00100000:0.0:1746147201.762682:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310055424 00000100:00100000:0.0:1746147201.762693:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19006 00000100:00100000:0.0:1746147201.762699:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967310055296:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147201.762710:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.762722:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909c0600/0x3139939425060b7c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dcff expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.762738:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.762740:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.762747:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909c0600/0x3139939425060b7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcff expref: 13 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.762757:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800909c0600/0x3139939425060b7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcff expref: 13 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.762765:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909c0600, rc 0) 00000100:00100000:0.0:1746147201.762790:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310055296:12345-192.168.204.25@tcp:101:cat.0 Request processed in 91us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.762797:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19006 00000100:00100000:0.0:1746147201.762808:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19007 00000100:00100000:0.0:1746147201.762812:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310055552:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147201.762819:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.762839:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134ae9c00/0x3139939425060b83 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dd0d expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.762849:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.762851:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.762854:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134ae9c00/0x3139939425060b83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd0d expref: 22 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.762863:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134ae9c00/0x3139939425060b83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd0d expref: 22 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.762870:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ae9c00, rc 0) 00000100:00100000:0.0:1746147201.762884:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310055552:12345-192.168.204.25@tcp:101:cat.0 Request processed in 72us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.762888:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19007 00000100:00100000:0.0:1746147201.762897:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19008 00000100:00100000:0.0:1746147201.762901:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2525:x1830967310055936:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147201.762906:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.762911:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134ae8800/0x3139939425060b8a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dd22 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.762924:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f212a00/0x3139939425060b28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2637824->3088383) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dce3 expref: 12 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.762930:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147201.762931:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147201.762934:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134ae8800/0x3139939425060b8a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd22 expref: 26 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.762954:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011f212a00/0x3139939425060b28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2637824->3088383) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dce3 expref: 12 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.762965:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011f212a00/0x3139939425060b28 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2637824->3088383) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dce3 expref: 12 pid: 12201 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746147201.762974:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311339648:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147201.763024:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147201.763040:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19009 00000100:00100000:0.0:1746147201.763044:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310055808:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147201.763049:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.763054:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093731a00/0x3139939425060b91 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dd1b expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.763062:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.763064:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.763067:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093731a00/0x3139939425060b91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd1b expref: 22 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.763074:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093731a00/0x3139939425060b91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd1b expref: 22 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.763156:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093731a00, rc 0) 00000100:00100000:0.0:1746147201.763171:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310055808:12345-192.168.204.25@tcp:101:cat.0 Request processed in 126us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.763176:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19009 00000100:00100000:0.0:1746147201.763193:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19010 00000100:00100000:0.0:1746147201.763197:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310055424:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147201.763202:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.763208:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093730000/0x3139939425060b98 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dd06 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.763217:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.763218:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.763222:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093730000/0x3139939425060b98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd06 expref: 22 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.763229:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093730000/0x3139939425060b98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd06 expref: 22 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.763235:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093730000, rc 0) 00000100:00100000:0.0:1746147201.763247:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310055424:12345-192.168.204.25@tcp:101:cat.0 Request processed in 51us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.763251:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19010 00000100:00100000:0.0:1746147201.763279:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.763290:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310055680 00000100:00100000:0.0:1746147201.763292:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310055680 00000100:00100000:0.0:1746147201.763305:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19011 00000100:00100000:0.0:1746147201.763309:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310055680:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147201.763314:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.763319:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425060b9f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dd14 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.763326:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.763327:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.763330:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425060b9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd14 expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.763337:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425060b9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd14 expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.763343:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093731800, rc 0) 00000100:00100000:0.0:1746147201.763353:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310055680:12345-192.168.204.25@tcp:101:cat.0 Request processed in 44us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.763357:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19011 00000100:00100000:0.0:1746147201.767986:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.770560:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311339648:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147201.770583:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134ae8800/0x3139939425060b8a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd22 expref: 26 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.770598:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ae8800, rc 0) 00000100:00100000:0.0:1746147201.770872:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2525:x1830967310055936:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7969us (8306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.770879:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19008 00000100:00100000:0.0:1746147201.771273:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.793736:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.793757:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.793769:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.793791:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147201.804331:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147201.829509:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.842644:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.847076:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.855413:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6975 00000100:00100000:0.0:1746147201.855427:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2002:x1830967310058112:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147201.865231:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.865772:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.867574:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6977 00000100:00100000:0.0:1746147201.867583:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310058624:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147201.905085:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.921504:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.921552:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.921591:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310059264 00000100:00100000:0.0:1746147201.921598:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310059264 00010000:00010000:0.0:1746147201.921627:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092542600/0x3139939425060b6e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcf8 expref: 43 pid: 7237 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746147201.921649:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310059392 00000100:00100000:0.0:1746147201.921651:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310059392 00010000:00010000:0.0:1746147201.921658:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x3139939425060b44 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcea expref: 29 pid: 7238 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746147201.921673:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8618 00000100:00100000:0.0:1746147201.921679:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967310059264:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147201.921692:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147201.921696:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092542600/0x3139939425060b6e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcf8 expref: 43 pid: 7237 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746147201.921706:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092542600/0x3139939425060b6e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcf8 expref: 43 pid: 7237 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746147201.921724:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147201.921728:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092543400/0x3139939425060bb4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147201.921735:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880092543400/0x3139939425060bb4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147201.921740:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147201.921774:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967310059264:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 96us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.921780:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8618 00000100:00100000:0.0:1746147201.921792:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8619 00000100:00100000:0.0:1746147201.921796:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310059392:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147201.921804:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147201.921808:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x3139939425060b44 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcea expref: 29 pid: 7238 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746147201.921815:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c79bc00/0x3139939425060b44 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcea expref: 29 pid: 7238 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746147201.921842:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147201.921844:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092543400/0x3139939425060bb4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147201.921850:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092543400/0x3139939425060bb4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147201.921856:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092543400/0x3139939425060bb4 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147201.921868:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147201.921881:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310059392:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 85us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.921886:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8619 00000100:00100000:1.0:1746147201.922030:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310058624:12345-192.168.204.25@tcp:3:cat.0 Request processed in 54448us (56262us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147201.922037:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6977 00002000:00100000:1.0:1746147201.922045:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880097d77b80 x1830967310058624/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:577/0 lens 488/440 e 0 to 0 dl 1746147212 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147201.922053:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d77b80 with x1830967310058624 ext(2097152->4194303) 00002000:00010000:1.0:1746147201.922056:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d77b80 00000100:00100000:0.0:1746147201.943622:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.943731:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.943842:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310059648 00000100:00100000:1.0:1746147201.943852:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310059648 00000100:00100000:1.0:1746147201.943911:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6045 00000100:00100000:1.0:1746147201.943920:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2525:x1830967310059648:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147201.944164:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2525:x1830967310059648:12345-192.168.204.25@tcp:35:cat.0 Request processed in 245us (551us total) trans 8589937137 rc 0/0 00000100:00100000:1.0:1746147201.944171:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6045 00000100:00100000:0.0:1746147201.945327:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.949529:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.949589:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310060032 00000100:00100000:0.0:1746147201.949600:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310060032 00010000:00010000:0.0:1746147201.949644:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134ae8800/0x3139939425060b8a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd22 expref: 28 pid: 10340 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746147201.949676:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8620 00000100:00100000:0.0:1746147201.949685:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310060032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147201.949698:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147201.949719:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134ae8800/0x3139939425060b8a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd22 expref: 28 pid: 10340 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746147201.949731:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134ae8800/0x3139939425060b8a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd22 expref: 28 pid: 10340 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746147201.949758:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147201.949801:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310060032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 117us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.949811:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8620 00000100:00100000:0.0:1746147201.952247:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.952474:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.952511:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.952529:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310060416 00000100:00100000:0.0:1746147201.952534:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310060416 00010000:00010000:0.0:1746147201.952561:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425060b9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd14 expref: 17 pid: 9586 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746147201.952581:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310060544 00000100:00100000:0.0:1746147201.952582:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310060544 00010000:00010000:0.0:1746147201.952591:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x3139939425060b52 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcf1 expref: 27 pid: 12201 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746147201.952603:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8621 00000100:00100000:0.0:1746147201.952609:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2003:x1830967310060416:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147201.952619:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147201.952636:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425060b9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd14 expref: 17 pid: 9586 timeout: 839 lvb_type: 1 00010000:00010000:0.0:1746147201.952647:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425060b9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd14 expref: 17 pid: 9586 timeout: 839 lvb_type: 1 00010000:00010000:0.0:1746147201.952665:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425060b9f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd14 expref: 17 pid: 9586 timeout: 839 lvb_type: 1 00010000:00010000:0.0:1746147201.952679:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147201.953743:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310060416:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1133us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.953750:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8621 00000100:00100000:0.0:1746147201.960150:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311340672:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147201.960173:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147201.960225:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310060544:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7365us (7711us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.960236:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8622 00000100:00100000:0.0:1746147201.961273:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310060288:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8130us (9030us total) trans 0 rc 696320/696320 00000100:00100000:0.0:1746147201.961283:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1626 00002000:00100000:0.0:1746147201.961293:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880094e58000 x1830967310060288/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:577/0 lens 488/440 e 0 to 0 dl 1746147212 ref 1 fl Complete:H/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147201.961303:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e58000 with x1830967310060288 ext(4194304->4890623) 00010000:00010000:0.0:1746147201.961313:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425060ba6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd29 expref: 16 pid: 10340 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746147201.961328:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425060ba6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd29 expref: 16 pid: 10340 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746147201.961334:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094e58000 00000100:00100000:0.0:1746147201.961457:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310060800 00000100:00100000:0.0:1746147201.961464:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310060800 00002000:00100000:0.0:1746147201.961494:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1511424->1515519) req@ffff8800975a4700 x1830967310060800/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:577/0 lens 488/0 e 0 to 0 dl 1746147212 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147201.961501:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a4700 with x1830967310060800 ext(1511424->1515519) 00002000:00010000:0.0:1746147201.961505:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800975a4700 00000100:00100000:0.0:1746147201.961676:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6979 00000100:00100000:0.0:1746147201.961683:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310060800:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147201.961815:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310060800:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 132us (417us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147201.961831:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6979 00002000:00100000:0.0:1746147201.961836:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1511424->1515519) req@ffff8800975a4700 x1830967310060800/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:577/0 lens 488/4536 e 0 to 0 dl 1746147212 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147201.961842:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a4700 with x1830967310060800 ext(1511424->1515519) 00002000:00010000:0.0:1746147201.961845:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800975a4700 00000100:00100000:0.0:1746147201.966687:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.966770:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.967263:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19016 00000100:00100000:0.0:1746147201.967269:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2002:x1830967310061056:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147201.967275:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147201.967281:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095053a00/0x3139939425060bd7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dd4c expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147201.967301:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147201.967310:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095053a00/0x3139939425060bd7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd4c expref: 19 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.967319:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095053a00/0x3139939425060bd7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd4c expref: 19 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147201.967349:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095053a00, rc 0) 00000100:00100000:0.0:1746147201.967473:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310061056:12345-192.168.204.25@tcp:101:cat.0 Request processed in 203us (701us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147201.967479:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19016 00000100:00100000:0.0:1746147201.972333:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310061184 00000100:00100000:0.0:1746147201.972340:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310061184 00010000:00010000:0.0:1746147201.972597:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425060ba6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd29 expref: 16 pid: 10340 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746147201.972627:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8623 00000100:00100000:0.0:1746147201.972633:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2003:x1830967310061184:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147201.972646:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147201.972664:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425060ba6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd29 expref: 16 pid: 10340 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746147201.972675:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425060ba6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd29 expref: 16 pid: 10340 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746147201.973113:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092542c00/0x3139939425060ba6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd29 expref: 16 pid: 10340 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746147201.973162:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147201.973229:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2003:x1830967310061184:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 595us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147201.973236:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8623 00000100:00100000:0.0:1746147201.974957:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.977706:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.979429:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147201.980275:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6980 00000100:00100000:1.0:1746147201.980283:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310061952:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147201.980359:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310061952:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 78us (930us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147201.980364:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6980 00002000:00100000:1.0:1746147201.980368:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2351104->2355199) req@ffff880094e58700 x1830967310061952/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:577/0 lens 488/4536 e 0 to 0 dl 1746147212 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147201.980376:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e58700 with x1830967310061952 ext(2351104->2355199) 00002000:00010000:1.0:1746147201.980379:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e58700 00000100:00100000:1.0:1746147201.983549:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310062208 00000100:00100000:1.0:1746147201.983558:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310062208 00000100:00100000:1.0:1746147201.983603:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6046 00000100:00100000:1.0:1746147201.983611:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909c4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2532:x1830967310062208:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147201.983806:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909c4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2532:x1830967310062208:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 194us (411us total) trans 8589937138 rc 0/0 00000100:00100000:1.0:1746147201.983812:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6046 00000100:00100000:0.0:1746147201.987707:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147201.996378:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.000647:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.001365:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:1.0:1746147202.001625:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147202.001955:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19020 00000100:00100000:1.0:1746147202.001974:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310063104:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147202.001992:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147202.002008:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984ef200/0x3139939425060bf3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dd68 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147202.002035:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984ef200/0x3139939425060bf3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd68 expref: 20 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147202.002044:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984ef200/0x3139939425060bf3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd68 expref: 20 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147202.002073:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ef200, rc 0) 00000100:00100000:1.0:1746147202.002150:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310063104:12345-192.168.204.25@tcp:101:cat.0 Request processed in 183us (784us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147202.002156:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19020 00000100:00100000:0.0:1746147202.008648:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.013327:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:1.0:1746147202.013541:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147202.126244:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.134182:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.137247:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.141036:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:1.0:1746147202.141440:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147202.143712:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310064384 00000100:00100000:0.0:1746147202.143720:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310064384 00000100:00100000:0.0:1746147202.145541:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19026 00000100:00100000:0.0:1746147202.145549:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2002:x1830967310064384:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147202.145560:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147202.145569:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x3139939425060c39 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dd7d expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147202.145582:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147202.145583:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147202.145589:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x3139939425060c39 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd7d expref: 15 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147202.145599:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x3139939425060c39 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd7d expref: 15 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147202.145611:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095052600, rc 0) 00000100:00100000:0.0:1746147202.145643:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2002:x1830967310064384:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 90us (3022us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147202.145648:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19026 00000100:00100000:0.0:1746147202.154840:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.160721:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147202.160900:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310065280 00000100:00100000:1.0:1746147202.160910:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310065280 00010000:00010000:1.0:1746147202.160948:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeec00/0x3139939425060c0f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd6f expref: 15 pid: 7238 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746147202.160993:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8626 00000100:00100000:1.0:1746147202.161001:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310065280:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147202.161015:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147202.161021:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeec00/0x3139939425060c0f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd6f expref: 15 pid: 7238 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746147202.161032:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeec00/0x3139939425060c0f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd6f expref: 15 pid: 7238 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746147202.161054:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147202.161060:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093730e00/0x3139939425060c47 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147202.161070:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093730e00/0x3139939425060c47 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147202.161077:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093730e00/0x3139939425060c47 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147202.161113:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147202.161157:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310065280:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 157us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147202.161164:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8626 00000100:00100000:0.0:1746147202.164339:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.167787:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.171500:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.172780:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.174131:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.174146:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310066304 00000100:00100000:0.0:1746147202.174150:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310066304 00000100:00100000:1.0:1746147202.174216:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147202.174804:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.175531:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19031 00000100:00100000:0.0:1746147202.175538:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310066176:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147202.175555:0:1853:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095052a00/0x3139939425060c8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147202.175566:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x3139939425060bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd3e expref: 25 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147202.175571:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147202.175572:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147202.175574:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095052a00/0x3139939425060c8d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147202.175594:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x3139939425060bc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd3e expref: 25 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147202.175601:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x3139939425060bc9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd3e expref: 25 pid: 10340 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746147202.175609:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311343104:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147202.175657:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147202.178523:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.186973:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.187022:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.187063:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.187107:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.187122:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310067200 00000100:00100000:0.0:1746147202.187125:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310067200 00010000:00010000:0.0:1746147202.187148:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03d800/0x3139939425060b0c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcb2 expref: 26 pid: 1854 timeout: 840 lvb_type: 1 00000100:00100000:0.0:1746147202.187164:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8629 00000100:00100000:0.0:1746147202.187167:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2003:x1830967310066688:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147202.187181:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147202.187200:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x3139939425060c1d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd84 expref: 18 pid: 9584 timeout: 840 lvb_type: 1 00010000:00010000:0.0:1746147202.187209:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x3139939425060c1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd84 expref: 18 pid: 9584 timeout: 840 lvb_type: 1 00010000:00010000:0.0:1746147202.187230:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x3139939425060c1d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd84 expref: 18 pid: 9584 timeout: 840 lvb_type: 1 00010000:00010000:0.0:1746147202.187248:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1746147202.187415:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147202.188478:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967310066688:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1304us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147202.188485:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8629 00000100:00100000:0.0:1746147202.188531:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.188593:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147202.188701:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310067328 00000100:00100000:1.0:1746147202.188706:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310067328 00010000:00010000:1.0:1746147202.188727:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134ae9c00/0x3139939425060b83 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd0d expref: 22 pid: 10340 timeout: 840 lvb_type: 1 00000100:00100000:1.0:1746147202.189372:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8632 00000100:00100000:1.0:1746147202.189380:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2003:x1830967310067328:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147202.189388:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147202.189402:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134ae9c00/0x3139939425060b83 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd0d expref: 22 pid: 10340 timeout: 840 lvb_type: 1 00010000:00010000:1.0:1746147202.189411:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134ae9c00/0x3139939425060b83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd0d expref: 22 pid: 10340 timeout: 840 lvb_type: 1 00010000:00010000:1.0:1746147202.189425:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134ae9c00/0x3139939425060b83 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd0d expref: 22 pid: 10340 timeout: 840 lvb_type: 1 00010000:00010000:1.0:1746147202.189438:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147202.189458:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2003:x1830967310067328:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 79us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147202.189464:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8632 00000100:00100000:1.0:1746147202.191251:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311343104:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147202.191267:0:1853:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095052a00/0x3139939425060c8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147202.193368:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310067456 00000100:00100000:1.0:1746147202.193375:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310067456 00010000:00010000:1.0:1746147202.193418:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425060b21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcdc expref: 43 pid: 12201 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746147202.193452:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8633 00000100:00100000:1.0:1746147202.193461:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2002:x1830967310067456:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147202.193476:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147202.193497:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425060b21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcdc expref: 43 pid: 12201 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746147202.193508:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425060b21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcdc expref: 43 pid: 12201 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746147202.193532:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425060b21 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcdc expref: 43 pid: 12201 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746147202.193549:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147202.193552:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147202.193557:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098446000/0x3139939425060c78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147202.193564:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098446000/0x3139939425060c78 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147202.193604:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147202.193646:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967310067456:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 186us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147202.193652:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8633 00000100:00100000:0.0:1746147202.200997:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.201046:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.201073:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.201111:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147202.201120:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310067840 00000100:00100000:0.0:1746147202.201128:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310068224 00000100:00100000:1.0:1746147202.201130:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310067840 00000100:00100000:0.0:1746147202.201131:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310068224 00010000:00010000:1.0:1746147202.201167:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093715800/0x3139939425060b05 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcd5 expref: 43 pid: 1853 timeout: 840 lvb_type: 1 00000100:00100000:1.0:1746147202.201196:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310067712 00000100:00100000:1.0:1746147202.201198:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310067712 00010000:00010000:1.0:1746147202.201209:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098446600/0x3139939425060c32 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd99 expref: 16 pid: 13695 timeout: 840 lvb_type: 1 00000100:00100000:1.0:1746147202.201224:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8634 00000100:00100000:1.0:1746147202.201231:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967310067840:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147202.201245:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147202.201270:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093715800/0x3139939425060b05 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcd5 expref: 43 pid: 1853 timeout: 840 lvb_type: 1 00010000:00010000:1.0:1746147202.201281:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093715800/0x3139939425060b05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcd5 expref: 43 pid: 1853 timeout: 840 lvb_type: 1 00010000:00010000:1.0:1746147202.201304:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093715800/0x3139939425060b05 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcd5 expref: 43 pid: 1853 timeout: 840 lvb_type: 1 00010000:00010000:1.0:1746147202.201320:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147202.201356:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967310067840:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 125us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147202.201362:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8634 00010000:00010000:0.0:1746147202.201515:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425060af7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcb9 expref: 41 pid: 17600 timeout: 840 lvb_type: 1 00000100:00100000:0.0:1746147202.201542:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8636 00000100:00100000:0.0:1746147202.201547:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967310068224:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147202.201554:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147202.201601:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425060af7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcb9 expref: 41 pid: 17600 timeout: 840 lvb_type: 1 00010000:00010000:0.0:1746147202.201609:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425060af7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcb9 expref: 41 pid: 17600 timeout: 840 lvb_type: 1 00010000:00010000:0.0:1746147202.201622:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425060af7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dcb9 expref: 41 pid: 17600 timeout: 840 lvb_type: 1 00010000:00010000:0.0:1746147202.201642:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147202.201659:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967310068224:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 112us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147202.202075:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8636 00000100:00100000:0.0:1746147202.202746:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.203531:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.203563:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147202.203585:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310067968 00000100:00100000:1.0:1746147202.203589:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310067968 00010000:00010000:1.0:1746147202.203611:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x3139939425060c39 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd7d expref: 15 pid: 9585 timeout: 840 lvb_type: 1 00000100:00100000:0.0:1746147202.203614:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147202.203629:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310068352 00000100:00100000:1.0:1746147202.203631:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310068352 00010000:00010000:1.0:1746147202.203639:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093730000/0x3139939425060b98 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd06 expref: 21 pid: 9586 timeout: 840 lvb_type: 1 00000100:00100000:1.0:1746147202.203651:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310068096 00000100:00100000:1.0:1746147202.203653:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310068096 00010000:00010000:1.0:1746147202.203661:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093731a00/0x3139939425060b91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd1b expref: 22 pid: 9586 timeout: 840 lvb_type: 1 00000100:00100000:1.0:1746147202.203669:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310068480 00000100:00100000:1.0:1746147202.203670:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310068480 00010000:00010000:1.0:1746147202.203679:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009372de00/0x3139939425060bde lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->2355199] (req 2097152->2355199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd53 expref: 29 pid: 10340 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746147202.203693:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8637 00000100:00100000:1.0:1746147202.203699:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310067968:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147202.203707:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147202.203719:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x3139939425060c39 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd7d expref: 15 pid: 9585 timeout: 840 lvb_type: 1 00010000:00010000:1.0:1746147202.203728:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x3139939425060c39 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd7d expref: 15 pid: 9585 timeout: 840 lvb_type: 1 00010000:00010000:1.0:1746147202.203744:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x3139939425060c39 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd7d expref: 15 pid: 9585 timeout: 840 lvb_type: 1 00010000:00010000:1.0:1746147202.203760:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147202.203762:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147202.203766:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbee800/0x3139939425060c86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147202.203774:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbee800/0x3139939425060c86 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147202.204220:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147202.204237:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310067968:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 538us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147202.204242:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8637 00000100:00100000:0.0:1746147202.208755:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310067584:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 6270us (7758us total) trans 21474842434 rc 0/0 00000100:00100000:0.0:1746147202.208766:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1631 00002000:00100000:0.0:1746147202.208778:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1511424->2097151) req@ffff880097095180 x1830967310067584/t21474842434(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:578/0 lens 488/448 e 0 to 0 dl 1746147213 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147202.208787:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097095180 with x1830967310067584 ext(1511424->2097151) 00010000:00010000:0.0:1746147202.208797:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x3139939425060bc9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd3e expref: 28 pid: 10340 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746147202.208812:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x3139939425060bc9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd3e expref: 28 pid: 10340 timeout: 840 lvb_type: 0 00002000:00010000:0.0:1746147202.208831:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097095180 00000100:00100000:0.0:1746147202.213825:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147202.213894:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310068608 00000100:00100000:1.0:1746147202.213903:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310068608 00010000:00010000:1.0:1746147202.213940:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x3139939425060bc9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd3e expref: 28 pid: 10340 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746147202.213983:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8641 00000100:00100000:1.0:1746147202.213991:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967310068608:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147202.214009:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147202.214030:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x3139939425060bc9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd3e expref: 28 pid: 10340 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746147202.214042:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x3139939425060bc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd3e expref: 28 pid: 10340 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746147202.214070:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x3139939425060bc9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dd3e expref: 28 pid: 10340 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746147202.214121:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147202.214123:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147202.214129:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095052a00/0x3139939425060c8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147202.214136:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095052a00/0x3139939425060c8d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147202.214168:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147202.214215:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310068608:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 222us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147202.214221:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8641 00000100:00100000:1.0:1746147202.219239:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147202.219289:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147202.219317:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147202.219346:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147202.219376:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.219440:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310068864 00000100:00100000:0.0:1746147202.219450:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310068864 00000100:00100000:0.0:1746147202.219489:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310069248 00000100:00100000:0.0:1746147202.219491:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310069248 00000100:00100000:0.0:1746147202.219513:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310069120 00000100:00100000:0.0:1746147202.219515:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310069120 00000100:00100000:0.0:1746147202.219523:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310069376 00000100:00100000:0.0:1746147202.219524:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310069376 00000100:00100000:0.0:1746147202.219537:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 970 00000100:00100000:0.0:1746147202.219545:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+5:2003:x1830967310069248:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1746147202.219609:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+5:2003:x1830967310069248:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 65us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147202.219615:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 970 00000100:00100000:0.0:1746147202.219627:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 971 00000100:00100000:0.0:1746147202.219631:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+375:2003:x1830967310069120:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1746147202.219648:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+375:2003:x1830967310069120:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 17us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147202.219653:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 971 00000100:00100000:0.0:1746147202.219659:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 972 00000100:00100000:0.0:1746147202.219662:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+5:2003:x1830967310069376:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1746147202.219677:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+5:2003:x1830967310069376:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 14us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147202.219681:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 972 00000100:00100000:0.0:1746147202.219688:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16282 00000100:00100000:0.0:1746147202.219691:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2542:x1830967310068864:12345-192.168.204.25@tcp:36:mirror_io.0 00010000:00010000:0.0:1746147202.219727:0:7237:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147202.219755:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093730400/0x3139939425060c6a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddae expref: 16 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147202.219780:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147202.219784:0:7237:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147202.219977:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095053000/0x3139939425060c9b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147202.219991:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250606c8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da58 expref: 43 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147202.219998:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844be00/0x3139939425060723 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da7b expref: 28 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147202.220004:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0e0600/0x3139939425060643 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9e8 expref: 28 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147202.220009:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x313993942506064a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9ef expref: 43 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147202.220014:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095053000/0x3139939425060c9b lrc: 7/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147202.220042:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x313993942506064a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9ef expref: 43 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147202.220053:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x313993942506064a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9ef expref: 43 pid: 7238 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746147202.220064:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311343872:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147202.220157:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0e0600/0x3139939425060643 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9e8 expref: 28 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147202.220304:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0e0600/0x3139939425060643 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9e8 expref: 28 pid: 7237 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746147202.220314:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311344000:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147202.220355:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009844be00/0x3139939425060723 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da7b expref: 28 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147202.220362:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844be00/0x3139939425060723 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da7b expref: 28 pid: 7239 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746147202.220369:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311344128:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147202.220393:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250606c8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da58 expref: 43 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147202.220400:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250606c8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da58 expref: 43 pid: 7237 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746147202.220408:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311344256:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147202.220423:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147202.223671:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311343872:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147202.223686:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311344000:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147202.223693:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311344128:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147202.223702:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311344256:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147202.223731:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095053000/0x3139939425060c9b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147202.224510:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.224995:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.225024:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.225457:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147202.226020:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310069632 00000100:00100000:1.0:1746147202.226024:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310069632 00010000:00010000:1.0:1746147202.226045:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0e0600/0x3139939425060643 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9e8 expref: 29 pid: 7237 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746147202.226066:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310069888 00000100:00100000:1.0:1746147202.226068:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310069888 00010000:00010000:1.0:1746147202.226079:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250606c8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da58 expref: 45 pid: 7237 timeout: 840 lvb_type: 0 00000100:00100000:1.0:1746147202.226109:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8642 00000100:00100000:1.0:1746147202.226116:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967310069504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147202.226129:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147202.226135:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x313993942506064a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9ef expref: 45 pid: 7238 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746147202.226145:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x313993942506064a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9ef expref: 45 pid: 7238 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746147202.226167:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256ea00/0x313993942506064a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9ef expref: 45 pid: 7238 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746147202.226185:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147202.226190:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095053000/0x3139939425060c9b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147202.226198:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147202.226238:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967310069504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 122us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147202.226244:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8642 00000100:00100000:1.0:1746147202.226259:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8643 00000100:00100000:1.0:1746147202.226263:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2000:x1830967310069632:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147202.226269:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147202.226273:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0e0600/0x3139939425060643 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9e8 expref: 29 pid: 7237 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746147202.226284:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0e0600/0x3139939425060643 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9e8 expref: 29 pid: 7237 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746147202.226295:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0e0600/0x3139939425060643 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7d9e8 expref: 29 pid: 7237 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746147202.226305:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147202.226308:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095053000/0x3139939425060c9b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147202.226313:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147202.226324:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2000:x1830967310069632:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 61us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147202.226330:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8643 00000100:00100000:1.0:1746147202.226339:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8644 00000100:00100000:1.0:1746147202.226344:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967310069888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147202.226349:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147202.226352:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250606c8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da58 expref: 43 pid: 7237 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746147202.226359:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250606c8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da58 expref: 43 pid: 7237 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746147202.226368:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250606c8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7da58 expref: 43 pid: 7237 timeout: 840 lvb_type: 0 00010000:00010000:1.0:1746147202.226375:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147202.226378:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095053000/0x3139939425060c9b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147202.226382:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147202.226393:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967310069888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 50us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147202.226398:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8644 00010000:00010000:1.0:1746147202.228974:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095053000/0x3139939425060c9b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147202.228988:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095053000/0x3139939425060c9b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000040:00080000:1.0:1746147202.229295:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1127, 88 off107024 00000004:00080000:1.0:1746147202.229303:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 740219212751ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147202.229345:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1141, 88 off108256 00000004:00080000:1.0:1746147202.229350:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 740219260380ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147202.229373:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1142, 88 off108344 00000004:00080000:1.0:1746147202.229376:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 740219286120ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147202.229385:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1128, 88 off107112 00000004:00080000:1.0:1746147202.229388:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 740219298190ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147202.229397:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1129, 88 off107200 00000004:00080000:1.0:1746147202.229399:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 740219309683ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147202.229407:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1143, 88 off108432 00000004:00080000:1.0:1746147202.229410:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 740219320125ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147202.229419:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1144, 88 off108520 00000004:00080000:1.0:1746147202.229422:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 740219332190ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147202.229431:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1145, 88 off108608 00000004:00080000:1.0:1746147202.229433:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 740219343773ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147202.229442:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1130, 88 off107288 00000004:00080000:1.0:1746147202.229444:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 740219354737ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147202.229451:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1146, 88 off108696 00000004:00080000:1.0:1746147202.229454:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 740219364322ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147202.229462:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1131, 88 off107376 00000004:00080000:1.0:1746147202.229464:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 740219374682ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147202.229470:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1147, 88 off108784 00000004:00080000:1.0:1746147202.229473:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 740219383821ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147202.229481:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1132, 88 off107464 00000004:00080000:1.0:1746147202.229483:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 740219393673ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147202.229490:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1133, 88 off107552 00000004:00080000:1.0:1746147202.229492:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 740219402927ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147202.229499:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1134, 88 off107640 00000004:00080000:1.0:1746147202.229502:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 740219412190ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147202.229509:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1135, 88 off107728 00000004:00080000:1.0:1746147202.229511:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 740219421535ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147202.229518:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1148, 88 off108872 00000004:00080000:1.0:1746147202.229521:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 740219431132ns, next at 694367916532ns, rc = 0 00000100:00100000:1.0:1746147202.232902:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311344640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147202.232973:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147202.233010:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311345152:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147202.233026:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147202.233039:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746147202.233043:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311344512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147202.233056:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147202.233066:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311345024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147202.233080:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:1.0:1746147202.233156:0:7237:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f087480 reply state ffff88012e20f000 transno 8589937143 ns: mdt-lustre-MDT0000_UUID lock: ffff880095053000/0x3139939425060c9b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147202.233177:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095053000/0x3139939425060c9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147202.233184:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147202.233187:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746147202.233191:0:7237:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746147202.233271:0:7237:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746147202.233283:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2542:x1830967310068864:12345-192.168.204.25@tcp:36:mirror_io.0 Request processed in 13588us (14055us total) trans 8589937143 rc 0/0 00000100:00100000:1.0:1746147202.233290:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16282 00010000:00010000:1.0:1746147202.233314:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880095053000/0x3139939425060c9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147202.233321:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095053000/0x3139939425060c9b lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147202.233326:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095053000/0x3139939425060c9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147202.233331:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095053000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147202.233335:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095053000/0x3139939425060c9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147202.233335:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311344640 00000100:00100000:0.0:1746147202.233339:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311344640 00010000:00010000:1.0:1746147202.233340:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095053000/0x3139939425060c9b lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147202.233349:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00000100:00100000:0.0:1746147202.233351:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19036 00010000:00010000:1.0:1746147202.233352:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147202.233355:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095053000/0x3139939425060c9b lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147202.233359:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095053000/0x3139939425060c9b lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147202.233359:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3765:x1830967311344384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147202.233374:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311345664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147202.233395:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147202.233403:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311346176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147202.233414:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147202.233421:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746147202.233424:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311345536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147202.233433:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147202.233438:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311346048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147202.233449:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147202.233460:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311345664 00000100:00100000:1.0:1746147202.233463:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311345664 00000100:00100000:1.0:1746147202.233475:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311346176 00000100:00100000:1.0:1746147202.233477:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311346176 00000100:00100000:1.0:1746147202.233482:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311345536 00000100:00100000:1.0:1746147202.233483:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311345536 00000100:00100000:1.0:1746147202.233489:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311346048 00000100:00100000:1.0:1746147202.233490:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311346048 00000100:00100000:1.0:1746147202.233497:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19037 00000100:00100000:1.0:1746147202.233502:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:3765:x1830967311344896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147202.234568:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+55:3765:x1830967311344384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1208us (1462us total) trans 17179875065 rc 0/0 00000100:00100000:0.0:1746147202.234574:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19036 00000004:00080000:0.0:1746147202.235580:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db15f80/2, rc 0, transno 21474842437 00000100:00100000:0.0:1746147202.235585:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311345536:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147202.235592:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db14700/2, rc 0, transno 21474842438 00000100:00100000:0.0:1746147202.235594:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311346048:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147202.235601:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db14380/2, rc 0, transno 21474842435 00000100:00100000:0.0:1746147202.235603:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311345664:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147202.235612:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db17800/2, rc 0, transno 21474842436 00000100:00100000:0.0:1746147202.235614:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311346176:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147202.235623:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097096a00/2, rc 0, transno 17179875063 00000100:00100000:0.0:1746147202.235626:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311344512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147202.235632:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3765:x1830967311344896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2128us (2493us total) trans 17179875067 rc 0/0 00000004:00080000:0.0:1746147202.235633:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097097800/2, rc 0, transno 17179875061 00000100:00100000:0.0:1746147202.235636:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311345024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147202.235639:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19037 00000004:00080000:0.0:1746147202.235644:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097097b80/2, rc 0, transno 17179875060 00000100:00100000:0.0:1746147202.235646:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311345152:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147202.235653:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097096d80/2, rc 0, transno 17179875064 00000100:00100000:0.0:1746147202.235656:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311344640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147202.237677:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311346432 00000100:00100000:1.0:1746147202.237688:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311346432 00000100:00100000:1.0:1746147202.237728:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19049 00000100:00100000:1.0:1746147202.237735:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3765:x1830967311346432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147202.237883:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967311346432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 147us (438us total) trans 21474842443 rc 0/0 00000100:00100000:1.0:1746147202.237889:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19049 00000001:00080000:1.0:1746147202.238341:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875067 is committed 00000001:00080000:1.0:1746147202.238405:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875059 is committed 00000001:00080000:1.0:1746147202.238412:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875058 is committed 00000001:00080000:1.0:1746147202.238449:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875044 is committed 00000100:00100000:0.0:1746147202.238783:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147202.238935:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310070016 00000100:00100000:1.0:1746147202.238939:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310070016 00000100:00100000:1.0:1746147202.242924:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16283 00000100:00100000:1.0:1746147202.242946:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2542:x1830967310070016:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147202.242975:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147202.242998:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef800/0x3139939425060ca2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ddb5 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147202.243059:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef800/0x3139939425060ca2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddb5 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147202.243072:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef800/0x3139939425060ca2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddb5 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147202.243103:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147202.243106:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147202.243110:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ef800, rc 0) 00000100:00100000:1.0:1746147202.243172:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2542:x1830967310070016:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 236us (4391us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147202.243179:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16283 00000100:00100000:0.0:1746147202.261935:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.269394:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.269437:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.269465:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.269494:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310070400 00000100:00100000:1.0:1746147202.269495:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310070656 00000100:00100000:1.0:1746147202.269502:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310070656 00000100:00100000:0.0:1746147202.269502:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310070400 00000100:00100000:0.0:1746147202.269715:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19050 00000100:00100000:0.0:1746147202.269723:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2001:x1830967310070400:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147202.269745:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147202.269871:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095053600/0x3139939425060cb7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ddca expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147202.269882:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x96:0x0] initial LVB size: 2097152, mtime: 0x68141780, atime: 0x68141780, ctime: 0x68141780, blocks: 0x808 00010000:00010000:0.0:1746147202.269889:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147202.269892:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147202.269900:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095053600/0x3139939425060cb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddca expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147202.269915:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095053600/0x3139939425060cb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddca expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147202.269930:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095053600, rc 0) 00000100:00100000:0.0:1746147202.269972:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310070400:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 251us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147202.269977:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19050 00000100:00100000:0.0:1746147202.269991:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19052 00000100:00100000:0.0:1746147202.269995:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2001:x1830967310070656:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147202.270001:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147202.270010:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095053a00/0x3139939425060cc5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ddd8 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147202.270023:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x68141781, atime: 0x68141781, ctime: 0x68141781, blocks: 0x808 00010000:00010000:0.0:1746147202.270029:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147202.270030:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147202.270034:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095053a00/0x3139939425060cc5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddd8 expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147202.270042:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095053a00/0x3139939425060cc5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddd8 expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147202.270048:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095053a00, rc 0) 00000100:00100000:0.0:1746147202.270058:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310070656:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 63us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147202.270062:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19052 00000100:00100000:0.0:1746147202.270484:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.270539:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147202.270626:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147202.270697:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310070272 00000100:00100000:1.0:1746147202.270700:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310070272 00000100:00100000:1.0:1746147202.270715:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310070528 00000100:00100000:1.0:1746147202.270717:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310070528 00000100:00100000:1.0:1746147202.270734:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310070784 00000100:00100000:1.0:1746147202.270736:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310070784 00000100:00100000:1.0:1746147202.270757:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19053 00000100:00100000:1.0:1746147202.270762:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310070272:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147202.270769:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147202.270779:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x3139939425060ccc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ddc3 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147202.270790:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x93:0x0] initial LVB size: 1048576, mtime: 0x68141780, atime: 0x68141780, ctime: 0x68141780, blocks: 0x7e8 00010000:00010000:1.0:1746147202.270799:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147202.270801:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147202.270805:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x3139939425060ccc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddc3 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147202.270824:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x3139939425060ccc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddc3 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147202.270831:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984eee00, rc 0) 00000100:00100000:1.0:1746147202.270853:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310070272:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 91us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147202.270857:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19053 00000100:00100000:1.0:1746147202.270869:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19054 00000100:00100000:1.0:1746147202.270873:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310070528:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147202.270878:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147202.270887:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984ee200/0x3139939425060cd3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ddd1 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147202.270897:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x97:0x0] initial LVB size: 2097152, mtime: 0x68141781, atime: 0x68141780, ctime: 0x68141781, blocks: 0x800 00010000:00010000:1.0:1746147202.270905:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147202.270906:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147202.270910:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ee200/0x3139939425060cd3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddd1 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147202.270918:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984ee200/0x3139939425060cd3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddd1 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147202.271292:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ee200, rc 0) 00000100:00100000:1.0:1746147202.271310:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310070528:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 436us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147202.271315:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19054 00010000:00010000:1.0:1746147202.797894:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147203.277914:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.277956:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.280026:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.280050:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310071040 00000100:00100000:1.0:1746147203.280058:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310071040 00000100:00100000:1.0:1746147203.280109:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19056 00000100:00100000:1.0:1746147203.280116:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2003:x1830967310071040:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:1.0:1746147203.280195:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2003:x1830967310071040:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 80us (2288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147203.280201:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19056 00000100:00100000:0.0:1746147203.280542:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.280568:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.280588:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.283823:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.283858:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.283887:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.283914:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.283978:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.284005:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310071808 00000100:00100000:0.0:1746147203.284012:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310071808 00000100:00100000:0.0:1746147203.284044:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310071936 00000100:00100000:0.0:1746147203.284046:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310071936 00000100:00100000:0.0:1746147203.284058:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310072192 00000100:00100000:0.0:1746147203.284060:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310072192 00000100:00100000:0.0:1746147203.284070:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310072448 00000100:00100000:0.0:1746147203.284071:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310072448 00000100:00100000:0.0:1746147203.284080:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310072064 00000100:00100000:0.0:1746147203.284082:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310072064 00000100:00100000:0.0:1746147203.284117:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19062 00000100:00100000:0.0:1746147203.284124:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310071808:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:0.0:1746147203.284203:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310071808:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 79us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147203.285682:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19062 00000100:00100000:0.0:1746147203.290343:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.292597:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.300732:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.300763:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.303457:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.304158:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.304170:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310073728 00000100:00100000:0.0:1746147203.304172:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310073728 00000100:00100000:0.0:1746147203.304192:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6985 00000100:00100000:0.0:1746147203.304196:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2002:x1830967310073728:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:0.0:1746147203.304211:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f966000/0x3139939425060cf6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147203.304218:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147203.304220:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147203.304222:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f966000/0x3139939425060cf6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147203.304229:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f966000/0x3139939425060cf6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147203.309288:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.309320:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.309342:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.309373:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.310850:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6988 00000100:00100000:0.0:1746147203.310857:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2002:x1830967310074624:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:0.0:1746147203.310872:0:13334:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009371c400/0x3139939425060d0b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147203.310883:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147203.310885:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147203.310888:0:13334:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009371c400/0x3139939425060d0b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147203.310895:0:13334:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009371c400/0x3139939425060d0b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147203.311613:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6989 00000100:00100000:1.0:1746147203.311622:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2002:x1830967310074752:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:1.0:1746147203.311638:0:29474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425060d12 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.311645:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.311646:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.311649:0:29474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425060d12 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.311657:0:29474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425060d12 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.354483:0:29474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425060d12 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.354498:0:29474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425060d12 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.354505:0:29474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425060d12 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.354510:0:29474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984eea00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147203.354513:0:29474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425060d12 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.354519:0:29474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425060d12 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.354538:0:29474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425060d12 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.354543:0:29474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425060d12 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147203.354627:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2002:x1830967310074752:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 43001us (45247us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147203.354635:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6989 00000100:00100000:0.0:1746147203.362084:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147203.362219:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147203.363606:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.365869:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.379693:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.379759:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310075648 00000100:00100000:1.0:1746147203.379767:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310075648 00000100:00100000:1.0:1746147203.379859:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16285 00000100:00100000:1.0:1746147203.379866:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2554:x1830967310075648:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147203.379884:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.379899:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7e600/0x3139939425060d19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dded expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.379956:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425060d20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.379966:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425060d20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.379976:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425060d20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.379987:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425060d27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.379995:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425060d27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.380000:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425060d27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00080000:0.0:1746147203.380113:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147203.382135:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147203.382973:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f600/0x3139939425060d43 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.382981:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f600/0x3139939425060d43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.382987:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f600/0x3139939425060d43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:1.0:1746147203.383002:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147203.383052:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425060d20 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.383056:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425060d20 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.383061:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425060d20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.383065:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425060d20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.383069:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c7fa00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147203.383072:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425060d20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.383077:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425060d20 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.383100:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147203.383103:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147203.383106:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425060d20 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.383110:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425060d20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.383124:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425060d27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.383128:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425060d27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.383132:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425060d27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.383136:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c7f000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147203.383138:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425060d27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.383142:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425060d27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.383148:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012b447500) 00010000:00010000:1.0:1746147203.383149:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147203.383151:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425060d27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.383156:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425060d27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147203.383189:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7e600/0x3139939425060d19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dded expref: 29 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.383202:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f600/0x3139939425060d43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dded expref: 28 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.383207:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147203.383209:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147203.383212:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c7f600, rc 0) 00000100:00100000:1.0:1746147203.383612:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2554:x1830967310075648:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3746us (3925us total) trans 8589937146 rc 0/0 00000100:00100000:1.0:1746147203.383616:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16285 00000100:00100000:1.0:1746147203.387649:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310076544 00000100:00100000:1.0:1746147203.387654:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310076544 00000100:00100000:1.0:1746147203.387678:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19074 00000100:00100000:1.0:1746147203.387682:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310076544:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147203.387687:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.387694:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425060d9e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7de17 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.387703:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.387705:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.387708:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425060d9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de17 expref: 30 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.387717:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425060d9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de17 expref: 30 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.387723:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c7fa00, rc 0) 00000100:00100000:1.0:1746147203.387745:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310076544:12345-192.168.204.25@tcp:101:cat.0 Request processed in 62us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147203.387749:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19074 00000100:00100000:1.0:1746147203.387758:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19075 00000100:00100000:1.0:1746147203.387762:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310076672:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147203.387768:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.387774:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097c7fc00/0x3139939425060da5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7de1e expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.387782:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.387783:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.387786:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c7fc00/0x3139939425060da5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de1e expref: 25 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.387807:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097c7fc00/0x3139939425060da5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de1e expref: 25 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.387813:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c7fc00, rc 0) 00000100:00100000:1.0:1746147203.387827:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310076672:12345-192.168.204.25@tcp:101:cat.0 Request processed in 65us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147203.387832:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19075 00000100:00100000:0.0:1746147203.392455:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.392486:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.392506:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.392526:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310077312 00000100:00100000:0.0:1746147203.392533:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310077312 00000100:00100000:1.0:1746147203.392545:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310077568 00000100:00100000:1.0:1746147203.392548:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310077568 00000100:00100000:1.0:1746147203.393837:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310077824 00000100:00100000:1.0:1746147203.393843:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310077824 00000100:00100000:1.0:1746147203.393870:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19076 00000100:00100000:1.0:1746147203.393877:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310077312:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147203.393892:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19077 00010000:00010000:1.0:1746147203.393898:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147203.393898:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+5:2000:x1830967310077568:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147203.393904:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.393913:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f01ac00/0x3139939425060dac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7de33 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147203.393913:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800990cda00/0x3139939425060db3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7de41 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.393932:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147203.393932:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.393933:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147203.393934:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.393940:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f01ac00/0x3139939425060dac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de33 expref: 17 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147203.393940:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800990cda00/0x3139939425060db3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de41 expref: 6 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.393953:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f01ac00/0x3139939425060dac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de33 expref: 17 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147203.393953:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800990cda00/0x3139939425060db3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de41 expref: 6 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.393962:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f01ac00, rc 0) 00010000:00010000:0.0:1746147203.393962:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990cda00, rc 0) 00000100:00100000:0.0:1746147203.394434:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+6:2000:x1830967310077568:12345-192.168.204.25@tcp:101:cat.0 Request processed in 535us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147203.394440:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19077 00000100:00080000:0.0:1746147203.394458:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147203.395395:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310077312:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1516us (2946us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147203.395401:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19076 00000100:00100000:0.0:1746147203.395653:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.395685:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.395711:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.395721:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310077440 00000100:00100000:0.0:1746147203.395721:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310077696 00000100:00100000:1.0:1746147203.395725:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310077440 00000100:00100000:0.0:1746147203.395725:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310077696 00000100:00100000:0.0:1746147203.395742:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310077952 00000100:00100000:0.0:1746147203.395743:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310077952 00000100:00100000:1.0:1746147203.395745:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19079 00000100:00100000:1.0:1746147203.395750:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310077696:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147203.395753:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19080 00000100:00100000:0.0:1746147203.395756:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2000:x1830967310077440:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147203.395759:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147203.395760:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.395768:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f01a200/0x3139939425060dc1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7de48 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147203.395768:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800990cc000/0x3139939425060dc8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7de3a expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.395779:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147203.395779:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.395781:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147203.395781:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147203.395785:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800990cc000/0x3139939425060dc8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de3a expref: 8 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.395786:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f01a200/0x3139939425060dc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de48 expref: 18 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.395810:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f01a200/0x3139939425060dc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de48 expref: 18 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147203.395810:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800990cc000/0x3139939425060dc8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de3a expref: 8 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.395818:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f01a200, rc 0) 00010000:00010000:0.0:1746147203.395818:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990cc000, rc 0) 00000100:00100000:0.0:1746147203.395841:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310077440:12345-192.168.204.25@tcp:101:cat.0 Request processed in 84us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147203.395842:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310077696:12345-192.168.204.25@tcp:101:cat.0 Request processed in 93us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147203.395846:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19080 00000100:00100000:1.0:1746147203.395848:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19079 00000100:00100000:0.0:1746147203.395855:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19081 00000100:00100000:0.0:1746147203.395859:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2000:x1830967310077952:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147203.395864:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147203.395870:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800990cc200/0x3139939425060dcf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7de56 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147203.395879:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147203.395880:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147203.395883:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800990cc200/0x3139939425060dcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de56 expref: 8 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147203.395891:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800990cc200/0x3139939425060dcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de56 expref: 8 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147203.395896:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990cc200, rc 0) 00000100:00100000:0.0:1746147203.395907:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310077952:12345-192.168.204.25@tcp:101:cat.0 Request processed in 48us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147203.395911:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19081 00000100:00100000:0.0:1746147203.398771:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.398814:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.398840:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.402783:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.418507:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.418584:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.423001:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311347328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147203.423052:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147203.423105:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311347456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147203.423110:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311347328 00000100:00100000:1.0:1746147203.423116:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311347328 00000100:00100000:0.0:1746147203.423127:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147203.423140:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147203.423144:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311347584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147203.423155:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147203.425411:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311347968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147203.425446:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147203.425678:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311347456 00000100:00100000:1.0:1746147203.425684:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311347456 00000100:00100000:0.0:1746147203.425703:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147203.425718:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311347200 00000100:00100000:1.0:1746147203.425720:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311347200 00000100:00100000:0.0:1746147203.425724:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311347712:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147203.425732:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19082 00000100:00100000:1.0:1746147203.425739:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3767:x1830967311347328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147203.425739:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147203.425749:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746147203.425752:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311347840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147203.425762:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147203.425775:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19084 00000100:00100000:0.0:1746147203.425781:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3764:x1830967311347584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147203.426521:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147203.426524:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147201 -> 1746147201 00002000:00010000:1.0:1746147203.426526:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147201 -> 1746147201 00002000:00010000:1.0:1746147203.426527:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147201 -> 1746147201 00002000:00010000:1.0:1746147203.426529:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147203.426556:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3767:x1830967311347328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 818us (3504us total) trans 21474842445 rc 0/0 00000100:00100000:1.0:1746147203.426561:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19082 00000100:00100000:1.0:1746147203.426574:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19087 00000100:00100000:1.0:1746147203.426577:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3766:x1830967311347712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147203.426621:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3766:x1830967311347712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (881us total) trans 21474842446 rc 0/0 00000100:00100000:1.0:1746147203.426626:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19087 00000100:00100000:1.0:1746147203.426633:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19088 00000100:00100000:1.0:1746147203.426636:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3766:x1830967311347840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147203.426673:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3766:x1830967311347840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 36us (910us total) trans 21474842447 rc 0/0 00000100:00100000:1.0:1746147203.426678:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19088 00000100:00080000:1.0:1746147203.426690:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1746147203.426715:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258fb80/2, rc 0, transno 21474842445 00000100:00100000:1.0:1746147203.426723:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311347328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147203.426760:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746147203.426765:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311348224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147203.426780:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147203.426805:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311348224 00000100:00100000:1.0:1746147203.426808:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311348224 00000100:00100000:1.0:1746147203.426821:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19089 00000100:00100000:1.0:1746147203.426824:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3767:x1830967311348224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147203.426870:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3767:x1830967311348224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (89us total) trans 21474842448 rc 0/0 00000100:00100000:1.0:1746147203.426874:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19089 00000004:00080000:1.0:1746147203.426887:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096cfb800/2, rc 0, transno 21474842448 00000100:00100000:1.0:1746147203.426890:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311348224:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147203.427022:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258f480/2, rc 0, transno 21474842447 00000100:00100000:0.0:1746147203.427026:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311347840:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147203.427034:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258dc00/2, rc 0, transno 21474842446 00000100:00100000:0.0:1746147203.427037:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311347712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147203.427117:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311348736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147203.427140:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147203.427159:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311349248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147203.427174:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147203.427185:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746147203.427189:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311348352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147203.427203:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147203.427748:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311348864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147203.427763:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147203.428021:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258df80/2, rc 0, transno 21474842452 00000100:00100000:0.0:1746147203.428025:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311347200:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147203.428054:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147203.428056:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147203.428058:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147203.428059:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147203.428061:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:0.0:1746147203.428085:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3764:x1830967311347584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2305us (4928us total) trans 21474842450 rc 0/0 00000100:00100000:0.0:1746147203.428109:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19084 00000100:00100000:0.0:1746147203.428132:0:3766:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875067 gen 2 00000004:00080000:0.0:1746147203.428135:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c70e00, transno 17179875002 00000004:00080000:0.0:1746147203.428140:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cf8700, transno 17179875003 00000004:00080000:0.0:1746147203.428143:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c73b80, transno 17179875004 00000004:00080000:0.0:1746147203.428145:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c73480, transno 17179875005 00000004:00080000:0.0:1746147203.428146:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c72a00, transno 17179875006 00000004:00080000:0.0:1746147203.428149:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c72d80, transno 17179875007 00000004:00080000:0.0:1746147203.428151:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c70a80, transno 17179875008 00000004:00080000:0.0:1746147203.428153:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c70700, transno 17179875009 00000004:00080000:0.0:1746147203.428155:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f9f80, transno 17179875014 00000004:00080000:0.0:1746147203.428157:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098858e00, transno 17179875015 00000004:00080000:0.0:1746147203.428159:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098858000, transno 17179875016 00000004:00080000:0.0:1746147203.428161:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fb100, transno 17179875017 00000004:00080000:0.0:1746147203.428162:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f8a80, transno 17179875018 00000004:00080000:0.0:1746147203.428164:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096899180, transno 17179875019 00000004:00080000:0.0:1746147203.428167:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fad80, transno 17179875020 00000004:00080000:0.0:1746147203.428169:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fa300, transno 17179875021 00000004:00080000:0.0:1746147203.428171:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947e7800, transno 17179875022 00000004:00080000:0.0:1746147203.428173:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132126300, transno 17179875023 00000004:00080000:0.0:1746147203.428175:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca11880, transno 17179875024 00000004:00080000:0.0:1746147203.428177:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099153480, transno 17179875025 00000004:00080000:0.0:1746147203.428179:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099150a80, transno 17179875026 00000004:00080000:0.0:1746147203.428181:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947e5c00, transno 17179875027 00000004:00080000:0.0:1746147203.428183:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099152d80, transno 17179875028 00000004:00080000:0.0:1746147203.428185:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947e4a80, transno 17179875029 00000004:00080000:0.0:1746147203.428187:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f9c00, transno 17179875036 00000004:00080000:0.0:1746147203.428189:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f9880, transno 17179875037 00000004:00080000:0.0:1746147203.428191:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099155880, transno 17179875038 00000004:00080000:0.0:1746147203.428193:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099154a80, transno 17179875039 00000004:00080000:0.0:1746147203.428195:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fa680, transno 17179875040 00000004:00080000:0.0:1746147203.428197:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098820a80, transno 17179875041 00000004:00080000:0.0:1746147203.428198:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099155180, transno 17179875042 00000004:00080000:0.0:1746147203.428200:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099154380, transno 17179875043 00000004:00080000:0.0:1746147203.428203:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e486a00, transno 17179875045 00000004:00080000:0.0:1746147203.428205:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d6d880, transno 17179875046 00000004:00080000:0.0:1746147203.428207:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e485f80, transno 17179875047 00000004:00080000:0.0:1746147203.428209:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e487480, transno 17179875048 00000004:00080000:0.0:1746147203.428211:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d6ce00, transno 17179875049 00000004:00080000:0.0:1746147203.428213:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e484380, transno 17179875050 00000004:00080000:0.0:1746147203.428215:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e487b80, transno 17179875051 00000004:00080000:0.0:1746147203.428217:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e484a80, transno 17179875052 00000004:00080000:0.0:1746147203.428219:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097097b80, transno 17179875060 00000004:00080000:0.0:1746147203.428220:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097097800, transno 17179875061 00000004:00080000:0.0:1746147203.428222:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097097100, transno 17179875062 00000004:00080000:0.0:1746147203.428224:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097096a00, transno 17179875063 00000004:00080000:0.0:1746147203.428225:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097096d80, transno 17179875064 00000004:00080000:0.0:1746147203.428227:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097095c00, transno 17179875065 00000004:00080000:0.0:1746147203.428229:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097094e00, transno 17179875066 00000004:00080000:0.0:1746147203.428231:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097097480, transno 17179875067 00000100:00100000:0.0:1746147203.428235:0:3766:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880097096300 x1830967311348736/t17179875069(17179875069) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147219 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000100:00080000:1.0:1746147203.428236:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1746147203.428243:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097096300/2, rc 0, transno 17179875069 00000100:00100000:1.0:1746147203.428246:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311348096 00000100:00100000:0.0:1746147203.428246:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311348736:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147203.428248:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311348096 00000004:00080000:0.0:1746147203.428302:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097096680/2, rc 0, transno 17179875070 00000100:00100000:0.0:1746147203.428305:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311349248:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147203.428312:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b6e300/2, rc 0, transno 17179875072 00000100:00100000:0.0:1746147203.428314:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311348352:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147203.428319:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097095f80/2, rc 0, transno 17179875071 00000100:00100000:0.0:1746147203.428321:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311348864:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147203.428827:0:8112:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 48 done 00000004:00080000:0.0:1746147203.428849:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258e680/2, rc 0, transno 21474842449 00000100:00100000:0.0:1746147203.428852:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311347968:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147203.428860:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258ce00/2, rc 0, transno 21474842450 00000100:00100000:0.0:1746147203.428863:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311347584:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147203.428870:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258f800/2, rc 0, transno 21474842451 00000100:00100000:0.0:1746147203.428872:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311347456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147203.431153:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6991 00000100:00100000:0.0:1746147203.431160:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967310079232:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147203.431747:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6992 00000100:00100000:1.0:1746147203.431756:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310079488:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147203.432288:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.432301:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310080384 00000100:00100000:0.0:1746147203.432304:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310080384 00002000:00100000:0.0:1746147203.432318:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880098c70e00 x1830967310080384/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:579/0 lens 488/0 e 0 to 0 dl 1746147214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147203.432325:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c70e00 with x1830967310080384 ext(0->1048575) 00002000:00010000:0.0:1746147203.432328:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098c70e00 00000100:00100000:0.0:1746147203.432339:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6994 00000100:00100000:0.0:1746147203.432344:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310080384:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147203.432777:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.432812:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.432837:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.433718:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6997 00000100:00100000:1.0:1746147203.433725:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2003:x1830967310081024:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147203.449413:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310079232:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 18252us (18721us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147203.449420:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6991 00002000:00100000:1.0:1746147203.449426:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880097d75500 x1830967310079232/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:579/0 lens 488/440 e 0 to 0 dl 1746147214 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147203.449433:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d75500 with x1830967310079232 ext(0->1048575) 00002000:00010000:1.0:1746147203.449438:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d75500 00000100:00100000:1.0:1746147203.455209:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310079488:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 23446us (24484us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147203.455221:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6992 00002000:00100000:1.0:1746147203.455232:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880097d74000 x1830967310079488/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:579/0 lens 488/440 e 0 to 0 dl 1746147214 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147203.455241:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d74000 with x1830967310079488 ext(1048576->2097151) 00002000:00010000:1.0:1746147203.455245:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d74000 00000100:00100000:0.0:1746147203.482289:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.483822:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310081024:12345-192.168.204.25@tcp:3:cat.0 Request processed in 50097us (50982us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147203.483829:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6997 00002000:00100000:1.0:1746147203.483837:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880098c72a00 x1830967310081024/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:579/0 lens 488/440 e 0 to 0 dl 1746147214 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147203.483845:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c72a00 with x1830967310081024 ext(1048576->2097151) 00002000:00010000:1.0:1746147203.483848:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098c72a00 00000100:00100000:0.0:1746147203.495646:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.496404:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310081280 00000100:00100000:1.0:1746147203.496413:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310081280 00000100:00100000:1.0:1746147203.496785:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19099 00000100:00100000:1.0:1746147203.496802:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2550:x1830967310081280:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147203.496821:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.496839:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ffa200/0x3139939425060df9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7de72 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.496869:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x3139939425060cbe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dde6 expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.496877:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800990cc200/0x3139939425060dcf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de56 expref: 7 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.496884:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097c7fc00/0x3139939425060da5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de1e expref: 26 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.496890:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.496891:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.496895:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffa200/0x3139939425060df9 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [4038656->4104191] (req 4038656->4104191) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de72 expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.496921:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097c7fc00/0x3139939425060da5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de1e expref: 26 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.496937:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097c7fc00/0x3139939425060da5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de1e expref: 26 pid: 9585 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746147203.496948:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311349376:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147203.497816:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800990cc200/0x3139939425060dcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de56 expref: 7 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.497825:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800990cc200/0x3139939425060dcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de56 expref: 7 pid: 17600 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746147203.497832:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311349504:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147203.497863:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x3139939425060cbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dde6 expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.497871:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x3139939425060cbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dde6 expref: 10 pid: 12225 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746147203.497877:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311349632:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147203.497892:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147203.499084:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.507167:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.507250:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311349376:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147203.507251:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.507264:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311349504:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147203.507273:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311349632:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147203.507281:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147203.507314:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ffa200/0x3139939425060df9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [4038656->4104191] (req 4038656->4104191) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de72 expref: 28 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.507332:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffa200, rc 0) 00000100:00100000:1.0:1746147203.507363:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310081920 00000100:00100000:1.0:1746147203.507368:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310081920 00010000:00010000:1.0:1746147203.507402:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097c7fc00/0x3139939425060da5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de1e expref: 29 pid: 9585 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746147203.507435:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310082048 00000100:00100000:1.0:1746147203.507438:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310082048 00010000:00010000:1.0:1746147203.507448:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092543400/0x3139939425060cbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dde6 expref: 11 pid: 12225 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746147203.509418:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2550:x1830967310081280:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 12617us (13770us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147203.509427:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19099 00000100:00100000:0.0:1746147203.510031:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.510325:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.510346:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310083200 00000100:00100000:0.0:1746147203.510350:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310083200 00002000:00100000:0.0:1746147203.510367:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880097096a00 x1830967310083200/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:579/0 lens 488/0 e 0 to 0 dl 1746147214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147203.510374:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097096a00 with x1830967310083200 ext(1048576->2097151) 00002000:00010000:0.0:1746147203.510377:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097096a00 00000100:00100000:0.0:1746147203.510396:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7000 00000100:00100000:0.0:1746147203.510404:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310081792:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147203.511398:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7002 00000100:00100000:0.0:1746147203.511404:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967310082688:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147203.519206:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.519538:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310083456 00000100:00100000:1.0:1746147203.519545:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310083456 00002000:00100000:1.0:1746147203.519588:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (4038656->4042751) req@ffff880097096d80 x1830967310083456/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:579/0 lens 488/0 e 0 to 0 dl 1746147214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147203.519599:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097096d80 with x1830967310083456 ext(4038656->4042751) 00002000:00010000:1.0:1746147203.519604:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097096d80 00000100:00100000:1.0:1746147203.519622:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7004 00000100:00100000:1.0:1746147203.519629:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310083456:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147203.519744:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310083456:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 116us (551us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147203.519750:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7004 00002000:00100000:1.0:1746147203.519755:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (4038656->4042751) req@ffff880097096d80 x1830967310083456/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:579/0 lens 488/4536 e 0 to 0 dl 1746147214 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147203.519763:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097096d80 with x1830967310083456 ext(4038656->4042751) 00002000:00010000:1.0:1746147203.519765:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097096d80 00000100:00100000:1.0:1746147203.525215:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310081792:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14811us (15734us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147203.525221:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7000 00002000:00100000:1.0:1746147203.525226:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88009258d500 x1830967310081792/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:579/0 lens 488/440 e 0 to 0 dl 1746147214 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147203.525233:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258d500 with x1830967310081792 ext(1048576->2097151) 00002000:00010000:1.0:1746147203.525237:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009258d500 00000100:00100000:0.0:1746147203.543027:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.547518:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.547606:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.558674:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.561933:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310084352 00000100:00100000:1.0:1746147203.561949:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310084352 00000100:00100000:1.0:1746147203.562022:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19100 00000100:00100000:1.0:1746147203.562031:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2002:x1830967310084352:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147203.562053:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.562073:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x3139939425060e00 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7de79 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147203.562146:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311349888:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147203.562259:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746147203.568809:0:1854:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime: 1746147201 -> 1746147203 00002000:00010000:1.0:1746147203.568819:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime: 1746147201 -> 1746147203 00002000:00010000:1.0:1746147203.568822:0:1854:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime: 1746147200 -> 1746147203 00000100:00100000:1.0:1746147203.568846:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311349888:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147203.568883:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x3139939425060e00 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de79 expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.568896:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ffbe00/0x3139939425060e00 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de79 expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.568916:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffbe00, rc 0) 00000100:00100000:1.0:1746147203.569001:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2002:x1830967310084352:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6971us (10335us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147203.569011:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19100 00000100:00100000:0.0:1746147203.570024:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.570116:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310084480 00000100:00100000:1.0:1746147203.570124:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310084480 00000100:00100000:1.0:1746147203.570173:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19101 00000100:00100000:1.0:1746147203.570186:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2551:x1830967310084480:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147203.570202:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.570220:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ffbc00/0x3139939425060e07 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7de80 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.570248:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801312e7c00/0x3139939425060cda lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dddf expref: 11 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.570256:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x3139939425060dba lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de4f expref: 19 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.570264:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425060d9e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de17 expref: 29 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.570270:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.570272:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.570276:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffbc00/0x3139939425060e07 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [4091904->4194303] (req 4091904->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de80 expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.570302:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425060d9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de17 expref: 29 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.570315:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097c7fa00/0x3139939425060d9e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de17 expref: 29 pid: 9585 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746147203.570328:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311350016:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147203.570408:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x3139939425060dba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de4f expref: 19 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.570416:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x3139939425060dba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de4f expref: 19 pid: 1854 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746147203.570424:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311350144:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147203.570448:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801312e7c00/0x3139939425060cda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dddf expref: 11 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.570456:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801312e7c00/0x3139939425060cda lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dddf expref: 11 pid: 17600 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746147203.570469:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311350272:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147203.570488:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147203.571658:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311350016:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147203.571669:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311350144:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147203.571677:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311350272:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147203.571706:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ffbc00/0x3139939425060e07 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [4091904->4194303] (req 4091904->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de80 expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.571722:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffbc00, rc 0) 00000100:00100000:1.0:1746147203.571806:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2551:x1830967310084480:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1622us (1782us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147203.571814:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19101 00000100:00100000:0.0:1746147203.575179:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.575529:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.575565:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.576054:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310085248 00000100:00100000:1.0:1746147203.576059:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310085248 00000100:00100000:1.0:1746147203.576108:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19102 00000100:00100000:1.0:1746147203.576114:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2554:x1830967310085248:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147203.576124:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.576139:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425060e0e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7de87 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.576158:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.576164:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ffbc00/0x3139939425060e07 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [4091904->4194303] (req 4091904->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de80 expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.576174:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147203.576177:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425060e0e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de87 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.576409:0:1854:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ffbc00/0x3139939425060e07 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [4091904->4194303] (req 4091904->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de80 expref: 20 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.576421:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425060e0e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de87 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.576429:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffbe00, rc 0) 00000100:00100000:1.0:1746147203.576447:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2554:x1830967310085248:12345-192.168.204.25@tcp:101:cat.0 Request processed in 334us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147203.576452:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19102 00000100:00100000:0.0:1746147203.586592:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.586683:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310085504 00000100:00100000:1.0:1746147203.586693:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310085504 00000100:00100000:1.0:1746147203.586900:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19103 00000100:00100000:1.0:1746147203.586911:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2555:x1830967310085504:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147203.586934:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.586955:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ffb200/0x3139939425060e15 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7de8e expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.586988:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ffa200/0x3139939425060df9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4038656->4104191) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de72 expref: 24 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.586995:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147203.586997:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147203.587001:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffb200/0x3139939425060e15 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de8e expref: 8 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.587035:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097ffa200/0x3139939425060df9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4038656->4104191) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de72 expref: 24 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.587046:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097ffa200/0x3139939425060df9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4038656->4104191) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de72 expref: 24 pid: 1854 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746147203.587059:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311350528:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147203.587190:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147203.587545:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.589525:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311350528:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147203.589549:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ffb200/0x3139939425060e15 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de8e expref: 8 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.589564:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffb200, rc 0) 00000100:00100000:0.0:1746147203.589955:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.590182:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2555:x1830967310085504:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3271us (3600us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147203.590191:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19103 00000100:00100000:0.0:1746147203.591165:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.591253:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310086016 00000100:00100000:1.0:1746147203.591256:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310086016 00002000:00100000:1.0:1746147203.591273:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (4091904->4095999) req@ffff8800947e7800 x1830967310086016/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:579/0 lens 488/0 e 0 to 0 dl 1746147214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147203.591280:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e7800 with x1830967310086016 ext(4091904->4095999) 00010000:00010000:1.0:1746147203.591286:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097ffbc00/0x3139939425060e07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de80 expref: 19 pid: 1854 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746147203.591295:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097ffbc00/0x3139939425060e07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de80 expref: 19 pid: 1854 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746147203.591301:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947e7800 00000100:00100000:1.0:1746147203.591314:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1634 00000100:00100000:1.0:1746147203.591319:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310086016:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147203.591410:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310086016:12345-192.168.204.25@tcp:3:cat.0 Request processed in 90us (245us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147203.591415:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1634 00002000:00100000:1.0:1746147203.591420:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (4091904->4095999) req@ffff8800947e7800 x1830967310086016/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:579/0 lens 488/4536 e 0 to 0 dl 1746147214 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147203.591426:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e7800 with x1830967310086016 ext(4091904->4095999) 00010000:00010000:1.0:1746147203.591430:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097ffbc00/0x3139939425060e07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de80 expref: 18 pid: 1854 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746147203.591437:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097ffbc00/0x3139939425060e07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de80 expref: 18 pid: 1854 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746147203.591443:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947e7800 00000100:00100000:0.0:1746147203.593013:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310085760:12345-192.168.204.25@tcp:4:cat.0 Request processed in 2378us (3051us total) trans 17179875077 rc 0/0 00000100:00100000:0.0:1746147203.593023:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1633 00002000:00100000:0.0:1746147203.593031:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x98:0x0] (4038656->4104191) req@ffff880098859500 x1830967310085760/t17179875077(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:579/0 lens 488/448 e 0 to 0 dl 1746147214 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147203.593040:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098859500 with x1830967310085760 ext(4038656->4104191) 00010000:00010000:0.0:1746147203.593047:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097ffa200/0x3139939425060df9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4038656->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de72 expref: 27 pid: 1854 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746147203.593057:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097ffa200/0x3139939425060df9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4038656->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de72 expref: 27 pid: 1854 timeout: 841 lvb_type: 0 00002000:00010000:0.0:1746147203.593063:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098859500 00000100:00100000:0.0:1746147203.599434:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.599482:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.599866:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.599934:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310086400 00000100:00100000:1.0:1746147203.599938:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310086400 00000100:00100000:1.0:1746147203.599973:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19104 00000100:00100000:1.0:1746147203.599982:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2551:x1830967310086400:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147203.599999:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.600019:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425060e1c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7de95 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.600445:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147203.600449:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147203.600454:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425060e1c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->4042751] (req 3145728->4042751) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de95 expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.600575:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425060e1c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4042751) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de95 expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.600584:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffa800, rc 0) 00000100:00100000:1.0:1746147203.600803:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2551:x1830967310086400:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 822us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147203.600809:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19104 00000100:00100000:0.0:1746147203.604876:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310086272:12345-192.168.204.25@tcp:4:cat.0 Request processed in 4545us (5449us total) trans 21474842454 rc 0/0 00000100:00100000:0.0:1746147203.604888:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1635 00002000:00100000:0.0:1746147203.604900:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (4091904->4194303) req@ffff8800947e5c00 x1830967310086272/t21474842454(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:579/0 lens 488/448 e 0 to 0 dl 1746147214 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147203.604910:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e5c00 with x1830967310086272 ext(4091904->4194303) 00010000:00010000:0.0:1746147203.604920:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097ffbc00/0x3139939425060e07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de80 expref: 20 pid: 1854 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746147203.604935:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097ffbc00/0x3139939425060e07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4091904->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de80 expref: 20 pid: 1854 timeout: 841 lvb_type: 0 00002000:00010000:0.0:1746147203.604944:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947e5c00 00000100:00100000:0.0:1746147203.606026:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.606455:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.614138:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.614458:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.614681:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310087296 00000100:00100000:1.0:1746147203.614691:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310087296 00002000:00100000:1.0:1746147203.614736:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (4038656->4042751) req@ffff8800947e4380 x1830967310087296/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:579/0 lens 488/0 e 0 to 0 dl 1746147214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147203.614746:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e4380 with x1830967310087296 ext(4038656->4042751) 00002000:00010000:1.0:1746147203.614752:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947e4380 00000100:00100000:1.0:1746147203.614773:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310087424 00000100:00100000:1.0:1746147203.614775:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310087424 00002000:00100000:1.0:1746147203.614799:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800947e7b80 x1830967310087424/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:579/0 lens 488/0 e 0 to 0 dl 1746147214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147203.614806:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e7b80 with x1830967310087424 ext(3145728->4194303) 00002000:00010000:1.0:1746147203.614809:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947e7b80 00000100:00100000:1.0:1746147203.614835:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7010 00000100:00100000:1.0:1746147203.614842:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310087296:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147203.614988:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310087296:12345-192.168.204.25@tcp:3:cat.0 Request processed in 146us (859us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147203.614994:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7010 00002000:00100000:1.0:1746147203.614999:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (4038656->4042751) req@ffff8800947e4380 x1830967310087296/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:579/0 lens 488/4536 e 0 to 0 dl 1746147214 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147203.615005:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e4380 with x1830967310087296 ext(4038656->4042751) 00002000:00010000:1.0:1746147203.615007:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947e4380 00000100:00100000:1.0:1746147203.615023:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7011 00000100:00100000:1.0:1746147203.615026:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967310087424:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147203.620700:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967310087424:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5661us (6229us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147203.620713:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7011 00002000:00100000:1.0:1746147203.620724:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800947e7b80 x1830967310087424/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:579/0 lens 488/440 e 0 to 0 dl 1746147214 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147203.620733:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e7b80 with x1830967310087424 ext(3145728->4194303) 00002000:00010000:1.0:1746147203.620738:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947e7b80 00000100:00100000:0.0:1746147203.622752:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.623625:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.623709:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.623797:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310087936 00000100:00100000:1.0:1746147203.623801:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310087936 00000100:00100000:1.0:1746147203.623826:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19106 00000100:00100000:1.0:1746147203.623831:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2554:x1830967310087936:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147203.623839:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.623850:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ffaa00/0x3139939425060e2a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dea3 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.623869:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425060e1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4042751) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de95 expref: 8 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.623876:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147203.623877:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147203.623880:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffaa00/0x3139939425060e2a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dea3 expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.623906:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425060e1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4042751) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de95 expref: 8 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.623917:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425060e1c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4042751) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de95 expref: 8 pid: 1854 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746147203.623926:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311351168:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147203.623998:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147203.624917:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311351168:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147203.624936:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ffaa00/0x3139939425060e2a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dea3 expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.624945:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffaa00, rc 0) 00000100:00100000:1.0:1746147203.624965:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2554:x1830967310087936:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1134us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147203.624970:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19106 00000100:00100000:0.0:1746147203.626076:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.626136:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310088064 00000100:00100000:1.0:1746147203.626142:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310088064 00002000:00100000:1.0:1746147203.626182:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4042751) req@ffff880132126d80 x1830967310088064/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:579/0 lens 488/0 e 0 to 0 dl 1746147214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147203.626191:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132126d80 with x1830967310088064 ext(3145728->4042751) 00010000:00010000:1.0:1746147203.626202:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425060e1c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de95 expref: 9 pid: 1854 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746147203.626215:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097ffa800/0x3139939425060e1c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de95 expref: 9 pid: 1854 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746147203.626221:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880132126d80 00000100:00100000:1.0:1746147203.626243:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1636 00000100:00100000:1.0:1746147203.626250:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310088064:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147203.626762:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.645129:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310088448 00000100:00100000:1.0:1746147203.645133:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310088448 00000100:00100000:1.0:1746147203.645166:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19107 00000100:00100000:1.0:1746147203.645172:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2555:x1830967310088448:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147203.645187:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.645198:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x3139939425060e31 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7deaa expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.645214:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.645215:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.645220:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x3139939425060e31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7deaa expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.645236:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x3139939425060e31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7deaa expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.645244:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504f000, rc 0) 00000100:00100000:1.0:1746147203.645389:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2555:x1830967310088448:12345-192.168.204.25@tcp:101:cat.0 Request processed in 215us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147203.645395:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19107 00000100:00100000:0.0:1746147203.649998:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311351296:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147203.650018:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147203.650057:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967310088576:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5341us (5514us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147203.650067:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8659 00000100:00100000:0.0:1746147203.666194:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.667734:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.678635:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.679387:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.682043:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.683815:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.683860:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310090624 00000100:00100000:0.0:1746147203.683866:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310090624 00000100:00100000:0.0:1746147203.683903:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6054 00000100:00100000:0.0:1746147203.683909:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2555:x1830967310090624:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:0.0:1746147203.684037:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2555:x1830967310090624:12345-192.168.204.25@tcp:35:cat.0 Request processed in 123us (217us total) trans 8589937155 rc 0/0 00000100:00100000:0.0:1746147203.684043:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6054 00000100:00100000:0.0:1746147203.689249:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.689331:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310090752 00000100:00100000:1.0:1746147203.689339:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310090752 00000100:00100000:1.0:1746147203.689384:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19108 00000100:00100000:1.0:1746147203.689392:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2559:x1830967310090752:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147203.689406:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.689421:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425060e5b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7deb8 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.689446:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425060e0e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de87 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.689454:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fc000/0x3139939425060e23 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de9c expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.689459:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.689461:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.689464:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425060e5b lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2420736->2592767] (req 2420736->2592767) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7deb8 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.689726:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9fc000/0x3139939425060e23 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de9c expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.689737:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fc000/0x3139939425060e23 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de9c expref: 19 pid: 9586 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746147203.689749:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311351424:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147203.690033:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425060e0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de87 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.690041:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425060e0e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de87 expref: 31 pid: 1854 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746147203.690049:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311351552:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147203.690067:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147203.691202:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311351424:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147203.691209:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311351552:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147203.691225:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425060e5b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2420736->2592767] (req 2420736->2592767) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7deb8 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.691234:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504f400, rc 0) 00000100:00100000:1.0:1746147203.691450:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2559:x1830967310090752:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2057us (2206us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147203.691461:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19108 00000100:00100000:0.0:1746147203.694613:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.694640:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310090880 00000100:00100000:0.0:1746147203.694646:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310090880 00010000:00010000:0.0:1746147203.694676:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425060e0e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de87 expref: 31 pid: 1854 timeout: 841 lvb_type: 0 00000100:00100000:0.0:1746147203.694707:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8660 00000100:00100000:0.0:1746147203.694714:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967310090880:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147203.694725:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147203.694741:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425060e0e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de87 expref: 31 pid: 1854 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746147203.694751:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425060e0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de87 expref: 31 pid: 1854 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746147203.694769:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425060e0e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de87 expref: 31 pid: 1854 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746147203.694801:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147203.694846:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310090880:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 132us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147203.694852:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8660 00000100:00100000:0.0:1746147203.694895:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.694906:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310091008 00000100:00100000:0.0:1746147203.694908:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310091008 00010000:00010000:0.0:1746147203.694918:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fc000/0x3139939425060e23 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de9c expref: 20 pid: 9586 timeout: 841 lvb_type: 0 00000100:00100000:0.0:1746147203.695061:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8661 00000100:00100000:0.0:1746147203.695069:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310091008:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147203.695077:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147203.695084:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f9fc000/0x3139939425060e23 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de9c expref: 20 pid: 9586 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746147203.695117:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f9fc000/0x3139939425060e23 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de9c expref: 20 pid: 9586 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746147203.695128:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fc000/0x3139939425060e23 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de9c expref: 20 pid: 9586 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746147203.695137:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147203.695138:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147203.695144:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425060e5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2420736->2592767) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7deb8 expref: 29 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147203.695151:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425060e5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2420736->2592767) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7deb8 expref: 29 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147203.695178:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425060e5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2420736->2592767) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7deb8 expref: 29 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147203.695188:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e484a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311351680:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147203.695264:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147203.698826:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.702267:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.742655:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.757520:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.757740:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310091904 00000100:00100000:1.0:1746147203.757750:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310091904 00000100:00100000:1.0:1746147203.757825:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19109 00000100:00100000:1.0:1746147203.757834:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2564:x1830967310091904:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147203.757854:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.757876:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x3139939425060e85 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dec6 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.757907:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425060e5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2420736->2592767) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7deb8 expref: 29 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.757915:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147203.757917:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147203.757921:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x3139939425060e85 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2256896->2576383] (req 2256896->2576383) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dec6 expref: 20 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.757953:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425060e5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2420736->2592767) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7deb8 expref: 29 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.757965:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009504f400/0x3139939425060e5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2420736->2592767) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7deb8 expref: 29 pid: 1854 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746147203.757977:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311351808:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147203.758074:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147203.760446:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311351808:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147203.760485:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x3139939425060e85 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2256896->2576383] (req 2256896->2576383) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dec6 expref: 20 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.760503:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504e000, rc 0) 00000100:00100000:1.0:1746147203.760967:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2564:x1830967310091904:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3131us (3458us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147203.760978:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19109 00000100:00100000:0.0:1746147203.761282:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.770277:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.776857:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.782285:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.785015:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147203.797311:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147203.800764:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.805745:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.805814:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.805864:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310093440 00000100:00100000:1.0:1746147203.805874:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310093440 00000100:00100000:1.0:1746147203.805926:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19110 00000100:00100000:1.0:1746147203.805937:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967310093440:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147203.805954:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.805969:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009504f200/0x3139939425060eaf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ded4 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147203.806013:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311352064:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147203.806566:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658a80 going to sleep for 11 seconds 00002000:00010000:1.0:1746147203.808470:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746147201 -> 1746147203 00000100:00100000:1.0:1746147203.808498:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311352064:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147203.808530:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009504f200/0x3139939425060eaf lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ded4 expref: 32 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.808543:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009504f200/0x3139939425060eaf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ded4 expref: 32 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.808727:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504f200, rc 0) 00000100:00100000:1.0:1746147203.808802:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967310093440:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2862us (2983us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147203.808809:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19110 00000100:00100000:0.0:1746147203.814574:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.814686:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310093696 00000100:00100000:1.0:1746147203.814697:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310093696 00002000:00100000:1.0:1746147203.814745:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880099011180 x1830967310093696/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:579/0 lens 488/0 e 0 to 0 dl 1746147214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147203.814755:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099011180 with x1830967310093696 ext(0->1048575) 00002000:00010000:1.0:1746147203.814761:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099011180 00000100:00100000:1.0:1746147203.814804:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7021 00000100:00100000:1.0:1746147203.814812:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967310093696:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147203.822948:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967310093696:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8122us (8372us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147203.822962:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7021 00002000:00100000:1.0:1746147203.822974:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880099011180 x1830967310093696/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:579/0 lens 488/440 e 0 to 0 dl 1746147214 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147203.822984:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099011180 with x1830967310093696 ext(0->1048575) 00002000:00010000:1.0:1746147203.822990:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099011180 00000100:00100000:0.0:1746147203.823928:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.828190:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.829073:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.837604:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.837901:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.837981:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310094464 00000100:00100000:1.0:1746147203.837990:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310094464 00000100:00100000:1.0:1746147203.838116:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19112 00000100:00100000:1.0:1746147203.838123:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2568:x1830967310094464:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147203.838132:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.838147:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009504e200/0x3139939425060ee0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dee2 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.838232:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x3139939425060e85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->2576383) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dec6 expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.838240:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147203.838242:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147203.838246:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009504e200/0x3139939425060ee0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dee2 expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.838289:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x3139939425060e85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->2576383) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dec6 expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.838301:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x3139939425060e85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->2576383) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dec6 expref: 19 pid: 1854 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746147203.838313:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311352192:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147203.838744:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147203.843118:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311352192:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147203.843151:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009504e200/0x3139939425060ee0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dee2 expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.843169:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504e200, rc 0) 00000100:00100000:1.0:1746147203.843208:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2568:x1830967310094464:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5085us (5615us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147203.843218:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19112 00000100:00100000:0.0:1746147203.843427:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.844118:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310094720 00000100:00100000:1.0:1746147203.844125:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310094720 00002000:00100000:1.0:1746147203.844163:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2256896->2576383) req@ffff880091d6ce00 x1830967310094720/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:579/0 lens 488/0 e 0 to 0 dl 1746147214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147203.844172:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d6ce00 with x1830967310094720 ext(2256896->2576383) 00010000:00010000:1.0:1746147203.844179:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x3139939425060e85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->2576383) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dec6 expref: 20 pid: 1854 timeout: 841 lvb_type: 0 00010000:00010000:1.0:1746147203.844191:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x3139939425060e85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->2576383) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dec6 expref: 20 pid: 1854 timeout: 841 lvb_type: 0 00002000:00010000:1.0:1746147203.844198:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d6ce00 00000100:00100000:1.0:1746147203.844229:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1638 00000100:00100000:1.0:1746147203.844235:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310094720:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147203.851162:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310094720:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 6913us (7721us total) trans 21474842456 rc 0/0 00000100:00100000:0.0:1746147203.851176:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1638 00002000:00100000:0.0:1746147203.851190:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2256896->2576383) req@ffff880091d6ce00 x1830967310094720/t21474842456(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:579/0 lens 488/448 e 0 to 0 dl 1746147214 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147203.851199:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d6ce00 with x1830967310094720 ext(2256896->2576383) 00010000:00010000:0.0:1746147203.851209:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x3139939425060e85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->2576383) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dec6 expref: 22 pid: 1854 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746147203.851232:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009504e000/0x3139939425060e85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->2576383) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dec6 expref: 22 pid: 1854 timeout: 841 lvb_type: 0 00002000:00010000:0.0:1746147203.851240:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d6ce00 00000100:00100000:0.0:1746147203.854297:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.859269:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.863200:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.864082:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.865267:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.865605:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7024 00000100:00100000:0.0:1746147203.865614:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310095744:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147203.888299:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.888370:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310096000 00000100:00100000:1.0:1746147203.888379:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310096000 00000100:00100000:1.0:1746147203.888442:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19113 00000100:00100000:1.0:1746147203.888450:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2568:x1830967310096000:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147203.888471:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.888491:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f380a00/0x3139939425060ee7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7def0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.888526:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425060ed9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3571712->18446744073709551615] (req 3571712->3706879) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dee9 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.888534:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147203.888536:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147203.888539:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f380a00/0x3139939425060ee7 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7def0 expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.888572:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425060ed9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3571712->18446744073709551615] (req 3571712->3706879) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dee9 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.888583:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425060ed9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3571712->18446744073709551615] (req 3571712->3706879) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dee9 expref: 34 pid: 9586 timeout: 841 lvb_type: 0 00000100:00100000:1.0:1746147203.888595:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311352576:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147203.888692:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147203.893534:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311352576:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147203.893572:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f380a00/0x3139939425060ee7 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7def0 expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.893592:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f380a00, rc 0) 00000100:00100000:1.0:1746147203.893751:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2568:x1830967310096000:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5300us (5461us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147203.893762:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19113 00000100:00100000:0.0:1746147203.898023:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.903758:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.908980:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.909017:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.910161:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.910211:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310097024 00000100:00100000:1.0:1746147203.910217:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310097024 00000100:00100000:1.0:1746147203.910414:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19114 00000100:00100000:1.0:1746147203.910421:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2574:x1830967310097024:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147203.910438:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.910453:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060f11 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7df05 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.910475:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095053600/0x3139939425060cb7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddca expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.910483:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800990cc000/0x3139939425060dc8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de3a expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.910489:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425060d74 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de02 expref: 26 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.910495:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.910496:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.910499:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060f11 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [1175552->1236991] (req 1175552->1236991) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df05 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.910518:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425060d74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de02 expref: 26 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.910528:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425060d74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de02 expref: 26 pid: 9584 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746147203.910537:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311352832:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147203.910586:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800990cc000/0x3139939425060dc8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de3a expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.910593:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800990cc000/0x3139939425060dc8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de3a expref: 12 pid: 17600 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746147203.910600:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311352960:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147203.910625:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095053600/0x3139939425060cb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddca expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.910632:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095053600/0x3139939425060cb7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddca expref: 9 pid: 9586 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746147203.910640:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311353088:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147203.910654:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147203.914479:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.914508:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.914956:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311352832:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147203.914968:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311352960:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147203.914974:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311353088:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147203.915013:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060f11 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [1175552->1236991] (req 1175552->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df05 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.915034:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f380600, rc 0) 00000100:00100000:1.0:1746147203.915083:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2574:x1830967310097024:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4662us (4922us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147203.915110:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19114 00000100:00100000:0.0:1746147203.915350:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.915640:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.916614:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310097536 00000100:00100000:1.0:1746147203.916619:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310097536 00000100:00100000:1.0:1746147203.916653:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19115 00000100:00100000:1.0:1746147203.916659:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2002:x1830967310097536:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147203.916676:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.916690:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f239e00/0x3139939425060f3b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7df0c expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.916708:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.916717:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f239e00/0x3139939425060f3b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df0c expref: 12 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.916728:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f239e00/0x3139939425060f3b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df0c expref: 12 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.916744:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f239e00, rc 0) 00000100:00100000:1.0:1746147203.916777:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2002:x1830967310097536:12345-192.168.204.25@tcp:101:cat.0 Request processed in 118us (1136us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147203.916791:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19115 00000100:00100000:0.0:1746147203.917014:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.917077:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.917120:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.919189:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310098048 00000100:00100000:1.0:1746147203.919195:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310098048 00010000:00010000:1.0:1746147203.919219:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425060d74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de02 expref: 27 pid: 9584 timeout: 841 lvb_type: 1 00000100:00100000:1.0:1746147203.919241:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8667 00000100:00100000:1.0:1746147203.919247:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310098048:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147203.919257:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147203.919275:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425060d74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de02 expref: 27 pid: 9584 timeout: 841 lvb_type: 1 00010000:00010000:1.0:1746147203.919286:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425060d74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de02 expref: 27 pid: 9584 timeout: 841 lvb_type: 1 00010000:00010000:1.0:1746147203.919304:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425060d74 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de02 expref: 27 pid: 9584 timeout: 841 lvb_type: 1 00010000:00010000:1.0:1746147203.919316:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.919317:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147203.919321:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060f11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1175552->1236991) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df05 expref: 10 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.919329:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060f11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1175552->1236991) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df05 expref: 10 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147203.919356:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060f11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1175552->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df05 expref: 10 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147203.919366:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311353216:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147203.919424:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147203.925081:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.927812:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.927916:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311353216:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147203.927935:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147203.928428:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310098048:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 9170us (11296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147203.928441:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8667 00000100:00100000:0.0:1746147203.934804:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.936284:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.936491:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310098944 00000100:00100000:1.0:1746147203.936496:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310098944 00000100:00100000:1.0:1746147203.936522:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19117 00000100:00100000:1.0:1746147203.936528:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310098944:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147203.936539:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.936563:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425060f49 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7df1a expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147203.936614:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311353344:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147203.936670:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658a80 going to sleep for 11 seconds 00002000:00010000:1.0:1746147203.939129:0:1854:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime: 1746147200 -> 1746147203 00002000:00010000:1.0:1746147203.939136:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime: 1746147200 -> 1746147203 00002000:00010000:1.0:1746147203.939137:0:1854:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime: 1746147200 -> 1746147203 00000100:00100000:1.0:1746147203.939164:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311353344:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147203.939197:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425060f49 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df1a expref: 27 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.939210:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f381800/0x3139939425060f49 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df1a expref: 27 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.939238:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f381800, rc 0) 00000100:00100000:1.0:1746147203.939287:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310098944:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2757us (3004us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147203.939295:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19117 00000100:00100000:0.0:1746147203.942447:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.942505:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.947199:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.960928:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.961031:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310099840 00000100:00100000:1.0:1746147203.961041:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310099840 00000100:00100000:1.0:1746147203.961120:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19118 00000100:00100000:1.0:1746147203.961130:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967310099840:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147203.961150:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.961170:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f380c00/0x3139939425060f50 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7df21 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147203.961226:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311353472:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147203.961320:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147203.963891:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311353472:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147203.963926:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f380c00/0x3139939425060f50 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df21 expref: 27 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.963943:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f380c00/0x3139939425060f50 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df21 expref: 27 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147203.963974:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f380c00, rc 0) 00000100:00100000:1.0:1746147203.964032:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967310099840:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2902us (3112us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147203.964040:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19118 00000100:00100000:0.0:1746147203.967229:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.967513:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147203.967584:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310100224 00000100:00100000:1.0:1746147203.967589:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310100224 00000100:00100000:1.0:1746147203.967622:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19119 00000100:00100000:1.0:1746147203.967628:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310100224:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147203.967639:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147203.967657:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425060f57 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7df28 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147203.967707:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311353600:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147203.967797:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147203.976170:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147203.982193:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147203.987245:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7033 00002000:00100000:3.0:1746147203.987258:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff8801322ebb80 x1830967310100736/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:579/0 lens 488/440 e 0 to 0 dl 1746147214 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147203.987268:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801322ebb80 with x1830967310100736 ext(4194304->4890623) 00002000:00010000:3.0:1746147203.987274:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801322ebb80 00000100:00100000:1.0:1746147203.993589:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801322e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311353728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1746147203.993648:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147203.994177:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310100992 00000100:00100000:1.0:1746147203.994180:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311353728 00000100:00100000:3.0:1746147203.994184:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310100992 00000100:00100000:1.0:1746147203.994184:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311353728 00000100:00100000:1.0:1746147203.994221:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1746147203.994222:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6059 00000100:00100000:3.0:1746147203.994227:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2576:x1830967310100992:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147203.994227:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311353728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1746147203.994245:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1315804224 pending 3637248 free 3905277952 avail 3673755648 00000100:00100000:1.0:1746147203.994277:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311353728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147203.994281:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1746147203.994324:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801322e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311353728:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1746147203.994370:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147203.994376:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2576:x1830967310100992:12345-192.168.204.25@tcp:35:cat.0 Request processed in 149us (519us total) trans 8589937165 rc 0/0 00000100:00100000:3.0:1746147203.994381:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6059 00000100:00100000:0.0:1746147204.074907:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.076342:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310101248 00000100:00100000:1.0:1746147204.076351:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310101248 00000100:00080000:0.0:1746147204.076567:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147204.076600:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16298 00000100:00100000:1.0:1746147204.076609:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2581:x1830967310101248:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147204.076628:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.076645:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09e800/0x3139939425060f5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7df2f expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.076704:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.076717:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.076727:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.076739:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.076743:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.076748:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.076835:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f200/0x3139939425060f73 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.076844:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f200/0x3139939425060f73 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.076849:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f200/0x3139939425060f73 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:1.0:1746147204.076856:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147204.076911:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f65 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.076916:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f65 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.076921:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.076925:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.076930:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f09ea00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147204.076933:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.076938:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f65 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.076945:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147204.076948:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147204.076951:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f65 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.076955:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.077632:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.077638:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.077643:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.077647:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f09fc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147204.077649:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.077654:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.077661:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f2c5900) 00010000:00010000:1.0:1746147204.077663:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147204.077665:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.077670:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.077701:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09e800/0x3139939425060f5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df2f expref: 20 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.077710:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f200/0x3139939425060f73 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df2f expref: 19 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.077715:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.077717:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147204.077718:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f09f200, rc 0) 00000100:00100000:1.0:1746147204.078243:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2581:x1830967310101248:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1633us (3340us total) trans 8589937166 rc 0/0 00000100:00100000:1.0:1746147204.078250:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16298 00000100:00100000:0.0:1746147204.084084:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.084204:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310101376 00000100:00100000:1.0:1746147204.084215:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310101376 00000100:00100000:1.0:1746147204.084521:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 969 00000100:00100000:1.0:1746147204.084530:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2002:x1830967310101376:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.084546:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147204.084568:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f200/0x3139939425060f73 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df2f expref: 19 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.084596:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.084600:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147204.084653:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310101376:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 125us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.084661:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 969 00000100:00100000:0.0:1746147204.096235:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.096850:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310101504 00000100:00100000:1.0:1746147204.096860:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310101504 00000100:00100000:1.0:1746147204.096943:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16299 00000100:00100000:1.0:1746147204.096953:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+6:2582:x1830967310101504:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147204.096979:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.097000:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09e800/0x3139939425060f81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7df36 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.097063:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.097075:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.097085:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.097116:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.097121:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.097126:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.097197:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f000/0x3139939425060f96 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.097206:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093730400/0x3139939425060d66 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de25 expref: 35 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.097216:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f000/0x3139939425060f96 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.097250:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093730400/0x3139939425060d66 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de25 expref: 35 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.097261:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093730400/0x3139939425060d66 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de25 expref: 35 pid: 7239 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.097273:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311353856:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147204.097374:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.099574:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.099869:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311353856:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147204.099892:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f000/0x3139939425060f96 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:3.0:1746147204.100293:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310101760 00000100:00100000:3.0:1746147204.100300:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310101760 00000100:00100000:3.0:1746147204.100344:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6060 00000100:00100000:0.0:1746147204.100345:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.100351:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:8487:x1830967310101760:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147204.100577:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:8487:x1830967310101760:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 225us (1009us total) trans 8589937167 rc 0/0 00000100:00100000:3.0:1746147204.100584:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6060 00000100:00100000:0.0:1746147204.106473:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.106529:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.106583:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310102528 00000100:00100000:3.0:1746147204.106594:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310102528 00000100:00100000:0.0:1746147204.106620:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.106638:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16301 00000100:00100000:1.0:1746147204.106641:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310102144 00000100:00100000:3.0:1746147204.106646:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2587:x1830967310102528:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147204.106646:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310102144 00010000:00010000:3.0:1746147204.106670:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.106674:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093730400/0x3139939425060d66 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de25 expref: 40 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.106687:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95400/0x3139939425060fc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7df44 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.106694:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310102272 00000100:00100000:1.0:1746147204.106695:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310102272 00000100:00100000:1.0:1746147204.106742:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8668 00000100:00100000:1.0:1746147204.106747:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967310102144:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.106755:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147204.106760:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093730400/0x3139939425060d66 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de25 expref: 42 pid: 7239 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746147204.106764:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 970 00010000:00010000:3.0:1746147204.106768:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425060fc7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00000100:00100000:0.0:1746147204.106770:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967310102272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.106775:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093730400/0x3139939425060d66 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de25 expref: 42 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.106785:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147204.106790:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425060fc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147204.106800:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425060fc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147204.106800:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd600/0x3139939425060fb2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df3d expref: 42 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.106809:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425060fce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147204.106814:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425060fce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147204.106819:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425060fce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147204.106878:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.106879:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093730400/0x3139939425060d66 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de25 expref: 41 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.106883:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f000/0x3139939425060f96 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.106891:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f000/0x3139939425060f96 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.106896:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f000/0x3139939425060f96 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.106916:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x3139939425060fd5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.106922:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.106925:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147204.106929:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x3139939425060fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147204.106932:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147204.106933:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x3139939425060fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:3.0:1746147204.106940:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000100:00100000:1.0:1746147204.106966:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967310102144:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 218us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.106966:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2002:x1830967310102272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 195us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.106972:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8668 00000100:00100000:0.0:1746147204.106975:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 970 00010000:00010000:1.0:1746147204.106995:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f000/0x3139939425060f96 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.107001:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f000/0x3139939425060f96 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.107016:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425060fc7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147204.107021:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425060fc7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00000004:00200000:1.0:1746147204.107024:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:1.0:1746147204.107029:0:7237:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1746147204.107031:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425060fc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147204.107037:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425060fc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147204.107043:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d95000 already unused, calling callback (ffffffffa0efd690) 00000004:00010000:1.0:1746147204.107045:0:7237:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f000/0x3139939425060f96 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.107047:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425060fc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.107053:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f000/0x3139939425060f96 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.107054:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425060fc7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.107059:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f88 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.107061:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147204.107064:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147204.107067:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f88 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.107068:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425060fc7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147204.107072:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425060fc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.107073:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.107078:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.107079:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425060fce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.107081:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f09fc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147204.107082:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425060fce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.107083:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.107087:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425060fce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147204.107108:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d94a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147204.107110:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425060fce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.107111:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f88 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.107119:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425060fce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.107119:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147204.107120:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147204.107123:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f88 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.107124:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f2c5000) 00010000:00010000:3.0:1746147204.107126:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147204.107127:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09fc00/0x3139939425060f88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.107128:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425060fce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147204.107133:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425060fce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.107137:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.107141:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.107145:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.107149:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f09ea00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147204.107151:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.107159:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.107160:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95400/0x3139939425060fc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df44 expref: 40 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.107164:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f2c5000) 00010000:00010000:1.0:1746147204.107166:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147204.107167:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.107171:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x3139939425060fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df44 expref: 39 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.107172:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09ea00/0x3139939425060f8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.107181:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147204.107183:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147204.107185:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95800, rc 0) 00010000:00010000:1.0:1746147204.107198:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09e800/0x3139939425060f81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df36 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.107207:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f000/0x3139939425060f96 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df36 expref: 7 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.107213:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.107215:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147204.107217:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f09f000, rc 0) 00000100:00100000:3.0:1746147204.107508:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2587:x1830967310102528:12345-192.168.204.25@tcp:101:cat.0 Request processed in 861us (976us total) trans 8589937169 rc 0/0 00000100:00100000:1.0:1746147204.107508:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2582:x1830967310101504:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 10556us (11426us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.107514:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16301 00000100:00100000:1.0:1746147204.107517:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16299 00000100:00100000:0.0:1746147204.112233:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:0.0:1746147204.112949:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147204.113025:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.113049:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.113303:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310102784 00000100:00100000:1.0:1746147204.113313:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310102784 00000100:00100000:3.0:1746147204.113333:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310102912 00000100:00100000:3.0:1746147204.113337:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310102912 00000100:00100000:3.0:1746147204.113374:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19121 00000100:00100000:3.0:1746147204.113380:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2002:x1830967310102912:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147204.113387:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.113397:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d95c00/0x3139939425060fea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7df59 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.113443:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19122 00000100:00100000:1.0:1746147204.113450:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2002:x1830967310102784:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147204.113462:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.113475:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x3139939425060ff1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7df52 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.113514:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311354112:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147204.113675:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.113678:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.113686:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95c00/0x3139939425060fea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df59 expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.113701:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d95c00/0x3139939425060fea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df59 expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.113709:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95c00, rc 0) 00000100:00080000:0.0:1746147204.113812:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147204.113844:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.113850:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147204.113867:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310103040 00000100:00100000:1.0:1746147204.113870:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310103040 00000100:00100000:1.0:1746147204.113909:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19123 00000100:00100000:1.0:1746147204.113915:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2003:x1830967310103040:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:3.0:1746147204.113918:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2002:x1830967310102912:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 537us (867us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147204.113921:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147204.113924:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19121 00010000:00010000:1.0:1746147204.113929:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425060ff8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7df60 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.113940:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.113942:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.113949:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425060ff8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df60 expref: 12 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.113963:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425060ff8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df60 expref: 12 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.113971:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2b800, rc 0) 00000100:00100000:1.0:1746147204.113994:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310103040:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 79us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.114000:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19123 00000100:00100000:0.0:1746147204.117033:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.117774:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310103296 00000100:00100000:1.0:1746147204.117795:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310103296 00000100:00100000:3.0:1746147204.118026:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311353984:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147204.118052:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f381a00/0x3139939425060fe3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df4b expref: 27 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.118064:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f381a00/0x3139939425060fe3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df4b expref: 27 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.118073:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f381a00, rc 0) 00000100:00100000:3.0:1746147204.118122:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967310102656:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5272us (5896us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147204.118129:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19120 00000100:00100000:3.0:1746147204.118172:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311354112:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147204.118185:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x3139939425060ff1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df52 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.118193:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x3139939425060ff1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df52 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.118199:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2a800, rc 0) 00000100:00100000:3.0:1746147204.118212:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2002:x1830967310102784:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4764us (5188us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147204.118217:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19122 00000100:00100000:1.0:1746147204.118697:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16302 00000100:00100000:1.0:1746147204.118709:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2590:x1830967310103296:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.118736:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.118761:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425060fff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7df67 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.118847:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425061006 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.118861:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425061006 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.118873:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425061006 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.118885:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x313993942506100d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.118891:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x313993942506100d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.118896:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x313993942506100d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.118993:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425061014 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.119003:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425061014 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.119009:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425061014 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:1.0:1746147204.119017:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147204.119110:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425061006 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.119117:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425061006 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.119123:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425061006 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.119132:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425061006 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.119140:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2b400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147204.119143:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425061006 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.119149:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425061006 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.119159:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147204.119162:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147204.119165:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425061006 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.119170:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2b400/0x3139939425061006 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.119179:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x313993942506100d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.119183:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x313993942506100d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.119188:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x313993942506100d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.119192:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2a400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147204.119194:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x313993942506100d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.119199:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x313993942506100d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.119204:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f2c5600) 00010000:00010000:1.0:1746147204.119206:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147204.119208:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x313993942506100d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.119213:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x313993942506100d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.119250:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425060fff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df67 expref: 21 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.119259:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425061014 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df67 expref: 20 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.119265:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.119267:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147204.119269:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2ba00, rc 0) 00000100:00100000:1.0:1746147204.119319:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2590:x1830967310103296:12345-192.168.204.25@tcp:101:cat.0 Request processed in 613us (2293us total) trans 8589937170 rc 0/0 00000100:00100000:1.0:1746147204.119326:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16302 00000100:00100000:1.0:1746147204.123929:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310103552 00000100:00100000:1.0:1746147204.123941:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310103552 00000100:00100000:1.0:1746147204.124001:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16303 00000100:00100000:1.0:1746147204.124007:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2582:x1830967310103552:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147204.124024:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.124039:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2bc00/0x3139939425061029 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7df6e expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.124160:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425061030 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.124176:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x3139939425060fd5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df44 expref: 38 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.124183:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f000/0x3139939425060f96 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df36 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.124190:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425061014 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df67 expref: 19 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.124196:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425061030 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.124223:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425061014 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df67 expref: 19 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.124236:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425061014 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df67 expref: 19 pid: 7237 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.124247:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311354368:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147204.124385:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f000/0x3139939425060f96 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df36 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.124393:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f09f000/0x3139939425060f96 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df36 expref: 8 pid: 7237 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.124402:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311354624:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147204.124435:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x3139939425060fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df44 expref: 38 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.124444:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x3139939425060fd5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df44 expref: 38 pid: 7239 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.124452:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311354880:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147204.124468:0:7239:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658f00 going to sleep for 11 seconds 00000100:00080000:0.0:1746147204.124955:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147204.125944:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310103936 00000100:00100000:3.0:1746147204.125951:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310103936 00000100:00100000:3.0:1746147204.126009:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19126 00000100:00100000:3.0:1746147204.126015:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2581:x1830967310103936:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147204.126025:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.126036:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d94000/0x313993942506103e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7df83 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.126057:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.126059:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.126062:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94000/0x313993942506103e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [552960->978943] (req 552960->978943) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df83 expref: 23 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.126071:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d94000/0x313993942506103e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [552960->978943] (req 552960->978943) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df83 expref: 23 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.126081:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94000, rc 0) 00000100:00100000:3.0:1746147204.126128:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2581:x1830967310103936:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 114us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.126134:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19126 00000100:00080000:0.0:1746147204.126186:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147204.127499:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311354240:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147204.127651:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311354368:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147204.128018:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310104064 00000100:00100000:0.0:1746147204.128023:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310104064 00010000:00010000:0.0:1746147204.128052:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425061014 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df67 expref: 20 pid: 7237 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746147204.128080:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8669 00000100:00100000:0.0:1746147204.128087:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310104064:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147204.128120:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147204.128125:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425061014 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df67 expref: 20 pid: 7237 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.128135:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425061014 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df67 expref: 20 pid: 7237 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.128154:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425061014 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df67 expref: 20 pid: 7237 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.128176:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147204.128180:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425061030 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147204.128187:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425061030 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147204.128192:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147204.128254:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311354624:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147204.128268:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311354880:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147204.128303:0:7239:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425061030 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:1.0:1746147204.128363:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310104320 00000100:00100000:1.0:1746147204.128368:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310104320 00010000:00010000:1.0:1746147204.128392:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x3139939425060fd5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df44 expref: 39 pid: 7239 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.128421:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8671 00000100:00100000:1.0:1746147204.128427:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967310104320:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.128439:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147204.128444:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x3139939425060fd5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df44 expref: 39 pid: 7239 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.128506:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e487b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311355008:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.128540:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x3139939425061037 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df7c expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.128552:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0400, rc 0) 00000100:00100000:3.0:1746147204.128594:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2587:x1830967310103808:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4096us (4675us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.128600:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19125 00000100:00100000:3.0:1746147204.128639:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.128650:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310104576 00000100:00100000:3.0:1746147204.128652:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310104576 00010000:00010000:3.0:1746147204.128665:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x3139939425060ccc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddc3 expref: 12 pid: 9586 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746147204.128678:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8672 00000100:00100000:3.0:1746147204.128681:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310104576:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147204.128688:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147204.128704:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x3139939425060ccc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddc3 expref: 12 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.128711:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x3139939425060ccc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddc3 expref: 12 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.128734:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147204.128749:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310104576:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 67us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.128754:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8672 00000100:00100000:3.0:1746147204.128848:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.128858:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310104448 00000100:00100000:3.0:1746147204.128861:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310104448 00010000:00010000:3.0:1746147204.128872:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092542400/0x3139939425060d6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddfb expref: 37 pid: 9584 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746147204.128886:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8673 00000100:00100000:3.0:1746147204.128890:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310104448:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147204.128896:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147204.128902:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092542400/0x3139939425060d6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddfb expref: 37 pid: 9584 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.128909:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092542400/0x3139939425060d6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddfb expref: 37 pid: 9584 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.128920:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092542400/0x3139939425060d6d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddfb expref: 37 pid: 9584 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.128928:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147204.128944:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310104448:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 53us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.128949:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8673 00000100:00100000:3.0:1746147204.128976:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147204.129457:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x3139939425060fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df44 expref: 39 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.129487:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x3139939425060fd5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df44 expref: 39 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.129500:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.129504:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425061030 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.129514:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425061030 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.129521:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425061030 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00000100:00100000:0.0:1746147204.129529:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2000:x1830967310104064:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1442us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.129535:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8669 00010000:00010000:1.0:1746147204.129541:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147204.129574:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311354496:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147204.129576:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967310104320:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1148us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.129584:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8671 00010000:00010000:0.0:1746147204.129585:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x3139939425060ccc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddc3 expref: 11 pid: 9586 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746147204.129594:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e484380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311354752:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147204.129615:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f381c00/0x3139939425061022 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [16384->311295] (req 16384->311295) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df75 expref: 35 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.129623:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f381c00, rc 0) 00010000:00010000:1.0:1746147204.129643:0:7239:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425061030 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:0.0:1746147204.129644:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2586:x1830967310103680:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5637us (5757us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147204.129650:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425061030 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000100:00100000:0.0:1746147204.129650:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19124 00000004:00200000:1.0:1746147204.129671:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147204.129824:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2bc00/0x3139939425061029 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df6e expref: 9 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.129842:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425061030 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df6e expref: 8 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.129848:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.129851:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147204.129854:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2be00, rc 0) 00000100:00100000:1.0:1746147204.129878:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2582:x1830967310103552:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5871us (6040us total) trans 8589937171 rc 0/0 00000100:00100000:1.0:1746147204.129884:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16303 00000100:00100000:3.0:1746147204.129994:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.130756:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310104832 00000100:00100000:1.0:1746147204.130763:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310104832 00010000:00010000:1.0:1746147204.130793:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f01ac00/0x3139939425060dac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de33 expref: 23 pid: 9586 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746147204.130816:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8674 00000100:00100000:1.0:1746147204.130823:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2002:x1830967310104832:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.130832:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147204.130849:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f01ac00/0x3139939425060dac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de33 expref: 23 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.130859:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f01ac00/0x3139939425060dac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de33 expref: 23 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.130875:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f01ac00/0x3139939425060dac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de33 expref: 23 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.130890:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.130892:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.130899:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f381c00/0x3139939425061022 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->540671] (req 16384->311295) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df75 expref: 34 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.130906:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f381c00/0x3139939425061022 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->540671] (req 16384->311295) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df75 expref: 34 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.130913:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.130914:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.130917:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d94000/0x313993942506103e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [552960->18446744073709551615] (req 552960->978943) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df83 expref: 22 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.130924:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94000/0x313993942506103e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [552960->18446744073709551615] (req 552960->978943) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df83 expref: 22 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.130948:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d94000/0x313993942506103e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [552960->18446744073709551615] (req 552960->978943) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df83 expref: 22 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.130961:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311355136:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147204.131050:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f381c00/0x3139939425061022 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->540671] (req 16384->311295) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df75 expref: 34 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.131059:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311355264:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147204.131078:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.134540:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310104704:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 5112us (5554us total) trans 17179875079 rc 0/0 00000100:00100000:0.0:1746147204.134558:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1640 00002000:00100000:0.0:1746147204.134569:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x96:0x0] (1175552->1236991) req@ffff880099156a00 x1830967310104704/t17179875079(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/448 e 0 to 0 dl 1746147215 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147204.134579:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099156a00 with x1830967310104704 ext(1175552->1236991) 00010000:00010000:0.0:1746147204.134589:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060f11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1175552->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df05 expref: 13 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.134604:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060f11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1175552->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df05 expref: 13 pid: 1854 timeout: 842 lvb_type: 0 00002000:00010000:0.0:1746147204.134611:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099156a00 00000100:00100000:3.0:1746147204.134770:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.134957:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.135110:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311355136:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147204.135120:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311355264:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147204.135136:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147204.135138:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310104960 00000100:00100000:1.0:1746147204.135146:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310104960 00000100:00100000:0.0:1746147204.135156:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2002:x1830967310104832:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4334us (5163us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.135163:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8674 00000100:00100000:0.0:1746147204.135185:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310105216 00000100:00100000:1.0:1746147204.135188:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16304 00000100:00100000:0.0:1746147204.135189:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310105216 00000100:00100000:1.0:1746147204.135195:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2582:x1830967310104960:12345-192.168.204.25@tcp:101:lfs.0 00002000:00100000:0.0:1746147204.135210:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x93:0x0] (16384->20479) req@ffff880099156680 x1830967310105216/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746147204.135218:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:0.0:1746147204.135222:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099156680 with x1830967310105216 ext(16384->20479) 00002000:00010000:0.0:1746147204.135225:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099156680 00010000:00010000:1.0:1746147204.135236:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0e00/0x313993942506104c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7df8a expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147204.135246:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7034 00000100:00100000:0.0:1746147204.135251:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967310105216:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:1.0:1746147204.135323:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0a00/0x3139939425061053 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00000100:00100000:0.0:1746147204.135327:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967310105216:12345-192.168.204.25@tcp:3:cat.0 Request processed in 76us (370us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147204.135331:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7034 00002000:00100000:0.0:1746147204.135335:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x93:0x0] (16384->20479) req@ffff880099156680 x1830967310105216/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/4536 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746147204.135338:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425061030 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df6e expref: 9 pid: 7239 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746147204.135341:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099156680 with x1830967310105216 ext(16384->20479) 00010000:00010000:1.0:1746147204.135344:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0a00/0x3139939425061053 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00002000:00010000:0.0:1746147204.135348:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099156680 00010000:00010000:1.0:1746147204.135371:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425061030 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df6e expref: 9 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.135381:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425061030 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df6e expref: 9 pid: 7239 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.135391:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311355392:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147204.135448:0:7239:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.138003:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.138044:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.138077:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.138195:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310105728 00000100:00100000:1.0:1746147204.138207:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310105728 00000100:00100000:1.0:1746147204.138250:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310105600 00000100:00100000:1.0:1746147204.138252:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310105600 00000100:00100000:1.0:1746147204.138272:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19127 00000100:00100000:1.0:1746147204.138279:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310105728:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.138297:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.138315:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x313993942506105a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7df98 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.138367:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311355520:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147204.138369:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19128 00000100:00100000:3.0:1746147204.138383:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310105600:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147204.138401:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.138416:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425061061 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7df91 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.138444:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147204.138463:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311355648:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147204.139015:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.140441:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.140462:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310105856 00000100:00100000:0.0:1746147204.140466:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310105856 00010000:00010000:0.0:1746147204.140490:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425061030 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df6e expref: 10 pid: 7239 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746147204.140511:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8675 00000100:00100000:1.0:1746147204.140514:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311355392:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147204.140515:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2002:x1830967310105856:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147204.140525:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147204.140529:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425061030 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df6e expref: 10 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.140531:0:7239:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0a00/0x3139939425061053 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147204.140538:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425061030 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df6e expref: 10 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.140562:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2be00/0x3139939425061030 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df6e expref: 10 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.140573:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147204.140576:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0a00/0x3139939425061053 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147204.140583:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0a00/0x3139939425061053 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147204.140589:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0a00/0x3139939425061053 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147204.140607:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147204.140651:0:7239:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0a00/0x3139939425061053 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.140657:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0a00/0x3139939425061053 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:1.0:1746147204.140695:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:1.0:1746147204.140698:0:7239:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147204.140710:0:7239:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0a00/0x3139939425061053 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.140732:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0e00/0x313993942506104c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df8a expref: 10 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.140743:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0a00/0x3139939425061053 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df8a expref: 9 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.140748:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.140751:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147204.140753:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a0a00, rc 0) 00000100:00100000:1.0:1746147204.143139:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2582:x1830967310104960:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 7933us (8365us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.143141:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2002:x1830967310105856:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2624us (2700us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.143147:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16304 00000100:00100000:0.0:1746147204.143148:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8675 00000100:00100000:0.0:1746147204.143222:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.143241:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310105984 00000100:00100000:1.0:1746147204.143246:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310105984 00010000:00010000:1.0:1746147204.143268:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060f11 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1175552->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df05 expref: 15 pid: 1854 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.143295:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8676 00000100:00100000:1.0:1746147204.143301:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310105984:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.143312:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147204.143317:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147204.143329:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060f11 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1175552->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df05 expref: 15 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.143339:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060f11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1175552->1236991) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df05 expref: 15 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.143360:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.143362:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.143367:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x3139939425061037 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df7c expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.143374:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x3139939425061037 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df7c expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.143402:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x3139939425061037 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df7c expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.143417:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311355776:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147204.143488:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658a80 going to sleep for 11 seconds 00010000:00010000:1.0:1746147204.143512:0:9585:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff880096cf9880 x1830967311355520) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060f11 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1175552->1236991) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df05 expref: 15 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.143525:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f380600/0x3139939425060f11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1175552->1236991) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df05 expref: 15 pid: 1854 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.143534:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311355520:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147204.143552:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x313993942506105a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df98 expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.143561:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x313993942506105a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df98 expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.143567:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2a800, rc 0) 00000100:00100000:1.0:1746147204.143592:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310105728:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5313us (5547us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147204.143598:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19127 00002000:00010000:3.0:1746147204.143675:0:1853:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime: 1746147200 -> 1746147204 00002000:00010000:3.0:1746147204.143678:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime: 1746147200 -> 1746147204 00002000:00010000:3.0:1746147204.143680:0:1853:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime: 1746147200 -> 1746147204 00000100:00100000:3.0:1746147204.143689:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099154000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311355648:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147204.143706:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425061061 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df91 expref: 23 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.143714:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425061061 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df91 expref: 23 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.143735:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94800, rc 0) 00000100:00100000:3.0:1746147204.143754:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310105600:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5377us (5677us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147204.143759:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19128 00000100:00100000:0.0:1746147204.145609:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.145732:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311355776:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147204.145745:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147204.145792:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967310105984:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2491us (2569us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.145802:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8676 00000100:00100000:0.0:1746147204.146461:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.146515:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.146552:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310106624 00000100:00100000:3.0:1746147204.146556:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310106624 00000100:00100000:3.0:1746147204.146581:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310106752 00000100:00100000:3.0:1746147204.146584:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310106752 00000100:00100000:3.0:1746147204.146600:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19129 00000100:00100000:3.0:1746147204.146605:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310106624:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147204.146613:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.146627:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d7200/0x3139939425061068 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7df9f expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.146662:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311355904:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147204.146710:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.149487:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.156181:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.156225:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.156258:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.156291:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310107392 00000100:00100000:0.0:1746147204.156291:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.156300:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310107392 00000100:00100000:0.0:1746147204.156308:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310107008 00000100:00100000:0.0:1746147204.156311:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310107008 00000100:00100000:1.0:1746147204.156333:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310107520 00000100:00100000:0.0:1746147204.156333:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310107776 00000100:00100000:1.0:1746147204.156335:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310107520 00000100:00100000:0.0:1746147204.156335:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310107776 00000100:00100000:0.0:1746147204.156351:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6061 00000100:00100000:1.0:1746147204.156352:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19131 00000100:00100000:1.0:1746147204.156358:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310107392:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147204.156358:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2586:x1830967310107008:12345-192.168.204.25@tcp:35:multiop.0 00010000:00010000:1.0:1746147204.156372:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.156388:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2a600/0x3139939425061076 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dfad expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.156624:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311356032:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147204.156674:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6062 00000100:00100000:3.0:1746147204.156682:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2581:x1830967310107776:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147204.156708:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147204.156727:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19132 00000100:00100000:1.0:1746147204.156732:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310107520:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.156739:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.156747:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x313993942506107d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dfb4 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.156758:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.156759:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.156766:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x313993942506107d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfb4 expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.156789:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x313993942506107d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfb4 expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.156802:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2a800, rc 0) 00000100:00100000:1.0:1746147204.156825:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310107520:12345-192.168.204.25@tcp:101:cat.0 Request processed in 93us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.156830:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19132 00000100:00100000:0.0:1746147204.156960:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2586:x1830967310107008:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 602us (788us total) trans 8589937173 rc 0/0 00000100:00100000:0.0:1746147204.156967:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6061 00000100:00100000:3.0:1746147204.157372:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2581:x1830967310107776:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 690us (1079us total) trans 8589937172 rc 0/0 00000100:00100000:3.0:1746147204.157378:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6062 00000100:00100000:3.0:1746147204.158438:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310107264:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8646us (8988us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147204.158445:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7038 00002000:00100000:3.0:1746147204.158453:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880099889180 x1830967310107264/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.158461:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099889180 with x1830967310107264 ext(1048576->2097151) 00002000:00010000:3.0:1746147204.158465:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099889180 00000100:00100000:1.0:1746147204.159218:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311356032:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147204.159234:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2a600/0x3139939425061076 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfad expref: 23 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.159243:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2a600/0x3139939425061076 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfad expref: 23 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.159252:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2a600, rc 0) 00000100:00100000:1.0:1746147204.159479:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310107392:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3120us (3252us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147204.159485:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19131 00000100:00100000:0.0:1746147204.164961:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.165014:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.165357:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310108160 00000100:00100000:1.0:1746147204.165366:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310108160 00000100:00100000:1.0:1746147204.165420:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19133 00000100:00100000:1.0:1746147204.165429:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310108160:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.165448:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.165470:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2b600/0x3139939425061084 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dfc2 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.165526:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311356160:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147204.165616:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147204.165636:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310108032 00000100:00100000:1.0:1746147204.165639:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310108032 00000100:00100000:1.0:1746147204.165669:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16305 00000100:00100000:1.0:1746147204.165674:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2582:x1830967310108032:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147204.165684:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.165698:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2bc00/0x313993942506108b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dfbb expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.165814:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ac00/0x3139939425061092 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.165829:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ac00/0x3139939425061092 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.165838:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ac00/0x3139939425061092 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:1.0:1746147204.165849:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147204.165958:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2bc00/0x313993942506108b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfbb expref: 11 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.165975:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ac00/0x3139939425061092 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfbb expref: 10 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.165984:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.165988:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147204.165991:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2ac00, rc 0) 00000100:00100000:1.0:1746147204.166021:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2582:x1830967310108032:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 346us (1070us total) trans 8589937174 rc 0/0 00000100:00100000:1.0:1746147204.166031:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16305 00000100:00100000:1.0:1746147204.170648:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311356160:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147204.170696:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2b600/0x3139939425061084 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfc2 expref: 23 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.170713:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2b600/0x3139939425061084 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfc2 expref: 23 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.170724:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2b600, rc 0) 00000100:00100000:1.0:1746147204.170790:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310108160:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5361us (5774us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147204.170800:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19133 00000100:00100000:0.0:1746147204.171146:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.171168:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.171187:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.171209:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.171229:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.171245:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.171292:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310108544 00000100:00100000:1.0:1746147204.171297:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310108544 00000100:00100000:1.0:1746147204.171320:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310108800 00000100:00100000:1.0:1746147204.171322:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310108800 00000100:00100000:1.0:1746147204.171400:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19135 00000100:00100000:1.0:1746147204.171407:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310108416:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1746147204.171437:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095a2ba00/0x31399394250610a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.171451:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x3139939425061037 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df7c expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.171458:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x313993942506107d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfb4 expref: 12 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.171469:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x313993942506106f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfa6 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.171474:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.171476:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.171479:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2ba00/0x31399394250610a7 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.171499:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x313993942506106f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfa6 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.171509:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x313993942506106f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfa6 expref: 13 pid: 1854 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746147204.171520:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311356416:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147204.171560:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x313993942506107d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfb4 expref: 12 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.171568:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x313993942506107d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfb4 expref: 12 pid: 9585 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746147204.171575:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311356672:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147204.171603:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x3139939425061037 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df7c expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.171615:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x3139939425061037 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df7c expref: 26 pid: 1854 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.171622:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311356800:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147204.171637:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147204.171652:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19137 00000100:00100000:1.0:1746147204.171657:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310108544:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1746147204.171673:0:10340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250610b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.171683:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984ee200/0x3139939425060cd3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddd1 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.171690:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800990cda00/0x3139939425060db3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de41 expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.171697:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x3139939425060d89 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de09 expref: 26 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.171702:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.171704:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.171706:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250610b5 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.171721:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x3139939425060d89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de09 expref: 26 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.171730:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x3139939425060d89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de09 expref: 26 pid: 1398 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746147204.171738:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311357184:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147204.171801:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19139 00000100:00100000:3.0:1746147204.171811:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310108800:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147204.171828:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x31399394250610c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.171838:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009504e200/0x3139939425060ee0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dee2 expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.171845:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f380a00/0x3139939425060ee7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7def0 expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.171852:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d95c00/0x3139939425060fea lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df59 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.171858:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932d6a00/0x3139939425060f42 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df13 expref: 21 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.171864:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147204.171865:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147204.171867:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x31399394250610c3 lrc: 7/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.171884:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800932d6a00/0x3139939425060f42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df13 expref: 21 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.171892:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800932d6a00/0x3139939425060f42 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df13 expref: 21 pid: 9586 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746147204.171900:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311357568:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.171926:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d95c00/0x3139939425060fea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df59 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.171934:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d95c00/0x3139939425060fea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df59 expref: 13 pid: 9586 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746147204.171940:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311357824:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.171957:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f380a00/0x3139939425060ee7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7def0 expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.171963:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f380a00/0x3139939425060ee7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7def0 expref: 34 pid: 1854 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.171971:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e484380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311358080:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.171991:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009504e200/0x3139939425060ee0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dee2 expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.171999:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009504e200/0x3139939425060ee0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dee2 expref: 34 pid: 1854 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.172005:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311358336:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147204.172020:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a600 going to sleep for 11 seconds 00010000:00010000:1.0:1746147204.172806:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800990cda00/0x3139939425060db3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de41 expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.172816:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800990cda00/0x3139939425060db3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de41 expref: 12 pid: 17600 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746147204.172825:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311358464:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147204.173171:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984ee200/0x3139939425060cd3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddd1 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.173180:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984ee200/0x3139939425060cd3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddd1 expref: 13 pid: 9586 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746147204.173188:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311358592:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147204.173410:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147204.173424:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147204.180825:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310110208 00000100:00100000:3.0:1746147204.180840:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310110208 00000100:00100000:3.0:1746147204.180916:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6063 00000100:00100000:3.0:1746147204.180925:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2590:x1830967310110208:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147204.181231:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2590:x1830967310110208:12345-192.168.204.25@tcp:35:cat.0 Request processed in 306us (1852us total) trans 8589937175 rc 0/0 00000100:00100000:3.0:1746147204.181238:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6063 00000100:00100000:3.0:1746147204.181297:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311356544:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147204.181317:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311356928:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.181325:0:1853:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x31399394250610a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.181330:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311357056:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147204.181340:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311357312:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147204.181349:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310109440 00000100:00100000:3.0:1746147204.181353:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310109440 00010000:00010000:1.0:1746147204.181358:0:12201:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096d95400/0x31399394250610ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.181381:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310109824 00002000:00100000:3.0:1746147204.181383:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x93:0x0] (16384->311295) req@ffff88012ca10e00 x1830967310109440/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147204.181385:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310109824 00002000:00100000:3.0:1746147204.181392:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca10e00 with x1830967310109440 ext(16384->311295) 00010000:00010000:3.0:1746147204.181398:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f381c00/0x3139939425061022 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->540671] (req 16384->311295) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df75 expref: 35 pid: 9585 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.181407:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f381c00/0x3139939425061022 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->540671] (req 16384->311295) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df75 expref: 35 pid: 9585 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.181407:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f01a200/0x3139939425060dc1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de48 expref: 22 pid: 9586 timeout: 842 lvb_type: 1 00002000:00010000:3.0:1746147204.181412:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ca10e00 00000100:00100000:1.0:1746147204.181428:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8677 00000100:00100000:3.0:1746147204.181429:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1641 00000100:00100000:1.0:1746147204.181433:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310109824:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147204.181434:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967310109440:12345-192.168.204.25@tcp:4:cat.0 00010000:00010000:1.0:1746147204.181444:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147204.181462:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f01a200/0x3139939425060dc1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de48 expref: 22 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.181471:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f01a200/0x3139939425060dc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de48 expref: 22 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.181491:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f01a200/0x3139939425060dc1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de48 expref: 22 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.181504:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147204.181536:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967310109824:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 102us (2186us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.181541:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8677 00000100:00100000:1.0:1746147204.181570:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311356416:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147204.181581:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311356672:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147204.181592:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311356800:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147204.181611:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095a2ba00/0x31399394250610a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.181632:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311357184:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147204.186246:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311358336:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147204.186260:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099154000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311357568:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147204.186268:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099154380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311357824:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147204.186330:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311358464:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147204.186342:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311358592:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147204.186372:0:10340:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250610b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.186400:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.186425:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.186427:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310109184 00000100:00100000:0.0:1746147204.186433:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310109184 00000100:00100000:1.0:1746147204.186441:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310109568 00000100:00100000:1.0:1746147204.186444:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310109568 00010000:00010000:1.0:1746147204.186465:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x3139939425061037 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df7c expref: 27 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.186465:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x313993942506107d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfb4 expref: 13 pid: 9585 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746147204.186494:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8678 00000100:00100000:0.0:1746147204.186498:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8679 00000100:00100000:1.0:1746147204.186503:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967310109568:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147204.186504:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b43bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2002:x1830967310109184:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147204.186511:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e484380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311358080:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147204.186515:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147204.186515:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147204.186533:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x3139939425061037 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df7c expref: 27 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.186534:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x313993942506107d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfb4 expref: 13 pid: 9585 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.186535:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x31399394250610c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.186544:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x313993942506107d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfb4 expref: 13 pid: 9585 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.186554:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x3139939425061037 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df7c expref: 27 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.186737:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x313993942506107d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfb4 expref: 13 pid: 9585 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.186744:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x3139939425061037 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df7c expref: 27 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.186759:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147204.186760:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147204.186804:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967310109568:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 304us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.186811:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8678 00000100:00100000:0.0:1746147204.186811:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b43bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2002:x1830967310109184:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 306us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.186818:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8679 00000100:00100000:1.0:1746147204.186839:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.186848:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310109952 00000100:00100000:1.0:1746147204.186851:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310109952 00010000:00010000:1.0:1746147204.186861:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095053a00/0x3139939425060cc5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddd8 expref: 14 pid: 9586 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746147204.186879:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8680 00000100:00100000:1.0:1746147204.186884:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2002:x1830967310109952:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.186890:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147204.186893:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.186902:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310110592 00010000:00010000:1.0:1746147204.186905:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095053a00/0x3139939425060cc5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddd8 expref: 14 pid: 9586 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746147204.186905:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310110592 00010000:00010000:1.0:1746147204.186913:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095053a00/0x3139939425060cc5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddd8 expref: 14 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746147204.186915:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ee200/0x3139939425060cd3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddd1 expref: 14 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.186925:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095053a00/0x3139939425060cc5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddd8 expref: 14 pid: 9586 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746147204.186928:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8681 00000100:00100000:0.0:1746147204.186932:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2002:x1830967310110592:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.186933:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147204.186941:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147204.186945:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2002:x1830967310109952:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 61us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.186950:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8680 00010000:00010000:0.0:1746147204.186951:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984ee200/0x3139939425060cd3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddd1 expref: 14 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746147204.186959:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984ee200/0x3139939425060cd3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddd1 expref: 14 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746147204.186970:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984ee200/0x3139939425060cd3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ddd1 expref: 14 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746147204.186979:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147204.186983:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.186991:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310109056 00000100:00100000:0.0:1746147204.186992:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2002:x1830967310110592:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 60us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.186993:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310109056 00000100:00100000:0.0:1746147204.186997:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8681 00010000:00010000:1.0:1746147204.187001:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x313993942506106f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfa6 expref: 14 pid: 1854 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746147204.187019:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8682 00000100:00100000:1.0:1746147204.187022:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2002:x1830967310109056:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.187028:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147204.187033:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x313993942506106f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfa6 expref: 13 pid: 1854 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746147204.187038:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147204.187040:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x313993942506106f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfa6 expref: 13 pid: 1854 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.187048:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0000/0x313993942506106f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfa6 expref: 13 pid: 1854 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.187056:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.187057:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.187062:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2ba00/0x31399394250610a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.187069:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2ba00/0x31399394250610a7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147204.187070:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.187079:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310109696 00000100:00100000:0.0:1746147204.187082:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310109696 00010000:00010000:1.0:1746147204.187084:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147204.187111:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2002:x1830967310109056:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 87us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.187115:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8682 00010000:00010000:0.0:1746147204.187131:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425060d97 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de10 expref: 39 pid: 1398 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.187137:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095a2ba00/0x31399394250610a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.187145:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2ba00/0x31399394250610a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147204.187148:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8683 00000100:00100000:0.0:1746147204.187153:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2002:x1830967310109696:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.187159:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095a2ba00/0x31399394250610a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.187159:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147204.187166:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2ba00/0x31399394250610a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.187167:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425060d97 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de10 expref: 39 pid: 1398 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.187173:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095a2ba00/0x31399394250610a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.187180:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2ba00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147204.187180:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425060d97 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de10 expref: 39 pid: 1398 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.187184:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a2ba00/0x31399394250610a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.187191:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a2ba00/0x31399394250610a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.187191:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425060d97 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de10 expref: 39 pid: 1398 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746147204.187199:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.187201:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095a2ba00/0x31399394250610a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.187201:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147204.187204:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d95400/0x31399394250610ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.187206:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2ba00/0x31399394250610a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.187210:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95400/0x31399394250610ae lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.187223:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147204.187237:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967310109696:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 83us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.187242:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8683 00000100:00100000:1.0:1746147204.187245:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310108416:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 15838us (16075us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.187253:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19135 00000100:00100000:0.0:1746147204.187266:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147204.187271:0:12201:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096d95400/0x31399394250610ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.187277:0:12201:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d95400/0x31399394250610ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147204.187281:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310110464 00000100:00100000:0.0:1746147204.187283:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310110464 00010000:00010000:1.0:1746147204.187287:0:12201:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096d95400/0x31399394250610ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.187292:0:12201:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95400/0x31399394250610ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.187292:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x3139939425060d89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de09 expref: 26 pid: 1398 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.187298:0:12201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096d95400/0x31399394250610ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.187303:0:12201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d95400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147204.187304:0:12201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d95400/0x31399394250610ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.187309:0:12201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d95400/0x31399394250610ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.187316:0:12201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096d95400/0x31399394250610ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.187320:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d95400/0x31399394250610ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.187338:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310109312 00000100:00100000:3.0:1746147204.187342:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310109312 00000100:00100000:1.0:1746147204.187349:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310108672:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 15760us (16160us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.187354:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19136 00002000:00100000:3.0:1746147204.187371:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x93:0x0] (552960->978943) req@ffff8800769ac700 x1830967310109312/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.187380:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ac700 with x1830967310109312 ext(552960->978943) 00010000:00010000:3.0:1746147204.187386:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d94000/0x313993942506103e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [552960->18446744073709551615] (req 552960->978943) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df83 expref: 21 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.187395:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d94000/0x313993942506103e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [552960->18446744073709551615] (req 552960->978943) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df83 expref: 21 pid: 1853 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746147204.187402:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800769ac700 00000100:00100000:3.0:1746147204.187424:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1642 00000100:00100000:3.0:1746147204.187430:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310109312:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147204.188384:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8684 00000100:00100000:1.0:1746147204.188393:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967310110464:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.188403:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147204.188580:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x3139939425060d89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de09 expref: 26 pid: 1398 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.188591:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x3139939425060d89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de09 expref: 26 pid: 1398 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.188604:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093730e00/0x3139939425060d89 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de09 expref: 26 pid: 1398 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.188616:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147204.188634:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310110464:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 244us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.188640:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8684 00000100:00100000:1.0:1746147204.188729:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.188742:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310111232 00000100:00100000:1.0:1746147204.188746:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310111232 00000100:00100000:3.0:1746147204.188817:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310109440:12345-192.168.204.25@tcp:4:cat.0 Request processed in 7381us (9497us total) trans 21474842458 rc 0/0 00000100:00100000:3.0:1746147204.188824:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1641 00002000:00100000:3.0:1746147204.188832:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x93:0x0] (16384->311295) req@ffff88012ca10e00 x1830967310109440/t21474842458(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/448 e 0 to 0 dl 1746147215 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.188840:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca10e00 with x1830967310109440 ext(16384->311295) 00010000:00010000:3.0:1746147204.188848:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f381c00/0x3139939425061022 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->540671] (req 16384->311295) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df75 expref: 36 pid: 9585 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.188857:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f381c00/0x3139939425061022 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->540671] (req 16384->311295) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df75 expref: 36 pid: 9585 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746147204.188862:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ca10e00 00000100:00100000:0.0:1746147204.189300:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.189319:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310111360 00000100:00100000:0.0:1746147204.189322:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310111360 00010000:00010000:0.0:1746147204.189339:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x3139939425060e31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7deaa expref: 13 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.189353:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffb200/0x3139939425060e15 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de8e expref: 13 pid: 1854 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746147204.189370:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8685 00000100:00100000:0.0:1746147204.189376:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2002:x1830967310111360:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147204.189383:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147204.189388:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8686 00000100:00100000:1.0:1746147204.189394:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5235050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2002:x1830967310111232:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147204.189395:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x3139939425060e31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7deaa expref: 13 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.189401:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147204.189404:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x3139939425060e31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7deaa expref: 13 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.189414:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ffb200/0x3139939425060e15 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de8e expref: 13 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.189420:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x3139939425060e31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7deaa expref: 13 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.189423:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ffb200/0x3139939425060e15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 9 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de8e expref: 13 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.189434:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ffb200/0x3139939425060e15 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de8e expref: 12 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.189437:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147204.189443:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147204.189451:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2002:x1830967310111360:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 76us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.189456:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5235050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2002:x1830967310111232:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 62us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.189456:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8685 00000100:00100000:1.0:1746147204.189462:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8686 00000100:00100000:0.0:1746147204.189487:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.189516:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.189531:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310110720 00000100:00100000:1.0:1746147204.189534:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310110720 00000100:00100000:0.0:1746147204.189538:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147204.189546:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425060ff8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df60 expref: 11 pid: 10340 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746147204.189548:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310110976 00000100:00100000:0.0:1746147204.189551:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310110976 00010000:00010000:0.0:1746147204.189562:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800990cda00/0x3139939425060db3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de41 expref: 10 pid: 17600 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746147204.189563:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8687 00000100:00100000:1.0:1746147204.189568:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310110720:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.189575:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147204.189581:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425060ff8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df60 expref: 11 pid: 10340 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746147204.189588:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8688 00010000:00010000:1.0:1746147204.189589:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425060ff8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df60 expref: 11 pid: 10340 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746147204.189593:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310110976:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147204.189599:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147204.189600:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x3139939425060ff8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df60 expref: 11 pid: 10340 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746147204.189607:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800990cda00/0x3139939425060db3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de41 expref: 10 pid: 17600 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.189608:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147204.189615:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800990cda00/0x3139939425060db3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de41 expref: 10 pid: 17600 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746147204.189620:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310110720:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 52us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.189625:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8687 00010000:00010000:0.0:1746147204.189625:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800990cda00/0x3139939425060db3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de41 expref: 10 pid: 17600 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746147204.189634:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147204.189636:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147204.189641:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250610b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.189649:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250610b5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.189668:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147204.189671:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.189681:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310110976:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 87us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.189685:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310111616 00000100:00100000:0.0:1746147204.189687:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8688 00000100:00100000:1.0:1746147204.189688:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310111616 00010000:00010000:1.0:1746147204.189701:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f380a00/0x3139939425060ee7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7def0 expref: 36 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.189705:0:10340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250610b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.189712:0:10340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250610b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.189715:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8689 00000100:00100000:1.0:1746147204.189719:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310111616:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.189725:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147204.189731:0:10340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250610b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.189735:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f380a00/0x3139939425060ee7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7def0 expref: 36 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.189739:0:10340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250610b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.189742:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f380a00/0x3139939425060ee7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7def0 expref: 36 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.189746:0:10340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250610b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.189753:0:10340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0ce00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147204.189756:0:10340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250610b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.189760:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f380a00/0x3139939425060ee7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7def0 expref: 36 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.189763:0:10340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250610b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.189768:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147204.189773:0:10340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250610b5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.189791:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x31399394250610b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.189796:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967310111616:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 76us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.189801:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8689 00000100:00100000:0.0:1746147204.189824:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310108544:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 18166us (18613us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.189831:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19137 00000100:00100000:1.0:1746147204.189837:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.189848:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310110336 00000100:00100000:0.0:1746147204.189852:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310110336 00000100:00100000:1.0:1746147204.189858:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147204.189862:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009504e200/0x3139939425060ee0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dee2 expref: 35 pid: 1854 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.189883:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.189889:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310110848 00000100:00100000:0.0:1746147204.189891:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310110848 00010000:00010000:0.0:1746147204.189903:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95c00/0x3139939425060fea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df59 expref: 12 pid: 9586 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746147204.189919:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8690 00000100:00100000:0.0:1746147204.189924:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967310110336:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147204.189930:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147204.189939:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009504e200/0x3139939425060ee0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dee2 expref: 35 pid: 1854 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.189943:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8692 00000100:00100000:1.0:1746147204.189945:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147204.189946:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009504e200/0x3139939425060ee0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dee2 expref: 35 pid: 1854 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.189951:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5234c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310111104:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147204.189957:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009504e200/0x3139939425060ee0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dee2 expref: 35 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.189960:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147204.189965:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147204.189969:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ffaa00/0x3139939425060e2a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dea3 expref: 26 pid: 1854 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746147204.189977:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967310110336:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 53us (140us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147204.189978:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ffaa00/0x3139939425060e2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dea3 expref: 26 pid: 1854 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746147204.189983:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8690 00010000:00010000:3.0:1746147204.189989:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ffaa00/0x3139939425060e2a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dea3 expref: 26 pid: 1854 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746147204.189991:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310111744 00000100:00100000:0.0:1746147204.189994:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310111744 00010000:00010000:0.0:1746147204.190002:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d6a00/0x3139939425060f42 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df13 expref: 23 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.190003:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.190004:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.190007:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x31399394250610bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147204.190012:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8693 00010000:00010000:3.0:1746147204.190013:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x31399394250610bc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147204.190016:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2002:x1830967310111744:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147204.190021:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147204.190027:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800932d6a00/0x3139939425060f42 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df13 expref: 23 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.190030:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147204.190034:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800932d6a00/0x3139939425060f42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df13 expref: 23 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746147204.190045:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d6a00/0x3139939425060f42 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df13 expref: 23 pid: 9586 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746147204.190050:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5234c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310111104:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 100us (166us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147204.190053:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147204.190054:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147204.190056:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8692 00010000:00010000:0.0:1746147204.190057:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x31399394250610c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.190063:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x31399394250610c3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.190075:0:1398:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x31399394250610bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.190076:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147204.190082:0:1398:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x31399394250610bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.190113:0:1398:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x31399394250610bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147204.190118:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2002:x1830967310111744:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 100us (172us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147204.190119:0:1398:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x31399394250610bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147204.190123:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8693 00010000:00010000:3.0:1746147204.190125:0:1398:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x31399394250610bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.190131:0:1398:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5797400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147204.190133:0:1398:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x31399394250610bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.190138:0:1398:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x31399394250610bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.190144:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.190145:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.190150:0:1398:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250610ca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2478080->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfc9 expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.190161:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250610ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2478080->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfc9 expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.190184:0:1398:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250610ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2478080->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfc9 expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.190193:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e484380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311358720:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147204.190233:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8840 going to sleep for 11 seconds 00010000:00010000:3.0:1746147204.190249:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x31399394250610c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.190255:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x31399394250610c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.190266:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x31399394250610c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.190270:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x31399394250610c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.190276:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x31399394250610c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.190282:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147204.190284:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x31399394250610c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.190290:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x31399394250610c3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.190297:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x31399394250610c3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.190302:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x31399394250610c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.190336:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310108800:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 18527us (19089us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.190341:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19139 00000100:00100000:0.0:1746147204.193938:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.196339:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2002:x1830967310109312:12345-192.168.204.25@tcp:4:cat.0 Request processed in 8895us (9286us total) trans 21474842459 rc 0/0 00000100:00100000:3.0:1746147204.196353:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1642 00002000:00100000:3.0:1746147204.196366:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x93:0x0] (552960->978943) req@ffff8800769ac700 x1830967310109312/t21474842459(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/448 e 0 to 0 dl 1746147215 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.196376:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ac700 with x1830967310109312 ext(552960->978943) 00010000:00010000:3.0:1746147204.196386:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d94000/0x313993942506103e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [552960->18446744073709551615] (req 552960->978943) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df83 expref: 22 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.196404:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d94000/0x313993942506103e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [552960->18446744073709551615] (req 552960->978943) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7df83 expref: 22 pid: 1853 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746147204.196470:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800769ac700 00000100:00100000:0.0:1746147204.197687:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.197766:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e484380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311358720:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147204.197796:0:1398:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x31399394250610bc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.197804:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5797400/0x31399394250610bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.197860:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967310108928:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 26081us (26629us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.197867:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19138 00000100:00100000:0.0:1746147204.200322:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147204.202072:0:1853:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x31399394250610a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.202082:0:1853:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x31399394250610a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.202120:0:1853:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x31399394250610a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.202127:0:1853:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x31399394250610a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.202135:0:1853:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x31399394250610a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.202142:0:1853:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbe1800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147204.202145:0:1853:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x31399394250610a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.202154:0:1853:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x31399394250610a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.202168:0:1853:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x31399394250610a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.202173:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1800/0x31399394250610a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.202433:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310108288:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 31094us (31285us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.202442:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19134 00000100:00100000:3.0:1746147204.203053:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967310112128:12345-192.168.204.25@tcp:3:cat.0 Request processed in 4843us (5367us total) trans 0 rc 667648/667648 00000100:00100000:3.0:1746147204.203062:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7039 00002000:00100000:3.0:1746147204.203072:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x98:0x0] (2478080->3145727) req@ffff880098c71880 x1830967310112128/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.203084:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c71880 with x1830967310112128 ext(2478080->3145727) 00002000:00010000:3.0:1746147204.203106:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098c71880 00000100:00100000:0.0:1746147204.205066:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.207589:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.207670:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.207686:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.207701:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.207728:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310112768 00000100:00100000:3.0:1746147204.207736:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310112768 00000100:00100000:0.0:1746147204.207774:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147204.207793:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6600/0x3139939425060df2 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de6b expref: 21 pid: 7239 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.207822:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310112896 00000100:00100000:3.0:1746147204.207826:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310112896 00000100:00100000:0.0:1746147204.207828:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310113024 00000100:00100000:0.0:1746147204.207830:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310113024 00000100:00100000:1.0:1746147204.207831:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310113152 00000100:00100000:1.0:1746147204.207835:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310113152 00010000:00010000:3.0:1746147204.207837:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425060deb lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de64 expref: 39 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.207841:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x3139939425060e77 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7debf expref: 22 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.207850:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425060e4d lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7deb1 expref: 40 pid: 7239 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.207852:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8696 00000100:00100000:3.0:1746147204.207859:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310112768:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147204.207871:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147204.207881:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6600/0x3139939425060df2 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de6b expref: 22 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.207892:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6600/0x3139939425060df2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de6b expref: 22 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.207919:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147204.207925:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250610d1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.207933:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147204.207971:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310112768:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 113us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.208210:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8697 00000100:00100000:0.0:1746147204.208217:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097097800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2002:x1830967310112896:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147204.208223:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8698 00010000:00010000:0.0:1746147204.208225:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147204.208229:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425060deb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de64 expref: 40 pid: 7239 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.208230:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310113024:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.208237:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147204.208237:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425060deb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de64 expref: 40 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.208242:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x3139939425060e77 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7debf expref: 21 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.208250:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425060deb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7de64 expref: 40 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.208251:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x3139939425060e77 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7debf expref: 21 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.208262:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.208263:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x3139939425060e77 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7debf expref: 21 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.208266:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250610d1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.208270:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147204.208277:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.208280:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250610d1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.208286:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147204.208286:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097097800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2002:x1830967310112896:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 71us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.208293:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8697 00000100:00100000:1.0:1746147204.208306:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2002:x1830967310113024:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 76us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.208308:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8699 00000100:00100000:1.0:1746147204.208312:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8698 00000100:00100000:0.0:1746147204.208312:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5234850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967310113152:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147204.208318:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147204.208322:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425060e4d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7deb1 expref: 38 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.208329:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425060e4d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7deb1 expref: 38 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.208340:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd800/0x3139939425060e4d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7deb1 expref: 38 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.208348:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147204.208350:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250610d1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.208357:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250610d1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.208364:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250610d1 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00000100:00100000:3.0:1746147204.208368:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8696 00010000:00010000:0.0:1746147204.208378:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147204.208393:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310112640 00000100:00100000:0.0:1746147204.208394:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5234850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967310113152:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 81us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.208396:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310112640 00000100:00100000:0.0:1746147204.208400:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8699 00000100:00100000:3.0:1746147204.208416:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19141 00000100:00100000:3.0:1746147204.208420:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2587:x1830967310112640:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147204.208434:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.208452:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097034000/0x31399394250610d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dfd0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147204.208484:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4886560, mtime: 0x68141783, atime: 0x68141783, ctime: 0x68141783, blocks: 0x1558 00010000:00010000:3.0:1746147204.208501:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.208503:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.208511:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097034000/0x31399394250610d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfd0 expref: 34 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.208524:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097034000/0x31399394250610d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfd0 expref: 34 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.208532:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097034000, rc 0) 00000100:00100000:3.0:1746147204.208551:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2587:x1830967310112640:12345-192.168.204.25@tcp:101:cat.0 Request processed in 129us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.208556:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19141 00000100:00100000:0.0:1746147204.210838:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.210938:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310113280 00000100:00100000:1.0:1746147204.210947:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310113280 00000100:00100000:1.0:1746147204.210983:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16307 00000100:00100000:1.0:1746147204.210990:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2587:x1830967310113280:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.211010:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.211028:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x31399394250610df lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dfd7 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.211074:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250610d1 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.211082:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x31399394250610df lrc: 4/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfd7 expref: 38 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.211130:0:7239:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250610d1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.211142:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x31399394250610df lrc: 3/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfd7 expref: 38 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.211158:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.211161:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147204.211163:0:7239:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x31399394250610df lrc: 3/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfd7 expref: 38 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.211169:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c800, rc 0) 00000100:00100000:1.0:1746147204.211206:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2587:x1830967310113280:12345-192.168.204.25@tcp:101:cat.0 Request processed in 216us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.211211:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16307 00000100:00100000:3.0:1746147204.212717:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311359488:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147204.212753:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147204.212787:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746147204.212793:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311359360:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147204.212808:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147204.212829:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311359488 00000100:00100000:3.0:1746147204.212834:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311359488 00000100:00100000:0.0:1746147204.212902:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311360000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147204.212924:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147204.212939:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147204.212943:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097097800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311360128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147204.212957:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147204.212973:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311359360 00000100:00100000:0.0:1746147204.212975:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311359360 00000100:00100000:0.0:1746147204.212998:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311360000 00000100:00100000:0.0:1746147204.213000:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311360000 00000100:00100000:0.0:1746147204.213009:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311360128 00000100:00100000:0.0:1746147204.213011:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311360128 00000100:00100000:0.0:1746147204.213023:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19142 00000100:00100000:0.0:1746147204.213029:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3765:x1830967311359360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147204.213189:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3765:x1830967311359360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 159us (379us total) trans 17179875080 rc 0/0 00000100:00100000:0.0:1746147204.213195:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19142 00000100:00100000:0.0:1746147204.213206:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19143 00000100:00100000:0.0:1746147204.213211:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3764:x1830967311360000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147204.213268:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3764:x1830967311360000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (343us total) trans 17179875081 rc 0/0 00000100:00100000:0.0:1746147204.213274:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19143 00000100:00100000:0.0:1746147204.213282:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19144 00000100:00100000:0.0:1746147204.213286:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3764:x1830967311360128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147204.213333:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:0.0:1746147204.213336:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:0.0:1746147204.213338:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147204.213340:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:0.0:1746147204.213342:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:0.0:1746147204.213361:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3764:x1830967311360128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (403us total) trans 17179875082 rc 0/0 00000100:00100000:0.0:1746147204.213366:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19144 00000004:00080000:0.0:1746147204.213398:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097097800/2, rc 0, transno 17179875082 00000100:00100000:0.0:1746147204.213402:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097097800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311360128:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147204.213410:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c70380/2, rc 0, transno 17179875081 00000100:00100000:0.0:1746147204.213413:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311360000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147204.213481:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19145 00000100:00100000:3.0:1746147204.213486:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3765:x1830967311359488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147204.213544:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3765:x1830967311359488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (791us total) trans 17179875083 rc 0/0 00000100:00100000:3.0:1746147204.213548:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19145 00000004:00080000:3.0:1746147204.213569:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098858000/2, rc 0, transno 17179875080 00000100:00100000:3.0:1746147204.213572:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311359360:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147204.213579:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098859f80/2, rc 0, transno 17179875083 00000100:00100000:3.0:1746147204.213581:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311359488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147204.213637:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311359872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147204.213662:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147204.213675:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311360384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147204.213689:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147204.213773:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311360896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147204.213801:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147204.213811:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311361408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147204.213825:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147204.213843:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311360384 00000100:00100000:1.0:1746147204.213846:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311360384 00000100:00100000:1.0:1746147204.213857:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311360768 00000100:00100000:1.0:1746147204.213858:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311360768 00000100:00100000:1.0:1746147204.213865:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311361280 00000100:00100000:1.0:1746147204.213866:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311361280 00000100:00100000:1.0:1746147204.213875:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19146 00000100:00100000:1.0:1746147204.213879:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3767:x1830967311359872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147204.213920:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311360640:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147204.213938:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147204.213945:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311361152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147204.213958:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147204.213964:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746147204.213968:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311360512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147204.213980:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147204.213985:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311361024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147204.213999:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746147204.214021:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147204.214023:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147204.214025:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147204.214027:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147204.214029:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746147204.214041:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3767:x1830967311359872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 162us (379us total) trans 17179875085 rc 0/0 00000100:00100000:1.0:1746147204.214046:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19146 00000100:00100000:1.0:1746147204.214054:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311361024 00000100:00100000:1.0:1746147204.214056:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311361024 00000100:00100000:1.0:1746147204.214067:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19150 00000100:00100000:1.0:1746147204.214070:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3766:x1830967311360768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147204.214140:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:1.0:1746147204.214142:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147203 -> 1746147203 00002000:00010000:1.0:1746147204.214144:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147203 -> 1746147203 00002000:00010000:1.0:1746147204.214146:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147203 -> 1746147203 00002000:00010000:1.0:1746147204.214148:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:1.0:1746147204.214162:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3766:x1830967311360768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (389us total) trans 21474842460 rc 0/0 00000100:00100000:1.0:1746147204.214166:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19150 00000100:00100000:1.0:1746147204.214174:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19152 00000100:00100000:1.0:1746147204.214177:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3766:x1830967311361280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147204.214206:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147204.214208:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147204.214210:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147204.214211:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147204.214213:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:1.0:1746147204.214225:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3766:x1830967311361280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (413us total) trans 21474842462 rc 0/0 00000100:00100000:1.0:1746147204.214229:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19152 00000100:00100000:1.0:1746147204.214235:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19154 00000100:00100000:1.0:1746147204.214238:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3765:x1830967311360640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147204.214293:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3765:x1830967311360640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (354us total) trans 21474842463 rc 0/0 00000100:00100000:1.0:1746147204.214297:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19154 00000100:00100000:1.0:1746147204.214305:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19156 00000100:00100000:1.0:1746147204.214309:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3765:x1830967311360512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147204.214350:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3765:x1830967311360512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (369us total) trans 21474842466 rc 0/0 00000100:00100000:1.0:1746147204.214354:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19156 00000004:00080000:1.0:1746147204.214373:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096cf8000/2, rc 0, transno 21474842461 00000100:00100000:1.0:1746147204.214380:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311360896:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147204.214387:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c70000/2, rc 0, transno 17179875085 00000100:00100000:1.0:1746147204.214389:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311359872:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147204.214394:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094527480/2, rc 0, transno 17179875084 00000100:00100000:1.0:1746147204.214397:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311360384:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147204.214406:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096cfbb80/2, rc 0, transno 21474842466 00000100:00100000:1.0:1746147204.214409:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311360512:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147204.214414:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096cfad80/2, rc 0, transno 21474842467 00000100:00100000:1.0:1746147204.214416:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311361024:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147204.214421:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096cf8700/2, rc 0, transno 21474842463 00000100:00100000:1.0:1746147204.214424:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311360640:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147204.214429:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096cf9880/2, rc 0, transno 21474842465 00000100:00100000:1.0:1746147204.214431:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311361152:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147204.214449:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:1.0:1746147204.214451:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147204.214453:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147204.214455:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147204.214457:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:1.0:1746147204.214474:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3767:x1830967311361408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 239us (649us total) trans 21474842464 rc 0/0 00000100:00100000:1.0:1746147204.215232:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19153 00000004:00080000:1.0:1746147204.215266:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096cfb480/2, rc 0, transno 21474842464 00000100:00100000:1.0:1746147204.215271:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311361408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147204.215363:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311361536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147204.215393:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147204.215630:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311361536 00000100:00100000:1.0:1746147204.215636:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311361536 00000100:00100000:1.0:1746147204.215668:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19158 00000100:00100000:1.0:1746147204.215673:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3764:x1830967311361536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147204.215771:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3764:x1830967311361536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (377us total) trans 21474842468 rc 0/0 00000100:00100000:1.0:1746147204.215787:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19158 00000004:00080000:0.0:1746147204.215791:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909fb100/2, rc 0, transno 21474842468 00000100:00100000:0.0:1746147204.215794:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311361536:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746147204.216441:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250610d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.216449:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250610d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.216455:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250610d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.216461:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093714e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147204.216466:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250610d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.216472:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250610d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.216487:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.216490:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147204.216494:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250610d1 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.216499:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093714e00/0x31399394250610d1 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147204.216687:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.216767:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310113408 00000100:00100000:3.0:1746147204.216772:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310113408 00000100:00100000:3.0:1746147204.216816:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6064 00000100:00100000:3.0:1746147204.216822:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909c4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2587:x1830967310113408:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:3.0:1746147204.216885:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909c4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2587:x1830967310113408:12345-192.168.204.25@tcp:49:cat.0 Request processed in 63us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.216890:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6064 00000100:00100000:0.0:1746147204.219741:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.223225:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.223341:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310113664 00000100:00100000:3.0:1746147204.223352:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310113664 00000100:00100000:3.0:1746147204.223400:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16309 00000100:00100000:3.0:1746147204.223409:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2582:x1830967310113664:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147204.223430:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.223454:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097035e00/0x31399394250610ed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dfe5 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.223628:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097034400/0x31399394250610f4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.223642:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097034400/0x31399394250610f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.223652:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097034400/0x31399394250610f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:3.0:1746147204.223682:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147204.223687:0:7237:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147204.223703:0:7237:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880097034400/0x31399394250610f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.223725:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097035e00/0x31399394250610ed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfe5 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.223758:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097034400/0x31399394250610f4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfe5 expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.223766:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147204.223769:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147204.223772:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097034400, rc 0) 00000100:00100000:3.0:1746147204.223835:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2582:x1830967310113664:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 426us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.223841:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16309 00000100:00100000:0.0:1746147204.224336:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.224372:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.224415:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310113920 00000100:00100000:3.0:1746147204.224420:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310113920 00002000:00100000:3.0:1746147204.224455:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880094525c00 x1830967310113920/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.224464:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094525c00 with x1830967310113920 ext(3145728->4194303) 00002000:00010000:3.0:1746147204.224468:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094525c00 00000100:00100000:3.0:1746147204.224494:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7040 00000100:00100000:3.0:1746147204.224499:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310113920:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147204.226290:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.226366:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310114304 00000100:00100000:1.0:1746147204.226372:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310114304 00000100:00100000:1.0:1746147204.226415:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19159 00000100:00100000:0.0:1746147204.226415:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.226422:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310114304:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147204.226436:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.226457:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a56a00/0x31399394250610fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dfec expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.226470:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310114560 00000100:00100000:3.0:1746147204.226474:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310114560 00002000:00010000:1.0:1746147204.226477:0:9584:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x93:0x0] initial LVB size: 1048576, mtime: 0x68141784, atime: 0x68141784, ctime: 0x68141784, blocks: 0x7e8 00000100:00100000:3.0:1746147204.226493:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19160 00010000:00010000:1.0:1746147204.226493:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.226495:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147204.226497:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967310114560:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147204.226504:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a56a00/0x31399394250610fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfec expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.226505:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.226515:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425061102 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7dffa expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.226517:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a56a00/0x31399394250610fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfec expref: 10 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.226527:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56a00, rc 0) 00002000:00010000:3.0:1746147204.226528:0:1398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x97:0x0] initial LVB size: 2097152, mtime: 0x68141781, atime: 0x68141780, ctime: 0x68141781, blocks: 0x800 00010000:00010000:3.0:1746147204.226534:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.226536:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.226539:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425061102 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dffa expref: 9 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.226548:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425061102 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dffa expref: 9 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.226555:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d6e00, rc 0) 00000100:00100000:1.0:1746147204.226556:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310114304:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 135us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.226562:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19159 00000100:00100000:3.0:1746147204.226567:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310114560:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 70us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.226572:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19160 00000100:00100000:0.0:1746147204.228604:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.228644:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.228671:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.228692:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.228764:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310114816 00000100:00100000:3.0:1746147204.228772:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310114816 00000100:00100000:3.0:1746147204.228817:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310114432 00000100:00100000:3.0:1746147204.228820:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310114432 00000100:00100000:3.0:1746147204.228831:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310114688 00000100:00100000:3.0:1746147204.228833:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310114688 00000100:00100000:3.0:1746147204.228841:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310114944 00000100:00100000:3.0:1746147204.228843:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310114944 00000100:00100000:3.0:1746147204.228855:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19161 00000100:00100000:3.0:1746147204.228863:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310114816:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147204.228878:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.228896:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x3139939425061109 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e008 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.228918:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.228920:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.228929:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x3139939425061109 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e008 expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.228945:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x3139939425061109 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e008 expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.228955:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7000, rc 0) 00000100:00100000:3.0:1746147204.228994:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310114816:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 132us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.228999:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19161 00000100:00100000:3.0:1746147204.229015:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19163 00000100:00100000:3.0:1746147204.229019:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310114688:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147204.229023:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.229032:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d6000/0x3139939425061117 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e001 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147204.229044:0:17600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x68141781, atime: 0x68141781, ctime: 0x68141781, blocks: 0x808 00010000:00010000:3.0:1746147204.229051:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.229052:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.229055:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d6000/0x3139939425061117 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e001 expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.229063:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800932d6000/0x3139939425061117 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e001 expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.229070:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d6000, rc 0) 00000100:00100000:3.0:1746147204.229081:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310114688:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 62us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.229085:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19163 00000100:00100000:3.0:1746147204.229117:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19164 00000100:00100000:3.0:1746147204.229121:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310114944:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147204.229126:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.229133:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x313993942506111e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e00f expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.229141:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.229142:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.229145:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x313993942506111e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e00f expref: 11 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.229154:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x313993942506111e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e00f expref: 11 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.229160:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7e00, rc 0) 00000100:00100000:3.0:1746147204.229173:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310114944:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 52us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.229179:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19164 00000100:00100000:3.0:1746147204.236376:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310113920:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11864us (12028us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147204.236389:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7040 00002000:00100000:3.0:1746147204.236403:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880094525c00 x1830967310113920/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.236414:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094525c00 with x1830967310113920 ext(3145728->4194303) 00002000:00010000:3.0:1746147204.236420:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094525c00 00000100:00100000:1.0:1746147204.236628:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.236648:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310115200 00000100:00100000:1.0:1746147204.236655:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310115200 00000100:00100000:1.0:1746147204.236690:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19165 00000100:00100000:1.0:1746147204.236696:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310115200:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147204.236767:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310115200:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 71us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.236772:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19165 00000100:00100000:1.0:1746147204.236848:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.236858:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310115456 00000100:00100000:1.0:1746147204.236861:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310115456 00000100:00100000:1.0:1746147204.236877:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19166 00000100:00100000:1.0:1746147204.236881:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310115456:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147204.236917:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310115456:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 35us (68us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.236921:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19166 00000100:00100000:1.0:1746147204.236960:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.236970:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310115712 00000100:00100000:1.0:1746147204.236972:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310115712 00000100:00100000:1.0:1746147204.236987:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19167 00000100:00100000:1.0:1746147204.236991:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310115712:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147204.237021:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310115712:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 29us (61us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.237026:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19167 00000100:00100000:1.0:1746147204.237062:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.237072:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310115072 00000100:00100000:1.0:1746147204.237074:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310115072 00000100:00100000:1.0:1746147204.237105:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19168 00000100:00100000:1.0:1746147204.237111:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310115072:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147204.237146:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310115072:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 35us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.237151:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19168 00000100:00100000:1.0:1746147204.237190:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.237201:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310115328 00000100:00100000:1.0:1746147204.237204:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310115328 00000100:00100000:1.0:1746147204.237218:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19169 00000100:00100000:1.0:1746147204.237222:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310115328:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147204.237253:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310115328:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 30us (62us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.237258:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19169 00000100:00100000:1.0:1746147204.237304:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.237316:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310115584 00000100:00100000:1.0:1746147204.237318:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310115584 00000100:00100000:1.0:1746147204.237331:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19170 00000100:00100000:1.0:1746147204.237336:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310115584:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147204.237367:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310115584:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 30us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.237371:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19170 00000100:00100000:0.0:1746147204.242028:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.242072:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.242131:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.242147:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.242173:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310115968 00000100:00100000:0.0:1746147204.242181:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310115968 00000100:00100000:1.0:1746147204.242184:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310116224 00000100:00100000:1.0:1746147204.242189:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310116224 00000100:00100000:1.0:1746147204.242227:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310116480 00000100:00100000:1.0:1746147204.242229:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310116480 00000100:00100000:3.0:1746147204.242329:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310115840 00000100:00100000:3.0:1746147204.242341:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310115840 00000100:00100000:1.0:1746147204.242447:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19172 00000100:00100000:1.0:1746147204.242453:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310116480:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147204.242458:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19173 00000100:00100000:0.0:1746147204.242464:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310115968:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147204.242477:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19174 00000100:00100000:3.0:1746147204.242485:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310115840:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147204.242500:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310116480:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 47us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.242501:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310115968:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 38us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.242508:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19172 00000100:00100000:0.0:1746147204.242510:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19173 00000100:00100000:0.0:1746147204.242535:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.242550:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310116096 00000100:00100000:1.0:1746147204.242552:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310116096 00000100:00100000:1.0:1746147204.242565:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19175 00000100:00100000:1.0:1746147204.242569:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310116096:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147204.242580:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310115840:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 96us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.242585:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.242586:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19174 00000100:00100000:3.0:1746147204.242599:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310116352 00000100:00100000:3.0:1746147204.242602:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310116352 00000100:00100000:1.0:1746147204.242604:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310116096:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 33us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.242608:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.242610:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19175 00000100:00100000:3.0:1746147204.242632:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310116608 00000100:00100000:3.0:1746147204.242635:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310116608 00000100:00100000:1.0:1746147204.242637:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19176 00000100:00100000:1.0:1746147204.242641:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310116352:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147204.242656:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19177 00000100:00100000:3.0:1746147204.242661:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967310116608:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147204.242670:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147204.242674:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310116352:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 32us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.242679:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19176 00000100:00100000:0.0:1746147204.242682:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147204.242685:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425061125 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e016 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.242690:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310116736 00000100:00100000:1.0:1746147204.242692:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310116736 00010000:00010000:3.0:1746147204.242702:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.242704:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.242711:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425061125 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e016 expref: 35 pid: 1398 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147204.242714:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19178 00000100:00100000:1.0:1746147204.242719:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310116736:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147204.242723:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425061125 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e016 expref: 35 pid: 1398 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147204.242725:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147204.242726:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147204.242732:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310116864 00010000:00010000:3.0:1746147204.242733:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7c00, rc 0) 00000100:00100000:0.0:1746147204.242735:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310116864 00010000:00010000:1.0:1746147204.242740:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e3fe00/0x313993942506112c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e01d expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147204.242749:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19179 00000100:00100000:3.0:1746147204.242752:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967310116608:12345-192.168.204.25@tcp:101:cat.0 Request processed in 90us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.242754:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967310116864:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.242756:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147204.242757:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19177 00010000:00010000:1.0:1746147204.242757:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147204.242760:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.242763:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3fe00/0x313993942506112c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e01d expref: 27 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147204.242768:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425061133 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e024 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.242784:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e3fe00/0x313993942506112c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e01d expref: 28 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147204.242792:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.242793:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3fe00, rc 0) 00010000:00010000:0.0:1746147204.242794:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147204.242798:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425061133 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e024 expref: 28 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147204.242808:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425061133 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e024 expref: 28 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147204.242809:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967310116736:12345-192.168.204.25@tcp:101:cat.0 Request processed in 90us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.242815:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19178 00010000:00010000:0.0:1746147204.242821:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0c00, rc 0) 00000100:00100000:0.0:1746147204.242835:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967310116864:12345-192.168.204.25@tcp:101:cat.0 Request processed in 81us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.242840:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19179 00000100:00100000:0.0:1746147204.242886:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.242943:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310116992 00000100:00100000:1.0:1746147204.242946:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310116992 00000100:00100000:1.0:1746147204.242962:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19180 00000100:00100000:1.0:1746147204.242967:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967310116992:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.242973:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.242982:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e3f000/0x313993942506113a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e02b expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.242993:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.242994:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.242998:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e3f000/0x313993942506113a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e02b expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.243006:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e3f000/0x313993942506113a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e02b expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.243012:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3f000, rc 0) 00000100:00100000:1.0:1746147204.243044:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967310116992:12345-192.168.204.25@tcp:101:cat.0 Request processed in 77us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.243050:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19180 00000100:00100000:0.0:1746147204.246152:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.246223:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.246289:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310117120 00000100:00100000:1.0:1746147204.246296:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310117120 00000100:00100000:1.0:1746147204.246336:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19181 00000100:00100000:1.0:1746147204.246342:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310117120:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:1.0:1746147204.246494:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147204.246496:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147204.246498:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147204.246499:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147204.246500:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746147204.246533:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310117120:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 192us (389us total) trans 17179875088 rc 0/0 00000100:00100000:1.0:1746147204.246536:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19181 00000100:00100000:0.0:1746147204.248306:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.248406:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310117504 00000100:00100000:3.0:1746147204.248414:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310117504 00000100:00100000:3.0:1746147204.248456:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19182 00000100:00100000:3.0:1746147204.248462:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2002:x1830967310117504:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:3.0:1746147204.248627:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147204.248630:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147204.248632:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147204.248634:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147204.248636:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:3.0:1746147204.248681:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2002:x1830967310117504:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 218us (382us total) trans 21474842469 rc 0/0 00000100:00100000:3.0:1746147204.248686:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19182 00000100:00100000:3.0:1746147204.250536:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967310117376:12345-192.168.204.25@tcp:3:cat.0 Request processed in 4087us (4304us total) trans 0 rc 696320/696320 00000100:00100000:3.0:1746147204.250546:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7042 00002000:00100000:3.0:1746147204.250557:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880098822680 x1830967310117376/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.250566:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098822680 with x1830967310117376 ext(4194304->4890623) 00002000:00010000:3.0:1746147204.250773:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098822680 00000100:00100000:0.0:1746147204.256441:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.256480:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.256493:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.256516:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.256674:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310118016 00000100:00100000:3.0:1746147204.256682:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310118016 00000100:00100000:3.0:1746147204.256732:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310117888 00000100:00100000:3.0:1746147204.256734:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310117888 00000100:00100000:3.0:1746147204.256745:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310118272 00000100:00100000:3.0:1746147204.256746:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310118272 00000100:00100000:3.0:1746147204.256756:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310118400 00000100:00100000:3.0:1746147204.256758:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310118400 00000100:00100000:3.0:1746147204.256772:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7043 00000100:00100000:3.0:1746147204.256792:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2003:x1830967310118016:12345-192.168.204.25@tcp:3:lfs.0 00000100:00100000:0.0:1746147204.256810:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7044 00000100:00100000:0.0:1746147204.256816:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2003:x1830967310117888:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147204.256823:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800932d6400/0x3139939425061141 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.256828:0:9589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425061148 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.256836:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147204.256836:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.256838:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147204.256838:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.256841:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d6400/0x3139939425061141 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.256841:0:9589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425061148 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.256852:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d6400/0x3139939425061141 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.256852:0:9589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425061148 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.257509:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7046 00000100:00100000:3.0:1746147204.257515:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967310118400:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147204.257532:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425061156 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.257539:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.257540:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.257542:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425061156 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.257554:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425061156 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.258369:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.258402:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.258429:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310118784 00000100:00100000:1.0:1746147204.258435:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310118784 00000100:00100000:1.0:1746147204.258478:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310119040 00000100:00100000:1.0:1746147204.258480:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310119040 00000100:00100000:1.0:1746147204.258496:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7047 00000100:00100000:1.0:1746147204.258502:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967310118784:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147204.258523:0:29476:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880096e3ec00/0x313993942506115d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.258532:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.258534:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.258537:0:29476:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e3ec00/0x313993942506115d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.258553:0:29476:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e3ec00/0x313993942506115d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.258678:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7048 00000100:00100000:3.0:1746147204.258687:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2003:x1830967310119040:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147204.258706:0:29479:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800932d6a00/0x3139939425061164 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.258714:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.258715:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.258718:0:29479:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d6a00/0x3139939425061164 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.258725:0:29479:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d6a00/0x3139939425061164 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147204.259964:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.260015:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.260064:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310119296 00000100:00100000:3.0:1746147204.260071:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310119296 00000100:00100000:3.0:1746147204.260135:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310119552 00000100:00100000:3.0:1746147204.260138:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310119552 00000100:00100000:3.0:1746147204.260156:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7049 00000100:00100000:3.0:1746147204.260161:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2003:x1830967310119296:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147204.260181:0:13302:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x313993942506116b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.260191:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.260192:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.260197:0:13302:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x313993942506116b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.260206:0:13302:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x313993942506116b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.269442:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x313993942506114f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.269451:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x313993942506114f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.269455:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x313993942506114f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.269459:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093715c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147204.269462:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x313993942506114f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.269467:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x313993942506114f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.269478:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x313993942506114f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.269483:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x313993942506114f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147204.269706:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2003:x1830967310118272:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 12620us (13204us total) trans 0 rc 1032192/1032192 00000100:00100000:0.0:1746147204.269717:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7045 00000100:00100000:0.0:1746147204.270994:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.271298:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310119808 00000100:00100000:3.0:1746147204.271307:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310119808 00000100:00100000:3.0:1746147204.271359:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6065 00000100:00100000:3.0:1746147204.271366:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2587:x1830967310119808:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147204.271552:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2587:x1830967310119808:12345-192.168.204.25@tcp:35:cat.0 Request processed in 186us (561us total) trans 8589937177 rc 0/0 00000100:00100000:3.0:1746147204.271558:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6065 00010000:00010000:3.0:1746147204.275161:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425061156 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.275174:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425061156 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.275182:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425061156 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.275188:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147204.275193:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425061156 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.275200:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425061156 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.275224:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425061156 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.275231:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7600/0x3139939425061156 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.275375:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967310118400:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 17852us (18850us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147204.275386:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7046 00010000:00010000:1.0:1746147204.279033:0:9589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425061148 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.279058:0:9589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425061148 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.279067:0:9589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425061148 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.279076:0:9589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2bc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147204.279081:0:9589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425061148 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.279124:0:9589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425061148 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.279145:0:9589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425061148 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.279150:0:9589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425061148 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.279241:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2003:x1830967310117888:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 22419us (22754us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147204.279250:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7044 00010000:00010000:3.0:1746147204.281282:0:29479:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800932d6a00/0x3139939425061164 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.281300:0:29479:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d6a00/0x3139939425061164 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.281309:0:29479:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800932d6a00/0x3139939425061164 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.281315:0:29479:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d6a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147204.281319:0:29479:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800932d6a00/0x3139939425061164 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.281326:0:29479:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800932d6a00/0x3139939425061164 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.281344:0:29479:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800932d6a00/0x3139939425061164 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.281355:0:29479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d6a00/0x3139939425061164 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.281443:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967310119040:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 22754us (23037us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147204.281455:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7048 00010000:00010000:1.0:1746147204.284588:0:29476:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880096e3ec00/0x313993942506115d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.284604:0:29476:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096e3ec00/0x313993942506115d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.284616:0:29476:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096e3ec00/0x313993942506115d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.284624:0:29476:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096e3ec00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147204.284628:0:29476:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096e3ec00/0x313993942506115d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.284635:0:29476:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096e3ec00/0x313993942506115d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.284655:0:29476:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096e3ec00/0x313993942506115d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.284660:0:29476:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e3ec00/0x313993942506115d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.284746:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967310118784:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 26238us (26375us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147204.284756:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7047 00010000:00010000:3.0:1746147204.287420:0:13302:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x313993942506116b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.287436:0:13302:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x313993942506116b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.287443:0:13302:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x313993942506116b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.287450:0:13302:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d94200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147204.287454:0:13302:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x313993942506116b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.287460:0:13302:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x313993942506116b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.287477:0:13302:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x313993942506116b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.287483:0:13302:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x313993942506116b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.287569:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2003:x1830967310119296:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 27401us (27604us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147204.287579:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7049 00000100:00100000:0.0:1746147204.290124:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.290230:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310120064 00000100:00100000:3.0:1746147204.290239:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310120064 00000100:00100000:3.0:1746147204.290278:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16310 00000100:00100000:3.0:1746147204.290285:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2595:x1830967310120064:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147204.290310:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.290328:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x3139939425061179 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e032 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.291233:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425061180 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.291248:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425061180 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.291258:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425061180 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.291268:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425061187 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.291273:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425061187 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.291277:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425061187 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.291378:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506118e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.291390:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ac00/0x3139939425061092 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfbb expref: 8 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.291397:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506118e lrc: 4/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.291428:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ac00/0x3139939425061092 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfbb expref: 8 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.291440:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ac00/0x3139939425061092 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfbb expref: 8 pid: 7239 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.291452:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311361664:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147204.291536:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.294029:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.294140:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311361664:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.294166:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506118e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.294888:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506118e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.294895:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506118e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:3.0:1746147204.294909:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147204.294997:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506118e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295003:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506118e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295013:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506118e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295018:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ff5800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147204.295022:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506118e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295028:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506118e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295037:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147204.295039:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147204.295042:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506118e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295047:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x313993942506118e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295063:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425061180 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295068:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425061180 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295072:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425061180 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295077:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425061180 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147204.295078:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147204.295081:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ff4400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147204.295144:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425061180 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295153:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425061180 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295160:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147204.295162:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147204.295164:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425061180 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295168:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425061180 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295176:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425061187 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295180:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425061187 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295184:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425061187 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295189:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ff4200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147204.295191:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425061187 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295195:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425061187 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295201:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d4c7500) 00010000:00010000:3.0:1746147204.295203:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147204.295205:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425061187 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.295209:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425061187 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00000100:00100000:1.0:1746147204.295220:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310120448 00000100:00100000:1.0:1746147204.295226:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310120448 00000100:00100000:1.0:1746147204.295257:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16311 00000100:00100000:1.0:1746147204.295262:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2582:x1830967310120448:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:1.0:1746147204.295299:0:7239:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147204.295309:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097034400/0x31399394250610f4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfe5 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.295321:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.295324:0:7239:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147204.295353:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x313993942506119c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.295362:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x313993942506119c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.295367:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x313993942506119c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147204.295426:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x3139939425061179 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e032 expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1746147204.295426:0:7239:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8801312ed500 reply state ffff880097d22000 transno 8589937179 ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x313993942506119c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147204.295433:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x3139939425061179 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e032 expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.295434:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x313993942506119c lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.295440:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147204.295441:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff5000, rc 0) 00010000:00010000:1.0:1746147204.295442:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746147204.295444:0:7239:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746147204.295478:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2595:x1830967310120064:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5193us (5353us total) trans 8589937178 rc 301/301 00000100:00100000:3.0:1746147204.295483:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16310 00000100:00100000:1.0:1746147204.295484:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2582:x1830967310120448:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 222us (406us total) trans 8589937179 rc 0/0 00000100:00100000:1.0:1746147204.295490:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16311 00000100:00100000:0.0:1746147204.297270:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.297290:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310120576 00000100:00100000:3.0:1746147204.297296:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310120576 00000100:00100000:3.0:1746147204.297340:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19183 00000100:00100000:3.0:1746147204.297347:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2582:x1830967310120576:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147204.297358:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.297420:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ff4a00/0x31399394250611a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e039 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.297447:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a56a00/0x31399394250610fb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfec expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.297455:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425061125 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e016 expref: 35 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.297461:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.297463:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.297467:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff4a00/0x31399394250611a3 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e039 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.297659:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425061125 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e016 expref: 35 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.297672:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425061125 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e016 expref: 35 pid: 1398 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746147204.297684:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311361792:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.297789:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a56a00/0x31399394250610fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfec expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.297797:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a56a00/0x31399394250610fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfec expref: 14 pid: 9584 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746147204.297804:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e487b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311361920:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147204.297825:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.301198:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.301238:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.301298:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310120832 00000100:00100000:1.0:1746147204.301302:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310120832 00010000:00010000:1.0:1746147204.301322:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425061125 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e016 expref: 36 pid: 1398 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746147204.301353:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8701 00000100:00100000:1.0:1746147204.301361:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967310120832:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.301375:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147204.301396:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425061125 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e016 expref: 36 pid: 1398 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.301407:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425061125 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e016 expref: 36 pid: 1398 timeout: 842 lvb_type: 1 00010000:00010000:1.0:1746147204.301433:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147204.301476:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967310120832:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 115us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.301482:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8701 00010000:00010000:2.0:1746147204.301493:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4a00/0x31399394250611a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e039 expref: 15 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.301506:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff4a00/0x31399394250611a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e039 expref: 15 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.301521:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7c00/0x3139939425061125 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e016 expref: 35 pid: 1398 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746147204.301534:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311361792:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.301544:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a56a00/0x31399394250610fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfec expref: 15 pid: 9584 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746147204.301544:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097ff4a00/0x31399394250611a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e039 expref: 15 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.301551:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e487b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311361920:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147204.301559:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311362048:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147204.301582:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ff4a00/0x31399394250611a3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e039 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.301591:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4a00, rc 0) 00000100:00100000:3.0:1746147204.301612:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2582:x1830967310120576:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4265us (4348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.301618:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19183 00000100:00100000:2.0:1746147204.301619:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.303987:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.304079:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311362048:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147204.304123:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.304164:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310120704:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2730us (2974us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.304176:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8702 00000100:00100000:3.0:1746147204.304252:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310120960 00000100:00100000:3.0:1746147204.304259:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310120960 00000100:00100000:3.0:1746147204.304529:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19184 00000100:00100000:3.0:1746147204.304537:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2582:x1830967310120960:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147204.304554:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.304571:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d7600/0x31399394250611aa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e040 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.304599:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093714200/0x3139939425061110 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dff3 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.304608:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e3fe00/0x313993942506112c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e01d expref: 26 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.304614:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.304616:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.304620:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d7600/0x31399394250611aa lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e040 expref: 13 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.304648:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e3fe00/0x313993942506112c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e01d expref: 26 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.304660:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e3fe00/0x313993942506112c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e01d expref: 26 pid: 9584 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746147204.304672:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e487b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311362176:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.304744:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093714200/0x3139939425061110 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dff3 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.304752:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093714200/0x3139939425061110 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dff3 expref: 13 pid: 1853 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746147204.304760:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311362304:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147204.304791:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.311943:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.312056:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311362304:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147204.312488:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310121088 00000100:00100000:2.0:1746147204.312499:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310121088 00010000:00010000:2.0:1746147204.312534:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093714200/0x3139939425061110 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dff3 expref: 14 pid: 1853 timeout: 842 lvb_type: 1 00000100:00100000:2.0:1746147204.312571:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8703 00000100:00100000:2.0:1746147204.312577:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310121088:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147204.312592:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147204.312610:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093714200/0x3139939425061110 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dff3 expref: 14 pid: 1853 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746147204.312625:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093714200/0x3139939425061110 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dff3 expref: 14 pid: 1853 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746147204.312647:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093714200/0x3139939425061110 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dff3 expref: 14 pid: 1853 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746147204.312664:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.312716:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310121088:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 138us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.312722:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8703 00000100:00100000:0.0:1746147204.313329:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.313375:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310121216 00000100:00100000:3.0:1746147204.313379:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310121216 00010000:00010000:3.0:1746147204.313395:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3fe00/0x313993942506112c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e01d expref: 27 pid: 9584 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746147204.313409:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8704 00000100:00100000:3.0:1746147204.313413:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310121216:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147204.313420:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147204.313428:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e3fe00/0x313993942506112c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e01d expref: 27 pid: 9584 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.313442:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e3fe00/0x313993942506112c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e01d expref: 27 pid: 9584 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.313454:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.313456:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.313462:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7600/0x31399394250611aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e040 expref: 12 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.313469:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d7600/0x31399394250611aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e040 expref: 12 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.313496:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800932d7600/0x31399394250611aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e040 expref: 12 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.313508:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311362432:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147204.313556:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00010000:00010000:3.0:1746147204.313576:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e3fe00/0x313993942506112c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e01d expref: 27 pid: 9584 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746147204.313585:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e487b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311362176:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.313605:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7600/0x31399394250611aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e040 expref: 12 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.313613:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7600, rc 0) 00000100:00100000:3.0:1746147204.313628:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2582:x1830967310120960:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 9093us (9652us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.313634:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19184 00000100:00100000:0.0:1746147204.315827:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.315933:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311362432:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147204.315952:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147204.315986:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310121216:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2571us (2657us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.315995:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8704 00000100:00100000:2.0:1746147204.316189:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310121344 00000100:00100000:2.0:1746147204.316196:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310121344 00000100:00100000:2.0:1746147204.316609:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19185 00000100:00100000:2.0:1746147204.316618:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2582:x1830967310121344:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147204.316637:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.316655:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d42c00/0x31399394250611b1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e047 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.316683:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425061102 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dffa expref: 13 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.316692:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425061133 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e024 expref: 25 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.316697:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.316701:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.316704:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d42c00/0x31399394250611b1 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e047 expref: 13 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.316732:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425061133 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e024 expref: 25 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.316745:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425061133 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e024 expref: 25 pid: 9586 timeout: 842 lvb_type: 1 00000100:00100000:2.0:1746147204.316757:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311362560:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147204.317833:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425061102 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dffa expref: 13 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.317844:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425061102 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dffa expref: 13 pid: 1398 timeout: 842 lvb_type: 1 00000100:00100000:2.0:1746147204.317854:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311362688:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147204.317881:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.321696:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.321865:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311362560:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147204.321879:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311362688:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147204.321910:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d42c00/0x31399394250611b1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e047 expref: 13 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.321930:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d42c00, rc 0) 00000100:00100000:2.0:1746147204.321991:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2582:x1830967310121344:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5373us (6172us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.322000:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19185 00000100:00100000:0.0:1746147204.323227:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.323957:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310121600 00000100:00100000:3.0:1746147204.323966:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310121600 00010000:00010000:3.0:1746147204.324011:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425061102 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dffa expref: 13 pid: 1398 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746147204.324050:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310121472 00000100:00100000:3.0:1746147204.324053:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310121472 00010000:00010000:3.0:1746147204.324065:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425061133 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e024 expref: 26 pid: 9586 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746147204.324104:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8705 00000100:00100000:3.0:1746147204.324113:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2002:x1830967310121600:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147204.324127:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147204.324150:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425061102 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dffa expref: 13 pid: 1398 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.324160:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425061102 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dffa expref: 13 pid: 1398 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.324183:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d6e00/0x3139939425061102 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dffa expref: 13 pid: 1398 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.324200:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147204.324240:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2002:x1830967310121600:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 128us (2555us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.324247:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8705 00000100:00100000:3.0:1746147204.324261:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8706 00000100:00100000:3.0:1746147204.324265:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5237450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967310121472:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147204.324273:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147204.324280:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425061133 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e024 expref: 26 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.324290:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425061133 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e024 expref: 26 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.324301:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425061133 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e024 expref: 26 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.324310:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.324312:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.324319:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d42c00/0x31399394250611b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e047 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.324326:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d42c00/0x31399394250611b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e047 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.324359:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d42c00/0x31399394250611b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e047 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147204.324534:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.324666:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310121728 00000100:00100000:1.0:1746147204.324670:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310121728 00000100:00100000:1.0:1746147204.324700:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16312 00000100:00100000:1.0:1746147204.324705:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2595:x1830967310121728:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147204.324726:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.324740:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3f600/0x31399394250611b8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e04e expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.324797:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3f600/0x31399394250611b8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e04e expref: 9 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.324808:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3f600/0x31399394250611b8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e04e expref: 9 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.325004:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.325007:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147204.325011:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3f600, rc 0) 00000100:00100000:1.0:1746147204.325038:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2595:x1830967310121728:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 332us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.325044:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16312 00000100:00100000:3.0:1746147204.325303:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311362816:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147204.325375:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147204.328671:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311362816:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147204.328697:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147204.328757:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5237450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310121472:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4490us (5532us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.328768:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8706 00000100:00100000:2.0:1746147204.329294:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.329442:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310121856 00000100:00100000:0.0:1746147204.329449:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310121856 00000100:00100000:0.0:1746147204.329482:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19186 00000100:00100000:0.0:1746147204.329488:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2582:x1830967310121856:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147204.329504:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147204.329521:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x31399394250611bf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e055 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.329549:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932d6000/0x3139939425061117 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e001 expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147204.329558:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e3f000/0x313993942506113a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e02b expref: 34 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147204.329563:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147204.329565:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147204.329568:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x31399394250611bf lrc: 5/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e055 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.329596:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e3f000/0x313993942506113a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e02b expref: 34 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147204.329607:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e3f000/0x313993942506113a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e02b expref: 34 pid: 9586 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746147204.329618:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311362944:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147204.329679:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800932d6000/0x3139939425061117 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e001 expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147204.329686:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800932d6000/0x3139939425061117 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e001 expref: 14 pid: 17600 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746147204.329694:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311363072:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147204.329712:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147204.330387:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.330466:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310122112 00000100:00100000:1.0:1746147204.330471:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310122112 00000100:00100000:1.0:1746147204.330503:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16313 00000100:00100000:1.0:1746147204.330508:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2595:x1830967310122112:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147204.330518:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.330521:0:7237:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746147204.330543:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3f600/0x31399394250611b8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e04e expref: 9 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.331030:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.331035:0:7237:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147204.331047:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3fc00/0x31399394250611c6 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e05c expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.331105:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3e800/0x31399394250611cd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.331118:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x31399394250610df lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfd7 expref: 27 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.331125:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715800/0x31399394250610e6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfde expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.331130:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3e800/0x31399394250611cd lrc: 5/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.331156:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093715800/0x31399394250610e6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfde expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.331165:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715800/0x31399394250610e6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfde expref: 8 pid: 7237 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.331174:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311363200:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147204.331232:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x31399394250610df lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfd7 expref: 27 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.331240:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x31399394250610df lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfd7 expref: 27 pid: 7239 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.331247:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311363328:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147204.331266:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147204.337664:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.337766:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311363200:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147204.338022:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311362944:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147204.338031:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311363072:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147204.338065:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x31399394250611bf lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e055 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.338082:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cd2200, rc 0) 00000100:00100000:0.0:1746147204.338148:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2582:x1830967310121856:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 8660us (8854us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.338161:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19186 00000100:00100000:1.0:1746147204.338452:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.339274:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.339875:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.339891:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310122368 00000100:00100000:3.0:1746147204.339897:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310122368 00010000:00010000:3.0:1746147204.339929:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d6000/0x3139939425061117 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e001 expref: 14 pid: 17600 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746147204.340434:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310122240 00000100:00100000:3.0:1746147204.340437:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310122240 00010000:00010000:3.0:1746147204.340449:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e3f000/0x313993942506113a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e02b expref: 35 pid: 9586 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746147204.340462:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310122496 00000100:00100000:3.0:1746147204.340464:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310122496 00010000:00010000:3.0:1746147204.340473:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093715800/0x31399394250610e6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfde expref: 9 pid: 7237 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.340480:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310122624 00000100:00100000:3.0:1746147204.340481:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310122624 00010000:00010000:3.0:1746147204.340488:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x31399394250610df lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfd7 expref: 28 pid: 7239 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.340501:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8707 00000100:00100000:3.0:1746147204.340507:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2002:x1830967310122368:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147204.340519:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147204.340538:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800932d6000/0x3139939425061117 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e001 expref: 14 pid: 17600 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.340547:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800932d6000/0x3139939425061117 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e001 expref: 14 pid: 17600 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.340568:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d6000/0x3139939425061117 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e001 expref: 14 pid: 17600 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.340583:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.340622:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8708 00000100:00100000:2.0:1746147204.340629:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967310122240:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147204.340635:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147204.340641:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e3f000/0x313993942506113a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e02b expref: 35 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746147204.340651:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e3f000/0x313993942506113a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e02b expref: 35 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746147204.340663:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e3f000/0x313993942506113a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e02b expref: 35 pid: 9586 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746147204.340676:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.340678:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.340685:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x31399394250611bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e055 expref: 13 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.340692:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x31399394250611bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e055 expref: 13 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.340726:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x31399394250611bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e055 expref: 13 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.340742:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311363456:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147204.340871:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8709 00000100:00100000:1.0:1746147204.340879:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2002:x1830967310122496:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.340887:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147204.340892:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093715800/0x31399394250610e6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfde expref: 9 pid: 7237 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.340899:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093715800/0x31399394250610e6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfde expref: 9 pid: 7237 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.340911:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715800/0x31399394250610e6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfde expref: 9 pid: 7237 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.340927:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.340932:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3e800/0x31399394250611cd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.340940:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3e800/0x31399394250611cd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.340944:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147204.341166:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8710 00000100:00100000:0.0:1746147204.341173:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310122624:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147204.341179:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147204.341183:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x31399394250610df lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfd7 expref: 28 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.341193:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x31399394250610df lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfd7 expref: 28 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.341202:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147204.341205:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3e800/0x31399394250611cd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.341210:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3e800/0x31399394250611cd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.341215:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3e800/0x31399394250611cd lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.341225:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.341280:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962600 going to sleep for 11 seconds 00010000:00010000:2.0:1746147204.341308:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x31399394250610df lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfd7 expref: 28 pid: 7239 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.341316:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311363328:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147204.341333:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3e800/0x31399394250611cd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.341339:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3e800/0x31399394250611cd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.341344:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3e800/0x31399394250611cd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000040:00080000:2.0:1746147204.341604:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1154, 88 off109400 00000004:00080000:2.0:1746147204.341609:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742331519243ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147204.341635:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1165, 88 off110368 00000004:00080000:2.0:1746147204.341638:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742331548035ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147204.341649:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1166, 88 off110456 00000004:00080000:2.0:1746147204.341651:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742331561865ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147204.341659:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1155, 88 off109488 00000004:00080000:2.0:1746147204.341661:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742331571881ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147204.341668:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1156, 88 off109576 00000004:00080000:2.0:1746147204.341670:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742331581073ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147204.341677:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1167, 88 off110544 00000004:00080000:2.0:1746147204.341680:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742331590182ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147204.341795:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1168, 88 off110632 00000004:00080000:2.0:1746147204.341799:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742331710022ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147204.341810:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1169, 88 off110720 00000004:00080000:2.0:1746147204.341813:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742331723336ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147204.341821:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1157, 88 off109664 00000004:00080000:2.0:1746147204.341823:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742331733582ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147204.341829:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1170, 88 off110808 00000004:00080000:2.0:1746147204.341831:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742331742115ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147204.341838:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1158, 88 off109752 00000004:00080000:2.0:1746147204.341840:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742331750602ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147204.341846:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1171, 88 off110896 00000004:00080000:2.0:1746147204.341848:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742331758462ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147204.341855:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1159, 88 off109840 00000004:00080000:2.0:1746147204.341857:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742331767582ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147204.341864:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1160, 88 off109928 00000004:00080000:2.0:1746147204.341867:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742331777412ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147204.341874:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1161, 88 off110016 00000004:00080000:2.0:1746147204.341876:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742331786933ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147204.341883:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1162, 88 off110104 00000004:00080000:2.0:1746147204.341885:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742331795631ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147204.341892:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1172, 88 off110984 00000004:00080000:2.0:1746147204.341895:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742331805872ns, next at 694367916532ns, rc = 0 00000100:00100000:1.0:1746147204.342323:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2002:x1830967310122496:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1442us (3046us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.342331:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8709 00000100:00100000:0.0:1746147204.342835:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310122624:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1662us (2959us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.342843:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8710 00000100:00100000:2.0:1746147204.343005:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2002:x1830967310122368:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2496us (5350us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.343011:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8707 00000100:00100000:1.0:1746147204.344336:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.344398:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310122752 00000100:00100000:0.0:1746147204.344405:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310122752 00000001:00080000:3.0:1746147204.344426:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937180 is committed 00000004:00080000:3.0:1746147204.344431:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1150 committed 00000100:00100000:0.0:1746147204.344437:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19187 00000004:00080000:3.0:1746147204.344438:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1143 committed 00000004:00080000:3.0:1746147204.344443:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1142 committed 00000100:00100000:0.0:1746147204.344443:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2582:x1830967310122752:12345-192.168.204.25@tcp:101:lfs.0 00000004:00080000:3.0:1746147204.344445:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1141 committed 00000004:00080000:3.0:1746147204.344446:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1140 committed 00000004:00080000:3.0:1746147204.344449:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1149 committed 00000004:00080000:3.0:1746147204.344450:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1139 committed 00000004:00080000:3.0:1746147204.344452:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1148 committed 00000004:00080000:3.0:1746147204.344453:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1138 committed 00000004:00080000:3.0:1746147204.344454:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1147 committed 00000004:00080000:3.0:1746147204.344455:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1146 committed 00000004:00080000:3.0:1746147204.344457:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1145 committed 00000004:00080000:3.0:1746147204.344459:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1137 committed 00000004:00080000:3.0:1746147204.344461:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1136 committed 00010000:00010000:0.0:1746147204.344462:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:3.0:1746147204.344463:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1144 committed 00000004:00080000:3.0:1746147204.344464:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1143 committed 00000004:00080000:3.0:1746147204.344466:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1135 committed 00000001:00080000:3.0:1746147204.344475:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937179 is committed 00010000:00010000:0.0:1746147204.344479:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x31399394250611d4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e063 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1746147204.344481:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937177 is committed 00010000:00010000:0.0:1746147204.344504:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097034000/0x31399394250610d8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfd0 expref: 34 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.344512:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x3139939425061109 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e008 expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147204.344517:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147204.344519:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147204.344524:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x31399394250611d4 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e063 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147204.344535:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147204.344547:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311363584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147204.344573:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311364096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147204.344582:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147204.344593:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147204.344603:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311363968:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147204.344613:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311363840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147204.344616:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147204.344625:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311364480:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147204.344629:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147204.344637:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147204.344638:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311364352:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147204.344650:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147204.344655:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311363584 00000100:00100000:0.0:1746147204.344657:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311363584 00000100:00100000:3.0:1746147204.344658:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746147204.344661:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311363712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147204.344675:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147204.344687:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311364224:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147204.344700:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147204.344717:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311364096 00000100:00100000:3.0:1746147204.344720:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311364096 00000100:00100000:3.0:1746147204.344735:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311363968 00000100:00100000:3.0:1746147204.344737:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311363968 00000100:00100000:3.0:1746147204.344747:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311363840 00000100:00100000:3.0:1746147204.344749:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311363840 00000100:00100000:3.0:1746147204.344757:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311364480 00000100:00100000:3.0:1746147204.344759:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311364480 00000100:00100000:3.0:1746147204.344764:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311364352 00000100:00100000:3.0:1746147204.344766:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311364352 00000100:00100000:3.0:1746147204.344771:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311363712 00000100:00100000:0.0:1746147204.344772:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311364224 00000100:00100000:3.0:1746147204.344785:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311363712 00000100:00100000:0.0:1746147204.344787:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311364224 00000100:00100000:3.0:1746147204.344795:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19188 00000100:00100000:0.0:1746147204.344864:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19189 00000100:00100000:0.0:1746147204.344870:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3764:x1830967311363968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147204.344963:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3765:x1830967311364096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147204.344974:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147204.344977:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147204.344979:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147204.344981:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147204.344983:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:0.0:1746147204.345008:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3764:x1830967311363968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 138us (390us total) trans 21474842470 rc 0/0 00000100:00100000:0.0:1746147204.345014:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19189 00000100:00100000:3.0:1746147204.345018:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3765:x1830967311364096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 219us (424us total) trans 21474842471 rc 0/0 00000100:00100000:3.0:1746147204.345023:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19188 00000100:00100000:0.0:1746147204.345026:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19190 00000100:00100000:3.0:1746147204.345030:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19191 00000100:00100000:0.0:1746147204.345030:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3767:x1830967311363840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147204.345034:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3764:x1830967311364480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147204.345070:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:3.0:1746147204.345073:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147204.345074:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147204.345076:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147204.345077:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000004:00080000:0.0:1746147204.345079:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e487480/2, rc 0, transno 21474842470 00000100:00100000:0.0:1746147204.345086:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311363968:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147204.345111:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3764:x1830967311364480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (473us total) trans 21474842473 rc 0/0 00000004:00080000:0.0:1746147204.345111:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d74380/2, rc 0, transno 21474842473 00000100:00100000:0.0:1746147204.345114:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311364480:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147204.345116:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19191 00000100:00100000:3.0:1746147204.345126:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19192 00000100:00100000:3.0:1746147204.345129:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3764:x1830967311363584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147204.345134:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147204.345140:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311364608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147204.345156:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746147204.345166:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147204.345168:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147204 -> 1746147204 00002000:00010000:3.0:1746147204.345170:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147204 -> 1746147204 00002000:00010000:3.0:1746147204.345172:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147204 -> 1746147204 00002000:00010000:3.0:1746147204.345173:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00002000:00010000:0.0:1746147204.345175:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:0.0:1746147204.345177:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147203 -> 1746147203 00002000:00010000:0.0:1746147204.345178:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147203 -> 1746147203 00002000:00010000:0.0:1746147204.345180:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147203 -> 1746147203 00002000:00010000:0.0:1746147204.345182:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:3.0:1746147204.345191:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3764:x1830967311363584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (608us total) trans 21474842474 rc 0/0 00000100:00100000:3.0:1746147204.345196:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19192 00000100:00100000:0.0:1746147204.345196:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3767:x1830967311363840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 166us (566us total) trans 21474842472 rc 0/0 00000100:00100000:0.0:1746147204.345200:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19190 00000100:00100000:3.0:1746147204.345205:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311364608 00000100:00100000:3.0:1746147204.345207:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311364608 00000100:00100000:0.0:1746147204.345207:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19193 00000100:00100000:0.0:1746147204.345211:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3767:x1830967311364352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147204.345216:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19194 00000100:00100000:3.0:1746147204.345219:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3767:x1830967311363712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147204.345245:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147204.345247:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147204.345248:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147204.345249:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147201 -> 1746147201 00002000:00010000:0.0:1746147204.345249:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147204.345251:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147201 -> 1746147201 00002000:00010000:0.0:1746147204.345251:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147204.345252:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147201 -> 1746147201 00002000:00010000:0.0:1746147204.345253:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00002000:00010000:3.0:1746147204.345254:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147204.345268:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+42:3767:x1830967311363712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (593us total) trans 21474842476 rc 0/0 00000100:00100000:0.0:1746147204.345268:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3767:x1830967311364352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (617us total) trans 21474842475 rc 0/0 00000100:00100000:3.0:1746147204.345273:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19194 00000100:00100000:2.0:1746147204.345305:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19195 00000100:00100000:2.0:1746147204.345313:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3767:x1830967311364224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147204.345383:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3767:x1830967311364224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (682us total) trans 21474842477 rc 0/0 00000100:00100000:2.0:1746147204.345388:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19195 00000100:00100000:2.0:1746147204.345397:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19196 00000100:00100000:2.0:1746147204.345401:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3764:x1830967311364608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147204.345453:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3764:x1830967311364608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (295us total) trans 21474842478 rc 0/0 00000100:00100000:2.0:1746147204.345457:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19196 00000100:00100000:2.0:1746147204.345486:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311363456:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147204.345502:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.345533:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967310122240:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4904us (7081us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.345541:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8708 00010000:00010000:2.0:1746147204.345596:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3e800/0x31399394250611cd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e05c expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.345606:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147204.345609:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746147204.345624:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3fc00/0x31399394250611c6 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e05c expref: 9 pid: 7237 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746147204.345639:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3e800/0x31399394250611cd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e05c expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.345663:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147204.345665:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746147204.345668:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3e800, rc 0) 00000100:00100000:2.0:1746147204.345689:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2595:x1830967310122112:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 15181us (15304us total) trans 8589937180 rc 0/0 00000100:00100000:2.0:1746147204.345697:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16313 00010000:00010000:1.0:1746147204.346021:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x313993942506119c lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.346029:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x313993942506119c lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.346035:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x313993942506119c lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.346041:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096e3ea00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147204.346045:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x313993942506119c lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.346052:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x313993942506119c lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.346065:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.346067:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147204.346070:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x313993942506119c lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.346074:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x313993942506119c lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00000100:00100000:3.0:1746147204.346168:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311365120:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147204.346190:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147204.346203:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311365632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147204.346216:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147204.346221:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19193 00000100:00100000:0.0:1746147204.346230:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311365120 00000004:00080000:3.0:1746147204.346231:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e485f80/2, rc 0, transno 21474842471 00000100:00100000:0.0:1746147204.346233:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311365120 00000100:00100000:3.0:1746147204.346234:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311364096:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147204.346239:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746147204.346243:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311364992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147204.346246:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311365632 00000100:00100000:0.0:1746147204.346248:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311365632 00000100:00100000:0.0:1746147204.346259:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19197 00000100:00100000:3.0:1746147204.346262:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147204.346263:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3765:x1830967311365120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147204.346271:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311365504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147204.346286:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147204.346299:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311364992 00000100:00100000:3.0:1746147204.346302:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311364992 00000100:00100000:2.0:1746147204.346312:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311364736:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147204.346314:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311365504 00000100:00100000:3.0:1746147204.346316:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311365504 00000100:00100000:3.0:1746147204.346325:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19198 00002000:00010000:0.0:1746147204.346326:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147204.346328:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00000100:00100000:3.0:1746147204.346329:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3765:x1830967311365632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147204.346330:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147204.346332:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147204.346334:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746147204.346368:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3765:x1830967311365120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (177us total) trans 17179875089 rc 0/0 00000100:00100000:0.0:1746147204.346372:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19197 00000100:00100000:0.0:1746147204.346381:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19199 00000100:00100000:0.0:1746147204.346385:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3765:x1830967311364992:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147204.346424:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147204.346426:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147203 -> 1746147203 00002000:00010000:0.0:1746147204.346428:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147203 -> 1746147203 00002000:00010000:0.0:1746147204.346430:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147203 -> 1746147203 00002000:00010000:0.0:1746147204.346431:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746147204.346514:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19200 00000100:00100000:1.0:1746147204.346521:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3765:x1830967311365504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147204.347134:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3765:x1830967311365632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 804us (916us total) trans 17179875090 rc 0/0 00000100:00100000:3.0:1746147204.347140:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19198 00000100:00100000:2.0:1746147204.347140:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147204.347173:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009689a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311365248:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147204.347192:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147204.347225:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3765:x1830967311364992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 839us (961us total) trans 17179875091 rc 0/0 00000100:00100000:0.0:1746147204.347231:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19199 00000100:00100000:1.0:1746147204.347243:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3765:x1830967311365504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 723us (955us total) trans 17179875092 rc 0/0 00000100:00100000:1.0:1746147204.347251:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19200 00000100:00100000:3.0:1746147204.347271:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311364736 00000100:00100000:0.0:1746147204.347273:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311365248 00000100:00100000:3.0:1746147204.347274:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311364736 00000100:00100000:0.0:1746147204.347275:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311365248 00000100:00100000:3.0:1746147204.347285:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19201 00000100:00100000:2.0:1746147204.347287:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746147204.347288:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19202 00000100:00100000:3.0:1746147204.347289:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3766:x1830967311365248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147204.347291:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3766:x1830967311364736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147204.347293:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311364864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147204.347310:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147204.347318:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311365376:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147204.347327:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311364864 00000100:00100000:2.0:1746147204.347329:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147204.347330:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311364864 00002000:00010000:0.0:1746147204.347333:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147204.347335:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147203 -> 1746147203 00002000:00010000:0.0:1746147204.347336:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147203 -> 1746147203 00002000:00010000:0.0:1746147204.347338:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147203 -> 1746147203 00000100:00100000:3.0:1746147204.347339:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311365376 00002000:00010000:0.0:1746147204.347340:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147204.347341:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311365376 00000100:00100000:3.0:1746147204.347351:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19203 00000100:00100000:3.0:1746147204.347354:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3766:x1830967311364864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147204.347357:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19204 00000100:00100000:0.0:1746147204.347363:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3766:x1830967311364736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (225us total) trans 17179875094 rc 0/0 00000100:00100000:2.0:1746147204.347368:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3766:x1830967311365376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147204.347368:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19202 00000004:00080000:0.0:1746147204.347393:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e487b80/2, rc 0, transno 21474842476 00002000:00010000:3.0:1746147204.347394:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147204.347396:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147201 -> 1746147201 00002000:00010000:3.0:1746147204.347397:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147200 -> 1746147200 00000100:00100000:0.0:1746147204.347397:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311363712:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147204.347399:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147201 -> 1746147201 00002000:00010000:3.0:1746147204.347401:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000004:00080000:0.0:1746147204.347404:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e484380/2, rc 0, transno 21474842477 00000100:00100000:0.0:1746147204.347406:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311364224:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147204.347415:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e485500/2, rc 0, transno 21474842472 00000100:00100000:0.0:1746147204.347418:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311363840:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147204.347419:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3766:x1830967311364864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (109us total) trans 17179875095 rc 0/0 00000100:00100000:3.0:1746147204.347424:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19203 00000004:00080000:0.0:1746147204.347424:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312edc00/2, rc 0, transno 21474842475 00000100:00100000:0.0:1746147204.347426:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311364352:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147204.347441:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbc0e00/2, rc 0, transno 21474842478 00000100:00100000:0.0:1746147204.347443:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311364608:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147204.347445:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096899180/2, rc 0, transno 17179875091 00000100:00100000:3.0:1746147204.347448:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311364992:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147204.347450:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e485c00/2, rc 0, transno 21474842474 00000100:00100000:0.0:1746147204.347452:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311363584:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147204.347454:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096898000/2, rc 0, transno 17179875092 00000100:00100000:3.0:1746147204.347457:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311365504:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147204.347462:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096898a80/2, rc 0, transno 17179875089 00000100:00100000:3.0:1746147204.347464:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311365120:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147204.347469:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096899880/2, rc 0, transno 17179875090 00000100:00100000:3.0:1746147204.347472:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311365632:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147204.347480:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00010000:00010000:0.0:1746147204.347482:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x3139939425061109 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e008 expref: 14 pid: 17600 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746147204.347483:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:2.0:1746147204.347485:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147204.347487:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:2.0:1746147204.347488:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00010000:00010000:0.0:1746147204.347494:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x3139939425061109 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e008 expref: 14 pid: 17600 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746147204.347505:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311365760:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147204.347508:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3766:x1830967311365248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 219us (315us total) trans 17179875093 rc 0/0 00000100:00100000:3.0:1746147204.347512:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19201 00000100:00100000:2.0:1746147204.347519:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3766:x1830967311365376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 154us (188us total) trans 17179875096 rc 0/0 00000100:00100000:2.0:1746147204.347526:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19204 00010000:00010000:0.0:1746147204.347565:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097034000/0x31399394250610d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfd0 expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746147204.347566:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909f9f80/2, rc 0, transno 17179875095 00000100:00100000:2.0:1746147204.347572:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311364864:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746147204.347574:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097034000/0x31399394250610d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfd0 expref: 33 pid: 1853 timeout: 842 lvb_type: 0 00000004:00080000:2.0:1746147204.347582:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096898700/2, rc 0, transno 17179875096 00000100:00100000:0.0:1746147204.347582:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311365888:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147204.347585:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311365376:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147204.347593:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909f8e00/2, rc 0, transno 17179875094 00000100:00100000:2.0:1746147204.347596:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311364736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147204.347602:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8540 going to sleep for 11 seconds 00000004:00080000:2.0:1746147204.347603:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009689a300/2, rc 0, transno 17179875093 00000100:00100000:2.0:1746147204.347605:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009689a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311365248:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147204.348947:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311365760:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147204.348960:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311365888:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147204.348984:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x31399394250611d4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e063 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.348998:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ff6200, rc 0) 00000100:00100000:2.0:1746147204.349048:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2582:x1830967310122752:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4604us (4714us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.349054:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19187 00000100:00100000:0.0:1746147204.352614:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.352822:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310122880 00000100:00100000:2.0:1746147204.352832:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310122880 00010000:00010000:2.0:1746147204.352873:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x3139939425061109 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e008 expref: 14 pid: 17600 timeout: 842 lvb_type: 1 00000100:00100000:2.0:1746147204.352916:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8711 00000100:00100000:2.0:1746147204.352924:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310122880:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147204.352938:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147204.353267:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x3139939425061109 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e008 expref: 14 pid: 17600 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746147204.353281:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x3139939425061109 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e008 expref: 14 pid: 17600 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746147204.353307:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x3139939425061109 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e008 expref: 14 pid: 17600 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746147204.353327:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.353381:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310122880:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 457us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.353388:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8711 00000100:00100000:0.0:1746147204.354785:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.354829:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310123008 00000100:00100000:2.0:1746147204.354835:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310123008 00010000:00010000:2.0:1746147204.354857:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097034000/0x31399394250610d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfd0 expref: 34 pid: 1853 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.354888:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8712 00000100:00100000:2.0:1746147204.354895:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967310123008:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147204.354905:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147204.354918:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097034000/0x31399394250610d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfd0 expref: 34 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.354929:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097034000/0x31399394250610d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfd0 expref: 34 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.354946:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097034000/0x31399394250610d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfd0 expref: 34 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.354957:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.354960:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.354968:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x31399394250611d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e063 expref: 12 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.354975:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x31399394250611d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e063 expref: 12 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.355162:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x31399394250611d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e063 expref: 12 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.355174:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311366016:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147204.355238:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.357040:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.357128:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310123136 00000100:00100000:2.0:1746147204.357133:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310123136 00000100:00100000:2.0:1746147204.357379:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19205 00000100:00100000:2.0:1746147204.357386:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2595:x1830967310123136:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147204.357401:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147204.357406:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147204.357417:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e06a expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.357438:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7600/0x31399394250611aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e040 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.357444:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147204.357446:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147204.357449:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1323008->1769471] (req 1323008->1769471) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 10 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.357458:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311366016:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147204.357474:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800932d7600/0x31399394250611aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e040 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.357475:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147204.357485:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7600/0x31399394250611aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e040 expref: 11 pid: 1853 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.357496:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311366144:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147204.357720:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310123264 00000100:00100000:1.0:1746147204.357725:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310123264 00000100:00100000:3.0:1746147204.357734:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967310123008:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2838us (2961us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.357743:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8712 00000100:00100000:1.0:1746147204.357749:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19206 00000100:00100000:1.0:1746147204.357755:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2582:x1830967310123264:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147204.357762:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.357770:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250611e2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e071 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.357794:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250610ca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2478080->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfc9 expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.357801:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x313993942506111e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e00f expref: 13 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.357816:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.357817:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.357820:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250611e2 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e071 expref: 13 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.357839:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x313993942506111e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e00f expref: 13 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.357847:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x313993942506111e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e00f expref: 13 pid: 17600 timeout: 842 lvb_type: 1 00000100:00100000:1.0:1746147204.357855:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009689aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311366272:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147204.358012:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1500c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147204.358067:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250610ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2478080->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfc9 expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.358076:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250610ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2478080->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfc9 expref: 24 pid: 12201 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.358085:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096899500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311366400:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147204.358174:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147204.359693:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311366144:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147204.359714:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1323008->1769471] (req 1323008->1769471) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 10 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.359726:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43e00, rc 0) 00000100:00100000:1.0:1746147204.359827:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009689aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311366272:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147204.359955:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2595:x1830967310123136:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2568us (2918us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.359962:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19205 00000100:00100000:1.0:1746147204.360384:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.360441:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310123392 00000100:00100000:3.0:1746147204.360447:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310123392 00010000:00010000:3.0:1746147204.360470:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x313993942506111e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e00f expref: 14 pid: 17600 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746147204.360489:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8713 00000100:00100000:3.0:1746147204.360494:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5237850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310123392:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147204.360504:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147204.360521:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x313993942506111e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e00f expref: 14 pid: 17600 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.360531:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x313993942506111e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e00f expref: 14 pid: 17600 timeout: 842 lvb_type: 1 00010000:00010000:3.0:1746147204.360552:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x313993942506111e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e00f expref: 14 pid: 17600 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746147204.360558:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096899500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311366400:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147204.360574:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250611e2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e071 expref: 13 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.360577:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147204.360583:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f212600, rc 0) 00000100:00100000:3.0:1746147204.360602:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5237850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310123392:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 108us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.360602:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2582:x1830967310123264:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2848us (3197us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.360607:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8713 00000100:00100000:0.0:1746147204.360609:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19206 00000100:00100000:2.0:1746147204.365424:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.365513:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310123520 00000100:00100000:1.0:1746147204.365523:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310123520 00010000:00010000:1.0:1746147204.365562:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250610ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2478080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfc9 expref: 25 pid: 12201 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.365607:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8714 00000100:00100000:1.0:1746147204.365615:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310123520:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.365631:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147204.365653:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250610ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2478080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfc9 expref: 25 pid: 12201 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.365664:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250610ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2478080->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfc9 expref: 25 pid: 12201 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.365689:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093715000/0x31399394250610ca lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2478080->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7dfc9 expref: 25 pid: 12201 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.365710:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.365712:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.365719:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250611e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e071 expref: 11 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.365728:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250611e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e071 expref: 11 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.365767:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250611e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e071 expref: 11 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.365789:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009689b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311366528:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147204.365877:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147204.373490:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009689b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311366528:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147204.373509:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147204.373606:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.373658:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310123776 00000100:00100000:0.0:1746147204.373664:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310123776 00000100:00100000:2.0:1746147204.373849:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310123520:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8233us (8435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.373858:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8714 00000100:00100000:0.0:1746147204.373927:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19207 00000100:00100000:0.0:1746147204.373933:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310123776:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147204.374049:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147204.374052:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147203 -> 1746147203 00002000:00010000:0.0:1746147204.374054:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147203 -> 1746147203 00002000:00010000:0.0:1746147204.374055:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147203 -> 1746147204 00002000:00010000:0.0:1746147204.374057:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147204.374310:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.374337:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.374351:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310124032 00000100:00100000:1.0:1746147204.374354:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310124032 00000100:00100000:1.0:1746147204.374370:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310124288 00000100:00100000:1.0:1746147204.374372:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310124288 00000100:00100000:1.0:1746147204.374383:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19208 00000100:00100000:1.0:1746147204.374388:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2003:x1830967310124032:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147204.374447:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147204.374449:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147201 -> 1746147203 00002000:00010000:1.0:1746147204.374451:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147201 -> 1746147203 00002000:00010000:1.0:1746147204.374453:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147201 -> 1746147204 00002000:00010000:1.0:1746147204.374454:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147204.374476:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967310124032:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 87us (166us total) trans 21474842479 rc 0/0 00000100:00100000:1.0:1746147204.374482:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19208 00000100:00100000:1.0:1746147204.374492:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19209 00000100:00100000:1.0:1746147204.374497:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967310124288:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147204.374538:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147204.374540:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147203 -> 1746147203 00002000:00010000:1.0:1746147204.374541:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147203 -> 1746147203 00002000:00010000:1.0:1746147204.374543:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147203 -> 1746147204 00002000:00010000:1.0:1746147204.374544:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746147204.374561:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967310124288:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 64us (223us total) trans 17179875098 rc 0/0 00000100:00100000:1.0:1746147204.374569:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19209 00000100:00100000:1.0:1746147204.374596:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.374607:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310123648 00000100:00100000:1.0:1746147204.374610:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310123648 00000100:00100000:1.0:1746147204.374624:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19210 00000100:00100000:1.0:1746147204.374628:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967310123648:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147204.374666:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147204.374668:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147204 -> 1746147203 00002000:00010000:1.0:1746147204.374669:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147204 -> 1746147203 00002000:00010000:1.0:1746147204.374671:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147204 -> 1746147204 00002000:00010000:1.0:1746147204.374673:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:1.0:1746147204.374689:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967310123648:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 60us (92us total) trans 21474842480 rc 0/0 00000100:00100000:1.0:1746147204.374694:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19210 00000100:00100000:1.0:1746147204.374733:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.374749:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310123904 00000100:00100000:2.0:1746147204.374753:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310123904 00000100:00100000:1.0:1746147204.374772:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.374785:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19211 00000100:00100000:2.0:1746147204.374791:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967310123904:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:1.0:1746147204.374791:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310124160 00000100:00100000:1.0:1746147204.374793:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310124160 00000100:00100000:1.0:1746147204.374807:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19212 00000100:00100000:1.0:1746147204.374812:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967310124160:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:2.0:1746147204.374840:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147204.374843:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147201 -> 1746147203 00002000:00010000:2.0:1746147204.374844:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147200 -> 1746147203 00002000:00010000:2.0:1746147204.374846:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147201 -> 1746147204 00002000:00010000:2.0:1746147204.374848:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:1.0:1746147204.374851:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:1.0:1746147204.374853:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147203 -> 1746147203 00002000:00010000:1.0:1746147204.374855:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147203 -> 1746147203 00002000:00010000:1.0:1746147204.374857:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147203 -> 1746147204 00002000:00010000:1.0:1746147204.374858:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:2.0:1746147204.374865:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2003:x1830967310123904:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 75us (132us total) trans 17179875099 rc 0/0 00000100:00100000:2.0:1746147204.374871:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19211 00000100:00100000:1.0:1746147204.374876:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2003:x1830967310124160:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 64us (104us total) trans 21474842481 rc 0/0 00000100:00100000:1.0:1746147204.374882:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19212 00000100:00100000:0.0:1746147204.375127:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967310123776:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 1192us (1712us total) trans 17179875097 rc 0/0 00000100:00100000:0.0:1746147204.375132:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19207 00000100:00100000:0.0:1746147204.381618:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.381720:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310124544 00000100:00100000:2.0:1746147204.381728:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310124544 00000100:00100000:2.0:1746147204.381768:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16314 00000100:00100000:2.0:1746147204.381786:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2598:x1830967310124544:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147204.381808:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.381825:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43c00/0x31399394250611e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e078 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.381889:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250611f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.381900:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250611f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.381908:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250611f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.381922:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250611f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.381927:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250611f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.381931:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250611f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382017:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250611fe lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382024:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250611fe lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382029:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250611fe lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:2.0:1746147204.382037:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147204.382138:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250611fe lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382144:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250611fe lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382149:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250611fe lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382153:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d43000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147204.382157:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250611fe lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382162:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250611fe lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382170:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147204.382173:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147204.382176:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250611fe lrc: 2/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382180:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250611fe lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382202:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250611f0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382210:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250611f0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382214:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250611f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382218:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250611f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382221:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d42600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147204.382223:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250611f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382227:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250611f0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382232:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147204.382234:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147204.382236:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250611f0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382240:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250611f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382248:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250611f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382252:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250611f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382256:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250611f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382259:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d43800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147204.382261:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250611f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382264:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250611f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382269:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096bb1300) 00010000:00010000:2.0:1746147204.382271:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147204.382272:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250611f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382276:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250611f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.382304:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43c00/0x31399394250611e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e078 expref: 28 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.382310:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43c00/0x31399394250611e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e078 expref: 28 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.382316:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43c00, rc 0) 00000100:00100000:2.0:1746147204.382372:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2598:x1830967310124544:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 597us (761us total) trans 8589937181 rc 301/301 00000100:00100000:2.0:1746147204.382379:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16314 00000100:00100000:0.0:1746147204.393331:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.393423:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.393499:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310124800 00000100:00100000:3.0:1746147204.393509:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310124800 00010000:00010000:3.0:1746147204.393547:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d7600/0x31399394250611aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e040 expref: 15 pid: 1853 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.393569:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310124672 00000100:00100000:2.0:1746147204.393576:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310124672 00000100:00100000:3.0:1746147204.393581:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8715 00000100:00100000:3.0:1746147204.393588:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2002:x1830967310124800:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147204.393601:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147204.393618:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800932d7600/0x31399394250611aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e040 expref: 15 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.393630:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800932d7600/0x31399394250611aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e040 expref: 15 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.393650:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7600/0x31399394250611aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e040 expref: 15 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.393667:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.393670:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.393676:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->1769471) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.393683:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->1769471) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.393712:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->1769471) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.393717:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16315 00000100:00100000:3.0:1746147204.393723:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311366656:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147204.393725:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+6:2582:x1830967310124672:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147204.393747:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.393767:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43c00/0x313993942506120c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e07f expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.393827:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ae40 going to sleep for 11 seconds 00010000:00010000:2.0:1746147204.394002:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43c00/0x313993942506120c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e07f expref: 7 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.394016:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43c00/0x313993942506120c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e07f expref: 7 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.394032:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147204.394035:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147204.394038:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43c00, rc 0) 00000100:00100000:2.0:1746147204.394904:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2582:x1830967310124672:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1177us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.394911:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16315 00000100:00100000:0.0:1746147204.395219:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.395272:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310125056 00000100:00100000:2.0:1746147204.395277:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310125056 00000100:00100000:3.0:1746147204.395304:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311366656:192.168.204.25@tcp:105: 00002000:00100000:2.0:1746147204.395307:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1323008->1327103) req@ffff88012dbc1500 x1830967310125056/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.395316:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc1500 with x1830967310125056 ext(1323008->1327103) 00010000:00010000:3.0:1746147204.395321:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:2.0:1746147204.395321:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbc1500 00000100:00100000:2.0:1746147204.395347:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7051 00000100:00100000:2.0:1746147204.395353:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310125056:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147204.395497:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2002:x1830967310124800:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1907us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.395506:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8715 00000100:00100000:2.0:1746147204.397207:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310125056:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 1845us (1984us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147204.397220:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7051 00002000:00100000:2.0:1746147204.397230:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1323008->1327103) req@ffff88012dbc1500 x1830967310125056/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/4536 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.397240:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc1500 with x1830967310125056 ext(1323008->1327103) 00002000:00010000:2.0:1746147204.397246:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbc1500 00000100:00100000:0.0:1746147204.399221:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.399297:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310125184 00000100:00100000:2.0:1746147204.399308:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310125184 00000100:00100000:2.0:1746147204.401050:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19213 00000100:00100000:2.0:1746147204.401064:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2582:x1830967310125184:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147204.401082:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.401124:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061213 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e086 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.401151:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->1769471) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.401158:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147204.401165:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147204.401168:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061213 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e086 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.401200:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->1769471) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.401212:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->1769471) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 9 pid: 1853 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.401223:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099153800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311366784:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147204.401588:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989856c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.403417:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.403508:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310125312 00000100:00100000:2.0:1746147204.403515:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310125312 00000100:00100000:2.0:1746147204.403561:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16316 00000100:00100000:2.0:1746147204.403567:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2598:x1830967310125312:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147204.403586:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.403602:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x313993942506121a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e08d expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.403646:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x313993942506121a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e08d expref: 28 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.403657:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x313993942506121a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e08d expref: 28 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.403674:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147204.403676:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147204.403679:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff5000, rc 0) 00000100:00100000:2.0:1746147204.403722:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2598:x1830967310125312:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 155us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.403731:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16316 00000100:00100000:3.0:1746147204.403822:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099153800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311366784:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.403842:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061213 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e086 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.403854:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d42600, rc 0) 00000100:00100000:3.0:1746147204.404195:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2582:x1830967310125184:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3135us (4978us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.404202:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19213 00000100:00100000:0.0:1746147204.404747:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.404825:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310125696 00000100:00100000:2.0:1746147204.404829:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310125696 00000100:00100000:2.0:1746147204.404859:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16317 00000100:00100000:2.0:1746147204.404865:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2604:x1830967310125696:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147204.404876:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.404886:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x3139939425061221 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e094 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.404936:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x3139939425061228 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.404943:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x3139939425061228 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.404952:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x3139939425061228 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.404960:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x313993942506122f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.404964:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x313993942506122f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.404969:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x313993942506122f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405036:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7c00/0x3139939425061236 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405043:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7c00/0x3139939425061236 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405047:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7c00/0x3139939425061236 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:2.0:1746147204.405057:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147204.405127:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7c00/0x3139939425061236 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405132:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7c00/0x3139939425061236 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405136:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7c00/0x3139939425061236 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405140:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e7c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147204.405143:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7c00/0x3139939425061236 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405148:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7c00/0x3139939425061236 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405155:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147204.405157:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147204.405160:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7c00/0x3139939425061236 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405165:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7c00/0x3139939425061236 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405186:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x3139939425061228 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405190:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x3139939425061228 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405198:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x3139939425061228 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405202:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x3139939425061228 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405204:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d42000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147204.405206:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x3139939425061228 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405209:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x3139939425061228 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405214:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147204.405216:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147204.405218:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x3139939425061228 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405222:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x3139939425061228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405231:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x313993942506122f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405235:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x313993942506122f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405240:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x313993942506122f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405244:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d43800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147204.405246:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x313993942506122f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405253:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x313993942506122f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405257:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096bb1f00) 00010000:00010000:2.0:1746147204.405258:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147204.405260:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x313993942506122f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405265:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x313993942506122f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.405292:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x3139939425061221 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e094 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.405298:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x3139939425061221 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e094 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.405303:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43000, rc 0) 00000100:00100000:2.0:1746147204.405335:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2604:x1830967310125696:12345-192.168.204.25@tcp:101:cat.0 Request processed in 469us (588us total) trans 8589937182 rc 301/301 00000100:00100000:2.0:1746147204.405341:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16317 00000100:00100000:2.0:1746147204.405854:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.406402:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310125952 00000100:00100000:0.0:1746147204.406407:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310125952 00000100:00100000:0.0:1746147204.406444:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16318 00000100:00100000:0.0:1746147204.406449:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2605:x1830967310125952:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147204.406459:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147204.406466:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822bc00/0x3139939425061244 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e09b expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.406573:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x313993942506124b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.406583:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x313993942506124b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.406590:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x313993942506124b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.406598:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x3139939425061252 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.406603:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x3139939425061252 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.406608:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x3139939425061252 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.406915:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822aa00/0x3139939425061259 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407386:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009822aa00/0x3139939425061259 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407395:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822aa00/0x3139939425061259 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:0.0:1746147204.407404:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147204.407457:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822aa00/0x3139939425061259 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407463:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009822aa00/0x3139939425061259 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407467:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009822aa00/0x3139939425061259 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407472:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009822aa00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147204.407475:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822aa00/0x3139939425061259 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407480:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822aa00/0x3139939425061259 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407489:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147204.407491:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147204.407494:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009822aa00/0x3139939425061259 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407499:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822aa00/0x3139939425061259 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407521:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x313993942506124b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407527:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x313993942506124b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407534:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x313993942506124b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407537:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x313993942506124b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407541:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009822b800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147204.407543:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x313993942506124b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407547:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x313993942506124b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407553:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147204.407554:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147204.407557:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x313993942506124b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407560:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x313993942506124b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407567:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x3139939425061252 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407571:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x3139939425061252 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407575:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x3139939425061252 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407578:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009822be00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147204.407580:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x3139939425061252 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407586:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x3139939425061252 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407591:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094fbdf00) 00010000:00010000:0.0:1746147204.407592:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147204.407594:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x3139939425061252 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407597:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822be00/0x3139939425061252 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147204.407625:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822bc00/0x3139939425061244 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e09b expref: 30 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.407631:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822bc00/0x3139939425061244 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e09b expref: 30 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.407637:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822bc00, rc 0) 00000100:00100000:0.0:1746147204.407675:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2605:x1830967310125952:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1226us (1821us total) trans 8589937183 rc 301/301 00000100:00100000:0.0:1746147204.407681:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16318 00000100:00100000:1.0:1746147204.407787:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.407891:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310126080 00000100:00100000:3.0:1746147204.407897:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310126080 00002000:00100000:3.0:1746147204.407923:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1765376->1769471) req@ffff880096899f80 x1830967310126080/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.407932:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096899f80 with x1830967310126080 ext(1765376->1769471) 00010000:00010000:3.0:1746147204.407939:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 10 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.407950:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 10 pid: 1853 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746147204.407956:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096899f80 00000100:00100000:3.0:1746147204.407971:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1643 00000100:00100000:3.0:1746147204.407977:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310126080:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147204.408076:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310126080:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 99us (288us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147204.408080:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1643 00002000:00100000:3.0:1746147204.408084:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1765376->1769471) req@ffff880096899f80 x1830967310126080/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/4536 e 0 to 0 dl 1746147215 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.408112:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096899f80 with x1830967310126080 ext(1765376->1769471) 00010000:00010000:3.0:1746147204.408116:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 10 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.408124:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 10 pid: 1853 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746147204.408134:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096899f80 00000100:00100000:0.0:1746147204.409412:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.409460:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310126208 00000100:00100000:3.0:1746147204.409466:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310126208 00000100:00100000:3.0:1746147204.409507:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19214 00000100:00100000:3.0:1746147204.409517:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2598:x1830967310126208:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147204.409528:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.409541:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d95000/0x3139939425061267 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e0a2 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.409562:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x31399394250611d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e063 expref: 15 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.409568:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147204.409569:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147204.409571:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95000/0x3139939425061267 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2584576->2904063] (req 2584576->2904063) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a2 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.409591:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x31399394250611d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e063 expref: 15 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.409597:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x31399394250611d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e063 expref: 15 pid: 1853 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.409605:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311366912:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147204.409719:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.410246:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.410622:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310126336 00000100:00100000:2.0:1746147204.410627:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310126336 00000100:00100000:2.0:1746147204.410663:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16319 00000100:00100000:2.0:1746147204.410669:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2605:x1830967310126336:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147204.410681:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.410693:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942506126e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e0a9 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.410760:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42200/0x3139939425061275 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.410770:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42200/0x3139939425061275 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.410791:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42200/0x3139939425061275 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:2.0:1746147204.410812:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:2.0:1746147204.410815:0:7237:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147204.410828:0:7237:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42200/0x3139939425061275 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.410848:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942506126e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a9 expref: 31 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.410875:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42200/0x3139939425061275 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a9 expref: 30 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.410881:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147204.410883:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147204.410885:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d42200, rc 0) 00000100:00100000:2.0:1746147204.410912:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2605:x1830967310126336:12345-192.168.204.25@tcp:101:cat.0 Request processed in 243us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.410917:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16319 00000100:00100000:0.0:1746147204.411685:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.411744:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310126464 00000100:00100000:1.0:1746147204.411748:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310126464 00000100:00100000:1.0:1746147204.411793:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16320 00000100:00100000:1.0:1746147204.411799:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2604:x1830967310126464:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.411809:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.411817:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6000/0x313993942506127c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e0b0 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.411859:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6200/0x3139939425061283 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.411867:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6200/0x3139939425061283 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.411874:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6200/0x3139939425061283 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:1.0:1746147204.411888:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:1.0:1746147204.411891:0:7239:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147204.411900:0:7239:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6200/0x3139939425061283 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147204.411915:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6000/0x313993942506127c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0b0 expref: 11 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.411931:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6200/0x3139939425061283 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0b0 expref: 10 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.411942:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.411944:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147204.411946:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c6200, rc 0) 00000100:00100000:1.0:1746147204.411970:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2604:x1830967310126464:12345-192.168.204.25@tcp:101:cat.0 Request processed in 172us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.411975:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16320 00000100:00100000:0.0:1746147204.414984:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.415019:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.415054:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.415074:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.415078:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310127104 00000100:00100000:3.0:1746147204.415123:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310127104 00000100:00100000:0.0:1746147204.415152:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.415153:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310127232 00000100:00100000:0.0:1746147204.415175:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.415181:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6066 00000100:00100000:0.0:1746147204.415188:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.415190:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2595:x1830967310127104:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147204.415200:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.415213:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.415221:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310127360 00000100:00100000:2.0:1746147204.415226:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310127360 00000100:00100000:0.0:1746147204.415226:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.415238:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.415254:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310127488 00000100:00100000:0.0:1746147204.415258:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310127488 00000100:00100000:2.0:1746147204.415268:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310127616 00000100:00100000:2.0:1746147204.415271:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310127616 00000100:00100000:0.0:1746147204.415277:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310127744 00000100:00100000:0.0:1746147204.415279:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310127744 00000100:00100000:1.0:1746147204.415280:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310127232 00000100:00100000:2.0:1746147204.415287:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310128000 00000100:00100000:2.0:1746147204.415289:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310128000 00000100:00100000:0.0:1746147204.415291:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310128128 00000100:00100000:0.0:1746147204.415293:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310128128 00000100:00100000:2.0:1746147204.415298:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310128256 00000100:00100000:2.0:1746147204.415301:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310128256 00000100:00100000:1.0:1746147204.415309:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19215 00000100:00100000:0.0:1746147204.415316:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19216 00000100:00100000:1.0:1746147204.415317:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310127360:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147204.415321:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310127488:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147204.415326:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19217 00010000:00010000:0.0:1746147204.415331:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147204.415332:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310127616:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.415332:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.415339:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.415348:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b80200/0x3139939425061298 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e0cc expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.415348:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800990c7e00/0x313993942506128a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e0c5 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.415348:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009822be00/0x3139939425061291 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e0be expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147204.415393:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311367040:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147204.415394:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311367296:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147204.415395:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096898e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311367168:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147204.415400:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2595:x1830967310127104:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 211us (344us total) trans 8589937184 rc 0/0 00000100:00100000:3.0:1746147204.415407:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6066 00000100:00100000:3.0:1746147204.415432:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19218 00000100:00100000:3.0:1746147204.415437:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310127744:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147204.415446:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.415454:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x313993942506129f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e0d3 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.415477:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311367424:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147204.415491:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147204.415508:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147204.415509:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19219 00000100:00100000:3.0:1746147204.415512:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.415516:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19220 00000100:00100000:2.0:1746147204.415517:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967310127232:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147204.415522:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967310128000:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147204.415524:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147204.415527:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19221 00010000:00010000:0.0:1746147204.415529:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.415531:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x31399394250612a6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e0b7 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.415533:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19222 00000100:00100000:1.0:1746147204.415533:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310128128:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147204.415536:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009822a600/0x31399394250612ad lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e0da expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.415538:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967310128256:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.415539:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.415544:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.415545:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c7c00/0x31399394250612b4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e0e8 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.415550:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x31399394250612bb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e0ef expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.415553:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311367552:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147204.415558:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094187b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311367680:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147204.415566:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009689b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311367808:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147204.415570:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311367936:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147204.415576:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1500c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.415583:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147204.415586:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147204.415587:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147204.415589:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147204.415603:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310126848 00000100:00100000:1.0:1746147204.415605:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310126720 00000100:00100000:2.0:1746147204.415606:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310126848 00000100:00100000:1.0:1746147204.415608:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310126720 00000100:00100000:0.0:1746147204.415612:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.415615:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311366912:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147204.415621:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x31399394250611d4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e063 expref: 16 pid: 1853 timeout: 842 lvb_type: 0 00002000:00100000:1.0:1746147204.415626:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1323008->1769471) req@ffff880094186a00 x1830967310126720/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147204.415634:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094186a00 with x1830967310126720 ext(1323008->1769471) 00010000:00010000:3.0:1746147204.415636:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d95000/0x3139939425061267 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2584576->2904063] (req 2584576->2904063) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a2 expref: 40 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.415639:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1323008->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 12 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.415647:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1323008->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 12 pid: 1853 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.415648:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8716 00010000:00010000:3.0:1746147204.415650:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95000, rc 0) 00000100:00100000:2.0:1746147204.415652:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310126848:12345-192.168.204.25@tcp:103:ldlm_bl.0 00002000:00010000:1.0:1746147204.415653:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094186a00 00010000:00010000:2.0:1746147204.415660:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147204.415663:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2598:x1830967310126208:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6147us (6256us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.415666:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1644 00000100:00100000:3.0:1746147204.415668:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19214 00000100:00100000:1.0:1746147204.415671:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310126720:12345-192.168.204.25@tcp:4:multiop.0 00010000:00010000:2.0:1746147204.415674:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x31399394250611d4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e063 expref: 16 pid: 1853 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746147204.415677:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.415681:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310128384 00010000:00010000:2.0:1746147204.415683:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x31399394250611d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e063 expref: 16 pid: 1853 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.415684:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310128384 00010000:00010000:2.0:1746147204.415701:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.415703:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147204.415704:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310128512 00000100:00100000:3.0:1746147204.415706:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310128512 00010000:00010000:2.0:1746147204.415708:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d95000/0x3139939425061267 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2584576->2904063) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a2 expref: 39 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.415714:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95000/0x3139939425061267 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2584576->2904063) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a2 expref: 39 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.415717:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19223 00000100:00100000:3.0:1746147204.415722:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2000:x1830967310128384:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147204.415727:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147204.415731:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19224 00010000:00010000:3.0:1746147204.415733:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x31399394250612c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e0f6 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.415736:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967310128512:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147204.415743:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.415750:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b80600/0x31399394250612c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e0fd expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.415756:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311368064:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147204.415770:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311368192:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147204.415791:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147204.415805:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154180 going to sleep for 11 seconds 00010000:00010000:2.0:1746147204.415830:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d95000/0x3139939425061267 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2584576->2904063) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a2 expref: 39 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.415838:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311368320:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147204.415855:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.416202:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.416244:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.416251:0:10340:0:(service.c:3346:ptlrpc_start_thread()) ost[0] started 12 min 3 max 116 00000100:00100000:2.0:1746147204.416269:0:10340:0:(service.c:3405:ptlrpc_start_thread()) starting thread 'll_ost00_012' 00000100:00100000:3.0:1746147204.416342:0:1853:0:(service.c:3346:ptlrpc_start_thread()) ost[0] started 12 min 3 max 116 00000100:00100000:3.0:1746147204.416350:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310128640 00000100:00100000:3.0:1746147204.416353:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310128640 00000100:00100000:3.0:1746147204.416364:0:1853:0:(service.c:3346:ptlrpc_start_thread()) ost[0] started 12 min 3 max 116 00000100:00100000:3.0:1746147204.416367:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310127872 00000100:00100000:3.0:1746147204.416368:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310127872 00000100:00100000:3.0:1746147204.416519:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19225 00000100:00100000:3.0:1746147204.416525:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310128640:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147204.416532:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.416540:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e0c00/0x31399394250612d0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e104 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.416563:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311368448:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147204.416619:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ae40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147204.420024:0:1854:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x31399394250611bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e055 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.420060:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009689b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311367808:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147204.420514:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311367552:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147204.420536:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x31399394250612a6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0b7 expref: 39 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.420548:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x31399394250612a6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0b7 expref: 39 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.420563:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81c00, rc 0) 00000100:00100000:2.0:1746147204.420604:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967310127232:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5087us (5528us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147204.420613:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19219 00000100:00100000:2.0:1746147204.420646:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19226 00000100:00100000:2.0:1746147204.420656:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967310127872:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147204.420670:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.420685:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800990c7600/0x31399394250612d7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e0e1 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.420735:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311368576:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147204.420790:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941540c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746147204.420812:0:12225:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff880096d42c00/0x31399394250611b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e047 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.420828:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311367296:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147204.420845:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b80200/0x3139939425061298 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0cc expref: 29 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.420852:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096b80200/0x3139939425061298 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0cc expref: 29 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.420859:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80200, rc 0) 00000100:00100000:0.0:1746147204.420874:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311367040:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147204.420875:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967310127616:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5544us (5686us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147204.420881:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19217 00010000:00010000:0.0:1746147204.420890:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009822be00/0x3139939425061291 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0be expref: 26 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147204.420898:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009822be00/0x3139939425061291 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0be expref: 26 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147204.420908:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822be00, rc 0) 00000100:00100000:0.0:1746147204.420924:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2000:x1830967310127488:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5603us (5748us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147204.420929:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19216 00010000:00010000:0.0:1746147204.420954:0:13695:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x31399394250611bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e055 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147204.420974:0:9584:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime: 1746147203 -> 1746147204 00000100:00100000:2.0:1746147204.420982:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096898e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311367168:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147204.420995:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800990c7e00/0x313993942506128a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0c5 expref: 27 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.421002:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800990c7e00/0x313993942506128a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0c5 expref: 27 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.421009:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7e00, rc 0) 00000100:00100000:2.0:1746147204.421025:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967310127360:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5710us (5936us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147204.421029:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19215 00010000:00010000:2.0:1746147204.421085:0:17600:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250611e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e071 expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.421114:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311368192:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147204.421127:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b80600/0x31399394250612c9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0fd expref: 25 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.421136:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096b80600/0x31399394250612c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0fd expref: 25 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.421142:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80600, rc 0) 00000100:00100000:2.0:1746147204.421159:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2002:x1830967310128512:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5423us (5482us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147204.421165:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19224 00000100:00100000:2.0:1746147204.421297:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.421321:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311368320:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147204.421329:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147204.421362:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311367424:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147204.421378:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x313993942506129f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0d3 expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.421378:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c7c00/0x31399394250612b4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0e8 expref: 24 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.421385:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x313993942506129f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0d3 expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147204.421421:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094187b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311367680:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147204.421436:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009822a600/0x31399394250612ad lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0da expref: 37 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147204.421443:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009822a600/0x31399394250612ad lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0da expref: 37 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147204.421453:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822a600, rc 0) 00010000:00010000:1.0:1746147204.421876:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c7c00/0x31399394250612b4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0e8 expref: 24 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.421888:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7c00, rc 0) 00010000:00010000:3.0:1746147204.422240:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95c00, rc 0) 00000100:00100000:1.0:1746147204.422384:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310128128:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6849us (7155us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147204.422387:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310126848:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6733us (7365us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.422391:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19221 00000100:00100000:2.0:1746147204.422395:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8716 00000100:00100000:3.0:1746147204.422413:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967310127744:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6975us (7210us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147204.422418:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19218 00000100:00100000:1.0:1746147204.422426:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310128896 00000100:00100000:1.0:1746147204.422432:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310128896 00010000:00010000:3.0:1746147204.422447:0:1136:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff880099889500 x1830967311367936) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x31399394250611d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e063 expref: 15 pid: 1853 timeout: 842 lvb_type: 0 00002000:00100000:1.0:1746147204.422462:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2584576->2588671) req@ffff880099150000 x1830967310128896/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746147204.422466:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098ff6200/0x31399394250611d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e063 expref: 15 pid: 1853 timeout: 842 lvb_type: 0 00002000:00100000:1.0:1746147204.422471:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150000 with x1830967310128896 ext(2584576->2588671) 00000100:00100000:3.0:1746147204.422475:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311367936:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147204.422475:0:13712:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250611e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e071 expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147204.422475:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099150000 00000100:00100000:2.0:1746147204.422486:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311368448:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147204.422489:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7052 00010000:00010000:3.0:1746147204.422491:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x31399394250612bb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0ef expref: 37 pid: 1136 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147204.422495:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967310128896:12345-192.168.204.25@tcp:3:multiop.0 00010000:00010000:2.0:1746147204.422498:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e0c00/0x31399394250612d0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e104 expref: 15 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.422503:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x31399394250612bb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0ef expref: 37 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.422505:0:13712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e0c00/0x31399394250612d0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e104 expref: 15 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.422510:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95e00, rc 0) 00010000:00010000:2.0:1746147204.422513:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0c00, rc 0) 00000100:00100000:2.0:1746147204.422528:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310128640:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6005us (6328us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147204.422529:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967310128256:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6990us (7289us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147204.422532:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19225 00000100:00100000:3.0:1746147204.422535:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19222 00002000:00010000:3.0:1746147204.422559:0:9586:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746147203 -> 1746147204 00002000:00010000:3.0:1746147204.422562:0:9586:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746147203 -> 1746147204 00000100:00100000:3.0:1746147204.422567:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311368064:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147204.422579:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x31399394250612c2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0f6 expref: 22 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.422587:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x31399394250612c2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0f6 expref: 22 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.422593:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95800, rc 0) 00000100:00100000:1.0:1746147204.422858:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967310128896:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 362us (1561us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147204.422864:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7052 00002000:00100000:1.0:1746147204.422869:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2584576->2588671) req@ffff880099150000 x1830967310128896/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/4536 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147204.422876:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150000 with x1830967310128896 ext(2584576->2588671) 00002000:00010000:1.0:1746147204.422879:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099150000 00000100:00100000:3.0:1746147204.423128:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310128384:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7404us (7514us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147204.423134:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19223 00000100:00100000:0.0:1746147204.423277:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967310128000:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7753us (8061us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147204.423283:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19220 00010000:00010000:2.0:1746147204.424282:0:12201:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff880096d42c00/0x31399394250611b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e047 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.424309:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311368576:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147204.424336:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800990c7600/0x31399394250612d7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0e1 expref: 15 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.424347:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800990c7600/0x31399394250612d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0e1 expref: 15 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.424359:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7600, rc 0) 00000100:00100000:2.0:1746147204.424446:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310127872:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3792us (8199us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147204.424453:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19226 00000100:00100000:1.0:1746147204.425217:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310126720:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 9544us (10243us total) trans 17179875100 rc 0/0 00000100:00100000:1.0:1746147204.425226:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1644 00002000:00100000:1.0:1746147204.425233:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1323008->1769471) req@ffff880094186a00 x1830967310126720/t17179875100(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/448 e 0 to 0 dl 1746147215 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147204.425241:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094186a00 with x1830967310126720 ext(1323008->1769471) 00010000:00010000:1.0:1746147204.425248:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 12 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.425259:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1323008->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 12 pid: 1853 timeout: 842 lvb_type: 0 00002000:00010000:1.0:1746147204.425265:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094186a00 00000100:00100000:0.0:1746147204.427282:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.427316:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.427348:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.427450:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310129152 00000100:00100000:2.0:1746147204.427450:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310129024 00000100:00100000:3.0:1746147204.427457:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310129152 00000100:00100000:2.0:1746147204.427457:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310129024 00000100:00100000:1.0:1746147204.427478:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310129280 00000100:00100000:1.0:1746147204.427482:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310129280 00000100:00100000:3.0:1746147204.427488:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19227 00000100:00100000:3.0:1746147204.427494:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310129152:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147204.427494:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19228 00000100:00100000:2.0:1746147204.427501:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967310129024:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147204.427509:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.427509:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.427522:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095053000/0x31399394250612de lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e112 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.427522:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b81600/0x31399394250612e5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e10b expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.427528:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19229 00000100:00100000:1.0:1746147204.427533:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310129280:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.427539:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.427546:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098446000/0x31399394250612ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e119 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.427562:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311368704:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147204.427562:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311368832:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147204.427567:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009689b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311368960:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147204.427620:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147204.427628:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147204.427628:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.428125:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.428150:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.428171:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.428196:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.428316:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310129408 00000100:00100000:1.0:1746147204.428320:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310129408 00000100:00100000:1.0:1746147204.428340:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310129536 00000100:00100000:1.0:1746147204.428342:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310129536 00000100:00100000:1.0:1746147204.428352:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310129664 00000100:00100000:1.0:1746147204.428354:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310129664 00000100:00100000:1.0:1746147204.428364:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19230 00000100:00100000:1.0:1746147204.428369:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2000:x1830967310129408:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.428377:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.428384:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d43000/0x31399394250612f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e120 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.428410:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096899500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311369088:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147204.428441:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310129792 00000100:00100000:3.0:1746147204.428445:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310129792 00000100:00100000:1.0:1746147204.428447:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147204.428463:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19231 00000100:00100000:3.0:1746147204.428467:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2000:x1830967310129536:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147204.428473:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.428479:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095053400/0x31399394250612fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e127 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.428500:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311369216:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147204.428517:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147204.428578:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19232 00000100:00100000:1.0:1746147204.428585:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310129664:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147204.428589:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19233 00010000:00010000:1.0:1746147204.428592:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147204.428596:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2605:x1830967310129792:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.428599:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091e31a00/0x3139939425061301 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e12e expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.428603:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147204.428609:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x3139939425061308 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e135 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.428619:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009689aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311369344:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147204.428624:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4a00/0x31399394250611a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e039 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.428631:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147204.428633:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147204.428636:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x3139939425061308 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e135 expref: 35 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.428637:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746147204.428652:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ff4a00/0x31399394250611a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e039 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.428661:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ff4a00/0x31399394250611a3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e039 expref: 14 pid: 1853 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746147204.428670:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f55f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311369472:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147204.428691:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.429978:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.430006:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.430025:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310129920 00000100:00100000:2.0:1746147204.430030:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310129920 00010000:00010000:2.0:1746147204.430052:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 18 pid: 1853 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.430054:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310130432 00000100:00100000:1.0:1746147204.430058:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310130432 00000100:00100000:2.0:1746147204.430073:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8717 00000100:00100000:2.0:1746147204.430079:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310129920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00002000:00100000:1.0:1746147204.430080:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2899968->2904063) req@ffff880129f54380 x1830967310130432/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147204.430105:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:1.0:1746147204.430105:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f54380 with x1830967310130432 ext(2899968->2904063) 00002000:00010000:1.0:1746147204.430109:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f54380 00010000:00010000:2.0:1746147204.430121:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1323008->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 18 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.430125:0:9586:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff88009988b800 x1830967311368704) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1323008->1769471) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 18 pid: 1853 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.430127:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7053 00010000:00010000:2.0:1746147204.430131:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1323008->1769471) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 18 pid: 1853 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.430133:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967310130432:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:3.0:1746147204.430149:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x31399394250611db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1323008->1769471) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e06a expref: 18 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.430149:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.430150:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.430155:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e086 expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.430159:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311368704:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147204.430162:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061213 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e086 expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.430178:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095053000/0x31399394250612de lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e112 expref: 17 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.430182:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061213 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e086 expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.430190:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095053000/0x31399394250612de lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e112 expref: 17 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.430196:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095053000, rc 0) 00000100:00100000:2.0:1746147204.430197:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311369600:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147204.430224:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967310130432:12345-192.168.204.25@tcp:3:cat.0 Request processed in 91us (216us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147204.430229:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310129152:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2734us (2912us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147204.430235:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19227 00000100:00100000:1.0:1746147204.430235:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7053 00002000:00100000:1.0:1746147204.430240:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2899968->2904063) req@ffff880129f54380 x1830967310130432/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/4536 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147204.430246:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154780 going to sleep for 11 seconds 00002000:00100000:1.0:1746147204.430252:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f54380 with x1830967310130432 ext(2899968->2904063) 00002000:00010000:1.0:1746147204.430255:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f54380 00000100:00100000:1.0:1746147204.430446:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f55f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311369472:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147204.430460:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x3139939425061308 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e135 expref: 35 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.430468:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097034400, rc 0) 00000100:00100000:1.0:1746147204.430485:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2605:x1830967310129792:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1890us (2288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.430489:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19233 00010000:00010000:1.0:1746147204.431111:0:9585:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x31399394250611bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e055 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.431124:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096899500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311369088:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147204.431126:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311369216:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147204.431139:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d43000/0x31399394250612f3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e120 expref: 26 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.431141:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095053400/0x31399394250612fa lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e127 expref: 26 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.431148:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d43000/0x31399394250612f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e120 expref: 26 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.431149:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095053400/0x31399394250612fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e127 expref: 26 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.431155:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43000, rc 0) 00010000:00010000:2.0:1746147204.431157:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095053400, rc 0) 00000100:00100000:2.0:1746147204.431179:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2000:x1830967310129536:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2710us (3027us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147204.431183:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2000:x1830967310129408:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2808us (3054us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147204.431184:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19231 00000100:00100000:1.0:1746147204.431189:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19230 00010000:00010000:1.0:1746147204.431216:0:13695:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff880096d42c00/0x31399394250611b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e047 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.431229:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009689b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311368960:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147204.431240:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098446000/0x31399394250612ec lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e119 expref: 15 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.431247:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098446000/0x31399394250612ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e119 expref: 15 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.431252:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098446000, rc 0) 00000100:00100000:1.0:1746147204.431271:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310129280:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3738us (3921us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147204.431276:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19229 00010000:00010000:1.0:1746147204.431297:0:1854:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250611e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e071 expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.431308:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009689aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311369344:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147204.431318:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091e31a00/0x3139939425061301 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e12e expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.431324:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091e31a00/0x3139939425061301 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e12e expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.431330:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091e31a00, rc 0) 00000100:00100000:1.0:1746147204.431344:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967310129664:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2760us (3172us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147204.431349:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19232 00000100:00100000:3.0:1746147204.431409:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311368832:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147204.431422:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b81600/0x31399394250612e5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e10b expref: 22 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.431430:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b81600/0x31399394250612e5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e10b expref: 22 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.431436:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81600, rc 0) 00000100:00100000:3.0:1746147204.431453:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967310129024:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3953us (4178us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147204.431457:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19228 00000100:00100000:2.0:1746147204.433126:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311369600:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147204.433139:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147204.433140:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.433165:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310130688 00000100:00100000:1.0:1746147204.433170:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310130688 00000100:00100000:1.0:1746147204.433198:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6067 00000100:00100000:1.0:1746147204.433203:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2598:x1830967310130688:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147204.433328:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2598:x1830967310130688:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 124us (189us total) trans 8589937185 rc 0/0 00000100:00100000:1.0:1746147204.433333:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6067 00000100:00100000:2.0:1746147204.433514:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2000:x1830967310129920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3093us (3198us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.433522:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8717 00000100:00100000:0.0:1746147204.434707:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.435297:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310130816 00000100:00100000:3.0:1746147204.435306:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310130816 00000100:00100000:3.0:1746147204.435353:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19234 00000100:00100000:3.0:1746147204.435361:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2582:x1830967310130816:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147204.435379:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.435398:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x313993942506130f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e13c expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.435429:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d95000/0x3139939425061267 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2904063) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a2 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.435436:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147204.435438:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147204.435441:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x313993942506130f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e13c expref: 16 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.435472:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d95000/0x3139939425061267 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2904063) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a2 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.435483:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d95000/0x3139939425061267 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2904063) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a2 expref: 34 pid: 9586 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.435495:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311369728:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147204.435580:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.438513:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.438619:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310130944 00000100:00100000:1.0:1746147204.438627:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310130944 00000100:00100000:1.0:1746147204.438680:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19235 00000100:00100000:1.0:1746147204.438688:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2604:x1830967310130944:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.438704:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.438719:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x3139939425061316 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e143 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.438754:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147204.438758:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x3139939425061316 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e143 expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.438768:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x3139939425061316 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e143 expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.438801:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098886a00, rc 0) 00000100:00100000:1.0:1746147204.438851:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2604:x1830967310130944:12345-192.168.204.25@tcp:101:cat.0 Request processed in 163us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.438859:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19235 00000100:00100000:3.0:1746147204.440618:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311369728:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.440651:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x313993942506130f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e13c expref: 16 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.440665:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095053800, rc 0) 00000100:00100000:3.0:1746147204.440708:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2582:x1830967310130816:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5347us (6007us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.440716:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19234 00000100:00100000:0.0:1746147204.441085:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.441168:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310131072 00000100:00100000:2.0:1746147204.441173:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310131072 00002000:00100000:2.0:1746147204.441206:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2584576->2904063) req@ffff8800a4396d80 x1830967310131072/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.441215:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4396d80 with x1830967310131072 ext(2584576->2904063) 00010000:00010000:2.0:1746147204.441221:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d95000/0x3139939425061267 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2904063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a2 expref: 35 pid: 9586 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.441231:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d95000/0x3139939425061267 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2904063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a2 expref: 35 pid: 9586 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746147204.441237:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4396d80 00000100:00100000:2.0:1746147204.441264:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1645 00000100:00100000:2.0:1746147204.441270:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967310131072:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147204.447048:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310131072:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5770us (5956us total) trans 21474842482 rc 0/0 00000100:00100000:0.0:1746147204.447058:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1645 00002000:00100000:0.0:1746147204.447068:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2584576->2904063) req@ffff8800a4396d80 x1830967310131072/t21474842482(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/448 e 0 to 0 dl 1746147215 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147204.447077:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4396d80 with x1830967310131072 ext(2584576->2904063) 00010000:00010000:0.0:1746147204.447086:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d95000/0x3139939425061267 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2904063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a2 expref: 37 pid: 9586 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.447120:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d95000/0x3139939425061267 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2904063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a2 expref: 37 pid: 9586 timeout: 842 lvb_type: 0 00002000:00010000:0.0:1746147204.447126:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4396d80 00000100:00100000:0.0:1746147204.449760:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.449916:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310131200 00000100:00100000:2.0:1746147204.449923:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310131200 00010000:00010000:2.0:1746147204.449955:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95000/0x3139939425061267 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2904063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a2 expref: 37 pid: 9586 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.449980:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8718 00000100:00100000:2.0:1746147204.449988:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967310131200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147204.450000:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147204.450018:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d95000/0x3139939425061267 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2584576->2904063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a2 expref: 37 pid: 9586 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.450028:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d95000/0x3139939425061267 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2584576->2904063) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a2 expref: 37 pid: 9586 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.450047:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d95000/0x3139939425061267 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2584576->2904063) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a2 expref: 37 pid: 9586 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.450844:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.450846:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.450853:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x313993942506130f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e13c expref: 15 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.450862:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x313993942506130f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e13c expref: 15 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.450890:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x313993942506130f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e13c expref: 15 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.450900:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311369856:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147204.450973:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.454084:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.454313:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310131328 00000100:00100000:3.0:1746147204.454322:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310131328 00000100:00100000:1.0:1746147204.454380:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.454405:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.454416:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310131584 00000100:00100000:1.0:1746147204.454418:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.454420:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310131840 00000100:00100000:3.0:1746147204.454424:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310131584 00000100:00100000:0.0:1746147204.454424:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310131840 00000100:00100000:1.0:1746147204.454433:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.454447:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310131456 00000100:00100000:3.0:1746147204.454450:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310131456 00000100:00100000:0.0:1746147204.454457:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19236 00000100:00100000:3.0:1746147204.454466:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310131712 00000100:00100000:1.0:1746147204.454466:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.454467:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19237 00000100:00100000:3.0:1746147204.454468:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310131712 00000100:00100000:0.0:1746147204.454471:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310131584:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:3.0:1746147204.454477:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310131968 00000100:00100000:3.0:1746147204.454479:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310131968 00000100:00100000:2.0:1746147204.454484:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19238 00000100:00100000:1.0:1746147204.454492:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19239 00000100:00100000:2.0:1746147204.454493:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310131840:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:1.0:1746147204.454501:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310131456:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:3.0:1746147204.454505:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19240 00000100:00100000:3.0:1746147204.454511:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310131712:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:3.0:1746147204.454555:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19241 00000100:00100000:3.0:1746147204.454560:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310131968:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:2.0:1746147204.454570:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:0.0:1746147204.454570:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147204.454572:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147203 -> 1746147203 00002000:00010000:2.0:1746147204.454573:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147204 -> 1746147203 00002000:00010000:0.0:1746147204.454573:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147203 -> 1746147203 00002000:00010000:2.0:1746147204.454575:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147204 -> 1746147203 00002000:00010000:0.0:1746147204.454575:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147204 -> 1746147204 00002000:00010000:0.0:1746147204.454576:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:2.0:1746147204.454577:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147204 -> 1746147204 00002000:00010000:2.0:1746147204.454578:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00002000:00010000:1.0:1746147204.454600:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147204.454603:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147204.454603:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147204 -> 1746147203 00002000:00010000:3.0:1746147204.454605:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147203 -> 1746147203 00002000:00010000:1.0:1746147204.454605:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147203 -> 1746147203 00002000:00010000:3.0:1746147204.454607:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147203 -> 1746147203 00002000:00010000:1.0:1746147204.454607:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147204 -> 1746147204 00002000:00010000:1.0:1746147204.454608:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:3.0:1746147204.454609:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147204 -> 1746147204 00002000:00010000:3.0:1746147204.454610:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746147204.454614:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967310131584:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 143us (234us total) trans 17179875101 rc 0/0 00000100:00100000:0.0:1746147204.454618:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19237 00000100:00100000:0.0:1746147204.454630:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967310131328:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:2.0:1746147204.454640:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967310131840:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 148us (233us total) trans 21474842483 rc 0/0 00000100:00100000:3.0:1746147204.454641:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310131968:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 79us (173us total) trans 17179875103 rc 0/0 00000100:00100000:3.0:1746147204.454646:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19241 00000100:00100000:2.0:1746147204.454649:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19238 00000100:00100000:1.0:1746147204.454651:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310131456:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 152us (231us total) trans 17179875102 rc 0/0 00002000:00010000:0.0:1746147204.454657:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:1.0:1746147204.454658:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19239 00002000:00010000:0.0:1746147204.454659:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147203 -> 1746147203 00002000:00010000:0.0:1746147204.454660:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147203 -> 1746147203 00002000:00010000:0.0:1746147204.454661:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147204 -> 1746147204 00002000:00010000:0.0:1746147204.454662:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00002000:00010000:3.0:1746147204.454673:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147204.454675:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147203 -> 1746147203 00000100:00100000:0.0:1746147204.454675:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967310131328:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 214us (602us total) trans 21474842485 rc 0/0 00002000:00010000:3.0:1746147204.454677:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147203 -> 1746147203 00002000:00010000:3.0:1746147204.454678:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147204 -> 1746147204 00000100:00100000:0.0:1746147204.454679:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19236 00002000:00010000:3.0:1746147204.454680:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147204.454694:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310131712:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 184us (261us total) trans 21474842484 rc 0/0 00000100:00100000:2.0:1746147204.454696:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311369856:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147204.454700:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19240 00010000:00010000:2.0:1746147204.454710:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.454730:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967310131200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4743us (4976us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.454737:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8718 00000100:00100000:0.0:1746147204.457027:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.457285:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.457379:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310132352 00000100:00100000:3.0:1746147204.457388:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310132352 00000100:00100000:3.0:1746147204.457440:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6068 00000100:00100000:3.0:1746147204.457447:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2582:x1830967310132352:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:2.0:1746147204.457478:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310132096 00000100:00100000:2.0:1746147204.457488:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310132096 00010000:00010000:2.0:1746147204.457523:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff4a00/0x31399394250611a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e039 expref: 19 pid: 1853 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.457571:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8719 00000100:00100000:2.0:1746147204.457578:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2003:x1830967310132096:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147204.457596:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147204.457615:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ff4a00/0x31399394250611a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e039 expref: 19 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.457626:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ff4a00/0x31399394250611a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e039 expref: 19 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.457646:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4a00/0x31399394250611a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e039 expref: 19 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.457661:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.457663:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.457670:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x3139939425061308 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e135 expref: 35 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.457677:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x3139939425061308 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e135 expref: 35 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.457681:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2582:x1830967310132352:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 229us (391us total) trans 8589937186 rc 0/0 00010000:00010000:2.0:1746147204.457684:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.457685:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147204.457688:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6068 00010000:00010000:2.0:1746147204.457688:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x3139939425061316 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e143 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.457694:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x3139939425061316 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e143 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.457745:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x3139939425061316 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e143 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.457760:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311369984:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147204.457839:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x3139939425061308 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e135 expref: 35 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.457847:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311370112:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147204.457866:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.459751:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.459836:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310132608 00000100:00100000:3.0:1746147204.459845:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310132608 00000100:00100000:3.0:1746147204.459953:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6069 00000100:00100000:3.0:1746147204.459962:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2582:x1830967310132608:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:2.0:1746147204.460024:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311369984:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147204.460033:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311370112:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147204.460049:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.460083:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2003:x1830967310132096:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2506us (3067us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.460118:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8719 00000100:00100000:3.0:1746147204.460317:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2582:x1830967310132608:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 354us (570us total) trans 8589937187 rc 0/0 00000100:00100000:3.0:1746147204.460323:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6069 00000100:00100000:0.0:1746147204.461853:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.461904:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.461936:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310132864 00000100:00100000:2.0:1746147204.461946:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310132864 00000100:00100000:1.0:1746147204.461979:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310133120 00000100:00100000:1.0:1746147204.461985:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310133120 00002000:00100000:2.0:1746147204.461989:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff8800a4395500 x1830967310132864/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.461999:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395500 with x1830967310132864 ext(0->1048575) 00002000:00010000:2.0:1746147204.462003:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4395500 00002000:00100000:1.0:1746147204.462014:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff8800a4394000 x1830967310133120/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147204.462023:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4394000 with x1830967310133120 ext(0->1048575) 00002000:00010000:1.0:1746147204.462027:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4394000 00000100:00100000:2.0:1746147204.462029:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7054 00000100:00100000:2.0:1746147204.462036:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967310132864:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147204.462056:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7055 00000100:00100000:1.0:1746147204.462063:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310133120:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147204.471677:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967310132864:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9630us (9818us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147204.471693:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7054 00002000:00100000:2.0:1746147204.471705:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff8800a4395500 x1830967310132864/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.471714:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395500 with x1830967310132864 ext(0->1048575) 00002000:00010000:2.0:1746147204.471720:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4395500 00000100:00100000:1.0:1746147204.474628:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310133120:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12554us (12713us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147204.474637:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7055 00002000:00100000:1.0:1746147204.474646:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff8800a4394000 x1830967310133120/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147204.474652:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4394000 with x1830967310133120 ext(0->1048575) 00002000:00010000:1.0:1746147204.474657:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4394000 00000100:00100000:0.0:1746147204.478427:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.478575:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310133248 00000100:00100000:3.0:1746147204.478586:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310133248 00000100:00100000:3.0:1746147204.478633:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19242 00000100:00100000:3.0:1746147204.478640:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c06d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2605:x1830967310133248:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147204.478659:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.478986:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x313993942506131d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e14a expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.479023:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e086 expref: 17 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.479030:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147204.479032:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147204.479035:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x313993942506131d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e14a expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.479067:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061213 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e086 expref: 17 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.479080:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061213 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e086 expref: 17 pid: 9586 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.479206:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311370240:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147204.479399:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.479578:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.479682:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310133376 00000100:00100000:1.0:1746147204.479686:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310133376 00000100:00100000:1.0:1746147204.479713:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19243 00000100:00100000:1.0:1746147204.479719:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2604:x1830967310133376:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.479727:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.479735:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098886200/0x3139939425061324 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e151 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.479753:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147204.479757:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098886200/0x3139939425061324 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e151 expref: 12 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.479765:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098886200/0x3139939425061324 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e151 expref: 12 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.479785:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098886200, rc 0) 00000100:00100000:1.0:1746147204.479813:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2604:x1830967310133376:12345-192.168.204.25@tcp:101:cat.0 Request processed in 93us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.479818:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19243 00000100:00100000:3.0:1746147204.481048:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311370240:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.481070:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x313993942506131d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e14a expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.481115:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095052400, rc 0) 00000100:00100000:3.0:1746147204.481367:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c06d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2605:x1830967310133248:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2725us (2949us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.481375:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19242 00000100:00100000:0.0:1746147204.481577:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.481613:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310133504 00000100:00100000:2.0:1746147204.481688:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310133504 00010000:00010000:2.0:1746147204.481723:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061213 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e086 expref: 18 pid: 9586 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.481761:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8720 00000100:00100000:2.0:1746147204.481767:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b404e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310133504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147204.481784:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147204.481803:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061213 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e086 expref: 18 pid: 9586 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.481814:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061213 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e086 expref: 18 pid: 9586 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.481838:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061213 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e086 expref: 18 pid: 9586 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.481865:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.482390:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.482398:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x313993942506131d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e14a expref: 24 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.482411:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x313993942506131d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e14a expref: 24 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.482419:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.482420:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.482423:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098886200/0x3139939425061324 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e151 expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.482429:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098886200/0x3139939425061324 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e151 expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.482459:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098886200/0x3139939425061324 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e151 expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.482471:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311370368:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147204.482719:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x313993942506131d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e14a expref: 24 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.482728:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311370496:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147204.482763:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147204.484501:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311370368:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147204.484512:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311370496:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147204.484528:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.484590:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b404e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310133504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2822us (3019us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.484599:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8720 00000100:00100000:0.0:1746147204.486696:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.486812:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310133760 00000100:00100000:1.0:1746147204.486824:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310133760 00002000:00100000:1.0:1746147204.486872:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8800a4396300 x1830967310133760/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147204.486881:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4396300 with x1830967310133760 ext(1048576->2097151) 00002000:00010000:1.0:1746147204.486886:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4396300 00000100:00100000:1.0:1746147204.486926:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7056 00000100:00100000:1.0:1746147204.486934:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310133760:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147204.487066:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.487108:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310134016 00000100:00100000:0.0:1746147204.487115:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310134016 00002000:00100000:0.0:1746147204.487148:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8800a4394e00 x1830967310134016/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147204.487157:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4394e00 with x1830967310134016 ext(1048576->2097151) 00002000:00010000:0.0:1746147204.487162:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4394e00 00000100:00100000:0.0:1746147204.487185:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7057 00000100:00100000:0.0:1746147204.487192:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967310134016:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147204.496597:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967310134016:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9397us (9523us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147204.496609:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7057 00002000:00100000:2.0:1746147204.496619:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8800a4394e00 x1830967310134016/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.496629:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4394e00 with x1830967310134016 ext(1048576->2097151) 00002000:00010000:2.0:1746147204.496634:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4394e00 00000100:00100000:2.0:1746147204.504376:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.504500:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310134144 00000100:00100000:3.0:1746147204.504515:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310134144 00000100:00100000:3.0:1746147204.504573:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19244 00000100:00100000:3.0:1746147204.504581:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2604:x1830967310134144:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147204.504610:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.504625:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x313993942506132b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e158 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.504650:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d42c00/0x31399394250611b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e047 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.504657:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147204.504658:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147204.504661:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x313993942506132b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e158 expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.504687:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d42c00/0x31399394250611b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e047 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.504698:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d42c00/0x31399394250611b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e047 expref: 16 pid: 1853 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.504714:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311370624:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147204.504798:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147204.504939:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310133760:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17999us (18243us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147204.504948:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7056 00002000:00100000:1.0:1746147204.504956:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8800a4396300 x1830967310133760/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147204.504972:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4396300 with x1830967310133760 ext(1048576->2097151) 00002000:00010000:1.0:1746147204.504975:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4396300 00000100:00100000:1.0:1746147204.507372:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.507458:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310134272 00000100:00100000:2.0:1746147204.507464:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310134272 00010000:00010000:2.0:1746147204.507491:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d42c00/0x31399394250611b1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e047 expref: 17 pid: 1853 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.507522:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8721 00000100:00100000:2.0:1746147204.507528:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310134272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147204.507539:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147204.507555:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d42c00/0x31399394250611b1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e047 expref: 17 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.507565:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d42c00/0x31399394250611b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e047 expref: 17 pid: 1853 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.507589:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311370624:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147204.507611:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d42c00/0x31399394250611b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e047 expref: 17 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.507795:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x313993942506132b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e158 expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.507805:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.507806:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.507811:0:13712:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x313993942506132b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e158 expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.507817:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x313993942506132b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e158 expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.507841:0:13712:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x313993942506132b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e158 expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.507852:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311370752:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147204.507922:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962180 going to sleep for 11 seconds 00010000:00010000:2.0:1746147204.508253:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.508284:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310134272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 754us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.508290:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8721 00000100:00100000:0.0:1746147204.510783:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.511172:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310134400 00000100:00100000:1.0:1746147204.511179:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310134400 00000100:00100000:1.0:1746147204.511215:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19245 00000100:00100000:1.0:1746147204.511222:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2605:x1830967310134400:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:3.0:1746147204.511513:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311370752:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147204.511530:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095052600, rc 0) 00000100:00100000:3.0:1746147204.511564:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2604:x1830967310134144:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6985us (7203us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.511570:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19244 00010000:00010000:1.0:1746147204.511705:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.511719:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425061332 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e15f expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.511738:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.511740:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.511745:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425061332 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e15f expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.511757:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425061332 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e15f expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.511765:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098887800, rc 0) 00000100:00100000:1.0:1746147204.511850:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2605:x1830967310134400:12345-192.168.204.25@tcp:101:cat.0 Request processed in 629us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.511855:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19245 00000100:00100000:0.0:1746147204.514980:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.515056:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310134656 00000100:00100000:1.0:1746147204.515063:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310134656 00002000:00100000:1.0:1746147204.515151:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff8800a4397800 x1830967310134656/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147204.515160:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4397800 with x1830967310134656 ext(1048576->2097151) 00002000:00010000:1.0:1746147204.515164:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4397800 00000100:00100000:1.0:1746147204.515192:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7058 00000100:00100000:1.0:1746147204.515199:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310134656:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147204.515931:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.515998:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310134912 00000100:00100000:2.0:1746147204.516001:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310134912 00002000:00100000:2.0:1746147204.516021:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff8800a4394a80 x1830967310134912/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.516030:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4394a80 with x1830967310134912 ext(1048576->2097151) 00002000:00010000:2.0:1746147204.516033:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4394a80 00000100:00100000:2.0:1746147204.516058:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7059 00000100:00100000:2.0:1746147204.516064:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310134912:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147204.521867:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310134912:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5789us (5924us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147204.521878:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7059 00002000:00100000:2.0:1746147204.521889:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff8800a4394a80 x1830967310134912/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.521897:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4394a80 with x1830967310134912 ext(1048576->2097151) 00002000:00010000:2.0:1746147204.521902:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4394a80 00000100:00100000:1.0:1746147204.523990:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310134656:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8785us (9010us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147204.524000:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7058 00002000:00100000:1.0:1746147204.524009:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff8800a4397800 x1830967310134656/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147204.524017:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4397800 with x1830967310134656 ext(1048576->2097151) 00002000:00010000:1.0:1746147204.524022:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4397800 00000100:00100000:2.0:1746147204.528909:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.528977:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310135040 00000100:00100000:1.0:1746147204.528985:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310135040 00000100:00100000:1.0:1746147204.529037:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19246 00000100:00100000:1.0:1746147204.529045:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2604:x1830967310135040:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.529060:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.529076:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425061339 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e166 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.529118:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x31399394250611bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e055 expref: 17 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.529125:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147204.529127:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147204.529130:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425061339 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e166 expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.529156:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x31399394250611bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e055 expref: 17 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.529167:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x31399394250611bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e055 expref: 17 pid: 1853 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.529177:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311370880:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147204.529538:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.529983:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.530083:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310135168 00000100:00100000:3.0:1746147204.530117:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310135168 00000100:00100000:3.0:1746147204.530152:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19247 00000100:00100000:3.0:1746147204.530158:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2605:x1830967310135168:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147204.530172:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.530185:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x3139939425061340 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e16d expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.530206:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147204.530210:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x3139939425061340 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e16d expref: 37 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.530221:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x3139939425061340 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e16d expref: 37 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.530230:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ef800, rc 0) 00000100:00100000:3.0:1746147204.530793:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2605:x1830967310135168:12345-192.168.204.25@tcp:101:cat.0 Request processed in 634us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.530799:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19247 00000100:00100000:0.0:1746147204.531235:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311370880:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147204.531256:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425061339 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e166 expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.531265:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098446600, rc 0) 00000100:00100000:0.0:1746147204.531288:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2604:x1830967310135040:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2245us (2388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.531294:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19246 00000100:00100000:0.0:1746147204.531659:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.531791:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310135296 00000100:00100000:2.0:1746147204.531796:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310135296 00010000:00010000:2.0:1746147204.531825:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x31399394250611bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e055 expref: 18 pid: 1853 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.531866:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8722 00000100:00100000:2.0:1746147204.531872:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310135296:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147204.531883:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147204.531902:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x31399394250611bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e055 expref: 18 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.531912:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x31399394250611bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e055 expref: 18 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.531932:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x31399394250611bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e055 expref: 18 pid: 1853 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.531955:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.531958:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.531965:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425061339 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e166 expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.531972:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425061339 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e166 expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.531979:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.531981:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.531984:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x3139939425061340 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e16d expref: 36 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.531991:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x3139939425061340 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e16d expref: 36 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.532017:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x3139939425061340 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e16d expref: 36 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.532029:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311371008:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147204.532121:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425061339 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e166 expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.532131:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311371136:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147204.532354:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.534166:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.534234:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310135552 00000100:00100000:2.0:1746147204.534242:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310135552 00000100:00100000:2.0:1746147204.534300:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16321 00000100:00100000:2.0:1746147204.534307:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2610:x1830967310135552:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147204.534331:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.534351:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x3139939425061347 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e174 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.534427:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x313993942506134e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.534677:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x313993942506134e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.534691:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x313993942506134e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.534705:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425061355 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.534715:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425061355 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.534721:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425061355 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.534827:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81e00/0x313993942506135c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.534836:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81e00/0x313993942506135c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.534842:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81e00/0x313993942506135c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:2.0:1746147204.534850:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147204.534917:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x313993942506134e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.534922:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x313993942506134e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.534928:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x313993942506134e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.534933:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x313993942506134e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.534939:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096b81a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147204.534942:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x313993942506134e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.534949:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x313993942506134e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.534962:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147204.534965:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147204.534968:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x313993942506134e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.534973:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x313993942506134e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.534983:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425061355 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.534988:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425061355 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.534993:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425061355 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.534996:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096b80200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147204.534998:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425061355 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.535002:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425061355 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.535007:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096bb1f00) 00010000:00010000:2.0:1746147204.535009:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147204.535010:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425061355 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.535014:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x3139939425061355 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.535045:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80e00/0x3139939425061347 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e174 expref: 14 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.535056:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81e00/0x313993942506135c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e174 expref: 13 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.535062:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147204.535065:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147204.535067:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81e00, rc 0) 00000100:00100000:2.0:1746147204.535167:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2610:x1830967310135552:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 859us (1007us total) trans 8589937188 rc 0/0 00000100:00100000:2.0:1746147204.535174:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16321 00000100:00100000:0.0:1746147204.538235:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.538268:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.538308:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310135808 00000100:00100000:1.0:1746147204.538315:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310135808 00002000:00100000:1.0:1746147204.538349:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800a4395f80 x1830967310135808/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147204.538359:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311371008:192.168.204.25@tcp:105: 00002000:00100000:1.0:1746147204.538363:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395f80 with x1830967310135808 ext(1048576->2097151) 00002000:00010000:1.0:1746147204.538367:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4395f80 00000100:00100000:3.0:1746147204.538369:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311371136:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147204.538386:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310136064 00000100:00100000:1.0:1746147204.538387:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310136064 00010000:00010000:3.0:1746147204.538389:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746147204.538396:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800a4394380 x1830967310136064/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147204.538401:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4394380 with x1830967310136064 ext(1048576->2097151) 00002000:00010000:1.0:1746147204.538404:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4394380 00000100:00100000:3.0:1746147204.538409:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7060 00000100:00100000:3.0:1746147204.538415:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2001:x1830967310135808:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147204.538426:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7061 00000100:00100000:1.0:1746147204.538431:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310136064:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147204.538483:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310135296:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6611us (6824us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.538491:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8722 00000100:00100000:0.0:1746147204.540119:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.540139:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.540194:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310136320 00000100:00100000:1.0:1746147204.540200:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310136320 00000100:00100000:1.0:1746147204.540241:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19248 00000100:00100000:1.0:1746147204.540247:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2610:x1830967310136320:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147204.540263:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.540282:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x313993942506136a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e17b expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.540305:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x3139939425061308 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e135 expref: 38 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.540313:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x3139939425061316 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e143 expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.540320:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.540322:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.540326:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x313993942506136a lrc: 5/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [913408->950271] (req 913408->950271) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e17b expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.540350:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x3139939425061316 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e143 expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.540361:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x3139939425061316 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e143 expref: 26 pid: 1854 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.540371:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311371264:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147204.540444:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x3139939425061308 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e135 expref: 38 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.540452:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x3139939425061308 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e135 expref: 38 pid: 1398 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.540461:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311371392:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147204.540480:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147204.541978:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310136192 00000100:00100000:2.0:1746147204.541991:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310136192 00000100:00100000:2.0:1746147204.542051:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 971 00000100:00100000:2.0:1746147204.542058:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2003:x1830967310136192:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147204.542071:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147204.542110:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81e00/0x313993942506135c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e174 expref: 13 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.542127:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147204.542131:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.542174:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2003:x1830967310136192:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 116us (2059us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.542180:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 971 00000100:00100000:0.0:1746147204.545780:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311371264:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147204.545793:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311371392:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147204.545818:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x313993942506136a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [913408->950271] (req 913408->950271) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e17b expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.545832:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cd2200, rc 0) 00000100:00100000:0.0:1746147204.545877:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2610:x1830967310136320:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5630us (5735us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.545885:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19248 00000100:00100000:0.0:1746147204.548955:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.548992:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.550796:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310136448 00000100:00100000:2.0:1746147204.550813:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310136448 00010000:00010000:2.0:1746147204.550860:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x3139939425061316 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e143 expref: 26 pid: 1854 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.550887:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310136576 00000100:00100000:1.0:1746147204.550905:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310136576 00000100:00100000:2.0:1746147204.550911:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8723 00000100:00100000:2.0:1746147204.550919:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2000:x1830967310136448:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147204.550934:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147204.550939:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x3139939425061308 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e135 expref: 39 pid: 1398 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.550954:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x3139939425061316 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e143 expref: 26 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.550965:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x3139939425061316 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e143 expref: 26 pid: 1854 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.550970:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8724 00000100:00100000:1.0:1746147204.550978:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967310136576:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147204.550990:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x3139939425061316 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e143 expref: 26 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.550990:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147204.551008:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x3139939425061308 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e135 expref: 39 pid: 1398 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.551020:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x3139939425061308 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e135 expref: 39 pid: 1398 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.551040:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097034400/0x3139939425061308 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e135 expref: 39 pid: 1398 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.551545:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.551552:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.551562:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x313993942506136a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->950271) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e17b expref: 25 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.551572:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x313993942506136a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->950271) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e17b expref: 25 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.551623:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x313993942506136a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->950271) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e17b expref: 25 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.551638:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311371520:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147204.551735:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.551865:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147204.551970:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310136576:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 988us (2972us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.551979:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8724 00000100:00100000:1.0:1746147204.552076:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310136064:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13644us (13806us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147204.552083:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7061 00002000:00100000:1.0:1746147204.552113:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800a4394380 x1830967310136064/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147204.552121:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4394380 with x1830967310136064 ext(1048576->2097151) 00002000:00010000:1.0:1746147204.552125:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4394380 00000100:00100000:2.0:1746147204.553347:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2001:x1830967310135808:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14925us (15113us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147204.553360:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7060 00002000:00100000:2.0:1746147204.553372:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800a4395f80 x1830967310135808/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.553382:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395f80 with x1830967310135808 ext(1048576->2097151) 00002000:00010000:2.0:1746147204.553387:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4395f80 00000100:00100000:0.0:1746147204.554857:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.554894:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311371520:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147204.554919:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.554965:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310136448:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4046us (6018us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.554971:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310136832 00000100:00100000:2.0:1746147204.554975:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8723 00000100:00100000:3.0:1746147204.554979:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310136832 00002000:00100000:3.0:1746147204.555011:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x93:0x0] (913408->917503) req@ffff8800975a7b80 x1830967310136832/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.555020:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a7b80 with x1830967310136832 ext(913408->917503) 00002000:00010000:3.0:1746147204.555024:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800975a7b80 00000100:00100000:3.0:1746147204.555050:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7062 00000100:00100000:3.0:1746147204.555056:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2002:x1830967310136832:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147204.555194:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2002:x1830967310136832:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 139us (343us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147204.555199:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7062 00002000:00100000:3.0:1746147204.555204:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x93:0x0] (913408->917503) req@ffff8800975a7b80 x1830967310136832/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/4536 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.555211:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a7b80 with x1830967310136832 ext(913408->917503) 00002000:00010000:3.0:1746147204.555214:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800975a7b80 00000100:00100000:0.0:1746147204.557795:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.557931:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310137088 00000100:00100000:3.0:1746147204.557941:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310137088 00002000:00100000:3.0:1746147204.557982:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x93:0x0] (946176->950271) req@ffff8800975a4380 x1830967310137088/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.557993:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a4380 with x1830967310137088 ext(946176->950271) 00002000:00010000:3.0:1746147204.557998:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800975a4380 00000100:00100000:3.0:1746147204.558037:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7063 00000100:00100000:3.0:1746147204.558045:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2002:x1830967310137088:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147204.558299:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2002:x1830967310137088:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 253us (526us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147204.558305:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7063 00002000:00100000:3.0:1746147204.558311:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x93:0x0] (946176->950271) req@ffff8800975a4380 x1830967310137088/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/4536 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.558318:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a4380 with x1830967310137088 ext(946176->950271) 00002000:00010000:3.0:1746147204.558321:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800975a4380 00000100:00100000:0.0:1746147204.559046:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.559077:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.559125:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.559152:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.559284:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310137344 00000100:00100000:1.0:1746147204.559284:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310137216 00000100:00100000:2.0:1746147204.559290:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310137344 00000100:00100000:1.0:1746147204.559290:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310137216 00000100:00100000:2.0:1746147204.559321:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310137600 00000100:00100000:3.0:1746147204.559323:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310137472 00000100:00100000:2.0:1746147204.559323:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310137600 00000100:00100000:3.0:1746147204.559325:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310137472 00000100:00100000:0.0:1746147204.559372:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.559421:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310137728 00000100:00100000:1.0:1746147204.559423:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310137728 00000100:00100000:2.0:1746147204.559435:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19249 00000100:00100000:2.0:1746147204.559442:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967310137344:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147204.559451:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19250 00010000:00010000:2.0:1746147204.559453:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147204.559461:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967310137216:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.559467:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.559473:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b81800/0x3139939425061371 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e189 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.559477:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c7600/0x3139939425061378 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e182 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.559522:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311371648:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147204.559523:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311371776:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147204.559587:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19251 00000100:00100000:0.0:1746147204.559650:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310137600:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147204.559661:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147204.559673:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9a4a00/0x313993942506137f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e197 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.559676:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19252 00000100:00100000:3.0:1746147204.559683:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310137728:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147204.559690:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.559700:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d91a00/0x3139939425061386 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e19e expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147204.559701:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311371904:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147204.559724:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311372032:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147204.559746:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19253 00000100:00100000:2.0:1746147204.559752:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310137472:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:3.0:1746147204.559756:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147204.559761:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00010000:00010000:2.0:1746147204.559762:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.559768:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b80200/0x313993942506138d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e190 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.559783:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147204.559801:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311372160:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147204.559821:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.559873:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.559908:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.560028:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310137984 00000100:00100000:3.0:1746147204.560031:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310137984 00000100:00100000:1.0:1746147204.560085:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6070 00000100:00100000:1.0:1746147204.560117:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801370fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2610:x1830967310137984:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147204.560879:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801370fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2610:x1830967310137984:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 762us (968us total) trans 8589937189 rc 0/0 00000100:00100000:1.0:1746147204.560889:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6070 00000100:00100000:3.0:1746147204.562157:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311372032:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147204.562266:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311371776:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147204.562295:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b81800/0x3139939425061371 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e189 expref: 39 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.562308:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b81800/0x3139939425061371 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e189 expref: 39 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.562318:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81800, rc 0) 00000100:00100000:1.0:1746147204.562354:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967310137344:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2913us (3276us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147204.562361:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19249 00010000:00010000:3.0:1746147204.562548:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d91a00/0x3139939425061386 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e19e expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.562558:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d91a00/0x3139939425061386 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e19e expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.562575:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d91a00, rc 0) 00000100:00100000:3.0:1746147204.562598:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310137728:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2917us (3226us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147204.562604:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19252 00000100:00100000:0.0:1746147204.562634:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311371904:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147204.562653:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a4a00/0x313993942506137f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e197 expref: 27 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147204.562662:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a4a00/0x313993942506137f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e197 expref: 27 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147204.562676:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a4a00, rc 0) 00000100:00100000:0.0:1746147204.562691:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310137600:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3098us (3566us total) trans 0 rc 301/301 00002000:00010000:1.0:1746147204.562696:0:12201:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime: 1746147203 -> 1746147204 00000100:00100000:0.0:1746147204.562697:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19251 00002000:00010000:1.0:1746147204.562699:0:12201:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime: 1746147203 -> 1746147204 00000100:00100000:1.0:1746147204.562706:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311371648:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147204.562725:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c7600/0x3139939425061378 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e182 expref: 37 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.562733:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c7600/0x3139939425061378 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e182 expref: 37 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.562740:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7600, rc 0) 00000100:00100000:1.0:1746147204.562758:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967310137216:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3301us (3714us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147204.562921:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311372160:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147204.562936:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b80200/0x313993942506138d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e190 expref: 24 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.562944:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b80200/0x313993942506138d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e190 expref: 24 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.562967:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80200, rc 0) 00000100:00100000:2.0:1746147204.562986:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310137472:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3234us (3833us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147204.562991:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19253 00000100:00100000:1.0:1746147204.563450:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19250 00000100:00100000:0.0:1746147204.565173:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.565224:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.565286:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310138112 00000100:00100000:2.0:1746147204.565295:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310138112 00000100:00100000:1.0:1746147204.565310:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310138240 00000100:00100000:1.0:1746147204.565315:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310138240 00000100:00100000:2.0:1746147204.565349:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19254 00000100:00100000:2.0:1746147204.565356:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2604:x1830967310138112:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147204.565365:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19255 00000100:00100000:1.0:1746147204.565371:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2605:x1830967310138240:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147204.565373:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.565378:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.565392:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x3139939425061394 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e1a5 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.565412:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x313993942506139b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e1ac expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.565422:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x313993942506130f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e13c expref: 16 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.565431:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147204.565432:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147204.565436:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x3139939425061394 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1a5 expref: 24 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.565470:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147204.565475:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x313993942506139b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ac expref: 37 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.565485:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x313993942506139b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ac expref: 37 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.565494:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c6600, rc 0) 00000100:00100000:1.0:1746147204.565536:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2605:x1830967310138240:12345-192.168.204.25@tcp:101:cat.0 Request processed in 165us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.565542:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19255 00010000:00010000:2.0:1746147204.565735:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x313993942506130f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e13c expref: 16 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.565749:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x313993942506130f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e13c expref: 16 pid: 12201 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.565762:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311372288:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147204.566284:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.568140:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.568319:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310138368 00000100:00100000:3.0:1746147204.568327:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310138368 00010000:00010000:3.0:1746147204.568362:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x313993942506130f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e13c expref: 17 pid: 12201 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.568403:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8725 00000100:00100000:3.0:1746147204.568411:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310138368:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147204.568424:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147204.568438:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311372288:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.568444:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x313993942506130f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e13c expref: 17 pid: 12201 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.568455:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x313993942506130f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e13c expref: 17 pid: 12201 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.568761:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095053800/0x313993942506130f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e13c expref: 17 pid: 12201 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.568761:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x3139939425061394 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1a5 expref: 24 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.568782:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.568784:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.568791:0:13695:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x3139939425061394 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1a5 expref: 24 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.568798:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x3139939425061394 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1a5 expref: 24 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.568806:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.568808:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.568811:0:13695:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x313993942506139b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ac expref: 36 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.568817:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x313993942506139b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ac expref: 36 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.568822:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147204.568842:0:13695:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x313993942506139b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ac expref: 36 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.568852:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311372416:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147204.568956:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310138368:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 544us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.568962:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8725 00010000:00010000:2.0:1746147204.569035:0:13695:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x3139939425061394 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1a5 expref: 24 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.569044:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311372544:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147204.569064:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147204.570173:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311372416:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147204.571364:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311372544:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147204.571386:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81c00, rc 0) 00000100:00100000:2.0:1746147204.571740:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2604:x1830967310138112:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6382us (6571us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.571749:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19254 00000100:00100000:0.0:1746147204.572527:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.572599:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310138624 00000100:00100000:3.0:1746147204.572607:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310138624 00002000:00100000:3.0:1746147204.572652:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88011db16680 x1830967310138624/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.572663:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db16680 with x1830967310138624 ext(2097152->3145727) 00002000:00010000:3.0:1746147204.572668:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db16680 00000100:00100000:3.0:1746147204.572796:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7064 00000100:00100000:3.0:1746147204.572803:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967310138624:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147204.576054:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.576575:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310138880 00000100:00100000:1.0:1746147204.576585:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310138880 00002000:00100000:1.0:1746147204.576631:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88011db16300 x1830967310138880/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147204.576642:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db16300 with x1830967310138880 ext(2097152->3145727) 00002000:00010000:1.0:1746147204.576649:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db16300 00000100:00100000:1.0:1746147204.576678:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7065 00000100:00100000:1.0:1746147204.576686:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2000:x1830967310138880:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147204.584017:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967310138624:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11200us (11478us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147204.584031:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7064 00002000:00100000:3.0:1746147204.584044:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88011db16680 x1830967310138624/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.584053:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db16680 with x1830967310138624 ext(2097152->3145727) 00002000:00010000:3.0:1746147204.584059:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db16680 00000100:00100000:0.0:1746147204.589559:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.589605:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310139008 00000100:00100000:2.0:1746147204.589615:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310139008 00000100:00100000:2.0:1746147204.589673:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19256 00000100:00100000:2.0:1746147204.589682:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2605:x1830967310139008:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147204.589702:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.589723:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x31399394250613a2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e1b3 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.589755:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250611e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e071 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.589763:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147204.589765:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147204.589780:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x31399394250613a2 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1b3 expref: 27 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.589813:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250611e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e071 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.589825:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250611e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e071 expref: 15 pid: 9586 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.589838:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311372672:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147204.589926:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147204.589977:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2000:x1830967310138880:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13289us (13930us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147204.589987:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7065 00002000:00100000:1.0:1746147204.589997:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88011db16300 x1830967310138880/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147204.590007:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db16300 with x1830967310138880 ext(2097152->3145727) 00002000:00010000:1.0:1746147204.590011:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db16300 00000100:00100000:0.0:1746147204.592494:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.592612:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311372672:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147204.592644:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x31399394250613a2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1b3 expref: 27 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.592661:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7000, rc 0) 00000100:00100000:2.0:1746147204.592700:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2605:x1830967310139008:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3019us (3149us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.592710:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19256 00000100:00100000:3.0:1746147204.592828:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310139136 00000100:00100000:3.0:1746147204.592835:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310139136 00010000:00010000:3.0:1746147204.592861:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250611e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e071 expref: 16 pid: 9586 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.592893:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8726 00000100:00100000:3.0:1746147204.592900:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b404e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2003:x1830967310139136:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147204.592910:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147204.592930:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250611e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e071 expref: 16 pid: 9586 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.592946:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250611e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e071 expref: 16 pid: 9586 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.592969:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f212600/0x31399394250611e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e071 expref: 16 pid: 9586 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.593003:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.593005:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.593012:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x31399394250613a2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1b3 expref: 26 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.593020:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x31399394250613a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1b3 expref: 26 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.593049:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x31399394250613a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1b3 expref: 26 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.593061:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311372800:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147204.593155:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.594339:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.595392:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311372800:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147204.595410:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.595458:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310139264 00000100:00100000:2.0:1746147204.595467:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310139264 00000100:00100000:3.0:1746147204.595548:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b404e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967310139136:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2646us (3060us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.595558:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8726 00000100:00100000:2.0:1746147204.595654:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19257 00000100:00100000:2.0:1746147204.595662:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2604:x1830967310139264:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147204.595678:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.595693:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x31399394250613a9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e1ba expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.595717:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.595718:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.595724:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x31399394250613a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ba expref: 14 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.595737:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x31399394250613a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ba expref: 14 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.595749:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7e00, rc 0) 00000100:00100000:2.0:1746147204.595880:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2604:x1830967310139264:12345-192.168.204.25@tcp:101:cat.0 Request processed in 217us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.595885:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19257 00000100:00100000:0.0:1746147204.599599:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.599648:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.599677:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310139520 00000100:00100000:1.0:1746147204.599686:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310139520 00002000:00100000:1.0:1746147204.599726:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88011db16d80 x1830967310139520/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147204.599736:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db16d80 with x1830967310139520 ext(2097152->4194303) 00002000:00010000:1.0:1746147204.599743:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db16d80 00000100:00100000:1.0:1746147204.599759:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310139776 00000100:00100000:1.0:1746147204.599761:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310139776 00002000:00100000:1.0:1746147204.599786:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88011db17100 x1830967310139776/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147204.599790:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7066 00002000:00100000:1.0:1746147204.599792:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db17100 with x1830967310139776 ext(3145728->4194303) 00002000:00010000:1.0:1746147204.599794:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db17100 00000100:00100000:3.0:1746147204.599808:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310139520:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147204.599822:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7067 00000100:00100000:1.0:1746147204.599829:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310139776:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147204.605797:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.605847:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.605938:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310140160 00000100:00100000:2.0:1746147204.605949:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310140160 00002000:00100000:2.0:1746147204.605996:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800a5575880 x1830967310140160/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.606007:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5575880 with x1830967310140160 ext(3145728->4194303) 00002000:00010000:2.0:1746147204.606013:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5575880 00000100:00100000:2.0:1746147204.606031:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310140288 00000100:00100000:2.0:1746147204.606034:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310140288 00002000:00100000:2.0:1746147204.606046:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff8800a5576a00 x1830967310140288/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.606053:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5576a00 with x1830967310140288 ext(2097152->4194303) 00002000:00010000:2.0:1746147204.606055:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5576a00 00000100:00100000:2.0:1746147204.606084:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7068 00000100:00100000:2.0:1746147204.606112:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2000:x1830967310140160:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147204.606911:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7069 00000100:00100000:0.0:1746147204.606920:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310140288:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147204.610234:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310139776:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10392us (10572us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147204.610247:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7067 00002000:00100000:2.0:1746147204.610259:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88011db17100 x1830967310139776/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.610269:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db17100 with x1830967310139776 ext(3145728->4194303) 00002000:00010000:2.0:1746147204.610275:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db17100 00000100:00100000:3.0:1746147204.620499:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310139520:12345-192.168.204.25@tcp:3:cat.0 Request processed in 20689us (20898us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147204.620509:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7066 00002000:00100000:3.0:1746147204.620518:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88011db16d80 x1830967310139520/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.620527:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db16d80 with x1830967310139520 ext(2097152->4194303) 00002000:00010000:3.0:1746147204.620532:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db16d80 00000100:00100000:2.0:1746147204.622427:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2000:x1830967310140160:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16328us (16633us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147204.622437:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7068 00002000:00100000:2.0:1746147204.622446:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800a5575880 x1830967310140160/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.622455:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5575880 with x1830967310140160 ext(3145728->4194303) 00002000:00010000:2.0:1746147204.622459:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5575880 00000100:00100000:0.0:1746147204.631330:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.631696:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310140416 00000100:00100000:2.0:1746147204.631707:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310140416 00000100:00100000:2.0:1746147204.631762:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19258 00000100:00100000:2.0:1746147204.631778:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310140416:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147204.631799:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.631817:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c7e00/0x31399394250613b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e1c1 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.631870:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311372928:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147204.631953:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147204.632349:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310140288:12345-192.168.204.25@tcp:3:cat.0 Request processed in 25420us (26492us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147204.632360:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7069 00002000:00100000:1.0:1746147204.632371:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff8800a5576a00 x1830967310140288/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147204.632381:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5576a00 with x1830967310140288 ext(2097152->4194303) 00002000:00010000:1.0:1746147204.632386:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5576a00 00000100:00100000:2.0:1746147204.635443:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311372928:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147204.635472:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c7e00/0x31399394250613b0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1c1 expref: 38 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.635483:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c7e00/0x31399394250613b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1c1 expref: 38 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.635505:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7e00, rc 0) 00000100:00100000:2.0:1746147204.635553:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310140416:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3784us (4235us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147204.635561:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19258 00000100:00100000:0.0:1746147204.641197:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.641434:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310140672 00000100:00100000:1.0:1746147204.641449:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310140672 00002000:00100000:1.0:1746147204.641493:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff8800a5577480 x1830967310140672/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147204.641502:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5577480 with x1830967310140672 ext(4194304->4890623) 00002000:00010000:1.0:1746147204.641506:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5577480 00000100:00100000:1.0:1746147204.641543:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7070 00000100:00100000:1.0:1746147204.641550:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310140672:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147204.646235:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.646935:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310140928 00000100:00100000:2.0:1746147204.646944:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310140928 00002000:00100000:2.0:1746147204.646976:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff8800a5576300 x1830967310140928/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.646985:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5576300 with x1830967310140928 ext(4194304->4890623) 00002000:00010000:2.0:1746147204.646989:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5576300 00000100:00100000:1.0:1746147204.647840:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310140672:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6287us (6651us total) trans 0 rc 696320/696320 00000100:00100000:1.0:1746147204.647849:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7070 00002000:00100000:1.0:1746147204.647856:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff8800a5577480 x1830967310140672/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147204.647864:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5577480 with x1830967310140672 ext(4194304->4890623) 00002000:00010000:1.0:1746147204.647868:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5577480 00000100:00100000:1.0:1746147204.647886:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7071 00000100:00100000:1.0:1746147204.647892:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2002:x1830967310140928:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147204.652415:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.653154:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310141056 00000100:00100000:2.0:1746147204.653165:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310141056 00000100:00100000:2.0:1746147204.653218:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19259 00000100:00100000:2.0:1746147204.653225:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310141056:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147204.653229:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2002:x1830967310140928:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5338us (7001us total) trans 0 rc 696320/696320 00000100:00100000:1.0:1746147204.653237:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7071 00010000:00010000:2.0:1746147204.653238:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:1.0:1746147204.653245:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff8800a5576300 x1830967310140928/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147204.653252:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c7c00/0x31399394250613b7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e1c8 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746147204.653253:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5576300 with x1830967310140928 ext(4194304->4890623) 00002000:00010000:1.0:1746147204.653257:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5576300 00000100:00100000:2.0:1746147204.653293:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311373056:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147204.653363:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147204.654751:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311373056:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147204.654799:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c7c00/0x31399394250613b7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1c8 expref: 38 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.654813:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c7c00/0x31399394250613b7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1c8 expref: 38 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.654840:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7c00, rc 0) 00000100:00100000:2.0:1746147204.654888:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310141056:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1662us (2482us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147204.654896:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19259 00000100:00100000:0.0:1746147204.659604:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.659691:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310141184 00000100:00100000:2.0:1746147204.659701:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310141184 00000100:00100000:2.0:1746147204.659749:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19260 00000100:00100000:2.0:1746147204.659756:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310141184:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147204.659789:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.659809:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c7400/0x31399394250613be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e1cf expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.659865:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311373184:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147204.659956:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.662777:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.662918:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310141440 00000100:00100000:1.0:1746147204.662930:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310141440 00000100:00100000:3.0:1746147204.663417:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6071 00000100:00100000:3.0:1746147204.663427:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2604:x1830967310141440:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:0.0:1746147204.663460:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.663521:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310141696 00000100:00100000:2.0:1746147204.663526:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310141696 00000100:00100000:2.0:1746147204.663559:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16322 00000100:00100000:2.0:1746147204.663564:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2613:x1830967310141696:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147204.663575:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.663729:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x31399394250613c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e1d6 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.663799:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250613cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.663812:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250613cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.663823:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250613cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.663839:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x31399394250613d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.663843:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x31399394250613d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.663848:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x31399394250613d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:3.0:1746147204.663913:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2604:x1830967310141440:12345-192.168.204.25@tcp:35:cat.0 Request processed in 487us (1153us total) trans 8589937190 rc 0/0 00000100:00100000:3.0:1746147204.663919:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6071 00010000:00010000:2.0:1746147204.663920:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x31399394250613da lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.663928:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x31399394250613da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.663934:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x31399394250613da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:2.0:1746147204.663941:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147204.663979:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250613cc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.663985:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250613cc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.663990:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250613cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.663995:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250613cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00000100:00100000:3.0:1746147204.663999:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311373184:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147204.664000:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d95000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147204.664004:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250613cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.664009:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250613cc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.664018:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147204.664021:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147204.664024:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250613cc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.664027:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c7400/0x31399394250613be lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1cf expref: 38 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.664028:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250613cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.664036:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c7400/0x31399394250613be lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1cf expref: 38 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.664043:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7400, rc 0) 00000100:00100000:3.0:1746147204.664067:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310141184:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4307us (4471us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147204.664073:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19260 00010000:00010000:2.0:1746147204.664153:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x31399394250613d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.664159:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x31399394250613d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.664163:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x31399394250613d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.664167:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d95800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147204.664169:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x31399394250613d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.664173:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x31399394250613d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.664180:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096bb1f00) 00010000:00010000:2.0:1746147204.664183:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147204.664185:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x31399394250613d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.664189:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95800/0x31399394250613d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.664264:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f972c00/0x31399394250613c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1d6 expref: 34 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.664275:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x31399394250613da lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1d6 expref: 33 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.664281:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147204.664284:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147204.664286:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95e00, rc 0) 00000100:00100000:2.0:1746147204.664438:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2613:x1830967310141696:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 873us (985us total) trans 8589937191 rc 0/0 00000100:00100000:2.0:1746147204.664444:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16322 00000100:00100000:0.0:1746147204.667291:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.667420:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310141824 00000100:00100000:3.0:1746147204.667429:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310141824 00000100:00100000:3.0:1746147204.667479:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 972 00000100:00100000:3.0:1746147204.667487:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967310141824:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147204.667500:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147204.667523:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x31399394250613da lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1d6 expref: 33 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.667540:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147204.667544:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147204.667583:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967310141824:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 97us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.667589:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 972 00000100:00100000:0.0:1746147204.668053:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.668122:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310142080 00000100:00100000:3.0:1746147204.668126:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310142080 00000100:00100000:3.0:1746147204.668155:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6072 00000100:00100000:3.0:1746147204.668164:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2605:x1830967310142080:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147204.668858:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2605:x1830967310142080:12345-192.168.204.25@tcp:35:cat.0 Request processed in 691us (803us total) trans 8589937192 rc 0/0 00000100:00100000:3.0:1746147204.668865:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6072 00000100:00100000:0.0:1746147204.685853:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.686223:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310142336 00000100:00100000:2.0:1746147204.686234:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310142336 00000100:00100000:2.0:1746147204.686324:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16323 00000100:00100000:2.0:1746147204.686333:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2616:x1830967310142336:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147204.686360:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.686381:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x31399394250613e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e1dd expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.686487:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250613ef lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.686502:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42200/0x3139939425061275 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a9 expref: 32 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.686508:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6200/0x3139939425061283 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0b0 expref: 15 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.686514:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250613ef lrc: 5/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.686546:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6200/0x3139939425061283 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0b0 expref: 15 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.686559:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6200/0x3139939425061283 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0b0 expref: 15 pid: 7239 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.686576:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311373312:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147204.687373:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42200/0x3139939425061275 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a9 expref: 32 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.687382:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42200/0x3139939425061275 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a9 expref: 32 pid: 7237 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.687390:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311373440:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147204.687407:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147204.688926:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311373440:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147204.689323:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.689358:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.689386:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310142592 00000100:00100000:1.0:1746147204.689392:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310142592 00000100:00100000:3.0:1746147204.689415:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310142464 00000100:00100000:3.0:1746147204.689419:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310142464 00010000:00010000:1.0:1746147204.689425:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6200/0x3139939425061283 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0b0 expref: 16 pid: 7239 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.689426:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311373312:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.689435:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42200/0x3139939425061275 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a9 expref: 33 pid: 7237 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.689449:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8727 00010000:00010000:2.0:1746147204.689453:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250613ef lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:3.0:1746147204.689454:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8728 00000100:00100000:1.0:1746147204.689456:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967310142592:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147204.689459:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967310142464:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.689466:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147204.689467:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147204.689471:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42200/0x3139939425061275 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a9 expref: 33 pid: 7237 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.689471:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6200/0x3139939425061283 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0b0 expref: 16 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.689480:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42200/0x3139939425061275 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a9 expref: 33 pid: 7237 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.689500:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42200/0x3139939425061275 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0a9 expref: 33 pid: 7237 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.689533:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147204.689538:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250613ef lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.689545:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250613ef lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147204.689550:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147204.689586:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967310142464:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 125us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.689593:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8728 00010000:00010000:1.0:1746147204.690027:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6200/0x3139939425061283 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0b0 expref: 16 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.690040:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6200/0x3139939425061283 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e0b0 expref: 16 pid: 7239 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.690067:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.690071:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250613ef lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.690078:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250613ef lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.690084:0:4349:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250613ef lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.690122:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147204.690129:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250613ef lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.690135:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250613ef lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:1.0:1746147204.690149:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2001:x1830967310142592:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 693us (828us total) trans 0 rc 0/0 00000004:00200000:2.0:1746147204.690154:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000100:00100000:1.0:1746147204.690155:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8727 00010000:00010000:2.0:1746147204.690673:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x31399394250613e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1dd expref: 16 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.690702:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250613ef lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1dd expref: 15 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.690713:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147204.690715:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147204.690718:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94e00, rc 0) 00000100:00100000:2.0:1746147204.690762:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2616:x1830967310142336:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4427us (4917us total) trans 8589937193 rc 0/0 00000100:00100000:2.0:1746147204.690780:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16323 00000100:00100000:0.0:1746147204.773269:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.773837:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310142720 00000100:00100000:2.0:1746147204.773848:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310142720 00000100:00100000:2.0:1746147204.773913:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16324 00000100:00100000:2.0:1746147204.773921:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2618:x1830967310142720:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147204.773948:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.773971:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x31399394250613fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e1e4 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.774037:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x3139939425061404 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.774050:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x3139939425061404 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.774060:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x3139939425061404 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.774072:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x313993942506140b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.774081:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x313993942506140b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.774127:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x313993942506140b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.774199:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425061412 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.774209:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250613ef lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1dd expref: 14 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.774213:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425061412 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.774239:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250613ef lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1dd expref: 14 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.774248:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250613ef lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1dd expref: 14 pid: 7237 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.774257:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311373568:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147204.774346:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147204.777972:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311373568:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147204.777976:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147204.778001:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425061412 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:1.0:1746147204.778223:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310142848 00000100:00100000:1.0:1746147204.778231:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310142848 00010000:00010000:1.0:1746147204.778267:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250613ef lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1dd expref: 15 pid: 7237 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.778309:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8729 00000100:00100000:1.0:1746147204.778318:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2001:x1830967310142848:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.778333:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147204.778339:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250613ef lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1dd expref: 15 pid: 7237 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.778351:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250613ef lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1dd expref: 15 pid: 7237 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.778378:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x31399394250613ef lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1dd expref: 15 pid: 7237 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.778395:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147204.778400:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425061412 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.778409:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425061412 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.778416:0:4349:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425061412 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147204.778434:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147204.778484:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310142848:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 167us (510us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147204.778490:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425061412 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:1.0:1746147204.778491:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8729 00010000:00010000:2.0:1746147204.778497:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425061412 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:2.0:1746147204.778553:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:2.0:1746147204.778557:0:7237:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147204.778576:0:7237:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425061412 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.778585:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425061412 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.778596:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x3139939425061404 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.778602:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x3139939425061404 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.778607:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x3139939425061404 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.778612:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x3139939425061404 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.778617:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d94400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147204.778621:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x3139939425061404 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.778627:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x3139939425061404 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.778635:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147204.778637:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147204.778640:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x3139939425061404 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.778644:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x3139939425061404 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.778671:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x313993942506140b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.778676:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x313993942506140b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.778681:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x313993942506140b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.778685:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d94800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147204.778687:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x313993942506140b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.778738:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x313993942506140b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.778746:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096bb1a00) 00010000:00010000:2.0:1746147204.778748:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147204.778750:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x313993942506140b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.778754:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x313993942506140b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147204.778795:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x31399394250613fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1e4 expref: 11 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.778807:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425061412 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1e4 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.778813:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147204.778815:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147204.778818:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94200, rc 0) 00000100:00100000:2.0:1746147204.778845:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2618:x1830967310142720:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 4926us (5586us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.778852:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16324 00000100:00100000:0.0:1746147204.781155:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.781375:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310142976 00000100:00100000:3.0:1746147204.781386:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310142976 00000100:00100000:3.0:1746147204.781607:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19261 00000100:00100000:3.0:1746147204.781619:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2613:x1830967310142976:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147204.781635:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.781651:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d91e00/0x3139939425061419 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e1eb expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.781682:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x3139939425061394 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1a5 expref: 23 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.781689:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x313993942506139b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ac expref: 38 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.781696:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.781697:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.781700:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d91e00/0x3139939425061419 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3178496->4042751] (req 3178496->4042751) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1eb expref: 38 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.781732:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x313993942506139b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ac expref: 38 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.781742:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x313993942506139b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ac expref: 38 pid: 12201 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.781752:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311373696:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.781859:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x3139939425061394 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1a5 expref: 23 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.781867:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x3139939425061394 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1a5 expref: 23 pid: 13695 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.781874:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311373824:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147204.781893:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.781918:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.781937:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.781973:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.781990:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310143104 00000100:00100000:0.0:1746147204.781993:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310143104 00000100:00100000:0.0:1746147204.782019:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310143232 00000100:00100000:0.0:1746147204.782021:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310143232 00000100:00100000:0.0:1746147204.782033:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310143360 00000100:00100000:0.0:1746147204.782035:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310143360 00000100:00100000:0.0:1746147204.782047:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19262 00000100:00100000:0.0:1746147204.782053:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2003:x1830967310143104:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147204.782061:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147204.782068:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092542200/0x3139939425061420 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e1f2 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147204.782131:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311373952:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147204.782167:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147204.782205:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19263 00000100:00100000:3.0:1746147204.782211:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2002:x1830967310143232:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147204.782219:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.782227:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d90800/0x3139939425061427 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e1f9 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.782239:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.782241:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.782246:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d90800/0x3139939425061427 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1f9 expref: 17 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.782257:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d90800/0x3139939425061427 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1f9 expref: 17 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.782265:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d90800, rc 0) 00000100:00100000:3.0:1746147204.782295:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2002:x1830967310143232:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 80us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.782301:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19263 00000100:00100000:2.0:1746147204.782310:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19264 00000100:00100000:2.0:1746147204.782322:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2003:x1830967310143360:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147204.782336:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.782348:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x313993942506142e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e200 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.782367:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.782369:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.782375:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x313993942506142e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e200 expref: 17 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.782388:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x313993942506142e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e200 expref: 17 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.782396:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94a00, rc 0) 00000100:00100000:2.0:1746147204.782431:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967310143360:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 112us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.782437:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19264 00000100:00100000:0.0:1746147204.782793:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.783535:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.783602:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310143488 00000100:00100000:2.0:1746147204.783603:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310143616 00000100:00100000:3.0:1746147204.783608:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310143488 00000100:00100000:2.0:1746147204.783609:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310143616 00000100:00100000:3.0:1746147204.783635:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19265 00000100:00100000:3.0:1746147204.783640:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2003:x1830967310143488:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147204.783651:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147204.783654:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19266 00010000:00010000:3.0:1746147204.783659:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c7400/0x3139939425061435 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e207 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.783662:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2003:x1830967310143616:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147204.783673:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.783676:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.783677:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.783682:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c7400/0x3139939425061435 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e207 expref: 20 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.783683:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x313993942506143c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e20e expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.783691:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c7400/0x3139939425061435 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e207 expref: 21 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.783696:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.783697:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7400, rc 0) 00010000:00010000:2.0:1746147204.783704:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x313993942506143c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e20e expref: 21 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.783712:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x313993942506143c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e20e expref: 21 pid: 12201 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147204.783721:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2003:x1830967310143488:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 81us (929us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147204.783723:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95800, rc 0) 00000100:00100000:3.0:1746147204.783726:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19265 00000100:00100000:2.0:1746147204.783745:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2003:x1830967310143616:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 84us (211us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147204.783750:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19266 00000100:00100000:2.0:1746147204.784329:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.784342:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310143744 00000100:00100000:0.0:1746147204.784346:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310143744 00000100:00100000:0.0:1746147204.784380:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19267 00000100:00100000:0.0:1746147204.784386:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2002:x1830967310143744:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147204.784395:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147204.784405:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425061443 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e215 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.784417:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147204.784419:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147204.784424:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425061443 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e215 expref: 18 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147204.784440:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425061443 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e215 expref: 18 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147204.784449:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542000, rc 0) 00000100:00100000:0.0:1746147204.784478:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2002:x1830967310143744:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 91us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.784483:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19267 00000100:00100000:2.0:1746147204.795803:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.795836:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.795872:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310143872 00000100:00100000:2.0:1746147204.795881:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310143872 00010000:00010000:2.0:1746147204.795919:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x313993942506139b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ac expref: 39 pid: 12201 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.795947:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310144000 00000100:00100000:2.0:1746147204.795950:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310144000 00010000:00010000:2.0:1746147204.795961:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x3139939425061394 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1a5 expref: 24 pid: 13695 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.795983:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8730 00000100:00100000:2.0:1746147204.795990:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967310143872:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147204.796003:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147204.796024:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x313993942506139b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ac expref: 39 pid: 12201 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.796035:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x313993942506139b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ac expref: 39 pid: 12201 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.796061:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147204.796071:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8731 00000100:00100000:0.0:1746147204.796080:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2001:x1830967310144000:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147204.796101:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147204.796111:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x3139939425061394 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1a5 expref: 24 pid: 13695 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.796119:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967310143872:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 128us (327us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147204.796122:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x3139939425061394 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1a5 expref: 24 pid: 13695 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.796126:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8730 00010000:00010000:0.0:1746147204.796135:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147204.796138:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.796146:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x313993942506139b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ac expref: 38 pid: 12201 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.796146:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d91e00/0x3139939425061419 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3178496->4042751) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1eb expref: 38 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.796154:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d91e00/0x3139939425061419 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3178496->4042751) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1eb expref: 38 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.796185:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311373696:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147204.796187:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d91e00/0x3139939425061419 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3178496->4042751) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1eb expref: 37 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.796200:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b81c00/0x3139939425061394 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1a5 expref: 24 pid: 13695 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746147204.796200:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311374080:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147204.796210:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311373824:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.796236:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d91e00/0x3139939425061419 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->4042751) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1eb expref: 37 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.796239:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311373952:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147204.796260:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092542200/0x3139939425061420 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1f2 expref: 18 pid: 9584 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147204.796262:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c83c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746147204.796269:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092542200/0x3139939425061420 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1f2 expref: 18 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.796287:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542200, rc 0) 00010000:00010000:3.0:1746147204.796304:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d91e00, rc 0) 00000100:00100000:2.0:1746147204.796308:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967310143104:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 14255us (14390us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147204.796314:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19262 00000100:00100000:3.0:1746147204.796347:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2613:x1830967310142976:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 14732us (15201us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.796356:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19261 00010000:00010000:0.0:1746147204.799274:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147204.800252:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.800365:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311374080:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147204.800382:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147204.800401:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310144512 00000100:00100000:1.0:1746147204.800409:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310144512 00000100:00100000:0.0:1746147204.800420:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2001:x1830967310144000:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4341us (4583us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.800431:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8731 00002000:00100000:1.0:1746147204.800456:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3178496->3182591) req@ffff880099153100 x1830967310144512/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147204.800466:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099153100 with x1830967310144512 ext(3178496->3182591) 00002000:00010000:1.0:1746147204.800470:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099153100 00000100:00100000:0.0:1746147204.800473:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.800500:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7072 00000100:00100000:1.0:1746147204.800508:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310144512:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147204.800637:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310144512:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 129us (393us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147204.800643:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7072 00002000:00100000:1.0:1746147204.800649:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3178496->3182591) req@ffff880099153100 x1830967310144512/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/4536 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147204.800657:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099153100 with x1830967310144512 ext(3178496->3182591) 00002000:00010000:1.0:1746147204.800660:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099153100 00000100:00100000:3.0:1746147204.800699:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310144256 00000100:00100000:3.0:1746147204.800710:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310144256 00000100:00100000:2.0:1746147204.800763:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.800857:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310144768 00000100:00100000:3.0:1746147204.800860:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310144768 00000100:00100000:2.0:1746147204.800863:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16325 00000100:00100000:2.0:1746147204.800872:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2621:x1830967310144256:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147204.800887:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147204.800893:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16326 00000100:00100000:3.0:1746147204.800900:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2618:x1830967310144768:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147204.800906:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x313993942506144a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e21c expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.800916:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.800931:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7e00/0x3139939425061451 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e223 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.800973:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425061458 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.800986:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425061458 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.800996:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425061458 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.801007:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506145f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147204.801012:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7c00/0x3139939425061466 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147204.801013:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506145f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.801019:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506145f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147204.801024:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425061412 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1e4 expref: 11 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.801030:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7c00/0x3139939425061466 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.801056:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425061412 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1e4 expref: 11 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.801066:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425061412 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1e4 expref: 11 pid: 7237 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.801077:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311374208:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147204.801134:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x313993942506146d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.801142:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x313993942506146d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.801154:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x313993942506146d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147204.801162:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147204.801241:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425061458 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.801246:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425061458 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.801252:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425061458 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.801258:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425061458 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.801264:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d95000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147204.801268:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425061458 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.801273:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425061458 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.801283:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147204.801286:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147204.801289:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425061458 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.801293:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425061458 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.801303:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506145f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.801308:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506145f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.801316:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506145f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.801319:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d95e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147204.801321:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506145f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.801325:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506145f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.801330:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096bb1c00) 00010000:00010000:2.0:1746147204.801332:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147204.801333:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506145f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.801338:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506145f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147204.801371:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94400/0x313993942506144a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e21c expref: 35 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.801380:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x313993942506146d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e21c expref: 34 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.801386:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147204.801387:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147204.801390:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7600, rc 0) 00000100:00100000:2.0:1746147204.801414:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2621:x1830967310144256:12345-192.168.204.25@tcp:101:cat.0 Request processed in 545us (939us total) trans 8589937194 rc 0/0 00000100:00100000:3.0:1746147204.801417:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147204.801420:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16325 00000100:00100000:0.0:1746147204.803114:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.803139:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310144896 00000100:00100000:0.0:1746147204.803145:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310144896 00010000:00010000:0.0:1746147204.803173:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425061412 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1e4 expref: 12 pid: 7237 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.803241:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311374208:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.803263:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7c00/0x3139939425061466 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147204.803334:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8732 00000100:00100000:0.0:1746147204.803341:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b404ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2002:x1830967310144896:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147204.803354:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147204.803359:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425061412 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1e4 expref: 12 pid: 7237 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.803370:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425061412 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1e4 expref: 12 pid: 7237 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.803389:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94200/0x3139939425061412 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1e4 expref: 12 pid: 7237 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746147204.803449:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147204.803454:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7c00/0x3139939425061466 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147204.803465:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7c00/0x3139939425061466 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147204.803470:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7c00/0x3139939425061466 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147204.803495:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147204.803526:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b404ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2002:x1830967310144896:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 184us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.803532:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8732 00010000:00010000:3.0:1746147204.803794:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7c00/0x3139939425061466 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.803800:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7c00/0x3139939425061466 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147204.803817:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147204.803935:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7e00/0x3139939425061451 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e223 expref: 12 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.803949:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7c00/0x3139939425061466 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e223 expref: 11 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.803955:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147204.803957:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147204.803959:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7c00, rc 0) 00000100:00100000:3.0:1746147204.803985:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2618:x1830967310144768:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 3086us (3223us total) trans 8589937195 rc 0/0 00000100:00100000:3.0:1746147204.803991:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16326 00000100:00100000:0.0:1746147204.806467:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.806641:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310145152 00000100:00100000:3.0:1746147204.806648:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310145152 00000100:00100000:3.0:1746147204.806736:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16327 00000100:00100000:3.0:1746147204.806745:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2618:x1830967310145152:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147204.806778:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.806782:0:16099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147204.806807:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7c00/0x3139939425061466 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e223 expref: 11 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.806822:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147204.806826:0:16099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147204.806837:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91200/0x3139939425061482 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e22a expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.807287:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061489 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.807305:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061489 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.807314:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061489 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.807325:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061489 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.807331:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061489 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.807336:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061489 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.807342:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d91400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147204.807345:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061489 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.807351:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061489 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.807358:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147204.807361:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147204.807364:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061489 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.807368:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061489 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.807390:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91200/0x3139939425061482 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e22a expref: 11 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.807397:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91200/0x3139939425061482 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e22a expref: 11 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.807403:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d91200, rc 0) 00000100:00100000:3.0:1746147204.807500:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2618:x1830967310145152:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 755us (1041us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147204.807507:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16327 00000100:00100000:0.0:1746147204.809551:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.809649:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310145408 00000100:00100000:3.0:1746147204.809658:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310145408 00000100:00100000:3.0:1746147204.809716:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6073 00000100:00100000:3.0:1746147204.809723:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2618:x1830967310145408:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:3.0:1746147204.809918:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2618:x1830967310145408:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 195us (374us total) trans 8589937196 rc 0/0 00000100:00100000:3.0:1746147204.809924:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6073 00000100:00100000:0.0:1746147204.810499:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.810641:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310145664 00000100:00100000:3.0:1746147204.810646:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310145664 00002000:00100000:3.0:1746147204.810670:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4038656->4042751) req@ffff88012f3cdc00 x1830967310145664/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.810684:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cdc00 with x1830967310145664 ext(4038656->4042751) 00002000:00010000:3.0:1746147204.810688:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3cdc00 00000100:00100000:3.0:1746147204.810842:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7073 00000100:00100000:3.0:1746147204.810848:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310145664:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147204.811186:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310145664:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 336us (686us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147204.811386:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7073 00002000:00100000:3.0:1746147204.811393:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4038656->4042751) req@ffff88012f3cdc00 x1830967310145664/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/4536 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.811399:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cdc00 with x1830967310145664 ext(4038656->4042751) 00002000:00010000:3.0:1746147204.811402:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3cdc00 00000100:00100000:0.0:1746147204.813842:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.814227:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310145792 00000100:00100000:3.0:1746147204.814236:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310145792 00000100:00100000:3.0:1746147204.814289:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19268 00000100:00100000:3.0:1746147204.814296:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310145792:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147204.814312:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.814334:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d90200/0x3139939425061490 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e231 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147204.814397:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311374336:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147204.814485:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.816397:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.816591:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310146048 00000100:00100000:3.0:1746147204.816598:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310146048 00000100:00100000:3.0:1746147204.816646:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6074 00000100:00100000:3.0:1746147204.816655:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2613:x1830967310146048:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147204.816731:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311374336:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147204.816763:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d90200/0x3139939425061490 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e231 expref: 38 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.816790:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d90200/0x3139939425061490 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e231 expref: 38 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.816813:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d90200, rc 0) 00000100:00100000:3.0:1746147204.816854:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2613:x1830967310146048:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 199us (463us total) trans 8589937197 rc 0/0 00000100:00100000:2.0:1746147204.816854:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310145792:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2559us (3020us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147204.816861:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6074 00000100:00100000:2.0:1746147204.816861:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19268 00000100:00100000:0.0:1746147204.818653:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.818754:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310146176 00000100:00100000:2.0:1746147204.818762:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310146176 00000100:00100000:2.0:1746147204.818810:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19269 00000100:00100000:2.0:1746147204.818816:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2621:x1830967310146176:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147204.818831:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.818974:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x3139939425061497 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e238 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.819007:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x313993942506136a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->950271) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e17b expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.819015:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147204.819017:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147204.819020:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x3139939425061497 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e238 expref: 38 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.819050:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x313993942506136a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->950271) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e17b expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.819062:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x313993942506136a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->950271) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e17b expref: 22 pid: 1854 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.819073:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099153800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311374464:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147204.819507:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147204.821541:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.821762:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310146304 00000100:00100000:3.0:1746147204.821779:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310146304 00000100:00100000:0.0:1746147204.821871:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099153800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311374464:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147204.821908:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x3139939425061497 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e238 expref: 38 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147204.821928:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c6600, rc 0) 00000100:00100000:0.0:1746147204.822001:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2621:x1830967310146176:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3181us (3351us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147204.822013:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19269 00002000:00100000:3.0:1746147204.822127:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (913408->950271) req@ffff880099150700 x1830967310146304/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.822136:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150700 with x1830967310146304 ext(913408->950271) 00010000:00010000:3.0:1746147204.822143:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x313993942506136a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->950271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e17b expref: 23 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.822156:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x313993942506136a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->950271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e17b expref: 23 pid: 1854 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746147204.822162:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099150700 00000100:00100000:3.0:1746147204.822186:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1646 00000100:00100000:3.0:1746147204.822193:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2001:x1830967310146304:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147204.825046:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2001:x1830967310146304:12345-192.168.204.25@tcp:4:cat.0 Request processed in 2842us (3504us total) trans 21474842486 rc 0/0 00000100:00100000:3.0:1746147204.825055:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1646 00002000:00100000:3.0:1746147204.825064:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (913408->950271) req@ffff880099150700 x1830967310146304/t21474842486(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/448 e 0 to 0 dl 1746147215 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.825072:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150700 with x1830967310146304 ext(913408->950271) 00010000:00010000:3.0:1746147204.825081:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x313993942506136a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->950271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e17b expref: 25 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.825121:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x313993942506136a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->950271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e17b expref: 25 pid: 1854 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746147204.825128:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099150700 00000100:00100000:0.0:1746147204.826713:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.826829:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310146432 00000100:00100000:2.0:1746147204.826837:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310146432 00010000:00010000:2.0:1746147204.826873:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x313993942506136a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->950271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e17b expref: 25 pid: 1854 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.826903:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8733 00000100:00100000:2.0:1746147204.826911:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2001:x1830967310146432:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147204.826925:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147204.826945:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x313993942506136a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->950271) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e17b expref: 25 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.826957:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x313993942506136a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->950271) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e17b expref: 25 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.826981:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cd2200/0x313993942506136a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->950271) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e17b expref: 25 pid: 1854 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.827019:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.827022:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.827030:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x3139939425061497 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e238 expref: 37 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.827038:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x3139939425061497 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e238 expref: 37 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.827077:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x3139939425061497 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e238 expref: 37 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.827213:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311374592:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147204.827505:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147204.832372:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311374592:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147204.832390:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147204.832399:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.832440:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2001:x1830967310146432:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5530us (5732us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.832451:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8733 00000100:00100000:3.0:1746147204.832554:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310146688 00000100:00100000:3.0:1746147204.832562:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310146688 00002000:00100000:3.0:1746147204.832599:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88012f3cc380 x1830967310146688/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.832607:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cc380 with x1830967310146688 ext(0->1048575) 00002000:00010000:3.0:1746147204.832612:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3cc380 00000100:00100000:3.0:1746147204.832749:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7074 00000100:00100000:3.0:1746147204.832755:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310146688:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147204.833511:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.833575:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310146816 00000100:00100000:1.0:1746147204.833579:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310146816 00000100:00100000:1.0:1746147204.833603:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19270 00000100:00100000:1.0:1746147204.833608:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2616:x1830967310146816:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147204.833617:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.833633:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e23f expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.833658:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d91e00/0x3139939425061419 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->4042751) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1eb expref: 39 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.833664:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147204.833666:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147204.833668:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3047424->3145727] (req 3047424->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 25 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.833695:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d91e00/0x3139939425061419 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->4042751) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1eb expref: 39 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.833710:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d91e00/0x3139939425061419 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->4042751) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1eb expref: 39 pid: 13695 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.833720:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311374720:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147204.833788:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.837831:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.837950:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311374720:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147204.837982:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3047424->3145727] (req 3047424->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 25 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.838002:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9b4e00, rc 0) 00000100:00100000:1.0:1746147204.838049:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2616:x1830967310146816:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4439us (4538us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.838057:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19270 00000100:00100000:2.0:1746147204.838151:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310146944 00000100:00100000:2.0:1746147204.838159:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310146944 00002000:00100000:2.0:1746147204.838194:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3178496->4042751) req@ffff8800a5576d80 x1830967310146944/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.838203:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5576d80 with x1830967310146944 ext(3178496->4042751) 00010000:00010000:2.0:1746147204.838209:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d91e00/0x3139939425061419 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1eb expref: 40 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.838220:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d91e00/0x3139939425061419 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1eb expref: 40 pid: 13695 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746147204.838231:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5576d80 00000100:00100000:2.0:1746147204.838284:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1647 00000100:00100000:2.0:1746147204.838291:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967310146944:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147204.838879:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967310146688:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6123us (6489us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147204.838886:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7074 00002000:00100000:2.0:1746147204.838892:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88012f3cc380 x1830967310146688/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.838899:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cc380 with x1830967310146688 ext(0->1048575) 00002000:00010000:2.0:1746147204.838903:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3cc380 00000100:00100000:2.0:1746147204.847610:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967310146944:12345-192.168.204.25@tcp:4:cat.0 Request processed in 9306us (9776us total) trans 21474842487 rc 0/0 00000100:00100000:2.0:1746147204.847624:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1647 00002000:00100000:2.0:1746147204.847638:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3178496->4042751) req@ffff8800a5576d80 x1830967310146944/t21474842487(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/448 e 0 to 0 dl 1746147215 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.847646:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5576d80 with x1830967310146944 ext(3178496->4042751) 00010000:00010000:2.0:1746147204.847657:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d91e00/0x3139939425061419 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1eb expref: 40 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.847672:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d91e00/0x3139939425061419 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1eb expref: 40 pid: 13695 timeout: 842 lvb_type: 0 00002000:00010000:2.0:1746147204.847678:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5576d80 00000100:00100000:0.0:1746147204.850530:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.850650:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310147072 00000100:00100000:2.0:1746147204.850660:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310147072 00010000:00010000:2.0:1746147204.850696:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d91e00/0x3139939425061419 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1eb expref: 40 pid: 13695 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.850725:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8734 00000100:00100000:2.0:1746147204.850733:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967310147072:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147204.850749:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147204.850777:0:7226:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147203 -> 1746147204 00010000:00010000:2.0:1746147204.850783:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d91e00/0x3139939425061419 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3178496->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1eb expref: 40 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.850794:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d91e00/0x3139939425061419 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3178496->4042751) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1eb expref: 40 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.850818:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d91e00/0x3139939425061419 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3178496->4042751) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1eb expref: 40 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.850851:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.850853:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.850861:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 24 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.850867:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 24 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.850900:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 24 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.850917:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311374848:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147204.851124:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.851510:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.851657:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310147200 00000100:00100000:2.0:1746147204.851661:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310147200 00000100:00100000:2.0:1746147204.851686:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19271 00000100:00100000:2.0:1746147204.851692:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2621:x1830967310147200:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147204.851706:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147204.851718:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x31399394250614a5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e246 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.851734:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 24 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.851740:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147204.851741:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147204.851744:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x31399394250614a5 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e246 expref: 41 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.851758:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 24 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.851782:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 24 pid: 13695 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.851790:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099153480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311374976:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147204.851847:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.853603:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.853659:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099153480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311374976:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.853688:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x31399394250614a5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e246 expref: 41 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.853705:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371ca00, rc 0) 00000100:00100000:3.0:1746147204.853755:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2621:x1830967310147200:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2061us (2243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147204.853774:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19271 00000100:00100000:3.0:1746147204.853820:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310147456 00000100:00100000:3.0:1746147204.853826:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310147456 00002000:00100000:3.0:1746147204.853861:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3047424->3051519) req@ffff880091d96680 x1830967310147456/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746147204.853869:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311374848:192.168.204.25@tcp:105: 00002000:00100000:3.0:1746147204.853870:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d96680 with x1830967310147456 ext(3047424->3051519) 00010000:00010000:3.0:1746147204.853877:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 25 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.853889:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 25 pid: 13695 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746147204.853895:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d96680 00000100:00100000:3.0:1746147204.853910:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1648 00000100:00100000:3.0:1746147204.853916:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2001:x1830967310147456:12345-192.168.204.25@tcp:3:multiop.0 00010000:00010000:2.0:1746147204.853980:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.854004:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967310147072:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3272us (3484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.854013:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8734 00000100:00100000:3.0:1746147204.854725:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2001:x1830967310147456:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 808us (1127us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147204.854731:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1648 00002000:00100000:3.0:1746147204.854736:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3047424->3051519) req@ffff880091d96680 x1830967310147456/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/4536 e 0 to 0 dl 1746147215 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.854744:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d96680 with x1830967310147456 ext(3047424->3051519) 00010000:00010000:3.0:1746147204.854895:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 25 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.854906:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 25 pid: 13695 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746147204.854913:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d96680 00000100:00100000:0.0:1746147204.857125:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.857220:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310147712 00000100:00100000:3.0:1746147204.857231:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310147712 00002000:00100000:3.0:1746147204.857274:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3047424->3145727) req@ffff880091d96d80 x1830967310147712/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.857283:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d96d80 with x1830967310147712 ext(3047424->3145727) 00010000:00010000:3.0:1746147204.857292:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 25 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.857304:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 25 pid: 13695 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746147204.857310:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d96d80 00000100:00100000:3.0:1746147204.857341:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1649 00000100:00100000:3.0:1746147204.857348:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2000:x1830967310147712:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147204.857356:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.857528:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310147840 00000100:00100000:3.0:1746147204.857531:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310147840 00000100:00100000:3.0:1746147204.857559:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19272 00000100:00100000:3.0:1746147204.857563:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2616:x1830967310147840:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147204.857572:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.857585:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250614ac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e24d expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.857604:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x31399394250613a2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1b3 expref: 26 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.857610:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425061443 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e215 expref: 17 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.857618:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x31399394250613a9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ba expref: 15 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.857622:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.857624:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147204.857626:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250614ac lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->2936831] (req 2097152->2936831) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e24d expref: 15 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.857652:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x31399394250613a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ba expref: 15 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.857658:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x31399394250613a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ba expref: 15 pid: 13695 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.857666:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311375104:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.857740:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425061443 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e215 expref: 17 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147204.857748:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425061443 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e215 expref: 17 pid: 1136 timeout: 842 lvb_type: 1 00000100:00100000:3.0:1746147204.857756:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311375232:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147204.857800:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x31399394250613a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1b3 expref: 26 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.857812:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x31399394250613a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1b3 expref: 26 pid: 13695 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147204.857820:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311375360:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147204.857845:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.861124:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311375104:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147204.861140:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311375232:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147204.861471:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.861569:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311375360:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147204.861620:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250614ac lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->2936831] (req 2097152->2936831) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e24d expref: 15 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.861634:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05000, rc 0) 00000100:00100000:1.0:1746147204.861673:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2616:x1830967310147840:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4108us (4316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.861681:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19272 00000100:00100000:2.0:1746147204.861759:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310147968 00000100:00100000:2.0:1746147204.861777:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310147968 00010000:00010000:2.0:1746147204.861807:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425061443 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e215 expref: 18 pid: 1136 timeout: 842 lvb_type: 1 00000100:00100000:2.0:1746147204.861833:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8735 00000100:00100000:2.0:1746147204.861840:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310147968:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147204.861852:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147204.861869:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425061443 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e215 expref: 18 pid: 1136 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746147204.861879:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425061443 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e215 expref: 18 pid: 1136 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746147204.861900:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425061443 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e215 expref: 18 pid: 1136 timeout: 842 lvb_type: 1 00010000:00010000:2.0:1746147204.861934:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.861973:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310147968:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 133us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.861983:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8735 00000100:00100000:3.0:1746147204.862591:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2000:x1830967310147712:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 5242us (5499us total) trans 21474842488 rc 0/0 00000100:00100000:3.0:1746147204.862600:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1649 00002000:00100000:3.0:1746147204.862608:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3047424->3145727) req@ffff880091d96d80 x1830967310147712/t21474842488(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/448 e 0 to 0 dl 1746147215 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.862617:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d96d80 with x1830967310147712 ext(3047424->3145727) 00010000:00010000:3.0:1746147204.862623:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 27 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.862633:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 27 pid: 13695 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746147204.862639:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d96d80 00000100:00100000:0.0:1746147204.863890:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.864063:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310148096 00000100:00100000:2.0:1746147204.864070:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310148096 00010000:00010000:2.0:1746147204.864126:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x31399394250613a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ba expref: 15 pid: 13695 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.864151:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8736 00000100:00100000:2.0:1746147204.864158:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310148096:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147204.864174:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147204.864189:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x31399394250613a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ba expref: 15 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.864200:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x31399394250613a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ba expref: 15 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.864218:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7e00/0x31399394250613a9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1ba expref: 15 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.864230:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.864276:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310148096:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 119us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.864282:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8736 00000100:00100000:3.0:1746147204.864652:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.864849:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310148224 00000100:00100000:1.0:1746147204.864853:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310148224 00010000:00010000:1.0:1746147204.864870:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 27 pid: 13695 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.864885:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8737 00000100:00100000:1.0:1746147204.864891:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2003:x1830967310148224:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147204.864898:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147204.864909:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 27 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.864917:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 27 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.864930:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4e00/0x313993942506149e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3047424->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e23f expref: 27 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:1.0:1746147204.864942:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.864944:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.864950:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x31399394250614a5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e246 expref: 39 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.864957:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x31399394250614a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e246 expref: 39 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.864984:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x31399394250614a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e246 expref: 39 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147204.864995:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311375488:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147204.865040:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.865405:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.865516:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310148352 00000100:00100000:2.0:1746147204.865521:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310148352 00010000:00010000:2.0:1746147204.865536:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x31399394250613a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1b3 expref: 27 pid: 13695 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.865572:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8738 00000100:00100000:2.0:1746147204.865577:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310148352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147204.865584:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147204.865593:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x31399394250613a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1b3 expref: 27 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.865602:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x31399394250613a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1b3 expref: 27 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.865612:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7000/0x31399394250613a2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1b3 expref: 27 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.865620:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.865626:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.865630:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250614ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2936831) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e24d expref: 13 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.865636:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250614ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2936831) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e24d expref: 13 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.865653:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250614ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2936831) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e24d expref: 13 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.866004:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311375616:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147204.866483:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147204.866972:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311375488:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147204.866986:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147204.867062:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2003:x1830967310148224:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2169us (2408us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.867069:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8737 00000100:00100000:2.0:1746147204.869373:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311375616:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147204.869392:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.869426:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310148352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3848us (4021us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.869434:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8738 00000100:00100000:3.0:1746147204.870133:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.870194:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310148608 00000100:00100000:0.0:1746147204.870201:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310148608 00002000:00100000:0.0:1746147204.870259:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88009988b100 x1830967310148608/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147204.870269:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009988b100 with x1830967310148608 ext(2097152->3145727) 00002000:00010000:0.0:1746147204.870273:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009988b100 00000100:00100000:0.0:1746147204.871174:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7075 00000100:00100000:0.0:1746147204.871183:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967310148608:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147204.874653:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.875221:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310148864 00000100:00100000:2.0:1746147204.875229:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310148864 00002000:00100000:2.0:1746147204.875261:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (2932736->2936831) req@ffff880091d97800 x1830967310148864/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.875271:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97800 with x1830967310148864 ext(2932736->2936831) 00002000:00010000:2.0:1746147204.875275:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d97800 00000100:00100000:2.0:1746147204.876182:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7076 00000100:00100000:2.0:1746147204.876190:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310148864:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147204.876303:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310148864:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 113us (1656us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147204.876309:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7076 00002000:00100000:2.0:1746147204.876315:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (2932736->2936831) req@ffff880091d97800 x1830967310148864/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/4536 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.876322:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97800 with x1830967310148864 ext(2932736->2936831) 00002000:00010000:2.0:1746147204.876325:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d97800 00000100:00100000:2.0:1746147204.882648:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967310148608:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11458us (12510us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147204.882659:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7075 00002000:00100000:2.0:1746147204.882670:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88009988b100 x1830967310148608/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.882685:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009988b100 with x1830967310148608 ext(2097152->3145727) 00002000:00010000:2.0:1746147204.882691:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009988b100 00000100:00100000:0.0:1746147204.883983:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.884041:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310149120 00000100:00100000:1.0:1746147204.884051:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310149120 00000100:00100000:1.0:1746147204.884126:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6075 00000100:00100000:1.0:1746147204.884133:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2616:x1830967310149120:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147204.884162:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.884361:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310149376 00000100:00100000:3.0:1746147204.884365:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310149376 00000100:00100000:3.0:1746147204.884391:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16328 00000100:00100000:3.0:1746147204.884396:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2626:x1830967310149376:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147204.884404:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147204.884594:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae200/0x31399394250614b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e254 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.884639:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.884648:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.884657:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:1.0:1746147204.884718:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2616:x1830967310149120:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 585us (742us total) trans 8589937198 rc 0/0 00000100:00100000:1.0:1746147204.884723:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6075 00010000:00010000:3.0:1746147204.884939:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x31399394250614c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.884951:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x31399394250614c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.884958:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x31399394250614c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.885170:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x31399394250614c8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.885179:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x31399394250614c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.885184:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x31399394250614c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147204.885192:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147204.885223:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.885232:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.885237:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.885241:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0ae600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147204.885243:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.885248:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.885255:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147204.885257:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147204.885261:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.885265:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.885274:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x31399394250614c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.885278:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x31399394250614c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.885282:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x31399394250614c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.885285:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0ae000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147204.885287:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x31399394250614c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.885293:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x31399394250614c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.885298:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094fbdd00) 00010000:00010000:3.0:1746147204.885300:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147204.885301:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x31399394250614c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.885304:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x31399394250614c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147204.885327:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae200/0x31399394250614b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e254 expref: 18 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.885335:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x31399394250614c8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e254 expref: 17 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147204.885339:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147204.885341:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147204.885342:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0aec00, rc 0) 00000100:00100000:3.0:1746147204.885365:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2626:x1830967310149376:12345-192.168.204.25@tcp:101:cat.0 Request processed in 969us (1204us total) trans 8589937199 rc 0/0 00000100:00100000:3.0:1746147204.885371:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16328 00000100:00100000:0.0:1746147204.888846:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.888938:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310149504 00000100:00100000:1.0:1746147204.888946:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310149504 00000100:00100000:1.0:1746147204.888990:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19273 00000100:00100000:1.0:1746147204.888996:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2621:x1830967310149504:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.889011:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.889024:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982a2600/0x31399394250614d6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e25b expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.889046:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250614ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2936831) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e24d expref: 13 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.889053:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147204.889054:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147204.889058:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a2600/0x31399394250614d6 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e25b expref: 27 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.889082:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250614ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2936831) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e24d expref: 13 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.889118:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250614ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2936831) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e24d expref: 13 pid: 13695 timeout: 842 lvb_type: 0 00000100:00100000:1.0:1746147204.889129:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311375744:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147204.889200:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147204.890189:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.890383:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.890441:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310149632 00000100:00100000:1.0:1746147204.890446:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310149632 00000100:00100000:2.0:1746147204.890462:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310149760 00000100:00100000:2.0:1746147204.890469:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310149760 00000100:00100000:1.0:1746147204.890486:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19274 00000100:00100000:1.0:1746147204.890491:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2001:x1830967310149632:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.890502:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.890513:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800982a3c00/0x31399394250614dd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e262 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.890521:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19275 00010000:00010000:1.0:1746147204.890526:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147204.890528:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2000:x1830967310149760:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.890528:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.890533:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800982a3c00/0x31399394250614dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e262 expref: 28 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.890542:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.890544:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800982a3c00/0x31399394250614dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e262 expref: 28 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147204.890551:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982a3c00, rc 0) 00010000:00010000:2.0:1746147204.890556:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009371c600/0x31399394250614e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e269 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.890578:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.890580:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.890587:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371c600/0x31399394250614e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e269 expref: 29 pid: 9584 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147204.890587:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310149632:12345-192.168.204.25@tcp:101:cat.0 Request processed in 95us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.890593:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19274 00010000:00010000:2.0:1746147204.890598:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009371c600/0x31399394250614e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e269 expref: 29 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147204.890607:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371c600, rc 0) 00000100:00100000:2.0:1746147204.890640:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2000:x1830967310149760:12345-192.168.204.25@tcp:101:cat.0 Request processed in 112us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.890646:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19275 00000100:00100000:1.0:1746147204.892500:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311375744:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147204.892523:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800982a2600/0x31399394250614d6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e25b expref: 27 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.892535:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982a2600, rc 0) 00000100:00100000:1.0:1746147204.892583:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2621:x1830967310149504:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3586us (3743us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.892590:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19273 00000100:00100000:0.0:1746147204.893175:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.893221:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310149888 00000100:00100000:3.0:1746147204.893227:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310149888 00002000:00100000:3.0:1746147204.893253:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->2936831) req@ffff880091d95c00 x1830967310149888/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.893259:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d95c00 with x1830967310149888 ext(2097152->2936831) 00010000:00010000:3.0:1746147204.893264:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250614ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e24d expref: 14 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.893272:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250614ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e24d expref: 14 pid: 13695 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746147204.893276:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091d95c00 00000100:00100000:3.0:1746147204.893288:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1650 00000100:00100000:3.0:1746147204.893292:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310149888:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147204.897965:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.898681:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310150144 00000100:00100000:2.0:1746147204.898690:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310150144 00002000:00100000:2.0:1746147204.898731:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880091d94000 x1830967310150144/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.898745:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94000 with x1830967310150144 ext(0->1048575) 00002000:00010000:2.0:1746147204.898750:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d94000 00000100:00100000:2.0:1746147204.898791:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7077 00000100:00100000:2.0:1746147204.898799:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2000:x1830967310150144:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147204.902082:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310149888:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 8778us (8898us total) trans 17179875104 rc 0/0 00000100:00100000:3.0:1746147204.902119:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1650 00002000:00100000:3.0:1746147204.902130:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->2936831) req@ffff880091d95c00 x1830967310149888/t17179875104(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/448 e 0 to 0 dl 1746147215 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.902140:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d95c00 with x1830967310149888 ext(2097152->2936831) 00010000:00010000:3.0:1746147204.902150:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250614ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e24d expref: 16 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:3.0:1746147204.902166:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250614ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e24d expref: 16 pid: 13695 timeout: 842 lvb_type: 0 00002000:00010000:3.0:1746147204.902172:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091d95c00 00000100:00100000:2.0:1746147204.906847:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2000:x1830967310150144:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8040us (8884us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147204.906859:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7077 00002000:00100000:2.0:1746147204.906868:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880091d94000 x1830967310150144/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.906878:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94000 with x1830967310150144 ext(0->1048575) 00002000:00010000:2.0:1746147204.906883:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d94000 00000100:00100000:1.0:1746147204.909865:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.910078:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310150272 00000100:00100000:2.0:1746147204.910086:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310150272 00010000:00010000:2.0:1746147204.910135:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250614ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e24d expref: 16 pid: 13695 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147204.910162:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8739 00000100:00100000:2.0:1746147204.910168:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b404c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967310150272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147204.910180:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147204.910196:0:7226:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147203 -> 1746147204 00010000:00010000:2.0:1746147204.910202:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250614ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e24d expref: 16 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.910213:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250614ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2936831) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e24d expref: 16 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.910233:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x31399394250614ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2936831) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e24d expref: 16 pid: 13695 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147204.910260:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.910263:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147204.910269:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982a2600/0x31399394250614d6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e25b expref: 26 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.910276:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a2600/0x31399394250614d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e25b expref: 26 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147204.910305:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800982a2600/0x31399394250614d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e25b expref: 26 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147204.910316:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311375872:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147204.910389:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147204.915937:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311375872:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147204.915956:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147204.916013:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b404c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2001:x1830967310150272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5845us (6156us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147204.916021:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8739 00000100:00100000:0.0:1746147204.920850:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.920933:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310150528 00000100:00100000:2.0:1746147204.920942:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310150528 00002000:00100000:2.0:1746147204.920982:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880091d97480 x1830967310150528/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.921065:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97480 with x1830967310150528 ext(2097152->3145727) 00002000:00010000:2.0:1746147204.921070:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d97480 00000100:00100000:2.0:1746147204.921128:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7078 00000100:00100000:2.0:1746147204.921136:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2001:x1830967310150528:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147204.922400:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.922443:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310150912 00000100:00100000:3.0:1746147204.922448:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310150912 00002000:00100000:3.0:1746147204.922473:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff880094e5b480 x1830967310150912/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.922486:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e5b480 with x1830967310150912 ext(2097152->4194303) 00002000:00010000:3.0:1746147204.922490:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e5b480 00000100:00100000:3.0:1746147204.922514:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7079 00000100:00100000:3.0:1746147204.922521:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310150912:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147204.924862:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147204.925276:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310151040 00000100:00100000:2.0:1746147204.925285:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310151040 00002000:00100000:2.0:1746147204.925317:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880094e58380 x1830967310151040/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.925326:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e58380 with x1830967310151040 ext(3145728->4194303) 00002000:00010000:2.0:1746147204.925332:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e58380 00000100:00100000:2.0:1746147204.925358:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7080 00000100:00100000:2.0:1746147204.925365:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967310151040:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147204.932794:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2001:x1830967310150528:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11650us (11944us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147204.932804:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7078 00002000:00100000:2.0:1746147204.932814:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880091d97480 x1830967310150528/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.932823:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97480 with x1830967310150528 ext(2097152->3145727) 00002000:00010000:2.0:1746147204.932828:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d97480 00000100:00100000:3.0:1746147204.940484:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310150912:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17954us (18083us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147204.940494:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7079 00002000:00100000:3.0:1746147204.940504:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff880094e5b480 x1830967310150912/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.940514:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e5b480 with x1830967310150912 ext(2097152->4194303) 00002000:00010000:3.0:1746147204.940519:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e5b480 00000100:00100000:0.0:1746147204.942328:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.942499:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310151168 00000100:00100000:1.0:1746147204.942507:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310151168 00000100:00100000:1.0:1746147204.942555:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19276 00000100:00100000:1.0:1746147204.942562:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2626:x1830967310151168:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147204.942576:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147204.942590:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091e31a00/0x31399394250614eb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e270 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.942610:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.942612:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147204.942618:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091e31a00/0x31399394250614eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e270 expref: 16 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.942634:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091e31a00/0x31399394250614eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e270 expref: 16 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147204.942643:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091e31a00, rc 0) 00000100:00100000:1.0:1746147204.942687:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2626:x1830967310151168:12345-192.168.204.25@tcp:101:cat.0 Request processed in 126us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147204.942692:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19276 00000100:00100000:3.0:1746147204.946999:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967310151040:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21625us (22134us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147204.947010:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7080 00002000:00100000:3.0:1746147204.947020:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880094e58380 x1830967310151040/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.947028:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e58380 with x1830967310151040 ext(3145728->4194303) 00002000:00010000:3.0:1746147204.947033:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e58380 00000100:00100000:0.0:1746147204.951172:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.951259:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310151424 00000100:00100000:3.0:1746147204.951266:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310151424 00002000:00100000:3.0:1746147204.951298:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff880091d94700 x1830967310151424/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.951304:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94700 with x1830967310151424 ext(2097152->4194303) 00002000:00010000:3.0:1746147204.951309:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d94700 00000100:00100000:3.0:1746147204.951337:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7081 00000100:00100000:3.0:1746147204.951344:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310151424:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147204.952459:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147204.953357:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310151680 00000100:00100000:0.0:1746147204.953363:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310151680 00002000:00100000:0.0:1746147204.953389:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880094e59c00 x1830967310151680/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147204.953397:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e59c00 with x1830967310151680 ext(3145728->4194303) 00002000:00010000:0.0:1746147204.953400:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e59c00 00000100:00100000:0.0:1746147204.953413:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7082 00000100:00100000:0.0:1746147204.953419:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2000:x1830967310151680:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147204.956131:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.956505:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310151936 00000100:00100000:3.0:1746147204.956513:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310151936 00002000:00100000:3.0:1746147204.956546:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880091d96300 x1830967310151936/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.956555:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d96300 with x1830967310151936 ext(4194304->4890623) 00002000:00010000:3.0:1746147204.956560:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d96300 00000100:00100000:3.0:1746147204.956587:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7083 00000100:00100000:3.0:1746147204.956592:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2002:x1830967310151936:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147204.963327:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310151424:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11975us (12153us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147204.963338:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7081 00002000:00100000:3.0:1746147204.963349:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff880091d94700 x1830967310151424/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.963358:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94700 with x1830967310151424 ext(2097152->4194303) 00002000:00010000:3.0:1746147204.963363:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d94700 00000100:00100000:2.0:1746147204.968057:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2000:x1830967310151680:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14629us (15591us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147204.968069:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7082 00002000:00100000:2.0:1746147204.968082:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880094e59c00 x1830967310151680/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147204.968111:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e59c00 with x1830967310151680 ext(3145728->4194303) 00002000:00010000:2.0:1746147204.968116:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e59c00 00000100:00100000:3.0:1746147204.970178:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2002:x1830967310151936:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13578us (14046us total) trans 0 rc 696320/696320 00000100:00100000:3.0:1746147204.970187:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7083 00002000:00100000:3.0:1746147204.970194:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880091d96300 x1830967310151936/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.970207:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d96300 with x1830967310151936 ext(4194304->4890623) 00002000:00010000:3.0:1746147204.970212:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d96300 00000100:00100000:0.0:1746147204.976431:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147204.976630:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310152192 00000100:00100000:3.0:1746147204.976639:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310152192 00002000:00100000:3.0:1746147204.976749:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880091d97b80 x1830967310152192/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/0 e 0 to 0 dl 1746147215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.976758:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97b80 with x1830967310152192 ext(4194304->4890623) 00002000:00010000:3.0:1746147204.976787:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d97b80 00000100:00100000:3.0:1746147204.976813:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7084 00000100:00100000:3.0:1746147204.976819:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2000:x1830967310152192:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147204.979357:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.979541:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310152448 00000100:00100000:1.0:1746147204.979549:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310152448 00000100:00100000:1.0:1746147204.979710:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6076 00000100:00100000:1.0:1746147204.979718:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2621:x1830967310152448:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147204.979908:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2621:x1830967310152448:12345-192.168.204.25@tcp:35:cat.0 Request processed in 190us (688us total) trans 8589937200 rc 0/0 00000100:00100000:1.0:1746147204.979914:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6076 00000100:00100000:3.0:1746147204.981118:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2000:x1830967310152192:12345-192.168.204.25@tcp:3:cat.0 Request processed in 4296us (4692us total) trans 0 rc 696320/696320 00000100:00100000:3.0:1746147204.981125:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7084 00002000:00100000:3.0:1746147204.981133:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880091d97b80 x1830967310152192/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:580/0 lens 488/440 e 0 to 0 dl 1746147215 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147204.981142:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97b80 with x1830967310152192 ext(4194304->4890623) 00002000:00010000:3.0:1746147204.981146:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d97b80 00000100:00100000:0.0:1746147204.987613:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147204.987707:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310152704 00000100:00100000:1.0:1746147204.987716:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310152704 00000100:00100000:1.0:1746147204.987775:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6077 00000100:00100000:1.0:1746147204.987782:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2626:x1830967310152704:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147204.987941:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2626:x1830967310152704:12345-192.168.204.25@tcp:35:cat.0 Request processed in 159us (334us total) trans 8589937201 rc 0/0 00000100:00100000:1.0:1746147204.987947:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6077 00000100:00100000:0.0:1746147205.004275:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.004370:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310152960 00000100:00100000:3.0:1746147205.004379:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310152960 00000100:00100000:3.0:1746147205.004427:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16329 00000100:00100000:3.0:1746147205.004434:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2631:x1830967310152960:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147205.004454:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.004470:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x31399394250614f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e277 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.004548:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614f9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.004559:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x31399394250614c8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e254 expref: 19 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.004565:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614f9 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.004590:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x31399394250614c8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e254 expref: 19 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.004600:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x31399394250614c8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e254 expref: 19 pid: 16099 timeout: 842 lvb_type: 0 00000100:00100000:3.0:1746147205.004611:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311376000:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.004701:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147205.006303:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311376000:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.006321:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614f9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147205.006713:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.006833:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310153088 00000100:00100000:2.0:1746147205.006839:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310153088 00010000:00010000:2.0:1746147205.006866:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x31399394250614c8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e254 expref: 20 pid: 16099 timeout: 842 lvb_type: 0 00000100:00100000:2.0:1746147205.007050:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8740 00000100:00100000:2.0:1746147205.007057:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310153088:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.007067:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.007071:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x31399394250614c8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e254 expref: 20 pid: 16099 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147205.007081:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x31399394250614c8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e254 expref: 20 pid: 16099 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147205.007120:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aec00/0x31399394250614c8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e254 expref: 20 pid: 16099 timeout: 842 lvb_type: 0 00010000:00010000:2.0:1746147205.007134:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.007137:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614f9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.007145:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614f9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.007150:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614f9 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.007162:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147205.007194:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614f9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.007199:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614f9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147205.007214:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000100:00100000:2.0:1746147205.007253:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310153088:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 196us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.007258:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8740 00010000:00010000:3.0:1746147205.007307:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x31399394250614f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e277 expref: 20 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.007334:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614f9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e277 expref: 19 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.007340:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147205.007342:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147205.007344:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0ae600, rc 0) 00000100:00100000:3.0:1746147205.007367:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2631:x1830967310152960:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2933us (3100us total) trans 8589937202 rc 0/0 00000100:00100000:3.0:1746147205.007373:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16329 00000100:00100000:0.0:1746147205.043711:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.044974:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310153344 00000100:00100000:3.0:1746147205.044987:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310153344 00000100:00100000:3.0:1746147205.045114:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16330 00000100:00100000:3.0:1746147205.045126:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2633:x1830967310153344:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147205.045149:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.045168:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x3139939425061507 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e27e expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.045246:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x313993942506150e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045260:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x313993942506150e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045271:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x313993942506150e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045286:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425061515 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045296:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425061515 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045302:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425061515 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045396:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942506151c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045405:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942506151c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045411:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942506151c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147205.045420:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147205.045480:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x313993942506150e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045487:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x313993942506150e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045492:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x313993942506150e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045496:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0afe00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147205.045499:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x313993942506150e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045504:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x313993942506150e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045513:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147205.045516:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147205.045519:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x313993942506150e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045524:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afe00/0x313993942506150e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045541:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425061515 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045545:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425061515 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045550:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425061515 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045554:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0aea00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147205.045556:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425061515 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045560:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425061515 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045565:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012c04da00) 00010000:00010000:3.0:1746147205.045566:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147205.045568:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425061515 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045572:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0aea00/0x3139939425061515 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.045602:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x3139939425061507 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e27e expref: 39 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.045614:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942506151c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e27e expref: 38 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.045619:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147205.045620:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147205.045622:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0ae400, rc 0) 00000100:00100000:3.0:1746147205.045667:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2633:x1830967310153344:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 545us (1963us total) trans 8589937203 rc 0/0 00000100:00100000:3.0:1746147205.045673:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16330 00000100:00080000:0.0:1746147205.045828:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147205.048734:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.048872:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310153472 00000100:00100000:2.0:1746147205.048880:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310153472 00000100:00100000:2.0:1746147205.048939:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 973 00000100:00100000:2.0:1746147205.048947:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310153472:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.048960:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.048982:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942506151c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e27e expref: 38 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.049001:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.049006:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147205.049043:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310153472:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 97us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.049049:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 973 00000100:00100000:0.0:1746147205.069411:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.069477:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310153600 00000100:00100000:3.0:1746147205.069485:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310153600 00000100:00100000:3.0:1746147205.069527:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19277 00000100:00100000:3.0:1746147205.069532:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2631:x1830967310153600:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147205.069545:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.069558:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0afa00/0x313993942506152a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e285 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.069578:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x3139939425061497 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e238 expref: 39 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.069586:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800982a3c00/0x31399394250614dd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e262 expref: 29 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.069591:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.069593:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.069596:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0afa00/0x313993942506152a lrc: 5/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [417792->1048575] (req 417792->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e285 expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.069622:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800982a3c00/0x31399394250614dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e262 expref: 29 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.069632:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800982a3c00/0x31399394250614dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e262 expref: 29 pid: 1854 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746147205.069641:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311376128:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.069847:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x3139939425061497 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e238 expref: 39 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.069856:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x3139939425061497 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e238 expref: 39 pid: 13695 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.069863:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311376256:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.069885:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147205.074527:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311376128:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.074540:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311376256:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.074791:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0afa00/0x313993942506152a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [417792->1048575] (req 417792->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e285 expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.074807:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0afa00, rc 0) 00000100:00100000:3.0:1746147205.075039:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2631:x1830967310153600:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5504us (5633us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.075050:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19277 00000100:00100000:0.0:1746147205.077220:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.077273:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310153856 00000100:00100000:0.0:1746147205.077278:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.077279:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310153856 00010000:00010000:1.0:1746147205.077306:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x3139939425061497 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e238 expref: 40 pid: 13695 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.077931:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310153728 00000100:00100000:2.0:1746147205.077936:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310153728 00000100:00100000:1.0:1746147205.077936:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8741 00000100:00100000:1.0:1746147205.077944:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967310153856:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.077951:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800982a3c00/0x31399394250614dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e262 expref: 29 pid: 1854 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746147205.077955:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.077968:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x3139939425061497 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e238 expref: 40 pid: 13695 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.077969:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8742 00000100:00100000:2.0:1746147205.077973:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310153728:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.077976:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x3139939425061497 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e238 expref: 40 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.077979:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.077991:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c6600/0x3139939425061497 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e238 expref: 40 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.077993:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800982a3c00/0x31399394250614dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e262 expref: 29 pid: 1854 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746147205.078002:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800982a3c00/0x31399394250614dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e262 expref: 29 pid: 1854 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746147205.078018:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.078019:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.078025:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0afa00/0x313993942506152a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 417792->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e285 expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.078031:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0afa00/0x313993942506152a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 417792->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e285 expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.078057:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0afa00/0x313993942506152a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 417792->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e285 expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147205.078066:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311376384:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147205.078107:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982a3c00/0x31399394250614dd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e262 expref: 29 pid: 1854 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746147205.078123:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.078141:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147205.078144:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2001:x1830967310153728:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 169us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.078150:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8742 00000100:00100000:1.0:1746147205.079946:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311376384:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147205.079951:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147205.079962:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.079985:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967310153856:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2042us (2770us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.079992:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8741 00000100:00100000:3.0:1746147205.080124:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310154112 00000100:00100000:3.0:1746147205.080129:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310154112 00002000:00100000:3.0:1746147205.080157:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (417792->421887) req@ffff880095063b80 x1830967310154112/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.080166:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095063b80 with x1830967310154112 ext(417792->421887) 00002000:00010000:3.0:1746147205.080170:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095063b80 00000100:00100000:3.0:1746147205.080194:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7085 00000100:00100000:3.0:1746147205.080199:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2001:x1830967310154112:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147205.080305:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2001:x1830967310154112:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 105us (353us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147205.080310:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7085 00002000:00100000:3.0:1746147205.080315:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (417792->421887) req@ffff880095063b80 x1830967310154112/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/4536 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.080322:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095063b80 with x1830967310154112 ext(417792->421887) 00002000:00010000:3.0:1746147205.080325:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095063b80 00000100:00100000:0.0:1746147205.087503:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.087716:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310154240 00000100:00100000:3.0:1746147205.087725:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310154240 00000100:00100000:3.0:1746147205.087790:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19278 00000100:00100000:3.0:1746147205.087798:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2631:x1830967310154240:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147205.087813:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.087828:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097c87200/0x3139939425061531 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e28c expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.087860:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x313993942506131d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e14a expref: 26 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.087868:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d90800/0x3139939425061427 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1f9 expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.087874:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098886200/0x3139939425061324 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e151 expref: 17 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.087879:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.087880:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.087883:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c87200/0x3139939425061531 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [1048576->1060863] (req 1048576->1060863) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e28c expref: 17 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.087906:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098886200/0x3139939425061324 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e151 expref: 17 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.087915:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098886200/0x3139939425061324 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e151 expref: 17 pid: 12201 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.087925:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311376512:192.168.204.25@tcp:104: 00000100:00080000:0.0:1746147205.087926:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746147205.088232:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d90800/0x3139939425061427 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1f9 expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.088240:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d90800/0x3139939425061427 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1f9 expref: 16 pid: 9586 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746147205.088248:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311376640:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.088509:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x313993942506131d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e14a expref: 26 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.088517:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x313993942506131d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e14a expref: 26 pid: 13712 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.088525:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311376768:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.088550:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147205.090478:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311376512:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147205.090546:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.090647:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310154368 00000100:00100000:1.0:1746147205.090652:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310154368 00000100:00080000:0.0:1746147205.090801:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746147205.090809:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d90800/0x3139939425061427 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1f9 expref: 17 pid: 9586 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746147205.090906:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311376640:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.090914:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311376768:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.090933:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097c87200/0x3139939425061531 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [1048576->1060863] (req 1048576->1060863) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e28c expref: 17 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.090943:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c87200, rc 0) 00000100:00100000:3.0:1746147205.091249:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2631:x1830967310154240:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3451us (3753us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.091256:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19278 00000100:00100000:0.0:1746147205.091394:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.091792:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310154496 00000100:00100000:1.0:1746147205.091796:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310154496 00000100:00100000:3.0:1746147205.091799:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8743 00000100:00100000:3.0:1746147205.091806:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2002:x1830967310154368:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.091808:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098886200/0x3139939425061324 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e151 expref: 17 pid: 12201 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.091815:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147205.091825:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8744 00000100:00100000:1.0:1746147205.091829:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310154496:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147205.091830:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d90800/0x3139939425061427 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1f9 expref: 17 pid: 9586 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746147205.091834:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147205.091839:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d90800/0x3139939425061427 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1f9 expref: 17 pid: 9586 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746147205.091889:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098886200/0x3139939425061324 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e151 expref: 17 pid: 12201 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.091897:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098886200/0x3139939425061324 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e151 expref: 17 pid: 12201 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.091914:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098886200/0x3139939425061324 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e151 expref: 17 pid: 12201 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746147205.091995:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.092028:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310154624 00000100:00100000:2.0:1746147205.092032:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310154624 00010000:00010000:2.0:1746147205.092050:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x313993942506131d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e14a expref: 27 pid: 13712 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.092065:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8745 00000100:00100000:2.0:1746147205.092070:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310154624:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.092076:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.092083:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x313993942506131d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e14a expref: 27 pid: 13712 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.092111:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x313993942506131d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e14a expref: 27 pid: 13712 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.092122:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x313993942506131d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e14a expref: 27 pid: 13712 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.092133:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147205.092164:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310154624:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 94us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.092169:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8745 00010000:00010000:3.0:1746147205.092540:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d90800/0x3139939425061427 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e1f9 expref: 17 pid: 9586 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746147205.092555:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.092557:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.092562:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097c87200/0x3139939425061531 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e28c expref: 16 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.092569:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c87200/0x3139939425061531 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e28c expref: 16 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.092593:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097c87200/0x3139939425061531 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e28c expref: 16 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147205.092603:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311376896:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147205.092647:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e240 going to sleep for 11 seconds 00010000:00010000:1.0:1746147205.093522:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.093554:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310154496:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1721us (2156us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.093561:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8744 00000100:00100000:0.0:1746147205.097291:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.097485:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311376896:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147205.097485:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147205.097501:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147205.097543:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2002:x1830967310154368:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5736us (6998us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.097552:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8743 00000100:00100000:2.0:1746147205.097553:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310154880 00000100:00100000:2.0:1746147205.097560:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310154880 00002000:00100000:2.0:1746147205.097594:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x96:0x0] (1056768->1060863) req@ffff880095063800 x1830967310154880/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746147205.097601:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310155008 00002000:00100000:2.0:1746147205.097602:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095063800 with x1830967310154880 ext(1056768->1060863) 00000100:00100000:3.0:1746147205.097604:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310155008 00002000:00010000:2.0:1746147205.097606:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095063800 00000100:00100000:2.0:1746147205.097622:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7086 00000100:00100000:2.0:1746147205.097628:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310154880:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147205.097636:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19279 00000100:00100000:3.0:1746147205.097641:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2633:x1830967310155008:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147205.097649:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.097662:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425061538 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e293 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.097681:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097c87200/0x3139939425061531 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e28c expref: 16 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.097687:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147205.097689:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147205.097692:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425061538 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1912832->2097151] (req 1912832->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e293 expref: 27 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.097715:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097c87200/0x3139939425061531 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e28c expref: 16 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.097725:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097c87200/0x3139939425061531 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e28c expref: 16 pid: 12201 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.097735:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311377024:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147205.097735:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310154880:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 107us (452us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147205.097741:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7086 00002000:00100000:2.0:1746147205.097746:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x96:0x0] (1056768->1060863) req@ffff880095063800 x1830967310154880/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/4536 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.097753:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095063800 with x1830967310154880 ext(1056768->1060863) 00010000:00010000:2.0:1746147205.097758:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097c87200/0x3139939425061531 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e28c expref: 16 pid: 12201 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.097778:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097c87200/0x3139939425061531 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e28c expref: 16 pid: 12201 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.097784:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e9c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746147205.097789:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095063800 00000100:00100000:3.0:1746147205.098917:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311377024:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.098930:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425061538 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1912832->2097151] (req 1912832->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e293 expref: 27 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.098944:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0afe00, rc 0) 00000100:00100000:3.0:1746147205.098963:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2633:x1830967310155008:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1322us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.098968:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19279 00000100:00100000:0.0:1746147205.101238:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.101295:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310155136 00000100:00100000:2.0:1746147205.101303:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310155136 00002000:00100000:2.0:1746147205.101335:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->1060863) req@ffff880095061180 x1830967310155136/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 12776/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.101344:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095061180 with x1830967310155136 ext(1048576->1060863) 00010000:00010000:2.0:1746147205.101351:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097c87200/0x3139939425061531 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e28c expref: 16 pid: 12201 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.101362:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097c87200/0x3139939425061531 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e28c expref: 16 pid: 12201 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746147205.101368:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095061180 00000100:00100000:2.0:1746147205.101397:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1651 00000100:00100000:2.0:1746147205.101404:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967310155136:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147205.104582:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.104591:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310155136:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 3187us (3358us total) trans 17179875105 rc 0/0 00000100:00100000:2.0:1746147205.104601:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1651 00002000:00100000:2.0:1746147205.104611:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->1060863) req@ffff880095061180 x1830967310155136/t17179875105(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 12776/448 e 0 to 0 dl 1746147216 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.104619:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095061180 with x1830967310155136 ext(1048576->1060863) 00010000:00010000:2.0:1746147205.104628:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097c87200/0x3139939425061531 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e28c expref: 18 pid: 12201 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.104644:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097c87200/0x3139939425061531 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e28c expref: 18 pid: 12201 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746147205.104649:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095061180 00000100:00100000:3.0:1746147205.104776:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310155392 00000100:00100000:3.0:1746147205.104782:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310155392 00000100:00100000:3.0:1746147205.104814:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16331 00000100:00100000:3.0:1746147205.104819:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2637:x1830967310155392:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147205.104835:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.104849:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942506153f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e29a expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.104900:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x3139939425061546 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.104910:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x3139939425061546 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.104918:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x3139939425061546 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.104928:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c86e00/0x313993942506154d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.104933:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c86e00/0x313993942506154d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.104937:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c86e00/0x313993942506154d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.105013:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c86200/0x3139939425061554 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.105020:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c86200/0x3139939425061554 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.105025:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c86200/0x3139939425061554 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147205.105033:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147205.105476:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x3139939425061546 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.105484:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x3139939425061546 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.105488:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x3139939425061546 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.105493:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0ae000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147205.105495:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x3139939425061546 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.105500:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x3139939425061546 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.105509:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147205.105512:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147205.105515:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x3139939425061546 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.105519:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x3139939425061546 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.105531:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c86e00/0x313993942506154d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.105535:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c86e00/0x313993942506154d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.105539:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097c86e00/0x313993942506154d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.105543:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c86e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147205.105545:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c86e00/0x313993942506154d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.105549:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c86e00/0x313993942506154d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.105554:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800958e2900) 00010000:00010000:3.0:1746147205.105556:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147205.105558:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097c86e00/0x313993942506154d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.105562:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c86e00/0x313993942506154d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.105590:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942506153f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e29a expref: 40 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.105599:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c86200/0x3139939425061554 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e29a expref: 39 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.105603:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147205.105606:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147205.105608:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c86200, rc 0) 00000100:00100000:3.0:1746147205.105803:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2637:x1830967310155392:12345-192.168.204.25@tcp:101:cat.0 Request processed in 982us (1227us total) trans 8589937204 rc 0/0 00000100:00100000:3.0:1746147205.105809:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16331 00000100:00100000:0.0:1746147205.109166:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.109202:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310155520 00000100:00100000:3.0:1746147205.109210:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310155520 00010000:00010000:3.0:1746147205.109244:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097c87200/0x3139939425061531 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e28c expref: 18 pid: 12201 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.109897:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8746 00000100:00100000:3.0:1746147205.109905:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310155520:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147205.109917:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147205.109931:0:4349:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147203 -> 1746147205 00002000:00010000:3.0:1746147205.109934:0:4349:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147204 -> 1746147205 00010000:00010000:3.0:1746147205.109939:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097c87200/0x3139939425061531 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e28c expref: 18 pid: 12201 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.109950:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097c87200/0x3139939425061531 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e28c expref: 18 pid: 12201 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.109968:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097c87200/0x3139939425061531 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e28c expref: 18 pid: 12201 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.109980:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.109982:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.109988:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425061538 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e293 expref: 26 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.109996:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425061538 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e293 expref: 26 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.110024:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425061538 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e293 expref: 26 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147205.110034:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311377152:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147205.110158:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147205.110344:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.110399:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.110473:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310155648 00000100:00100000:3.0:1746147205.110477:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310155648 00000100:00100000:3.0:1746147205.110496:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310155776 00000100:00100000:3.0:1746147205.110497:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310155776 00000100:00100000:3.0:1746147205.110511:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19280 00000100:00100000:3.0:1746147205.110515:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967310155648:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147205.110526:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.110536:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094182000/0x3139939425061562 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e2a1 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147205.110562:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311377280:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147205.110586:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147205.110650:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19281 00000100:00100000:1.0:1746147205.110657:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310155776:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147205.110664:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147205.110674:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c10400/0x3139939425061569 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e2a8 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147205.110696:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311377408:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147205.110715:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147205.112025:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.112081:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310155904 00000100:00100000:1.0:1746147205.112085:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310155904 00000100:00100000:1.0:1746147205.112663:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 974 00000100:00100000:1.0:1746147205.112668:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967310155904:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.112677:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.112693:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c86200/0x3139939425061554 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e29a expref: 39 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.112709:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147205.112712:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.112743:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310155904:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 74us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.112751:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 974 00002000:00010000:2.0:1746147205.113044:0:13695:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime: 1746147203 -> 1746147204 00000100:00100000:2.0:1746147205.113059:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311377408:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147205.113083:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c10400/0x3139939425061569 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2a8 expref: 28 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147205.113113:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c10400/0x3139939425061569 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2a8 expref: 28 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147205.113243:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c10400, rc 0) 00000100:00100000:2.0:1746147205.113265:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310155776:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2609us (2866us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147205.113270:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19281 00000100:00100000:2.0:1746147205.113770:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.114026:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311377152:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147205.114038:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147205.114070:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310155520:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4166us (4910us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.114076:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8746 00000100:00100000:3.0:1746147205.114493:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310156416 00000100:00100000:3.0:1746147205.114498:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310156416 00000100:00100000:3.0:1746147205.114525:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16332 00000100:00100000:3.0:1746147205.114530:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2640:x1830967310156416:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147205.114545:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.114557:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425061570 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e2af expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.114611:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136348400/0x3139939425061577 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114621:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136348400/0x3139939425061577 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114629:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136348400/0x3139939425061577 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114638:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136349200/0x313993942506157e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114643:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136349200/0x313993942506157e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114648:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136349200/0x313993942506157e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114719:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425061585 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114727:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425061585 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114731:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425061585 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147205.114742:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147205.114810:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136348400/0x3139939425061577 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114817:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136348400/0x3139939425061577 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114822:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136348400/0x3139939425061577 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114826:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136348400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147205.114829:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136348400/0x3139939425061577 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114835:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136348400/0x3139939425061577 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114842:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147205.114845:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147205.114847:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136348400/0x3139939425061577 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114851:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136348400/0x3139939425061577 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114860:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136349200/0x313993942506157e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114864:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136349200/0x313993942506157e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114868:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136349200/0x313993942506157e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114876:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136349200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147205.114878:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136349200/0x313993942506157e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114883:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136349200/0x313993942506157e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114888:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800958e2f00) 00010000:00010000:3.0:1746147205.114889:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147205.114891:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136349200/0x313993942506157e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114895:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136349200/0x313993942506157e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.114924:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425061570 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2af expref: 22 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.114933:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425061585 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2af expref: 21 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.114937:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147205.114939:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147205.114941:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136348a00, rc 0) 00000100:00100000:3.0:1746147205.114963:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2640:x1830967310156416:12345-192.168.204.25@tcp:101:cat.0 Request processed in 433us (1203us total) trans 8589937205 rc 0/0 00000100:00100000:3.0:1746147205.114968:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16332 00000100:00100000:0.0:1746147205.115462:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.115687:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310156160 00000100:00100000:2.0:1746147205.115690:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310156160 00002000:00100000:2.0:1746147205.115714:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x96:0x0] (1912832->1916927) req@ffff880095060e00 x1830967310156160/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.115722:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095060e00 with x1830967310156160 ext(1912832->1916927) 00002000:00010000:2.0:1746147205.115726:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095060e00 00000100:00100000:2.0:1746147205.115748:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7087 00000100:00100000:2.0:1746147205.115753:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967310156160:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147205.115843:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967310156160:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 89us (381us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147205.115849:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7087 00002000:00100000:2.0:1746147205.115853:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x96:0x0] (1912832->1916927) req@ffff880095060e00 x1830967310156160/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/4536 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.115859:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095060e00 with x1830967310156160 ext(1912832->1916927) 00002000:00010000:2.0:1746147205.115862:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095060e00 00002000:00010000:3.0:1746147205.116865:0:12201:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime: 1746147204 -> 1746147205 00002000:00010000:3.0:1746147205.116869:0:12201:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime: 1746147204 -> 1746147205 00000100:00100000:3.0:1746147205.116883:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311377280:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147205.116908:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094182000/0x3139939425061562 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2a1 expref: 40 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.116917:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094182000/0x3139939425061562 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2a1 expref: 40 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.116924:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094182000, rc 0) 00000100:00100000:3.0:1746147205.116961:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967310155648:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6445us (6617us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147205.116967:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19280 00000100:00100000:2.0:1746147205.120166:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.120261:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310156544 00000100:00100000:3.0:1746147205.120272:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310156544 00000100:00100000:3.0:1746147205.120318:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19282 00000100:00100000:3.0:1746147205.120325:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310156544:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147205.120338:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.120353:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061593 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e2b6 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147205.120395:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311377536:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147205.120466:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147205.120467:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.120488:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310156672 00000100:00100000:2.0:1746147205.120491:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310156672 00000100:00100000:2.0:1746147205.120512:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19283 00000100:00100000:2.0:1746147205.120517:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2633:x1830967310156672:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147205.120524:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147205.120530:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x313993942506159a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e2bd expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.120546:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x313993942506132b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e158 expref: 18 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.120554:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x313993942506142e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e200 expref: 15 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147205.120561:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425061332 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e15f expref: 28 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.120567:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.120568:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.120571:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x313993942506159a lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [1048576->1368063] (req 1048576->1368063) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2bd expref: 28 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.120588:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425061332 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e15f expref: 28 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.120598:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425061332 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e15f expref: 28 pid: 1854 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.120607:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311377664:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147205.120633:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x313993942506142e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e200 expref: 15 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147205.120639:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x313993942506142e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e200 expref: 15 pid: 12201 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746147205.120647:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311377792:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147205.120667:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x313993942506132b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e158 expref: 18 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.120673:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x313993942506132b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e158 expref: 18 pid: 13712 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.120685:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311377920:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147205.120698:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800941540c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147205.120723:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.120756:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310156800 00000100:00100000:0.0:1746147205.120770:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310156800 00000100:00100000:0.0:1746147205.120795:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19284 00000100:00100000:0.0:1746147205.120799:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2637:x1830967310156800:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147205.120804:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147205.120813:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x31399394250615a1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e2c4 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.120827:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0afa00/0x313993942506152a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 417792->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e285 expref: 27 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.120834:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147205.120835:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147205.120838:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x31399394250615a1 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2c4 expref: 40 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.120852:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0afa00/0x313993942506152a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 417792->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e285 expref: 27 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.120860:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0afa00/0x313993942506152a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 417792->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e285 expref: 27 pid: 12201 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746147205.120868:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095060700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311378048:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147205.120902:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8780 going to sleep for 11 seconds 00002000:00010000:3.0:1746147205.122474:0:12201:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime: 1746147204 -> 1746147205 00000100:00100000:3.0:1746147205.122492:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311377536:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147205.122511:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061593 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2b6 expref: 18 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.122526:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061593 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2b6 expref: 18 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.122537:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e572a00, rc 0) 00000100:00100000:2.0:1746147205.122691:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311377792:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.122856:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310156544:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2531us (2696us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147205.122863:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19282 00000100:00100000:1.0:1746147205.123772:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095060700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311378048:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147205.123777:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311377664:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147205.123784:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311377920:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147205.123787:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x31399394250615a1 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2c4 expref: 40 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.123798:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e81000, rc 0) 00010000:00010000:0.0:1746147205.123799:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x313993942506159a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [1048576->1368063] (req 1048576->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2bd expref: 28 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.123807:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33e00, rc 0) 00000100:00100000:1.0:1746147205.123828:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2637:x1830967310156800:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3028us (3104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147205.123828:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2633:x1830967310156672:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3310us (3361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147205.123834:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19283 00000100:00100000:1.0:1746147205.123969:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19284 00000100:00100000:0.0:1746147205.124304:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.124351:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310157184 00000100:00100000:0.0:1746147205.124353:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.124356:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310157184 00010000:00010000:3.0:1746147205.124375:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425061332 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e15f expref: 28 pid: 1854 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746147205.124377:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.124413:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.124429:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310157056 00000100:00100000:0.0:1746147205.124432:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310157056 00002000:00100000:0.0:1746147205.124452:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (417792->1048575) req@ffff88009455c000 x1830967310157056/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147205.124460:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455c000 with x1830967310157056 ext(417792->1048575) 00010000:00010000:0.0:1746147205.124465:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f0afa00/0x313993942506152a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 417792->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e285 expref: 28 pid: 12201 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746147205.124473:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f0afa00/0x313993942506152a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 417792->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e285 expref: 28 pid: 12201 timeout: 843 lvb_type: 0 00002000:00010000:0.0:1746147205.124478:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009455c000 00000100:00100000:0.0:1746147205.124490:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1652 00000100:00100000:0.0:1746147205.124496:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2001:x1830967310157056:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:1.0:1746147205.124741:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310156928 00000100:00100000:1.0:1746147205.124744:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310156928 00000100:00100000:3.0:1746147205.124745:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310157312 00000100:00100000:3.0:1746147205.124748:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310157312 00010000:00010000:3.0:1746147205.124757:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x313993942506132b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e158 expref: 17 pid: 13712 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.124757:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x313993942506142e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e200 expref: 16 pid: 12201 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746147205.124784:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8747 00000100:00100000:1.0:1746147205.124788:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8748 00000100:00100000:3.0:1746147205.124789:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967310157184:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147205.124792:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967310157312:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147205.124796:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.124797:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147205.124807:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425061332 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e15f expref: 28 pid: 1854 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.124807:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x313993942506132b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e158 expref: 17 pid: 13712 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.124815:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x313993942506132b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e158 expref: 17 pid: 13712 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.124845:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8749 00000100:00100000:2.0:1746147205.124852:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310156928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.124859:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147205.124882:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425061332 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e15f expref: 28 pid: 1854 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.124937:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095052600/0x313993942506132b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e158 expref: 17 pid: 13712 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.125004:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.125046:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967310157312:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 252us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.125051:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8748 00010000:00010000:2.0:1746147205.125124:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x313993942506142e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e200 expref: 16 pid: 12201 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746147205.125132:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x313993942506142e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e200 expref: 16 pid: 12201 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746147205.125142:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d94a00/0x313993942506142e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e200 expref: 16 pid: 12201 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746147205.125153:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147205.125167:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310156928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 316us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.125171:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8749 00010000:00010000:3.0:1746147205.125338:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425061332 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e15f expref: 28 pid: 1854 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.125347:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.125348:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.125354:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x313993942506159a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2bd expref: 27 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.125361:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x313993942506159a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2bd expref: 27 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.125385:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x313993942506159a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2bd expref: 27 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147205.125400:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311378176:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147205.125638:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147205.128217:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.128237:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310157440 00000100:00100000:1.0:1746147205.128245:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310157440 00000100:00100000:1.0:1746147205.128286:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19285 00000100:00100000:1.0:1746147205.128294:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2640:x1830967310157440:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147205.128308:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147205.128321:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x31399394250615a8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e2cb expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.128343:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147205.128346:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x31399394250615a8 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2cb expref: 31 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.128355:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x31399394250615a8 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2cb expref: 31 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.128363:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c11400, rc 0) 00000100:00100000:1.0:1746147205.128394:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2640:x1830967310157440:12345-192.168.204.25@tcp:101:cat.0 Request processed in 101us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.128399:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19285 00000100:00100000:3.0:1746147205.128413:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311378176:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147205.128428:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147205.128447:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310157184:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3657us (4143us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.128454:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8747 00000100:00100000:2.0:1746147205.130290:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.130304:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2001:x1830967310157056:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 5808us (5890us total) trans 21474842489 rc 0/0 00000100:00100000:0.0:1746147205.130313:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1652 00002000:00100000:0.0:1746147205.130321:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (417792->1048575) req@ffff88009455c000 x1830967310157056/t21474842489(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/448 e 0 to 0 dl 1746147216 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147205.130329:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455c000 with x1830967310157056 ext(417792->1048575) 00010000:00010000:0.0:1746147205.130336:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f0afa00/0x313993942506152a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 417792->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e285 expref: 31 pid: 12201 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746147205.130354:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f0afa00/0x313993942506152a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 417792->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e285 expref: 31 pid: 12201 timeout: 843 lvb_type: 0 00002000:00010000:0.0:1746147205.130360:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009455c000 00000100:00100000:0.0:1746147205.130374:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310157696 00000100:00100000:0.0:1746147205.130378:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310157696 00002000:00100000:0.0:1746147205.130398:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1363968->1368063) req@ffff880099152d80 x1830967310157696/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147205.130405:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152d80 with x1830967310157696 ext(1363968->1368063) 00002000:00010000:0.0:1746147205.130487:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099152d80 00000100:00100000:0.0:1746147205.130500:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7088 00000100:00100000:0.0:1746147205.130506:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310157696:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147205.130590:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310157696:12345-192.168.204.25@tcp:3:cat.0 Request processed in 83us (303us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147205.130595:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7088 00002000:00100000:0.0:1746147205.130600:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1363968->1368063) req@ffff880099152d80 x1830967310157696/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/4536 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147205.130607:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152d80 with x1830967310157696 ext(1363968->1368063) 00002000:00010000:0.0:1746147205.130610:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099152d80 00000100:00100000:0.0:1746147205.132021:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.132146:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310157952 00000100:00100000:3.0:1746147205.132151:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310157952 00000100:00100000:3.0:1746147205.132191:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6078 00000100:00100000:3.0:1746147205.132197:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2633:x1830967310157952:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147205.132360:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2633:x1830967310157952:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 161us (340us total) trans 8589937206 rc 0/0 00000100:00100000:3.0:1746147205.132366:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6078 00000100:00100000:0.0:1746147205.132610:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.132673:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310158080 00000100:00100000:3.0:1746147205.132677:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310158080 00010000:00010000:3.0:1746147205.132694:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0afa00/0x313993942506152a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 417792->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e285 expref: 31 pid: 12201 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.132724:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8750 00000100:00100000:3.0:1746147205.132730:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2001:x1830967310158080:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147205.132738:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147205.132751:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0afa00/0x313993942506152a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 417792->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e285 expref: 31 pid: 12201 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.132771:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0afa00/0x313993942506152a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 417792->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e285 expref: 31 pid: 12201 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.132790:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0afa00/0x313993942506152a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 417792->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e285 expref: 31 pid: 12201 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.132799:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.132800:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.132806:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x31399394250615a1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2c4 expref: 39 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.132812:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x31399394250615a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2c4 expref: 39 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.132823:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.132824:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.132826:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x31399394250615a8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2cb expref: 30 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.132832:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x31399394250615a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2cb expref: 30 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.132855:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x31399394250615a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2cb expref: 30 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147205.132865:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311378304:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147205.133033:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x31399394250615a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2c4 expref: 39 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147205.133042:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311378432:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147205.133063:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147205.135147:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311378304:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147205.135157:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311378432:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147205.135174:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147205.135211:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2001:x1830967310158080:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2480us (2600us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.135219:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8750 00000100:00100000:0.0:1746147205.136380:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.136459:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310158336 00000100:00100000:2.0:1746147205.136465:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310158336 00002000:00100000:2.0:1746147205.136496:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88009455c380 x1830967310158336/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.136504:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455c380 with x1830967310158336 ext(0->1048575) 00002000:00010000:2.0:1746147205.136508:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009455c380 00000100:00100000:2.0:1746147205.137235:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7089 00000100:00100000:2.0:1746147205.137243:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2000:x1830967310158336:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147205.141290:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.141325:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.141369:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.141393:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310158720 00000100:00100000:2.0:1746147205.141400:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310158720 00002000:00100000:2.0:1746147205.141439:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88009455d880 x1830967310158720/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.141449:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455d880 with x1830967310158720 ext(0->1048575) 00002000:00010000:2.0:1746147205.141453:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009455d880 00000100:00100000:2.0:1746147205.141467:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310158976 00000100:00100000:2.0:1746147205.141469:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310158976 00002000:00100000:2.0:1746147205.141481:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x97:0x0] (1368064->2097151) req@ffff88009455ca80 x1830967310158976/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.141487:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455ca80 with x1830967310158976 ext(1368064->2097151) 00002000:00010000:2.0:1746147205.141490:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009455ca80 00000100:00100000:2.0:1746147205.141498:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310158848 00000100:00100000:2.0:1746147205.141500:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310158848 00000100:00100000:3.0:1746147205.141504:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7090 00002000:00100000:2.0:1746147205.141507:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->1912831) req@ffff88009455fb80 x1830967310158848/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147205.141512:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967310158720:12345-192.168.204.25@tcp:3:cat.0 00002000:00100000:2.0:1746147205.141513:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455fb80 with x1830967310158848 ext(1048576->1912831) 00002000:00010000:2.0:1746147205.141516:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009455fb80 00000100:00100000:2.0:1746147205.141523:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7091 00000100:00100000:2.0:1746147205.141528:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967310158976:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147205.141974:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7092 00000100:00100000:2.0:1746147205.141979:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967310158848:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147205.147372:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2000:x1830967310158336:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10121us (10986us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147205.147383:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7089 00002000:00100000:2.0:1746147205.147393:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88009455c380 x1830967310158336/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/440 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.147400:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455c380 with x1830967310158336 ext(0->1048575) 00002000:00010000:2.0:1746147205.147405:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009455c380 00000100:00100000:3.0:1746147205.147883:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967310158976:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6351us (6554us total) trans 0 rc 729088/729088 00000100:00100000:3.0:1746147205.147891:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7091 00002000:00100000:3.0:1746147205.147898:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x97:0x0] (1368064->2097151) req@ffff88009455ca80 x1830967310158976/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/440 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 729088/729088 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.147905:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455ca80 with x1830967310158976 ext(1368064->2097151) 00002000:00010000:3.0:1746147205.147909:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009455ca80 00000100:00100000:3.0:1746147205.153079:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967310158720:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11560us (11789us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147205.153103:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7090 00002000:00100000:3.0:1746147205.153113:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88009455d880 x1830967310158720/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/440 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.153122:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455d880 with x1830967310158720 ext(0->1048575) 00002000:00010000:3.0:1746147205.153128:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009455d880 00000100:00100000:3.0:1746147205.153528:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310158848:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11548us (12157us total) trans 0 rc 864256/864256 00000100:00100000:3.0:1746147205.153534:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7092 00002000:00100000:3.0:1746147205.153539:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->1912831) req@ffff88009455fb80 x1830967310158848/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/440 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 864256/864256 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.153545:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455fb80 with x1830967310158848 ext(1048576->1912831) 00002000:00010000:3.0:1746147205.153548:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009455fb80 00000100:00100000:0.0:1746147205.158026:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.158544:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310159232 00000100:00100000:1.0:1746147205.158553:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310159232 00000100:00100000:1.0:1746147205.158592:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19286 00000100:00100000:1.0:1746147205.158599:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2640:x1830967310159232:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147205.158614:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147205.158629:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x31399394250615af lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e2d2 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.158654:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425061538 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e293 expref: 26 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.158661:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147205.158663:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147205.158666:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x31399394250615af lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d2 expref: 17 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.158691:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425061538 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e293 expref: 26 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.158702:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425061538 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e293 expref: 26 pid: 12201 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.158712:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311378560:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147205.159514:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147205.164179:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.164287:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311378560:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147205.164310:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x31399394250615af lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d2 expref: 17 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.164325:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49400, rc 0) 00000100:00100000:1.0:1746147205.164364:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2640:x1830967310159232:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5764us (6346us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.164371:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19286 00000100:00100000:3.0:1746147205.164447:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310159360 00000100:00100000:3.0:1746147205.164453:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310159360 00002000:00100000:3.0:1746147205.164486:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x96:0x0] (1912832->2097151) req@ffff88009455ed80 x1830967310159360/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.164495:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455ed80 with x1830967310159360 ext(1912832->2097151) 00010000:00010000:3.0:1746147205.164501:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425061538 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e293 expref: 27 pid: 12201 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.164512:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425061538 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e293 expref: 27 pid: 12201 timeout: 843 lvb_type: 0 00002000:00010000:3.0:1746147205.164518:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009455ed80 00000100:00100000:3.0:1746147205.164549:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1653 00000100:00100000:3.0:1746147205.164555:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310159360:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147205.167823:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310159360:12345-192.168.204.25@tcp:4:cat.0 Request processed in 3259us (3642us total) trans 17179875106 rc 0/0 00000100:00100000:3.0:1746147205.167832:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1653 00002000:00100000:3.0:1746147205.167842:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x96:0x0] (1912832->2097151) req@ffff88009455ed80 x1830967310159360/t17179875106(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/448 e 0 to 0 dl 1746147216 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.167850:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455ed80 with x1830967310159360 ext(1912832->2097151) 00010000:00010000:3.0:1746147205.167860:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425061538 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e293 expref: 29 pid: 12201 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.167873:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425061538 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e293 expref: 29 pid: 12201 timeout: 843 lvb_type: 0 00002000:00010000:3.0:1746147205.167879:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009455ed80 00000100:00100000:0.0:1746147205.171151:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.171222:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310159488 00000100:00100000:3.0:1746147205.171231:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310159488 00010000:00010000:3.0:1746147205.171260:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425061538 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e293 expref: 29 pid: 12201 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.171294:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8751 00000100:00100000:3.0:1746147205.171301:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310159488:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147205.171879:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147205.171898:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425061538 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e293 expref: 29 pid: 12201 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.171910:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425061538 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e293 expref: 29 pid: 12201 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.171928:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0afe00/0x3139939425061538 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e293 expref: 29 pid: 12201 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.171956:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.171958:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.171964:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x31399394250615af lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d2 expref: 16 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.171972:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x31399394250615af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d2 expref: 16 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.172001:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x31399394250615af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d2 expref: 16 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147205.172016:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311378688:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147205.172115:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147205.174455:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.175894:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310159616 00000100:00100000:1.0:1746147205.175904:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310159616 00000100:00100000:1.0:1746147205.175952:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19287 00000100:00100000:1.0:1746147205.175959:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967310159616:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147205.175975:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147205.175991:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x31399394250615b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e2d9 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.176011:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.176013:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.176020:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x31399394250615b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d9 expref: 30 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.176035:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x31399394250615b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d9 expref: 30 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.176046:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49c00, rc 0) 00000100:00100000:1.0:1746147205.176103:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967310159616:12345-192.168.204.25@tcp:101:cat.0 Request processed in 129us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.176110:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19287 00000100:00100000:3.0:1746147205.176437:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311378688:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147205.176453:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147205.176475:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310159488:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5175us (5335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.176483:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8751 00000100:00100000:0.0:1746147205.176896:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.177038:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310159872 00000100:00100000:3.0:1746147205.177042:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310159872 00002000:00100000:3.0:1746147205.177065:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88009455e300 x1830967310159872/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.177073:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455e300 with x1830967310159872 ext(1048576->2097151) 00002000:00010000:3.0:1746147205.177076:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009455e300 00000100:00100000:3.0:1746147205.177238:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7093 00000100:00100000:3.0:1746147205.177243:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310159872:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147205.183990:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310159872:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6736us (7084us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147205.184002:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7093 00002000:00100000:3.0:1746147205.184012:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88009455e300 x1830967310159872/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/440 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.184021:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455e300 with x1830967310159872 ext(1048576->2097151) 00002000:00010000:3.0:1746147205.184026:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009455e300 00000100:00100000:0.0:1746147205.184110:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.184602:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310160128 00000100:00100000:2.0:1746147205.184609:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310160128 00000100:00100000:2.0:1746147205.184639:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6079 00000100:00100000:2.0:1746147205.184645:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2637:x1830967310160128:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147205.184803:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2637:x1830967310160128:12345-192.168.204.25@tcp:35:cat.0 Request processed in 157us (713us total) trans 8589937207 rc 0/0 00000100:00100000:2.0:1746147205.184808:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6079 00000100:00100000:1.0:1746147205.191230:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.191337:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310160256 00000100:00100000:2.0:1746147205.191346:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310160256 00000100:00100000:2.0:1746147205.191382:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19288 00000100:00100000:2.0:1746147205.191389:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2640:x1830967310160256:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147205.191408:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147205.191425:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x31399394250615bd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e2e0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.191456:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x313993942506159a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2bd expref: 28 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.191463:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147205.191465:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147205.191468:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x31399394250615bd lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2e0 expref: 18 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.191565:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x313993942506159a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2bd expref: 28 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.191578:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x313993942506159a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2bd expref: 28 pid: 9584 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.191589:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311378816:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.193182:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147205.193207:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311378816:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.193227:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x31399394250615bd lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2e0 expref: 18 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.193240:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33800, rc 0) 00000100:00100000:3.0:1746147205.193278:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2640:x1830967310160256:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1889us (2056us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.193286:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19288 00000100:00100000:0.0:1746147205.193975:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.194053:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310160384 00000100:00100000:3.0:1746147205.194059:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310160384 00002000:00100000:3.0:1746147205.194177:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1368063) req@ffff88009455df80 x1830967310160384/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.194187:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455df80 with x1830967310160384 ext(1048576->1368063) 00010000:00010000:3.0:1746147205.194195:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x313993942506159a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2bd expref: 29 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.194206:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x313993942506159a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2bd expref: 29 pid: 9584 timeout: 843 lvb_type: 0 00002000:00010000:3.0:1746147205.194212:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009455df80 00000100:00100000:3.0:1746147205.194268:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1654 00000100:00100000:3.0:1746147205.194275:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310160384:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147205.200418:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967310160384:12345-192.168.204.25@tcp:4:cat.0 Request processed in 6135us (6436us total) trans 17179875107 rc 0/0 00000100:00100000:3.0:1746147205.200429:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1654 00002000:00100000:3.0:1746147205.200440:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1368063) req@ffff88009455df80 x1830967310160384/t17179875107(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/448 e 0 to 0 dl 1746147216 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.200449:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455df80 with x1830967310160384 ext(1048576->1368063) 00010000:00010000:3.0:1746147205.200458:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x313993942506159a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2bd expref: 31 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.200471:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x313993942506159a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2bd expref: 31 pid: 9584 timeout: 843 lvb_type: 0 00002000:00010000:3.0:1746147205.200477:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009455df80 00000100:00100000:0.0:1746147205.207951:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.208118:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310160512 00000100:00100000:3.0:1746147205.208126:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310160512 00010000:00010000:3.0:1746147205.208152:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x313993942506159a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2bd expref: 31 pid: 9584 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.208173:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8752 00000100:00100000:3.0:1746147205.208178:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967310160512:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147205.208189:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147205.208199:0:7226:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147203 -> 1746147205 00002000:00010000:3.0:1746147205.208201:0:7226:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147203 -> 1746147205 00002000:00010000:3.0:1746147205.208202:0:7226:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147204 -> 1746147205 00010000:00010000:3.0:1746147205.208205:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x313993942506159a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2bd expref: 31 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.208213:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x313993942506159a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2bd expref: 31 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.208231:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33e00/0x313993942506159a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2bd expref: 31 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.208251:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.208254:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.208260:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x31399394250615bd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2e0 expref: 17 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.208267:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x31399394250615bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2e0 expref: 17 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.208297:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x31399394250615bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2e0 expref: 17 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147205.208307:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311378944:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147205.208652:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147205.210067:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311378944:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147205.210082:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147205.210145:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310160512:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1965us (2199us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.210154:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8752 00000100:00100000:0.0:1746147205.216507:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.216623:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310160768 00000100:00100000:3.0:1746147205.216631:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310160768 00002000:00100000:3.0:1746147205.216668:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88009455dc00 x1830967310160768/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.216683:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455dc00 with x1830967310160768 ext(1048576->2097151) 00002000:00010000:3.0:1746147205.216689:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009455dc00 00000100:00100000:3.0:1746147205.216771:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7094 00000100:00100000:3.0:1746147205.216779:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310160768:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147205.228808:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310160768:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12021us (12301us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147205.228818:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7094 00002000:00100000:3.0:1746147205.228827:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88009455dc00 x1830967310160768/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/440 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.228835:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455dc00 with x1830967310160768 ext(1048576->2097151) 00002000:00010000:3.0:1746147205.228839:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009455dc00 00000100:00100000:0.0:1746147205.239581:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.239782:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310161024 00000100:00100000:3.0:1746147205.239790:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310161024 00000100:00100000:3.0:1746147205.239835:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6080 00000100:00100000:3.0:1746147205.239841:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2640:x1830967310161024:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147205.240007:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2640:x1830967310161024:12345-192.168.204.25@tcp:35:cat.0 Request processed in 166us (432us total) trans 8589937208 rc 0/0 00000100:00100000:3.0:1746147205.240012:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6080 00000100:00100000:0.0:1746147205.259479:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.259645:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310161280 00000100:00100000:2.0:1746147205.259653:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310161280 00000100:00100000:2.0:1746147205.259731:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16333 00000100:00100000:2.0:1746147205.259739:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2645:x1830967310161280:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147205.259768:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147205.259784:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250615c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e2e7 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.259881:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250615cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.259894:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250615cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.259903:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250615cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.259915:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x31399394250615d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.259920:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x31399394250615d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.259924:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x31399394250615d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.260005:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x31399394250615d9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.260014:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x31399394250615d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.260020:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x31399394250615d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147205.260027:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147205.260084:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250615cb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.260123:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250615cb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.260128:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250615cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.260133:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250615cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.260138:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147205.260141:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250615cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.260146:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250615cb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.260155:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147205.260157:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147205.260160:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250615cb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.260164:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32c00/0x31399394250615cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.260181:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x31399394250615d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.260185:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x31399394250615d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.260189:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x31399394250615d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.260192:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147205.260194:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x31399394250615d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.260198:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x31399394250615d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.260203:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009320e100) 00010000:00010000:2.0:1746147205.260205:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147205.260207:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x31399394250615d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.260215:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x31399394250615d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.260244:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250615c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2e7 expref: 43 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.260254:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x31399394250615d9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2e7 expref: 42 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.260259:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.260261:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147205.260263:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32200, rc 0) 00000100:00100000:2.0:1746147205.260319:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2645:x1830967310161280:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 580us (847us total) trans 8589937209 rc 0/0 00000100:00100000:2.0:1746147205.260325:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16333 00000100:00100000:0.0:1746147205.264674:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.264784:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310161408 00000100:00100000:3.0:1746147205.264793:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310161408 00000100:00100000:3.0:1746147205.264842:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 975 00000100:00100000:3.0:1746147205.264849:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967310161408:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147205.264864:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147205.264886:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x31399394250615d9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2e7 expref: 42 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.264915:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147205.264919:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147205.264956:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2002:x1830967310161408:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 107us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.264961:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 975 00000100:00100000:0.0:1746147205.321476:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.321641:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310161664 00000100:00100000:2.0:1746147205.321650:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310161664 00000100:00100000:2.0:1746147205.321701:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16334 00000100:00100000:2.0:1746147205.321713:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2647:x1830967310161664:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147205.321734:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147205.321749:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33200/0x31399394250615e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e2ee expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147205.321795:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147205.321829:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x31399394250615ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.321840:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x31399394250615ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.321851:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x31399394250615ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.321862:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250615f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00000100:00100000:3.0:1746147205.321863:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310161792 00010000:00010000:2.0:1746147205.321867:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250615f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00000100:00100000:3.0:1746147205.321868:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310161792 00010000:00010000:2.0:1746147205.321871:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250615f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:3.0:1746147205.321904:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19289 00000100:00100000:3.0:1746147205.321911:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c06cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2645:x1830967310161792:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147205.321918:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.321930:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136349a00/0x31399394250615fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e2f5 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.321949:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x31399394250614a5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e246 expref: 41 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.321952:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425061603 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.321957:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009371c600/0x31399394250614e4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e269 expref: 29 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147205.321961:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425061603 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.321962:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.321964:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.321966:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425061603 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.321967:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136349a00/0x31399394250615fc lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3510272->4182015] (req 3510272->4182015) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2f5 expref: 41 pid: 9584 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1746147205.321974:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147205.321994:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009371c600/0x31399394250614e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e269 expref: 29 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.322005:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009371c600/0x31399394250614e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e269 expref: 29 pid: 9584 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746147205.322016:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311379072:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147205.322034:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x31399394250615ee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.322039:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x31399394250615ee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.322044:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x31399394250615ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.322049:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x31399394250615ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.322054:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147205.322058:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x31399394250615ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.322063:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x31399394250615ee lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.322072:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147205.322074:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147205.322077:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x31399394250615ee lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.322081:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x31399394250615ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.322115:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250615f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.322119:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250615f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.322124:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250615f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.322127:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147205.322129:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250615f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.322133:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250615f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.322140:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009320ee00) 00010000:00010000:2.0:1746147205.322142:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147205.322144:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250615f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.322151:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x31399394250615f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.322182:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33200/0x31399394250615e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2ee expref: 25 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.322193:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425061603 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2ee expref: 24 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.322199:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.322201:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147205.322203:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33e00, rc 0) 00000100:00100000:2.0:1746147205.322242:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2647:x1830967310161664:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 530us (774us total) trans 8589937210 rc 0/0 00000100:00100000:2.0:1746147205.322248:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16334 00010000:00010000:3.0:1746147205.322475:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x31399394250614a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e246 expref: 41 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.322485:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x31399394250614a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e246 expref: 41 pid: 13695 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.322493:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311379200:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.322698:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147205.325131:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.325267:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311379072:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147205.325501:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310162176 00000100:00100000:3.0:1746147205.325539:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311379200:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.325565:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136349a00/0x31399394250615fc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3510272->4182015] (req 3510272->4182015) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2f5 expref: 41 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.325579:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136349a00, rc 0) 00000100:00100000:1.0:1746147205.325599:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.325627:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c06cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2645:x1830967310161792:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3717us (3833us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.325635:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19289 00000100:00100000:0.0:1746147205.325948:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310161920 00000100:00100000:0.0:1746147205.325954:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310161920 00000100:00100000:0.0:1746147205.325987:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 976 00000100:00100000:0.0:1746147205.325993:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2003:x1830967310161920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147205.326003:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147205.326021:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33e00/0x3139939425061603 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2ee expref: 24 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.326043:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147205.326046:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147205.326067:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2003:x1830967310161920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 74us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147205.326074:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 976 00000100:00100000:2.0:1746147205.326304:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310162176 00000100:00100000:2.0:1746147205.326327:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6081 00000100:00100000:2.0:1746147205.326331:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2647:x1830967310162176:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147205.326460:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2647:x1830967310162176:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 128us (1340us total) trans 8589937211 rc 0/0 00000100:00100000:2.0:1746147205.326465:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6081 00000100:00100000:0.0:1746147205.327277:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.328386:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310162304 00000100:00100000:3.0:1746147205.328394:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310162304 00010000:00010000:3.0:1746147205.328421:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009371c600/0x31399394250614e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e269 expref: 30 pid: 9584 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746147205.328455:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8753 00000100:00100000:3.0:1746147205.328462:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2001:x1830967310162304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147205.328479:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147205.328498:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009371c600/0x31399394250614e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e269 expref: 30 pid: 9584 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746147205.328507:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009371c600/0x31399394250614e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e269 expref: 30 pid: 9584 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746147205.328529:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009371c600/0x31399394250614e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e269 expref: 30 pid: 9584 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746147205.328550:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147205.328585:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310162304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 123us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.328590:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8753 00000100:00100000:0.0:1746147205.329140:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.329212:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310162432 00000100:00100000:3.0:1746147205.329216:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310162432 00000100:00100000:3.0:1746147205.329241:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19290 00000100:00100000:3.0:1746147205.329245:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2647:x1830967310162432:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147205.329256:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.329265:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425061611 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e2fc expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.329284:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425061339 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e166 expref: 30 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.329291:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990c7400/0x3139939425061435 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e207 expref: 16 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.329297:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x3139939425061340 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e16d expref: 40 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.329302:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.329303:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.329306:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425061611 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1904640->1961983] (req 1904640->1961983) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2fc expref: 30 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.329329:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x3139939425061340 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e16d expref: 40 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.329338:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x3139939425061340 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e16d expref: 40 pid: 13712 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.329349:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311379328:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.329408:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800990c7400/0x3139939425061435 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e207 expref: 16 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.329415:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800990c7400/0x3139939425061435 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e207 expref: 16 pid: 17600 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746147205.329422:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311379456:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.329440:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425061339 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e166 expref: 30 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.329446:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425061339 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e166 expref: 30 pid: 1854 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.329452:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311379584:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.329464:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147205.330440:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.330504:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310162560 00000100:00100000:2.0:1746147205.330515:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310162560 00010000:00010000:2.0:1746147205.330550:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x31399394250614a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e246 expref: 41 pid: 13695 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.330594:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8754 00000100:00100000:2.0:1746147205.330601:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2002:x1830967310162560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.330613:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.330631:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x31399394250614a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e246 expref: 41 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.330641:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x31399394250614a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e246 expref: 41 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.330660:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x31399394250614a5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e246 expref: 41 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.330675:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.330676:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.330683:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136349a00/0x31399394250615fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3510272->4182015) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2f5 expref: 40 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.330691:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136349a00/0x31399394250615fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3510272->4182015) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2f5 expref: 40 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.330721:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136349a00/0x31399394250615fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3510272->4182015) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2f5 expref: 40 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147205.330734:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311379712:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147205.330834:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147205.331144:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311379328:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.331155:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311379456:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.332468:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311379584:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.332495:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425061611 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1904640->1961983] (req 1904640->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2fc expref: 30 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.332509:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbee800, rc 0) 00000100:00100000:3.0:1746147205.332542:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2647:x1830967310162432:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3296us (3403us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.332550:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19290 00000100:00100000:0.0:1746147205.332838:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.333360:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.333376:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.333408:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.333435:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310162688 00000100:00100000:1.0:1746147205.333444:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310162688 00000100:00100000:2.0:1746147205.333460:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310162816 00000100:00100000:2.0:1746147205.333466:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310162816 00010000:00010000:1.0:1746147205.333485:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c7400/0x3139939425061435 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e207 expref: 17 pid: 17600 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746147205.333491:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x3139939425061340 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e16d expref: 41 pid: 13712 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.333513:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310163072 00000100:00100000:1.0:1746147205.333516:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310163072 00010000:00010000:1.0:1746147205.333529:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425061339 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e166 expref: 30 pid: 1854 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.333530:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8755 00000100:00100000:2.0:1746147205.333538:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310162688:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147205.333542:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8756 00000100:00100000:1.0:1746147205.333549:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967310162816:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.333550:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.333560:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.333569:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800990c7400/0x3139939425061435 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e207 expref: 17 pid: 17600 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746147205.333575:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x3139939425061340 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e16d expref: 41 pid: 13712 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.333580:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800990c7400/0x3139939425061435 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e207 expref: 17 pid: 17600 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746147205.333593:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x3139939425061340 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e16d expref: 41 pid: 13712 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.333660:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8757 00000100:00100000:3.0:1746147205.333668:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2001:x1830967310163072:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147205.333675:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.333751:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c7400/0x3139939425061435 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e207 expref: 17 pid: 17600 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746147205.333775:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147205.333800:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310162688:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 264us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.333805:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8755 00000100:00100000:2.0:1746147205.333834:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311379712:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147205.333846:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147205.333859:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2002:x1830967310162560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3259us (3422us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.333863:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8754 00000100:00100000:2.0:1746147205.333889:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310163200 00000100:00100000:2.0:1746147205.333892:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310163200 00002000:00100000:2.0:1746147205.333914:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3510272->3514367) req@ffff88012b8b1880 x1830967310163200/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.333922:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b1880 with x1830967310163200 ext(3510272->3514367) 00002000:00010000:2.0:1746147205.333926:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8b1880 00000100:00100000:2.0:1746147205.333943:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7095 00000100:00100000:2.0:1746147205.333948:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967310163200:12345-192.168.204.25@tcp:3:multiop.0 00010000:00010000:1.0:1746147205.333984:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984ef800/0x3139939425061340 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e16d expref: 41 pid: 13712 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.334004:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.334039:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967310162816:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 490us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.334044:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967310163200:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 95us (635us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147205.334045:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8756 00000100:00100000:2.0:1746147205.334049:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7095 00002000:00100000:2.0:1746147205.334054:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3510272->3514367) req@ffff88012b8b1880 x1830967310163200/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/4536 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.334060:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b1880 with x1830967310163200 ext(3510272->3514367) 00002000:00010000:2.0:1746147205.334062:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8b1880 00010000:00010000:3.0:1746147205.334269:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425061339 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e166 expref: 30 pid: 1854 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.334280:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425061339 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e166 expref: 30 pid: 1854 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.334292:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098446600/0x3139939425061339 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e166 expref: 30 pid: 1854 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.334303:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.334305:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.334310:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425061611 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1961983) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2fc expref: 29 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.334317:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425061611 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1961983) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2fc expref: 29 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.334343:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425061611 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2fc expref: 29 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147205.334353:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311379840:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147205.334414:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147205.336067:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311379840:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147205.336082:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147205.336232:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310163072:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2562us (2851us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.336241:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8757 00000100:00100000:0.0:1746147205.338855:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.339212:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310163456 00000100:00100000:2.0:1746147205.339224:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310163456 00002000:00100000:2.0:1746147205.339274:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1957888->1961983) req@ffff88012b8b1c00 x1830967310163456/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.339283:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b1c00 with x1830967310163456 ext(1957888->1961983) 00002000:00010000:2.0:1746147205.339289:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8b1c00 00000100:00100000:2.0:1746147205.339322:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7096 00000100:00100000:2.0:1746147205.339329:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310163456:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147205.339482:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310163456:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 153us (637us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147205.339492:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7096 00002000:00100000:2.0:1746147205.339498:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1957888->1961983) req@ffff88012b8b1c00 x1830967310163456/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/4536 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.339504:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b1c00 with x1830967310163456 ext(1957888->1961983) 00002000:00010000:2.0:1746147205.339507:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8b1c00 00000100:00100000:0.0:1746147205.342910:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.343283:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310163712 00000100:00100000:2.0:1746147205.343293:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310163712 00002000:00100000:2.0:1746147205.343337:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (4177920->4182015) req@ffff88012b8b2d80 x1830967310163712/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.343347:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b2d80 with x1830967310163712 ext(4177920->4182015) 00002000:00010000:2.0:1746147205.343353:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8b2d80 00000100:00100000:2.0:1746147205.343638:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7097 00000100:00100000:2.0:1746147205.343646:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967310163712:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147205.344025:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967310163712:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 377us (1124us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147205.344031:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7097 00002000:00100000:2.0:1746147205.344037:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (4177920->4182015) req@ffff88012b8b2d80 x1830967310163712/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/4536 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.344044:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b2d80 with x1830967310163712 ext(4177920->4182015) 00002000:00010000:2.0:1746147205.344047:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8b2d80 00000100:00100000:0.0:1746147205.350384:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.350507:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310163968 00000100:00100000:2.0:1746147205.350517:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310163968 00000100:00100000:2.0:1746147205.350598:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6082 00000100:00100000:2.0:1746147205.350607:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19d7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2645:x1830967310163968:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147205.351138:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19d7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2645:x1830967310163968:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 532us (811us total) trans 8589937212 rc 0/0 00000100:00100000:2.0:1746147205.351145:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6082 00000100:00100000:0.0:1746147205.361246:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.361381:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310164224 00000100:00100000:2.0:1746147205.361391:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310164224 00000100:00100000:2.0:1746147205.361458:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16335 00000100:00100000:2.0:1746147205.361467:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2652:x1830967310164224:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147205.361499:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147205.361521:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425061618 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e303 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.361599:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x313993942506161f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.361613:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x313993942506161f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.361624:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x313993942506161f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.361636:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x3139939425061626 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.361641:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x3139939425061626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.361647:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x3139939425061626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.361898:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x313993942506162d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.361914:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x313993942506162d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.361920:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x313993942506162d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147205.361928:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147205.361999:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x313993942506161f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.362005:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x313993942506161f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.362010:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x313993942506161f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.362014:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x313993942506161f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.362019:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147205.362022:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x313993942506161f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.362028:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x313993942506161f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.362038:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147205.362040:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147205.362044:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x313993942506161f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.362049:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32800/0x313993942506161f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.362078:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x3139939425061626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.362083:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x3139939425061626 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.362103:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x3139939425061626 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.362108:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c32200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147205.362110:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x3139939425061626 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.362114:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x3139939425061626 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.362120:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009320e100) 00010000:00010000:2.0:1746147205.362122:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147205.362125:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x3139939425061626 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.362130:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32200/0x3139939425061626 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147205.362165:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c32400/0x3139939425061618 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e303 expref: 27 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.362176:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x313993942506162d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e303 expref: 26 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.362182:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.362185:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147205.362187:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094182400, rc 0) 00000100:00100000:2.0:1746147205.362243:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2652:x1830967310164224:12345-192.168.204.25@tcp:101:cat.0 Request processed in 778us (1009us total) trans 8589937213 rc 0/0 00000100:00100000:2.0:1746147205.362249:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16335 00000100:00100000:1.0:1746147205.365608:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.365670:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.366002:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310164480 00000100:00100000:3.0:1746147205.366012:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310164480 00000100:00100000:3.0:1746147205.366055:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19291 00000100:00100000:3.0:1746147205.366063:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310164480:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147205.366081:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.366129:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009844a800/0x313993942506163b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e30a expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147205.366186:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311379968:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147205.366264:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147205.366600:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310164352 00000100:00100000:2.0:1746147205.366605:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310164352 00000100:00100000:2.0:1746147205.366833:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 977 00000100:00100000:2.0:1746147205.366840:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2002:x1830967310164352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.366851:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.366874:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x313993942506162d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e303 expref: 26 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.366930:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.366935:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147205.367310:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2002:x1830967310164352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 468us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.367317:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 977 00002000:00010000:3.0:1746147205.368031:0:9584:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746147204 -> 1746147205 00002000:00010000:3.0:1746147205.368035:0:9584:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746147203 -> 1746147205 00002000:00010000:3.0:1746147205.368036:0:9584:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime: 1746147204 -> 1746147205 00000100:00100000:3.0:1746147205.368182:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311379968:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147205.368207:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009844a800/0x313993942506163b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e30a expref: 30 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.368218:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009844a800/0x313993942506163b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e30a expref: 30 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.368235:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844a800, rc 0) 00000100:00100000:3.0:1746147205.368272:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310164480:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2210us (2601us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147205.368278:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19291 00000100:00100000:1.0:1746147205.376510:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.376610:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310164736 00000100:00100000:2.0:1746147205.376620:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310164736 00002000:00100000:2.0:1746147205.376672:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880094e59500 x1830967310164736/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 504/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.376682:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e59500 with x1830967310164736 ext(1048576->2097151) 00002000:00010000:2.0:1746147205.376689:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e59500 00000100:00100000:2.0:1746147205.376721:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7098 00000100:00100000:2.0:1746147205.376730:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2002:x1830967310164736:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147205.391496:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2002:x1830967310164736:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14753us (14985us total) trans 0 rc 991232/991232 00000100:00100000:2.0:1746147205.391510:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7098 00002000:00100000:2.0:1746147205.391525:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880094e59500 x1830967310164736/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 504/440 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.391535:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e59500 with x1830967310164736 ext(1048576->2097151) 00002000:00010000:2.0:1746147205.391542:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e59500 00000100:00100000:0.0:1746147205.399726:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.399950:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310164864 00000100:00100000:3.0:1746147205.399958:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310164864 00000100:00100000:3.0:1746147205.400015:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19292 00000100:00100000:3.0:1746147205.400022:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2652:x1830967310164864:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147205.400038:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.400052:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009844be00/0x3139939425061642 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e311 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.400080:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136349a00/0x31399394250615fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3510272->4182015) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2f5 expref: 38 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.400161:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147205.400164:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147205.400168:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009844be00/0x3139939425061642 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e311 expref: 30 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.400196:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136349a00/0x31399394250615fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3510272->4182015) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2f5 expref: 38 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.400207:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136349a00/0x31399394250615fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3510272->4182015) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2f5 expref: 38 pid: 9584 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.400218:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311380096:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.400303:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147205.402984:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.403043:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310165120 00000100:00100000:3.0:1746147205.403051:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310165120 00000100:00100000:3.0:1746147205.403113:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16336 00000100:00100000:3.0:1746147205.403122:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2655:x1830967310165120:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147205.403146:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.403167:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425061649 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e318 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.403234:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425061650 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403246:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425061650 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403256:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425061650 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403267:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x3139939425061657 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403272:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x3139939425061657 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403276:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x3139939425061657 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:2.0:1746147205.403304:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311380096:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147205.403329:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009844be00/0x3139939425061642 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e311 expref: 30 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.403343:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844be00, rc 0) 00010000:00010000:3.0:1746147205.403366:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942506165e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403374:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942506165e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403379:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942506165e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147205.403387:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000100:00100000:2.0:1746147205.403394:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2652:x1830967310164864:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3373us (3679us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.403400:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19292 00010000:00010000:3.0:1746147205.403448:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425061650 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403454:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425061650 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403459:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425061650 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403464:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425061650 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403469:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844b600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147205.403472:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425061650 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403477:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425061650 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403485:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147205.403489:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147205.403492:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425061650 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403496:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425061650 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403509:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x3139939425061657 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403513:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x3139939425061657 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403517:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x3139939425061657 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403521:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844ba00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147205.403523:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x3139939425061657 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403530:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x3139939425061657 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403535:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bf4eb00) 00010000:00010000:3.0:1746147205.403537:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147205.403539:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x3139939425061657 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403543:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ba00/0x3139939425061657 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.403575:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a400/0x3139939425061649 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e318 expref: 45 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.403583:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942506165e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e318 expref: 44 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.403589:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147205.403591:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147205.403593:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844ae00, rc 0) 00000100:00100000:3.0:1746147205.403614:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2655:x1830967310165120:12345-192.168.204.25@tcp:101:cat.0 Request processed in 493us (637us total) trans 8589937214 rc 0/0 00000100:00100000:3.0:1746147205.403619:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16336 00000100:00100000:2.0:1746147205.404146:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.405031:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310165248 00000100:00100000:3.0:1746147205.405038:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310165248 00002000:00100000:3.0:1746147205.405070:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3510272->4182015) req@ffff880099152a00 x1830967310165248/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.405079:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152a00 with x1830967310165248 ext(3510272->4182015) 00010000:00010000:3.0:1746147205.405872:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136349a00/0x31399394250615fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3510272->4182015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2f5 expref: 39 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.405889:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136349a00/0x31399394250615fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3510272->4182015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2f5 expref: 39 pid: 9584 timeout: 843 lvb_type: 0 00002000:00010000:3.0:1746147205.405897:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099152a00 00000100:00100000:3.0:1746147205.405916:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1655 00000100:00100000:3.0:1746147205.405923:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967310165248:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:1.0:1746147205.408848:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.409864:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.410152:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310165376 00000100:00100000:3.0:1746147205.410160:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310165376 00000100:00100000:3.0:1746147205.410200:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 978 00000100:00100000:3.0:1746147205.410206:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967310165376:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147205.410218:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147205.410238:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ae00/0x313993942506165e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e318 expref: 44 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.410253:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147205.410256:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147205.410287:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967310165376:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 81us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.410292:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 978 00000100:00100000:1.0:1746147205.411560:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.411586:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.411652:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310165504 00000100:00100000:2.0:1746147205.411657:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310165504 00000100:00100000:2.0:1746147205.411682:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310165632 00000100:00100000:2.0:1746147205.411683:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310165632 00000100:00100000:2.0:1746147205.411693:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310165760 00000100:00100000:2.0:1746147205.411695:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310165760 00000100:00100000:2.0:1746147205.411706:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19293 00000100:00100000:2.0:1746147205.411712:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967310165504:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147205.411725:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147205.411738:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x313993942506166c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e31f expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.411766:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.411767:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.411775:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x313993942506166c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e31f expref: 31 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147205.411787:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x313993942506166c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e31f expref: 31 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147205.411796:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99000, rc 0) 00000100:00100000:2.0:1746147205.411823:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967310165504:12345-192.168.204.25@tcp:101:cat.0 Request processed in 111us (1961us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.411828:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19293 00000100:00100000:2.0:1746147205.411844:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19294 00000100:00100000:2.0:1746147205.411848:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967310165632:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147205.411855:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147205.411864:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425061673 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e326 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147205.411896:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311380224:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147205.411939:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147205.412013:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19295 00000100:00100000:2.0:1746147205.412019:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2002:x1830967310165760:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147205.412025:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147205.412031:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d99200/0x313993942506167a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e32d expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147205.412056:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311380352:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147205.412080:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00002000:00010000:2.0:1746147205.414988:0:9584:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746147203 -> 1746147205 00002000:00010000:2.0:1746147205.414995:0:9584:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746147203 -> 1746147205 00002000:00010000:2.0:1746147205.414997:0:9584:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746147204 -> 1746147205 00000100:00100000:2.0:1746147205.415014:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311380224:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147205.415040:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425061673 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e326 expref: 46 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147205.415051:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425061673 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e326 expref: 46 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147205.415064:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d98c00, rc 0) 00000100:00100000:2.0:1746147205.415172:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2003:x1830967310165632:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3321us (3613us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147205.415179:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19294 00000100:00100000:2.0:1746147205.415273:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967310165248:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 9350us (11126us total) trans 21474842490 rc 0/0 00000100:00100000:2.0:1746147205.415280:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1655 00002000:00100000:2.0:1746147205.415287:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3510272->4182015) req@ffff880099152a00 x1830967310165248/t21474842490(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/448 e 0 to 0 dl 1746147216 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.415295:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152a00 with x1830967310165248 ext(3510272->4182015) 00010000:00010000:2.0:1746147205.415302:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136349a00/0x31399394250615fc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3510272->4182015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2f5 expref: 43 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.415314:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136349a00/0x31399394250615fc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3510272->4182015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2f5 expref: 43 pid: 9584 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746147205.415320:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099152a00 00000100:00100000:3.0:1746147205.416844:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311380352:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147205.416868:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d99200/0x313993942506167a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e32d expref: 42 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.416882:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d99200/0x313993942506167a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e32d expref: 42 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.416890:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99200, rc 0) 00000100:00100000:3.0:1746147205.417501:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2002:x1830967310165760:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5479us (5911us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147205.417510:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19295 00000100:00100000:0.0:1746147205.417765:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.417858:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310165888 00000100:00100000:2.0:1746147205.417864:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310165888 00010000:00010000:2.0:1746147205.417887:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136349a00/0x31399394250615fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3510272->4182015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2f5 expref: 41 pid: 9584 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.417917:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8758 00000100:00100000:2.0:1746147205.417923:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967310165888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.417933:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.417949:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136349a00/0x31399394250615fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3510272->4182015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2f5 expref: 41 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.417961:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136349a00/0x31399394250615fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3510272->4182015) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2f5 expref: 41 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.417977:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136349a00/0x31399394250615fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3510272->4182015) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2f5 expref: 41 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.417987:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.417989:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.417994:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009844be00/0x3139939425061642 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e311 expref: 29 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.418006:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009844be00/0x3139939425061642 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e311 expref: 29 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.418032:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009844be00/0x3139939425061642 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e311 expref: 29 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147205.418041:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311380480:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147205.418118:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147205.422437:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311380480:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147205.422455:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147205.422497:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967310165888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4573us (4750us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.422507:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8758 00000100:00100000:0.0:1746147205.423228:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.423290:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310166144 00000100:00100000:2.0:1746147205.423295:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310166144 00002000:00100000:2.0:1746147205.423326:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88012b8b2680 x1830967310166144/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.423335:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b2680 with x1830967310166144 ext(2097152->4194303) 00002000:00010000:2.0:1746147205.423339:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8b2680 00000100:00100000:2.0:1746147205.423353:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7099 00000100:00100000:2.0:1746147205.423358:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2001:x1830967310166144:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147205.428948:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.429680:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.429980:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310166400 00000100:00100000:2.0:1746147205.429988:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310166400 00002000:00100000:2.0:1746147205.430024:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88012b8b1f80 x1830967310166400/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.430034:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b1f80 with x1830967310166400 ext(1048576->2097151) 00002000:00010000:2.0:1746147205.430040:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8b1f80 00000100:00100000:2.0:1746147205.430062:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310166528 00000100:00100000:2.0:1746147205.430064:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310166528 00002000:00100000:2.0:1746147205.430072:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880094e59f80 x1830967310166528/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.430078:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e59f80 with x1830967310166528 ext(1048576->2097151) 00002000:00010000:2.0:1746147205.430080:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e59f80 00000100:00100000:2.0:1746147205.430110:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7100 00000100:00100000:2.0:1746147205.430116:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967310166400:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147205.430861:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7101 00000100:00100000:0.0:1746147205.430869:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967310166528:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147205.440137:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2001:x1830967310166144:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16768us (16900us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147205.440148:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7099 00002000:00100000:2.0:1746147205.440158:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88012b8b2680 x1830967310166144/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/440 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.440165:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b2680 with x1830967310166144 ext(2097152->4194303) 00002000:00010000:2.0:1746147205.440170:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8b2680 00000100:00100000:2.0:1746147205.445349:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967310166400:12345-192.168.204.25@tcp:3:cat.0 Request processed in 15223us (16401us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147205.445361:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7100 00002000:00100000:2.0:1746147205.445370:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88012b8b1f80 x1830967310166400/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/440 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.445378:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b1f80 with x1830967310166400 ext(1048576->2097151) 00002000:00010000:2.0:1746147205.445384:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8b1f80 00000100:00100000:2.0:1746147205.449222:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967310166528:12345-192.168.204.25@tcp:3:cat.0 Request processed in 18342us (19531us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147205.449234:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7101 00002000:00100000:2.0:1746147205.449244:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880094e59f80 x1830967310166528/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/440 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.449252:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e59f80 with x1830967310166528 ext(1048576->2097151) 00002000:00010000:2.0:1746147205.449256:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e59f80 00000100:00100000:1.0:1746147205.449397:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746147205.449412:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311380608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746147205.449450:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147205.449507:0:12153:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311380608 00000100:00100000:1.0:1746147205.449513:0:12153:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311380608 00000100:00100000:1.0:1746147205.449553:0:12153:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:1.0:1746147205.449558:0:12153:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311380608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1746147205.449575:0:12153:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1143874624 pending 3022848 free 3911233536 avail 3679711232 00000100:00100000:1.0:1746147205.449599:0:12153:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311380608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.449604:0:12153:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:1.0:1746147205.449636:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311380608:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1746147205.449704:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147205.455618:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.455709:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310166912 00000100:00100000:2.0:1746147205.455717:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310166912 00002000:00100000:2.0:1746147205.455763:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88012b8b0700 x1830967310166912/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.455773:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b0700 with x1830967310166912 ext(4194304->4890623) 00002000:00010000:2.0:1746147205.455778:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8b0700 00000100:00100000:2.0:1746147205.455966:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7102 00000100:00100000:2.0:1746147205.455973:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2002:x1830967310166912:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147205.461011:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.462404:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310167040 00000100:00100000:3.0:1746147205.462413:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310167040 00000100:00100000:3.0:1746147205.462453:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19296 00000100:00100000:3.0:1746147205.462460:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2655:x1830967310167040:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147205.462475:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.462490:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x3139939425061681 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e334 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.462513:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425061611 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2fc expref: 31 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.462520:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147205.462522:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147205.462524:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x3139939425061681 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e334 expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.462550:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425061611 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1961983) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2fc expref: 31 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.462564:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425061611 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1961983) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2fc expref: 31 pid: 9584 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.462575:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311380736:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.462639:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147205.462903:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2002:x1830967310166912:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6929us (7291us total) trans 0 rc 696320/696320 00000100:00100000:2.0:1746147205.462913:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7102 00002000:00100000:2.0:1746147205.462921:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88012b8b0700 x1830967310166912/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/440 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.462930:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b0700 with x1830967310166912 ext(4194304->4890623) 00002000:00010000:2.0:1746147205.462933:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8b0700 00000100:00100000:3.0:1746147205.464230:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311380736:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.464253:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x3139939425061681 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e334 expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.464268:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844b600, rc 0) 00000100:00100000:3.0:1746147205.464719:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2655:x1830967310167040:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2257us (3713us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.464727:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19296 00000100:00100000:0.0:1746147205.465154:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.465658:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310167168 00000100:00100000:2.0:1746147205.465666:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310167168 00002000:00100000:2.0:1746147205.465698:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1904640->1961983) req@ffff88012b8b0380 x1830967310167168/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.465707:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b0380 with x1830967310167168 ext(1904640->1961983) 00010000:00010000:2.0:1746147205.465713:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425061611 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2fc expref: 30 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.465725:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425061611 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2fc expref: 30 pid: 9584 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746147205.465730:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b8b0380 00000100:00100000:2.0:1746147205.465744:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1656 00000100:00100000:2.0:1746147205.465750:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2001:x1830967310167168:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147205.466927:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.467024:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310167296 00000100:00100000:3.0:1746147205.467225:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310167296 00000100:00100000:3.0:1746147205.467266:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19297 00000100:00100000:3.0:1746147205.467273:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2003:x1830967310167296:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147205.467284:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.467299:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009844a200/0x3139939425061688 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e33b expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147205.467340:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311380864:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147205.467438:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147205.468874:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2001:x1830967310167168:12345-192.168.204.25@tcp:4:cat.0 Request processed in 3120us (3717us total) trans 21474842491 rc 0/0 00000100:00100000:2.0:1746147205.468884:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1656 00002000:00100000:2.0:1746147205.468892:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1904640->1961983) req@ffff88012b8b0380 x1830967310167168/t21474842491(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/448 e 0 to 0 dl 1746147216 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.468901:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b0380 with x1830967310167168 ext(1904640->1961983) 00010000:00010000:2.0:1746147205.468909:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425061611 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2fc expref: 34 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.468920:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425061611 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2fc expref: 34 pid: 9584 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746147205.468926:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b8b0380 00000100:00100000:0.0:1746147205.471776:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.471855:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310167552 00000100:00100000:2.0:1746147205.471863:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310167552 00000100:00100000:2.0:1746147205.471907:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16337 00000100:00100000:2.0:1746147205.471913:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2657:x1830967310167552:12345-192.168.204.25@tcp:101:multiop.0 00000100:00100000:3.0:1746147205.471929:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311380864:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147205.471932:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147205.471947:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x313993942506168f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e342 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.471953:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009844a200/0x3139939425061688 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e33b expref: 33 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.471963:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009844a200/0x3139939425061688 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e33b expref: 33 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.471989:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844a200, rc 0) 00010000:00010000:2.0:1746147205.472007:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425061696 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472016:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425061696 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472025:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425061696 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472036:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942506169d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472041:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942506169d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472046:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942506169d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472148:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98c00/0x31399394250616a4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472158:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98c00/0x31399394250616a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472164:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98c00/0x31399394250616a4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:2.0:1746147205.472172:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147205.472232:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425061696 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472237:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425061696 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472242:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425061696 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472247:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d99400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147205.472250:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425061696 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472255:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425061696 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472264:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147205.472267:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746147205.472270:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2003:x1830967310167296:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4997us (5345us total) trans 0 rc 301/301 00010000:00010000:2.0:1746147205.472270:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425061696 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472275:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99400/0x3139939425061696 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00000100:00100000:3.0:1746147205.472277:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19297 00010000:00010000:2.0:1746147205.472285:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942506169d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472289:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942506169d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472293:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942506169d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472300:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d99200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147205.472302:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942506169d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472306:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942506169d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472312:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093157300) 00010000:00010000:2.0:1746147205.472313:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147205.472316:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942506169d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472320:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942506169d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.472350:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x313993942506168f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e342 expref: 28 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.472364:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98c00/0x31399394250616a4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e342 expref: 27 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.472369:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.472370:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147205.472372:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d98c00, rc 0) 00000100:00100000:2.0:1746147205.472394:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2657:x1830967310167552:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 481us (625us total) trans 8589937215 rc 0/0 00000100:00100000:2.0:1746147205.472399:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16337 00000100:00100000:0.0:1746147205.477733:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.477822:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310167808 00000100:00100000:2.0:1746147205.477832:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310167808 00000100:00100000:0.0:1746147205.477857:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147205.478038:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425061611 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2fc expref: 32 pid: 9584 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.478067:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8759 00000100:00100000:2.0:1746147205.478074:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2003:x1830967310167808:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.478086:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.478132:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425061611 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2fc expref: 32 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.478144:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425061611 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->1961983) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2fc expref: 32 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.478164:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbee800/0x3139939425061611 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1904640->1961983) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2fc expref: 32 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.478177:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.478179:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.478185:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x3139939425061681 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e334 expref: 40 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.478192:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x3139939425061681 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e334 expref: 40 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.478224:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x3139939425061681 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e334 expref: 40 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147205.478235:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311380992:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147205.478319:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147205.478972:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310167936 00000100:00100000:3.0:1746147205.478977:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310167936 00000100:00100000:3.0:1746147205.479010:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19298 00000100:00100000:3.0:1746147205.479017:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2002:x1830967310167936:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147205.479028:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.479040:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009844a600/0x31399394250616b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e349 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.479055:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.479057:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.479062:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009844a600/0x31399394250616b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e349 expref: 33 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.479075:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009844a600/0x31399394250616b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e349 expref: 33 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.479083:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844a600, rc 0) 00000100:00100000:3.0:1746147205.479129:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2002:x1830967310167936:12345-192.168.204.25@tcp:101:cat.0 Request processed in 112us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.479135:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19298 00000100:00100000:1.0:1746147205.479254:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.479332:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.479414:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310168192 00000100:00100000:3.0:1746147205.479418:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310168192 00000100:00100000:3.0:1746147205.479443:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6083 00000100:00100000:3.0:1746147205.479449:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2657:x1830967310168192:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147205.479518:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310167680 00000100:00100000:2.0:1746147205.479522:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310167680 00000100:00100000:2.0:1746147205.479546:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 979 00000100:00100000:2.0:1746147205.479551:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2000:x1830967310167680:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.479558:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.479573:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98c00/0x31399394250616a4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e342 expref: 29 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.479584:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.479587:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147205.479598:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2657:x1830967310168192:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 148us (265us total) trans 8589937216 rc 0/0 00000100:00100000:3.0:1746147205.479603:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6083 00000100:00100000:2.0:1746147205.479604:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2000:x1830967310167680:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 53us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.479610:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 979 00000100:00100000:2.0:1746147205.480770:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311380992:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147205.480789:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147205.480829:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2003:x1830967310167808:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2754us (3169us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.480837:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8759 00000100:00100000:0.0:1746147205.486180:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.486232:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.486568:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310168448 00000100:00100000:3.0:1746147205.486576:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310168448 00000100:00100000:3.0:1746147205.486619:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16338 00000100:00100000:3.0:1746147205.486626:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2659:x1830967310168448:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147205.486644:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.486659:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x31399394250616b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e350 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.486723:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x31399394250616c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.486733:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x31399394250616c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.486741:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x31399394250616c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.486763:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250616c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.486771:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250616c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.486776:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250616c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.486844:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a200/0x31399394250616ce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.486851:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a200/0x31399394250616ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.486855:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a200/0x31399394250616ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147205.486863:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000100:00100000:2.0:1746147205.486876:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310168704 00000100:00100000:2.0:1746147205.486880:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310168704 00002000:00100000:2.0:1746147205.486904:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880129f57100 x1830967310168704/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.486913:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f57100 with x1830967310168704 ext(1048576->2097151) 00002000:00010000:2.0:1746147205.486917:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f57100 00000100:00100000:2.0:1746147205.487044:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7103 00010000:00010000:3.0:1746147205.487049:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x31399394250616c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00000100:00100000:2.0:1746147205.487051:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967310168704:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:3.0:1746147205.487055:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x31399394250616c0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.487059:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x31399394250616c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.487063:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844b200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147205.487066:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x31399394250616c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.487071:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x31399394250616c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.487078:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147205.487081:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147205.487085:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x31399394250616c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.487105:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b200/0x31399394250616c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.487121:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250616c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.487125:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250616c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.487129:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250616c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.487132:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844a800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147205.487134:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250616c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.487138:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250616c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.487142:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bf4ee00) 00010000:00010000:3.0:1746147205.487167:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147205.487169:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250616c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.487172:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250616c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00000100:00100000:1.0:1746147205.487179:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147205.487203:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844aa00/0x31399394250616b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e350 expref: 46 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.487217:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a200/0x31399394250616ce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e350 expref: 45 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.487222:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147205.487224:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147205.487226:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844a200, rc 0) 00000100:00100000:3.0:1746147205.487768:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2659:x1830967310168448:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1141us (1593us total) trans 8589937217 rc 0/0 00000100:00100000:3.0:1746147205.487774:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16338 00000100:00100000:3.0:1746147205.487797:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310168960 00000100:00100000:3.0:1746147205.487800:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310168960 00000100:00100000:3.0:1746147205.487817:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6084 00000100:00100000:3.0:1746147205.487822:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2652:x1830967310168960:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147205.487902:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2652:x1830967310168960:12345-192.168.204.25@tcp:35:cat.0 Request processed in 79us (724us total) trans 8589937218 rc 0/0 00000100:00100000:3.0:1746147205.487907:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6084 00000100:00100000:0.0:1746147205.501325:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.501568:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310169088 00000100:00100000:2.0:1746147205.501577:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310169088 00000100:00100000:2.0:1746147205.501631:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 980 00000100:00100000:2.0:1746147205.501638:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967310169088:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.501652:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.501674:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a200/0x31399394250616ce lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e350 expref: 45 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.501692:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.501696:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147205.502030:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967310169088:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 392us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.502037:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 980 00000100:00100000:3.0:1746147205.502157:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967310168704:12345-192.168.204.25@tcp:3:cat.0 Request processed in 15105us (15923us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147205.502164:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7103 00002000:00100000:3.0:1746147205.502172:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880129f57100 x1830967310168704/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/440 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.502180:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f57100 with x1830967310168704 ext(1048576->2097151) 00002000:00010000:3.0:1746147205.502184:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f57100 00000100:00100000:0.0:1746147205.510895:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.511590:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310169216 00000100:00100000:2.0:1746147205.511599:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310169216 00000100:00100000:2.0:1746147205.511650:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19299 00000100:00100000:2.0:1746147205.511657:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2655:x1830967310169216:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147205.511671:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147205.511686:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d99a00/0x31399394250616dc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e357 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.511708:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.511710:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.511716:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d99a00/0x31399394250616dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e357 expref: 42 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.511732:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d99a00/0x31399394250616dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e357 expref: 42 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.511741:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99a00, rc 0) 00000100:00100000:2.0:1746147205.511803:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2655:x1830967310169216:12345-192.168.204.25@tcp:101:cat.0 Request processed in 146us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.511809:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19299 00000100:00100000:0.0:1746147205.520477:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.521775:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310169472 00000100:00100000:3.0:1746147205.521786:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310169472 00002000:00100000:3.0:1746147205.521827:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880129f55180 x1830967310169472/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.521837:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55180 with x1830967310169472 ext(2097152->4194303) 00002000:00010000:3.0:1746147205.521842:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f55180 00000100:00100000:3.0:1746147205.521859:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7104 00000100:00100000:3.0:1746147205.521866:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967310169472:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147205.538645:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967310169472:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16769us (18167us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147205.538658:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7104 00002000:00100000:3.0:1746147205.538669:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880129f55180 x1830967310169472/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/440 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.538678:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55180 with x1830967310169472 ext(2097152->4194303) 00002000:00010000:3.0:1746147205.538683:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f55180 00000100:00100000:0.0:1746147205.550259:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.550343:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310169728 00000100:00100000:3.0:1746147205.550354:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310169728 00002000:00100000:3.0:1746147205.550395:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880129f57800 x1830967310169728/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.550404:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f57800 with x1830967310169728 ext(4194304->4890623) 00002000:00010000:3.0:1746147205.550409:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f57800 00000100:00100000:3.0:1746147205.550439:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7105 00000100:00100000:3.0:1746147205.550445:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967310169728:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147205.556691:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967310169728:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6232us (6429us total) trans 0 rc 696320/696320 00000100:00100000:3.0:1746147205.556708:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7105 00002000:00100000:3.0:1746147205.556720:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880129f57800 x1830967310169728/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/440 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.556729:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f57800 with x1830967310169728 ext(4194304->4890623) 00002000:00010000:3.0:1746147205.556734:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f57800 00000100:00100000:0.0:1746147205.562781:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.562907:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310169984 00000100:00100000:3.0:1746147205.562919:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310169984 00000100:00100000:3.0:1746147205.562980:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6085 00000100:00100000:3.0:1746147205.562990:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2655:x1830967310169984:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147205.563267:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2655:x1830967310169984:12345-192.168.204.25@tcp:35:cat.0 Request processed in 275us (493us total) trans 8589937219 rc 0/0 00000100:00100000:3.0:1746147205.563274:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6085 00000100:00100000:0.0:1746147205.565060:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.565209:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310170112 00000100:00100000:3.0:1746147205.565217:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310170112 00000100:00100000:3.0:1746147205.565271:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19300 00000100:00100000:3.0:1746147205.565279:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2659:x1830967310170112:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147205.565294:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.565314:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x31399394250616e3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e35e expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.565344:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x31399394250615a1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2c4 expref: 43 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.565353:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x31399394250615a8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2cb expref: 31 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.565365:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.565367:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.565370:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x31399394250616e3 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [110592->733183] (req 110592->733183) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e35e expref: 43 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.565401:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x31399394250615a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2cb expref: 31 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.565413:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x31399394250615a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2cb expref: 31 pid: 13695 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.565424:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311381120:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.565637:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x31399394250615a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2c4 expref: 43 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.565645:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x31399394250615a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2c4 expref: 43 pid: 13695 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.565653:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311381248:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.565674:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147205.567075:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311381120:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.567086:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311381248:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.567231:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x31399394250616e3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [110592->733183] (req 110592->733183) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e35e expref: 43 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.567251:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9ff200, rc 0) 00000100:00100000:3.0:1746147205.567288:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2659:x1830967310170112:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2010us (2235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.567295:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19300 00000100:00100000:0.0:1746147205.569645:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.569722:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.569944:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310170240 00000100:00100000:2.0:1746147205.569952:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310170240 00010000:00010000:2.0:1746147205.569986:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x31399394250615a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2c4 expref: 43 pid: 13695 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.570023:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310170368 00000100:00100000:2.0:1746147205.570025:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310170368 00010000:00010000:2.0:1746147205.570036:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x31399394250615a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2cb expref: 32 pid: 13695 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.570052:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8760 00000100:00100000:2.0:1746147205.570060:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967310170240:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.570072:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.570122:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x31399394250615a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2c4 expref: 43 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.570132:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x31399394250615a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2c4 expref: 43 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.570161:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e81000/0x31399394250615a1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2c4 expref: 43 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.570179:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147205.570215:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967310170240:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 156us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.570221:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8760 00000100:00100000:2.0:1746147205.570234:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8761 00000100:00100000:2.0:1746147205.570239:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2000:x1830967310170368:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.570245:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.570252:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x31399394250615a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2cb expref: 32 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.570261:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x31399394250615a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2cb expref: 32 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.570272:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x31399394250615a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2cb expref: 32 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.570281:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.570282:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.570290:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x31399394250616e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->733183) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e35e expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.570298:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x31399394250616e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->733183) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e35e expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.570328:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x31399394250616e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->733183) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e35e expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147205.570341:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311381376:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147205.570396:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147205.572406:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311381376:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147205.572426:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147205.572466:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2000:x1830967310170368:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2225us (2743us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.572476:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8761 00000100:00100000:0.0:1746147205.573291:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.573376:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310170624 00000100:00100000:3.0:1746147205.573382:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310170624 00002000:00100000:3.0:1746147205.573415:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (110592->114687) req@ffff880094184700 x1830967310170624/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.573424:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094184700 with x1830967310170624 ext(110592->114687) 00002000:00010000:3.0:1746147205.573429:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094184700 00000100:00100000:3.0:1746147205.573459:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7106 00000100:00100000:3.0:1746147205.573466:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967310170624:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147205.573598:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2002:x1830967310170624:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 132us (308us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147205.573604:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7106 00002000:00100000:3.0:1746147205.573609:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (110592->114687) req@ffff880094184700 x1830967310170624/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/4536 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.573617:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094184700 with x1830967310170624 ext(110592->114687) 00002000:00010000:3.0:1746147205.573619:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094184700 00000100:00100000:1.0:1746147205.583423:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.583487:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310170880 00000100:00100000:3.0:1746147205.583495:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310170880 00002000:00100000:3.0:1746147205.583729:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (729088->733183) req@ffff8800a5574e00 x1830967310170880/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.583744:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5574e00 with x1830967310170880 ext(729088->733183) 00002000:00010000:3.0:1746147205.583757:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5574e00 00000100:00100000:3.0:1746147205.583786:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7107 00000100:00100000:3.0:1746147205.583794:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967310170880:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147205.583941:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967310170880:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 147us (527us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147205.583946:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7107 00002000:00100000:3.0:1746147205.583952:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (729088->733183) req@ffff8800a5574e00 x1830967310170880/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/4536 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.583958:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5574e00 with x1830967310170880 ext(729088->733183) 00002000:00010000:3.0:1746147205.583961:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5574e00 00000100:00100000:0.0:1746147205.588827:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.588940:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310171136 00000100:00100000:3.0:1746147205.588949:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310171136 00000100:00100000:3.0:1746147205.589412:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6086 00000100:00100000:3.0:1746147205.589421:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2659:x1830967310171136:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147205.589635:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2659:x1830967310171136:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 214us (818us total) trans 8589937220 rc 0/0 00000100:00100000:3.0:1746147205.589642:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6086 00000100:00100000:0.0:1746147205.620855:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.620949:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310171264 00000100:00100000:3.0:1746147205.620958:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310171264 00000100:00100000:3.0:1746147205.621017:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19301 00000100:00100000:3.0:1746147205.621026:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2657:x1830967310171264:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147205.621046:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.621066:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x31399394250616ea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e365 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.621133:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x31399394250615af lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d2 expref: 19 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.621143:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x31399394250615b6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d9 expref: 30 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.621150:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.621152:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.621155:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x31399394250616ea lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1470464->2097151] (req 1470464->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e365 expref: 19 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.621188:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x31399394250615b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d9 expref: 30 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.621200:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x31399394250615b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d9 expref: 30 pid: 13695 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746147205.621212:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311381504:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.621302:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x31399394250615af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d2 expref: 19 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.621309:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x31399394250615af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d2 expref: 19 pid: 13695 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.621315:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311381632:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.621332:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147205.627902:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311381504:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.627914:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311381632:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.627941:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x31399394250616ea lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1470464->2097151] (req 1470464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e365 expref: 19 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.627958:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9ff600, rc 0) 00000100:00100000:3.0:1746147205.628001:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2657:x1830967310171264:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6977us (7156us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.628010:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19301 00000100:00100000:0.0:1746147205.629949:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.629995:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.630025:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310171392 00000100:00100000:2.0:1746147205.630034:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310171392 00010000:00010000:2.0:1746147205.630066:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x31399394250615af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d2 expref: 19 pid: 13695 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.630938:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310171520 00000100:00100000:2.0:1746147205.630943:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310171520 00010000:00010000:2.0:1746147205.630958:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x31399394250615b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d9 expref: 31 pid: 13695 timeout: 843 lvb_type: 1 00000100:00100000:1.0:1746147205.630961:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8762 00000100:00100000:1.0:1746147205.630972:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2000:x1830967310171392:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147205.630977:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8763 00000100:00100000:2.0:1746147205.630982:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967310171520:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.630987:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.630989:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.631004:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x31399394250615b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d9 expref: 31 pid: 13695 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746147205.631005:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x31399394250615af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d2 expref: 19 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.631020:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x31399394250615b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d9 expref: 31 pid: 13695 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746147205.631033:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x31399394250615af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d2 expref: 19 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.631060:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d49400/0x31399394250615af lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d2 expref: 19 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.631083:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147205.631200:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d49c00/0x31399394250615b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2d9 expref: 31 pid: 13695 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746147205.631740:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.631742:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.631762:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x31399394250616ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e365 expref: 18 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.631771:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x31399394250616ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e365 expref: 18 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.631802:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x31399394250616ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e365 expref: 18 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147205.631814:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311381760:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147205.632133:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310171392:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1162us (2192us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.632140:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8762 00000100:00100000:2.0:1746147205.632270:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147205.634736:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311381760:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147205.634765:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147205.634805:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310171520:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3821us (4808us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.634814:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8763 00000100:00100000:0.0:1746147205.635028:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.635084:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310171776 00000100:00100000:1.0:1746147205.635106:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310171776 00002000:00100000:1.0:1746147205.635146:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1470464->1474559) req@ffff880094186d80 x1830967310171776/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147205.635156:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094186d80 with x1830967310171776 ext(1470464->1474559) 00002000:00010000:1.0:1746147205.635162:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094186d80 00000100:00100000:1.0:1746147205.635193:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7108 00000100:00100000:1.0:1746147205.635200:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310171776:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147205.635322:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310171776:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 122us (294us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147205.635328:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7108 00002000:00100000:1.0:1746147205.635332:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1470464->1474559) req@ffff880094186d80 x1830967310171776/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/4536 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147205.635345:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094186d80 with x1830967310171776 ext(1470464->1474559) 00002000:00010000:1.0:1746147205.635348:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094186d80 00000100:00100000:0.0:1746147205.648153:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.648758:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310171904 00000100:00100000:3.0:1746147205.648768:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310171904 00000100:00100000:3.0:1746147205.648827:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19302 00000100:00100000:3.0:1746147205.648836:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2657:x1830967310171904:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147205.648857:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.648877:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9fee00/0x31399394250616f1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e36c expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.648912:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x31399394250615bd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2e0 expref: 19 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.648920:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x313993942506166c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e31f expref: 29 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.648926:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.648928:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.648932:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fee00/0x31399394250616f1 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->1339391] (req 1048576->1339391) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e36c expref: 19 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.648963:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x313993942506166c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e31f expref: 29 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.648974:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x313993942506166c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e31f expref: 29 pid: 9584 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746147205.648986:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311381888:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.649116:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x31399394250615bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2e0 expref: 19 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.649124:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x31399394250615bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2e0 expref: 19 pid: 9584 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.649131:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311382016:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.649166:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147205.652052:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311381888:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.652066:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311382016:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.652166:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fee00/0x31399394250616f1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->1339391] (req 1048576->1339391) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e36c expref: 19 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.652186:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fee00, rc 0) 00000100:00100000:3.0:1746147205.652877:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2657:x1830967310171904:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4039us (4731us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.652889:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19302 00000100:00100000:0.0:1746147205.653170:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.653258:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.653724:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310172160 00000100:00100000:1.0:1746147205.653724:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310172032 00000100:00100000:2.0:1746147205.653732:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310172160 00000100:00100000:1.0:1746147205.653732:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310172032 00010000:00010000:2.0:1746147205.653773:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x31399394250615bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2e0 expref: 19 pid: 9584 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.653813:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8764 00000100:00100000:2.0:1746147205.653822:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310172160:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.653839:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.653860:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x31399394250615bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2e0 expref: 19 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.653864:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x313993942506166c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e31f expref: 30 pid: 9584 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746147205.653872:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x31399394250615bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2e0 expref: 19 pid: 9584 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.653892:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8765 00010000:00010000:2.0:1746147205.653895:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33800/0x31399394250615bd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2e0 expref: 19 pid: 9584 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.653898:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310172032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.653905:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.653913:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x313993942506166c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e31f expref: 30 pid: 9584 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746147205.653915:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147205.653923:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x313993942506166c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e31f expref: 30 pid: 9584 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746147205.653936:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d99000/0x313993942506166c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e31f expref: 30 pid: 9584 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746147205.653949:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.653951:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.653959:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fee00/0x31399394250616f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e36c expref: 18 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.653967:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fee00/0x31399394250616f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e36c expref: 18 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147205.653970:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310172160:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 149us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.653975:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8764 00010000:00010000:1.0:1746147205.654003:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9fee00/0x31399394250616f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e36c expref: 17 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147205.654015:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311382144:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147205.654084:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5658780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147205.658943:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311382144:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147205.658971:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.659027:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310172032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5129us (5768us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.659038:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8765 00000100:00100000:0.0:1746147205.662964:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.663036:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310172416 00000100:00100000:1.0:1746147205.663047:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310172416 00002000:00100000:1.0:1746147205.663134:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x97:0x0] (1335296->1339391) req@ffff880094187480 x1830967310172416/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147205.663144:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094187480 with x1830967310172416 ext(1335296->1339391) 00002000:00010000:1.0:1746147205.663150:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094187480 00000100:00100000:1.0:1746147205.663183:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7109 00000100:00100000:1.0:1746147205.663191:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310172416:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147205.664619:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310172416:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 1424us (1660us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147205.664629:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7109 00002000:00100000:1.0:1746147205.664637:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x97:0x0] (1335296->1339391) req@ffff880094187480 x1830967310172416/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/4536 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147205.664651:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094187480 with x1830967310172416 ext(1335296->1339391) 00002000:00010000:1.0:1746147205.664655:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094187480 00000100:00100000:0.0:1746147205.679058:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.679136:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310172544 00000100:00100000:3.0:1746147205.679147:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310172544 00000100:00100000:3.0:1746147205.679228:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16339 00000100:00100000:3.0:1746147205.679236:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2665:x1830967310172544:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147205.679261:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.679281:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x31399394250616f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e373 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.679341:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x31399394250616ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.679354:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x31399394250616ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.679364:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x31399394250616ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.679378:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x3139939425061706 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.679384:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x3139939425061706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.679389:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x3139939425061706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.682919:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fec00/0x313993942506170d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.682946:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614f9 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e277 expref: 27 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.682954:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fec00/0x313993942506170d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.682994:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614f9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e277 expref: 27 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.683008:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614f9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e277 expref: 27 pid: 16099 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.683024:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311382272:192.168.204.25@tcp:104: 00000100:00080000:0.0:1746147205.683155:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147205.683156:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147205.687168:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.687274:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311382272:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.687298:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fec00/0x313993942506170d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:1.0:1746147205.687736:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310172800 00000100:00100000:1.0:1746147205.687744:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310172800 00000100:00100000:3.0:1746147205.689298:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6087 00000100:00100000:3.0:1746147205.689314:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:8486:x1830967310172800:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147205.689568:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:8486:x1830967310172800:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 260us (2408us total) trans 8589937221 rc 0/0 00000100:00100000:3.0:1746147205.689575:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6087 00000100:00100000:0.0:1746147205.693376:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.693583:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310172928 00000100:00100000:1.0:1746147205.693594:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310172928 00010000:00010000:1.0:1746147205.693638:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614f9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e277 expref: 29 pid: 16099 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.693682:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8766 00000100:00100000:1.0:1746147205.693690:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2000:x1830967310172928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.693705:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.693715:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614f9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e277 expref: 29 pid: 16099 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.693732:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614f9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e277 expref: 29 pid: 16099 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.693765:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae600/0x31399394250614f9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e277 expref: 29 pid: 16099 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.693798:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147205.693804:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fec00/0x313993942506170d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.693814:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fec00/0x313993942506170d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.693826:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fec00/0x313993942506170d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.693930:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147205.693953:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fec00/0x313993942506170d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.693962:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fec00/0x313993942506170d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:1.0:1746147205.693987:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2000:x1830967310172928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 298us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.693994:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8766 00000004:00200000:3.0:1746147205.694016:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147205.694021:0:16099:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147205.694040:0:16099:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fec00/0x313993942506170d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.694051:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fec00/0x313993942506170d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.694059:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x31399394250616ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.694065:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x31399394250616ff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.694070:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x31399394250616ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.694075:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9ffc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147205.694079:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x31399394250616ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.694085:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x31399394250616ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.694120:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147205.694123:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147205.694126:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x31399394250616ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.694130:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x31399394250616ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.694144:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x3139939425061706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.694148:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x3139939425061706 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.694153:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x3139939425061706 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.694162:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9ff400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147205.694164:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x3139939425061706 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.694169:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x3139939425061706 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.694174:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bf4e600) 00010000:00010000:3.0:1746147205.694179:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147205.694181:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x3139939425061706 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.694188:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x3139939425061706 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.694224:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x31399394250616f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e373 expref: 13 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.694235:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fec00/0x313993942506170d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e373 expref: 12 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.694240:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147205.694242:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147205.694244:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fec00, rc 0) 00000100:00100000:3.0:1746147205.694271:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2665:x1830967310172544:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 15037us (15226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.694277:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16339 00000100:00100000:0.0:1746147205.698251:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.698291:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.698317:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.698337:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.698348:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310173056 00000100:00100000:0.0:1746147205.698351:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.698359:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310173056 00000100:00100000:1.0:1746147205.698374:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310173184 00000100:00100000:0.0:1746147205.698377:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.698385:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310173184 00000100:00100000:0.0:1746147205.698395:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310173312 00000100:00100000:0.0:1746147205.698398:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310173312 00000100:00100000:2.0:1746147205.698413:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310173440 00000100:00100000:2.0:1746147205.698416:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310173440 00000100:00100000:0.0:1746147205.698418:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310173568 00000100:00100000:0.0:1746147205.698420:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310173568 00000100:00100000:1.0:1746147205.698440:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310173696 00000100:00100000:1.0:1746147205.698443:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310173696 00000100:00100000:2.0:1746147205.698449:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19303 00000100:00100000:0.0:1746147205.698457:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19304 00000100:00100000:2.0:1746147205.698458:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2003:x1830967310173056:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:0.0:1746147205.698463:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967310173312:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147205.698476:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147205.698476:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147205.698479:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19305 00000100:00100000:1.0:1746147205.698486:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967310173184:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:3.0:1746147205.698489:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19306 00010000:00010000:2.0:1746147205.698496:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425061714 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e37a expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147205.698498:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2003:x1830967310173440:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147205.698499:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b0800/0x313993942506171b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e388 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.698501:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.698505:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.698513:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffe00/0x3139939425061722 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e38f expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.698515:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x3139939425061729 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e381 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.698525:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.698528:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.698541:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffe00/0x3139939425061722 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e38f expref: 20 pid: 12201 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147205.698546:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311382400:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147205.698546:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009689a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311382528:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147205.698556:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffe00/0x3139939425061722 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e38f expref: 20 pid: 12201 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147205.698562:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311382656:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147205.698567:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9ffe00, rc 0) 00000100:00100000:3.0:1746147205.698605:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2003:x1830967310173440:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 109us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.698610:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19306 00000100:00100000:0.0:1746147205.698619:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19307 00000100:00100000:2.0:1746147205.698620:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147205.698625:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147205.698626:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2003:x1830967310173568:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:3.0:1746147205.698627:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19308 00000100:00100000:3.0:1746147205.698632:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2003:x1830967310173696:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147205.698633:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.698638:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147205.698641:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425061730 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e396 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.698645:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9fe400/0x3139939425061737 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e39d expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.698652:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147205.698654:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.698655:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.698656:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.698660:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fe400/0x3139939425061737 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e39d expref: 20 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147205.698660:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425061730 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e396 expref: 20 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.698669:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fe400/0x3139939425061737 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e39d expref: 20 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147205.698670:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425061730 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e396 expref: 20 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.698675:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fe400, rc 0) 00010000:00010000:0.0:1746147205.698677:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1600, rc 0) 00000100:00100000:3.0:1746147205.698691:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2003:x1830967310173696:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 59us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.698695:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19308 00000100:00100000:0.0:1746147205.698699:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2003:x1830967310173568:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 74us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147205.698705:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19307 00000100:00100000:0.0:1746147205.698726:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8540 going to sleep for 11 seconds 00002000:00010000:2.0:1746147205.701004:0:9586:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime: 1746147204 -> 1746147205 00000100:00100000:2.0:1746147205.701037:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311382400:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147205.701070:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425061714 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e37a expref: 19 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147205.701082:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d98c00/0x3139939425061714 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e37a expref: 19 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147205.701135:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d98c00, rc 0) 00000100:00100000:2.0:1746147205.701184:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2003:x1830967310173056:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2726us (2941us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147205.701193:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19303 00000100:00100000:1.0:1746147205.701937:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009689a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311382528:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147205.701958:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b0800/0x313993942506171b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e388 expref: 19 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.701968:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b0800/0x313993942506171b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e388 expref: 19 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.701994:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b0800, rc 0) 00000100:00100000:1.0:1746147205.702022:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2003:x1830967310173312:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3559us (3704us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147205.702028:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19304 00000100:00100000:1.0:1746147205.702064:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311382656:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147205.702081:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x3139939425061729 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e381 expref: 17 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.702112:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x3139939425061729 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e381 expref: 17 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.702118:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371d200, rc 0) 00000100:00100000:1.0:1746147205.702135:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2003:x1830967310173184:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3650us (3844us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147205.702140:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19305 00000100:00100000:0.0:1746147205.707150:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.707203:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310173952 00000100:00100000:3.0:1746147205.707212:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310173952 00000100:00100000:3.0:1746147205.707262:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16340 00000100:00100000:3.0:1746147205.707271:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2665:x1830967310173952:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147205.707291:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.707310:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x313993942506173e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e3a4 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.707413:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425061745 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.707428:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fec00/0x313993942506170d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e373 expref: 13 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.707437:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425061745 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.707469:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fec00/0x313993942506170d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e373 expref: 13 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.707486:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fec00/0x313993942506170d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e373 expref: 13 pid: 16099 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.707498:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311382784:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.707599:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147205.710230:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.710319:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310174080 00000100:00100000:1.0:1746147205.710327:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310174080 00010000:00010000:1.0:1746147205.710361:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fec00/0x313993942506170d lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e373 expref: 14 pid: 16099 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.710404:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8767 00000100:00100000:1.0:1746147205.710412:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310174080:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.710425:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.710431:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fec00/0x313993942506170d lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e373 expref: 14 pid: 16099 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.710442:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fec00/0x313993942506170d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e373 expref: 14 pid: 16099 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.710466:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147205.710471:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425061745 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.710481:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425061745 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.710488:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425061745 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.710504:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.710552:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310174080:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 140us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.710558:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8767 00010000:00010000:3.0:1746147205.710780:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fec00/0x313993942506170d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e373 expref: 13 pid: 16099 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.710798:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311382784:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.710815:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425061745 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.710822:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425061745 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.710827:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425061745 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147205.710844:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147205.710973:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x313993942506173e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3a4 expref: 14 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.710986:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425061745 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3a4 expref: 13 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.710991:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147205.710994:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147205.710997:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9ffc00, rc 0) 00000100:00100000:3.0:1746147205.711897:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2665:x1830967310173952:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4624us (4755us total) trans 8589937222 rc 0/0 00000100:00100000:3.0:1746147205.711906:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16340 00000100:00100000:0.0:1746147205.714382:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.714455:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310174208 00000100:00100000:3.0:1746147205.714465:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310174208 00000100:00100000:3.0:1746147205.714572:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16341 00000100:00100000:3.0:1746147205.714581:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2665:x1830967310174208:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147205.714605:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.714625:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c43400/0x3139939425061753 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e3ab expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.714971:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42200/0x313993942506175a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.714987:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425061745 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3a4 expref: 14 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.714994:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42200/0x313993942506175a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147205.715023:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425061745 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3a4 expref: 14 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.715035:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425061745 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3a4 expref: 14 pid: 16099 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.715046:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311382912:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.715191:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147205.718135:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311382912:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.718163:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42200/0x313993942506175a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147205.718417:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.718634:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310174336 00000100:00100000:1.0:1746147205.718642:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310174336 00010000:00010000:1.0:1746147205.718675:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425061745 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3a4 expref: 15 pid: 16099 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.718716:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8768 00000100:00100000:1.0:1746147205.718724:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310174336:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.718736:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.718742:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425061745 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3a4 expref: 15 pid: 16099 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.718765:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425061745 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3a4 expref: 15 pid: 16099 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.718787:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x3139939425061745 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3a4 expref: 15 pid: 16099 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.718817:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147205.718821:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42200/0x313993942506175a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.718832:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42200/0x313993942506175a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.718839:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42200/0x313993942506175a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.718861:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147205.718880:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42200/0x313993942506175a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.718887:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42200/0x313993942506175a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:2.0:1746147205.718939:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:2.0:1746147205.718947:0:16099:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147205.718964:0:16099:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42200/0x313993942506175a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.718995:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c43400/0x3139939425061753 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ab expref: 15 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147205.719166:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310174336:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 442us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.719173:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8768 00010000:00010000:2.0:1746147205.719251:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42200/0x313993942506175a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ab expref: 13 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.719258:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.719261:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147205.719263:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c42200, rc 0) 00000100:00100000:2.0:1746147205.719291:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2665:x1830967310174208:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4711us (4923us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.719297:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16341 00000100:00100000:0.0:1746147205.721429:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.721466:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.721505:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.721630:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310174464 00000100:00100000:3.0:1746147205.721638:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310174464 00000100:00100000:1.0:1746147205.721645:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310174592 00000100:00100000:1.0:1746147205.721649:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310174592 00000100:00100000:1.0:1746147205.721711:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310174720 00000100:00100000:1.0:1746147205.721714:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310174720 00000100:00100000:3.0:1746147205.721720:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19309 00000100:00100000:2.0:1746147205.721727:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19310 00000100:00100000:3.0:1746147205.721729:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310174592:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:2.0:1746147205.721735:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310174464:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147205.721745:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147205.721745:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.721772:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9fec00/0x3139939425061761 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e3b9 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.721772:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d99c00/0x3139939425061768 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e3b2 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147205.721804:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19311 00000100:00100000:1.0:1746147205.721809:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310174720:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147205.721814:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147205.721818:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311383168:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147205.721818:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311383040:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147205.721821:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009371c400/0x313993942506176f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e3c0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147205.721841:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311383296:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147205.721885:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147205.721885:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147205.721886:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147205.724075:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311383040:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147205.724134:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d99c00/0x3139939425061768 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3b2 expref: 19 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147205.724147:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d99c00/0x3139939425061768 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3b2 expref: 19 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147205.724157:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99c00, rc 0) 00000100:00100000:2.0:1746147205.724207:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310174464:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2473us (2816us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147205.724214:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19310 00000100:00100000:3.0:1746147205.724538:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311383168:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147205.724555:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fec00/0x3139939425061761 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3b9 expref: 19 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.724563:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fec00/0x3139939425061761 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3b9 expref: 19 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.724576:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fec00, rc 0) 00000100:00100000:3.0:1746147205.724597:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310174592:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2870us (3130us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147205.724602:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19309 00000100:00100000:1.0:1746147205.724849:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311383296:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147205.724868:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009371c400/0x313993942506176f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3c0 expref: 17 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.724876:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009371c400/0x313993942506176f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3c0 expref: 17 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.724882:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371c400, rc 0) 00000100:00100000:1.0:1746147205.724897:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310174720:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3088us (3392us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147205.724902:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19311 00000100:00100000:0.0:1746147205.727315:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.727451:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310174976 00000100:00100000:2.0:1746147205.727460:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310174976 00000100:00100000:2.0:1746147205.727508:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16342 00000100:00100000:2.0:1746147205.727515:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2665:x1830967310174976:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147205.727532:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147205.727555:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98c00/0x3139939425061776 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e3c7 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.727652:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942506177d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.727668:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942506177d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.727679:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942506177d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:2.0:1746147205.727690:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147205.727819:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98c00/0x3139939425061776 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3c7 expref: 16 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.727834:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942506177d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3c7 expref: 15 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.727841:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.727843:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147205.727846:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99200, rc 0) 00000100:00100000:2.0:1746147205.727887:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2665:x1830967310174976:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 372us (580us total) trans 8589937223 rc 0/0 00000100:00100000:2.0:1746147205.727892:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16342 00000100:00100000:0.0:1746147205.729507:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.729536:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.729786:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310175232 00000100:00100000:1.0:1746147205.729794:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310175232 00000100:00100000:0.0:1746147205.729796:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.729823:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.730176:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310175488 00000100:00100000:1.0:1746147205.730180:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310175488 00000100:00100000:3.0:1746147205.730212:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310175744 00000100:00100000:3.0:1746147205.730218:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310175744 00000100:00100000:2.0:1746147205.730223:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310175104 00000100:00100000:2.0:1746147205.730228:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310175104 00000100:00100000:0.0:1746147205.730242:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19312 00000100:00100000:1.0:1746147205.730263:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19313 00000100:00100000:0.0:1746147205.730265:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310175232:12345-192.168.204.25@tcp:1:lfs.0 00000100:00100000:1.0:1746147205.730269:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310175488:12345-192.168.204.25@tcp:1:lfs.0 00000100:00100000:2.0:1746147205.730270:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19314 00000100:00100000:2.0:1746147205.730276:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310175104:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147205.730303:0:13695:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x313993942506178b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.730303:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x3139939425061792 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.730320:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x31399394250616e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->733183) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e35e expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.730320:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x3139939425061681 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e334 expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.730326:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147205.730328:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147205.730328:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffe00/0x3139939425061722 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e38f expref: 19 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147205.730330:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x313993942506178b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.730335:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009844a600/0x31399394250616b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e349 expref: 30 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.730345:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.730346:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.730348:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x3139939425061792 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.730360:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x31399394250616e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->733183) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e35e expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.730365:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009844a600/0x31399394250616b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e349 expref: 30 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147205.730372:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x31399394250616e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->733183) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e35e expref: 41 pid: 17600 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.730373:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009844a600/0x31399394250616b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e349 expref: 30 pid: 17600 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746147205.730385:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311383424:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147205.730385:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311383552:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.730415:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19315 00000100:00100000:3.0:1746147205.730420:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310175744:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147205.730438:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c43a00/0x3139939425061799 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.730445:0:12225:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250617a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.730450:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982a2600/0x31399394250614d6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e25b expref: 28 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.730455:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffe00/0x3139939425061722 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e38f expref: 19 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147205.730455:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x31399394250616ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e365 expref: 17 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.730456:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fe400/0x3139939425061737 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e39d expref: 17 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147205.730460:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147205.730461:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147205.730463:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffe00/0x3139939425061722 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e38f expref: 19 pid: 12201 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746147205.730463:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250617a0 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.730464:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091e31a00/0x31399394250614eb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e270 expref: 17 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.730468:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.730470:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147205.730470:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f55c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311383680:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.730472:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c43a00/0x3139939425061799 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.730485:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091e31a00/0x31399394250614eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e270 expref: 17 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.730485:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x31399394250616ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e365 expref: 17 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.730492:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091e31a00/0x31399394250614eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e270 expref: 17 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746147205.730492:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x31399394250616ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e365 expref: 17 pid: 17600 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.730502:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311383936:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147205.730502:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311383808:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147205.730527:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147205.730531:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8540 going to sleep for 11 seconds 00010000:00010000:3.0:1746147205.730537:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9fe400/0x3139939425061737 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e39d expref: 17 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.730545:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fe400/0x3139939425061737 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e39d expref: 17 pid: 12201 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746147205.730553:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311384064:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147205.730556:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147205.730576:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800982a2600/0x31399394250614d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e25b expref: 28 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.730583:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800982a2600/0x31399394250614d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e25b expref: 28 pid: 13695 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.730590:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311384192:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.730604:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147205.730616:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310175360 00000100:00100000:3.0:1746147205.730619:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310175360 00000100:00100000:0.0:1746147205.730634:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.730636:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19316 00000100:00100000:3.0:1746147205.730640:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310175360:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147205.730654:0:17600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6c00/0x31399394250617a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.730664:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fee00/0x31399394250616f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e36c expref: 17 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.730669:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147205.730670:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147205.730672:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6c00/0x31399394250617a7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.730685:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9fee00/0x31399394250616f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e36c expref: 17 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.730692:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fee00/0x31399394250616f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e36c expref: 17 pid: 17600 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.730699:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311384320:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.730721:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147205.730816:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310175616 00000100:00100000:2.0:1746147205.730819:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310175616 00000100:00100000:2.0:1746147205.730853:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19317 00000100:00100000:2.0:1746147205.730858:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967310175616:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147205.730874:0:13712:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x31399394250617ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.730884:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009844be00/0x3139939425061642 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e311 expref: 30 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.730891:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425061730 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e396 expref: 20 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147205.730898:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d99a00/0x31399394250616dc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e357 expref: 41 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.730903:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.730905:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.730907:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x31399394250617ae lrc: 6/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.730922:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d99a00/0x31399394250616dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e357 expref: 41 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.730929:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d99a00/0x31399394250616dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e357 expref: 41 pid: 9584 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.730936:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311384448:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147205.730976:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425061730 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e396 expref: 20 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147205.730985:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425061730 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e396 expref: 20 pid: 12225 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746147205.730993:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099153480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311384576:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147205.731023:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009844be00/0x3139939425061642 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e311 expref: 30 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.731030:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009844be00/0x3139939425061642 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e311 expref: 30 pid: 9584 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.731037:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099153800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311384704:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147205.731050:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154e40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147205.732453:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x3139939425061681 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e334 expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.732468:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x3139939425061681 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e334 expref: 41 pid: 17600 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.732486:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311384832:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147205.732717:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a56583c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147205.737417:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311383424:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147205.737417:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099154e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311383808:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147205.737442:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311383552:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147205.737443:0:13695:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x313993942506178b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.737443:0:12225:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250617a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147205.737534:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311384320:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147205.737535:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147205.737544:0:17600:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6c00/0x31399394250617a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147205.737574:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311383936:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147205.737579:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311384448:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.737584:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311384064:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147205.737588:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099153480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311384576:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.737591:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311384192:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147205.737598:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099153800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311384704:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.737608:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5c43a00/0x3139939425061799 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.737613:0:13712:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x31399394250617ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147205.737643:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310176128 00000100:00100000:1.0:1746147205.737649:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310176128 00002000:00100000:1.0:1746147205.737873:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1470464->2097151) req@ffff880099154e00 x1830967310176128/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147205.737882:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099154e00 with x1830967310176128 ext(1470464->2097151) 00010000:00010000:1.0:1746147205.737890:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x31399394250616ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e365 expref: 18 pid: 17600 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.737899:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x31399394250616ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e365 expref: 18 pid: 17600 timeout: 843 lvb_type: 0 00002000:00010000:1.0:1746147205.737906:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099154e00 00000100:00100000:1.0:1746147205.737937:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1657 00000100:00100000:1.0:1746147205.737944:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310176128:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:1.0:1746147205.742117:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f55c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311383680:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147205.743436:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.743532:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311384832:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147205.743566:0:1854:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x3139939425061792 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147205.743736:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.743839:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310176000 00000100:00100000:3.0:1746147205.743846:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310176000 00002000:00100000:3.0:1746147205.743888:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (110592->733183) req@ffff880099153800 x1830967310176000/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.743898:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099153800 with x1830967310176000 ext(110592->733183) 00010000:00010000:3.0:1746147205.743907:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x31399394250616e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->733183) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e35e expref: 42 pid: 17600 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.743917:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x31399394250616e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->733183) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e35e expref: 42 pid: 17600 timeout: 843 lvb_type: 0 00002000:00010000:3.0:1746147205.743924:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099153800 00000100:00100000:3.0:1746147205.743955:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1658 00000100:00100000:3.0:1746147205.743963:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967310176000:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147205.745066:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.745084:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.745113:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310176384 00000100:00100000:2.0:1746147205.745117:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310176384 00010000:00010000:2.0:1746147205.745147:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091e31a00/0x31399394250614eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e270 expref: 20 pid: 13695 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.745167:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310176640 00000100:00100000:2.0:1746147205.745169:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310176640 00010000:00010000:2.0:1746147205.745180:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a2600/0x31399394250614d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e25b expref: 29 pid: 13695 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.745192:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310175872 00000100:00100000:2.0:1746147205.745194:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310175872 00010000:00010000:2.0:1746147205.745204:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009844a600/0x31399394250616b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e349 expref: 31 pid: 17600 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746147205.745217:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8769 00000100:00100000:2.0:1746147205.745222:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310176384:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.745232:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.745253:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091e31a00/0x31399394250614eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e270 expref: 20 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.745264:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091e31a00/0x31399394250614eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e270 expref: 20 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.745287:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091e31a00/0x31399394250614eb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e270 expref: 20 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.745307:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147205.745336:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310176384:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 113us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.745342:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8769 00000100:00100000:2.0:1746147205.745357:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8770 00000100:00100000:2.0:1746147205.745362:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310176640:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.745368:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.745375:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800982a2600/0x31399394250614d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e25b expref: 29 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.745383:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800982a2600/0x31399394250614d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e25b expref: 29 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.745395:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982a2600/0x31399394250614d6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e25b expref: 29 pid: 13695 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.745408:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147205.745424:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310176640:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 62us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.745432:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8770 00000100:00100000:2.0:1746147205.745441:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8771 00000100:00100000:0.0:1746147205.745718:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.745741:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310176256 00000100:00100000:3.0:1746147205.745745:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310176256 00010000:00010000:3.0:1746147205.745773:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fe400/0x3139939425061737 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e39d expref: 19 pid: 12201 timeout: 843 lvb_type: 1 00000100:00100000:3.0:1746147205.745796:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8772 00000100:00100000:3.0:1746147205.745806:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310176256:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147205.745813:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147205.745822:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fe400/0x3139939425061737 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e39d expref: 19 pid: 12201 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746147205.745831:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f9fe400/0x3139939425061737 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e39d expref: 19 pid: 12201 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746147205.745843:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fe400/0x3139939425061737 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e39d expref: 19 pid: 12201 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746147205.745856:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.745858:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.745862:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c43a00/0x3139939425061799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.745878:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c43a00/0x3139939425061799 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.745895:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147205.745911:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310176256:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 110us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.745916:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8772 00010000:00010000:3.0:1746147205.745934:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5c43a00/0x3139939425061799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.745941:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c43a00/0x3139939425061799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.745956:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c43a00/0x3139939425061799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.745963:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c43a00/0x3139939425061799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.745970:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5c43a00/0x3139939425061799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.745977:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c43a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147205.745980:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5c43a00/0x3139939425061799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.745992:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5c43a00/0x3139939425061799 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.746000:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5c43a00/0x3139939425061799 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.746005:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c43a00/0x3139939425061799 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147205.746041:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310175744:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 15622us (16246us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.746048:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19315 00000100:00100000:2.0:1746147205.746219:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2001:x1830967310175872:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.746229:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.746242:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009844a600/0x31399394250616b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e349 expref: 31 pid: 17600 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746147205.746251:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009844a600/0x31399394250616b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e349 expref: 31 pid: 17600 timeout: 843 lvb_type: 1 00000100:00100000:1.0:1746147205.746262:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147205.746263:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009844a600/0x31399394250616b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e349 expref: 31 pid: 17600 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746147205.746273:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147205.746288:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2001:x1830967310175872:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 842us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.746293:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8771 00000100:00100000:3.0:1746147205.746500:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310176512 00000100:00100000:3.0:1746147205.746504:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310176512 00002000:00100000:3.0:1746147205.746526:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1339391) req@ffff880129f57b80 x1830967310176512/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147205.746534:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f57b80 with x1830967310176512 ext(1048576->1339391) 00010000:00010000:3.0:1746147205.746539:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fee00/0x31399394250616f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e36c expref: 19 pid: 17600 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.746549:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fee00/0x31399394250616f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e36c expref: 19 pid: 17600 timeout: 843 lvb_type: 0 00002000:00010000:3.0:1746147205.746554:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f57b80 00000100:00100000:1.0:1746147205.746802:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.746994:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1659 00000100:00100000:3.0:1746147205.747002:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310176512:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147205.747668:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310176768 00000100:00100000:2.0:1746147205.747672:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310176768 00010000:00010000:2.0:1746147205.747692:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425061730 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e396 expref: 21 pid: 12225 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746147205.747711:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8773 00000100:00100000:2.0:1746147205.747716:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967310176768:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.747724:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.747738:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425061730 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e396 expref: 21 pid: 12225 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746147205.747762:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425061730 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e396 expref: 21 pid: 12225 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746147205.747778:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425061730 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e396 expref: 21 pid: 12225 timeout: 843 lvb_type: 1 00010000:00010000:2.0:1746147205.747788:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147205.748598:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967310176768:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 878us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.748605:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8773 00000100:00100000:1.0:1746147205.748607:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.748650:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310176896 00000100:00100000:2.0:1746147205.748653:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310176896 00000100:00100000:1.0:1746147205.748656:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147205.748665:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffe00/0x3139939425061722 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e38f expref: 20 pid: 12201 timeout: 843 lvb_type: 1 00000100:00100000:1.0:1746147205.748674:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.748807:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310177024 00000100:00100000:2.0:1746147205.748810:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310177024 00000100:00100000:1.0:1746147205.748813:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147205.748823:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x3139939425061681 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e334 expref: 44 pid: 17600 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.748828:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310177152 00000100:00100000:1.0:1746147205.748831:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310177152 00000100:00100000:2.0:1746147205.748834:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310177280 00000100:00100000:2.0:1746147205.748836:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310177280 00010000:00010000:2.0:1746147205.748843:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009844be00/0x3139939425061642 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e311 expref: 30 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.748845:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d99a00/0x31399394250616dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e357 expref: 45 pid: 9584 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.748859:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8774 00000100:00100000:1.0:1746147205.748864:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967310176896:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.748871:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.748883:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffe00/0x3139939425061722 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e38f expref: 20 pid: 12201 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746147205.748893:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffe00/0x3139939425061722 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e38f expref: 20 pid: 12201 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746147205.748905:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffe00/0x3139939425061722 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e38f expref: 20 pid: 12201 timeout: 843 lvb_type: 1 00010000:00010000:1.0:1746147205.748920:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.748937:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310176896:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 73us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.748943:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8774 00000100:00100000:1.0:1746147205.748953:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8775 00000100:00100000:1.0:1746147205.748957:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967310177024:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.748963:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.748969:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x3139939425061681 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e334 expref: 45 pid: 17600 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.748977:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x3139939425061681 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e334 expref: 45 pid: 17600 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.748988:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x3139939425061681 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e334 expref: 45 pid: 17600 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.748996:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.748998:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.749002:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x3139939425061792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.749010:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x3139939425061792 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.749030:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.749046:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967310177024:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 88us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.749051:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8775 00000100:00100000:1.0:1746147205.749060:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8776 00000100:00100000:1.0:1746147205.749065:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967310177152:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.749071:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.749078:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d99a00/0x31399394250616dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e357 expref: 43 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.749085:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d99a00/0x31399394250616dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e357 expref: 43 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.749110:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d99a00/0x31399394250616dc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e357 expref: 43 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.749118:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.749133:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967310177152:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 68us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.749138:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8776 00010000:00010000:1.0:1746147205.749158:0:1854:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x3139939425061792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.749165:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x3139939425061792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.749179:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x3139939425061792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.749186:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x3139939425061792 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.749198:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x3139939425061792 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.749204:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009371ca00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147205.749208:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x3139939425061792 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.749216:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x3139939425061792 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.749225:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x3139939425061792 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.749230:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009371ca00/0x3139939425061792 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147205.749272:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310175488:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 19003us (19734us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.749280:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19313 00000100:00100000:2.0:1746147205.749376:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8777 00000100:00100000:2.0:1746147205.749383:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2000:x1830967310177280:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147205.749390:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.749396:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009844be00/0x3139939425061642 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e311 expref: 30 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.749404:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009844be00/0x3139939425061642 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e311 expref: 30 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.749416:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009844be00/0x3139939425061642 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e311 expref: 30 pid: 9584 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.749425:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.749426:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.749429:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x31399394250617ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.749436:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x31399394250617ae lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.749459:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147205.749477:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2000:x1830967310177280:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 94us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.749482:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8777 00010000:00010000:3.0:1746147205.749632:0:13712:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x31399394250617ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.749640:0:13712:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x31399394250617ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.749653:0:13712:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x31399394250617ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.749660:0:13712:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x31399394250617ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.749666:0:13712:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x31399394250617ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.749672:0:13712:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9ffc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147205.749674:0:13712:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x31399394250617ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.749680:0:13712:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x31399394250617ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.749690:0:13712:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x31399394250617ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.749695:0:13712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ffc00/0x31399394250617ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147205.749733:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310175616:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 18874us (19097us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.749738:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19317 00000100:00100000:0.0:1746147205.757514:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310176128:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 19556us (19970us total) trans 17179875108 rc 0/0 00000100:00100000:0.0:1746147205.757527:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1657 00002000:00100000:0.0:1746147205.757541:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1470464->2097151) req@ffff880099154e00 x1830967310176128/t17179875108(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/448 e 0 to 0 dl 1746147216 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147205.757550:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099154e00 with x1830967310176128 ext(1470464->2097151) 00010000:00010000:0.0:1746147205.757559:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x31399394250616ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e365 expref: 21 pid: 17600 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746147205.757573:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x31399394250616ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e365 expref: 21 pid: 17600 timeout: 843 lvb_type: 0 00002000:00010000:0.0:1746147205.757581:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099154e00 00000100:00100000:2.0:1746147205.759893:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967310176000:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 15922us (16451us total) trans 21474842492 rc 0/0 00000100:00100000:2.0:1746147205.759904:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1658 00002000:00100000:2.0:1746147205.759914:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (110592->733183) req@ffff880099153800 x1830967310176000/t21474842492(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/448 e 0 to 0 dl 1746147216 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.759924:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099153800 with x1830967310176000 ext(110592->733183) 00010000:00010000:2.0:1746147205.759933:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x31399394250616e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->733183) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e35e expref: 42 pid: 17600 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.759945:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x31399394250616e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->733183) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e35e expref: 42 pid: 17600 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746147205.759951:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099153800 00000100:00100000:0.0:1746147205.760593:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.760809:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310177408 00000100:00100000:1.0:1746147205.760818:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310177408 00010000:00010000:1.0:1746147205.760850:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x31399394250616ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e365 expref: 21 pid: 17600 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.760874:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8778 00000100:00100000:1.0:1746147205.760880:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2003:x1830967310177408:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.760893:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.761221:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x31399394250616ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e365 expref: 23 pid: 17600 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.761242:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x31399394250616ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e365 expref: 23 pid: 17600 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.761266:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ff600/0x31399394250616ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e365 expref: 23 pid: 17600 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.761281:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.761284:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.761288:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250617a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.761296:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250617a0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.761323:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147205.761364:0:12225:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250617a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.761376:0:12225:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250617a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.761391:0:12225:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250617a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.761398:0:12225:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250617a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.761404:0:12225:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250617a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.761410:0:12225:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800993b1e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147205.761413:0:12225:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250617a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.761419:0:12225:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250617a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.761432:0:12225:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250617a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.761437:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x31399394250617a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147205.761504:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310175232:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 31241us (32000us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147205.761511:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19312 00000100:00100000:1.0:1746147205.761695:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2003:x1830967310177408:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 814us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.761701:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8778 00000100:00100000:2.0:1746147205.762156:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310176512:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 15153us (15894us total) trans 17179875109 rc 0/0 00000100:00100000:2.0:1746147205.762164:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1659 00002000:00100000:2.0:1746147205.762171:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1339391) req@ffff880129f57b80 x1830967310176512/t17179875109(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:581/0 lens 488/448 e 0 to 0 dl 1746147216 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147205.762179:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f57b80 with x1830967310176512 ext(1048576->1339391) 00010000:00010000:2.0:1746147205.762187:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fee00/0x31399394250616f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e36c expref: 20 pid: 17600 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.762195:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fee00/0x31399394250616f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e36c expref: 20 pid: 17600 timeout: 843 lvb_type: 0 00002000:00010000:2.0:1746147205.762200:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f57b80 00000100:00100000:0.0:1746147205.762809:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.763052:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310177536 00000100:00100000:1.0:1746147205.763058:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310177536 00010000:00010000:1.0:1746147205.763081:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x31399394250616e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->733183) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e35e expref: 42 pid: 17600 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.763129:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8779 00000100:00100000:1.0:1746147205.763136:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967310177536:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.763147:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.763166:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x31399394250616e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 110592->733183) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e35e expref: 42 pid: 17600 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.763175:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x31399394250616e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 110592->733183) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e35e expref: 42 pid: 17600 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.763191:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9ff200/0x31399394250616e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 110592->733183) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e35e expref: 42 pid: 17600 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.763204:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.763206:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.763210:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x313993942506178b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.763216:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x313993942506178b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.763244:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.763277:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2003:x1830967310177536:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 142us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.763283:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8779 00010000:00010000:2.0:1746147205.763391:0:13695:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x313993942506178b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.763399:0:13695:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x313993942506178b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.763415:0:13695:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x313993942506178b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.763422:0:13695:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x313993942506178b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.763429:0:13695:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x313993942506178b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.763434:0:13695:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d99600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147205.763437:0:13695:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x313993942506178b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.763444:0:13695:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x313993942506178b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.763452:0:13695:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x313993942506178b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.763456:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x313993942506178b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147205.763501:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310175104:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 33224us (33676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.763508:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19314 00000100:00100000:0.0:1746147205.764030:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.764354:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310177664 00000100:00100000:1.0:1746147205.764359:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310177664 00010000:00010000:1.0:1746147205.764378:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fee00/0x31399394250616f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e36c expref: 20 pid: 17600 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.764408:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8780 00000100:00100000:1.0:1746147205.764414:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310177664:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.764422:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.764434:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fee00/0x31399394250616f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e36c expref: 20 pid: 17600 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.764444:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f9fee00/0x31399394250616f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e36c expref: 20 pid: 17600 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.764458:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fee00/0x31399394250616f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e36c expref: 20 pid: 17600 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.764474:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.764476:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.764479:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6c00/0x31399394250617a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.764486:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6c00/0x31399394250617a7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.764507:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147205.764524:0:17600:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6c00/0x31399394250617a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.764531:0:17600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6c00/0x31399394250617a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147205.764537:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2000:x1830967310177664:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 123us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.764546:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8780 00010000:00010000:2.0:1746147205.764549:0:17600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6c00/0x31399394250617a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.764555:0:17600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6c00/0x31399394250617a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.764562:0:17600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6c00/0x31399394250617a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.764567:0:17600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e5c6c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147205.764570:0:17600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6c00/0x31399394250617a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.764576:0:17600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6c00/0x31399394250617a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.764585:0:17600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6c00/0x31399394250617a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.764591:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6c00/0x31399394250617a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147205.764638:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310175360:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 33996us (34080us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.764645:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19316 00000100:00100000:0.0:1746147205.766138:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.766211:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310177920 00000100:00100000:2.0:1746147205.766216:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310177920 00000100:00100000:2.0:1746147205.766257:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16343 00000100:00100000:2.0:1746147205.766263:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2665:x1830967310177920:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:2.0:1746147205.766312:0:16099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746147205.766332:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42200/0x313993942506175a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ab expref: 15 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.766348:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43c00/0x313993942506120c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e07f expref: 14 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.766357:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.766362:0:16099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147205.766386:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.766397:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x313993942506146d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e21c expref: 45 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.766403:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425061585 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2af expref: 27 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.766409:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3e800/0x31399394250611cd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e05c expref: 27 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.766414:0:16099:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x313993942506121a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e08d expref: 45 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.766425:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.766452:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x313993942506121a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e08d expref: 45 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.766464:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x313993942506121a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e08d expref: 45 pid: 7237 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.766477:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099153480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311384960:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147205.766561:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3e800/0x31399394250611cd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e05c expref: 27 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.766570:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3e800/0x31399394250611cd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e05c expref: 27 pid: 7237 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.766578:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311385088:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147205.766604:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425061585 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2af expref: 27 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.766610:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425061585 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2af expref: 27 pid: 16099 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.766617:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311385216:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147205.766634:0:16099:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x313993942506146d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e21c expref: 45 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.766644:0:16099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x313993942506146d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e21c expref: 45 pid: 7238 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.766651:0:16099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311385344:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147205.766667:0:16099:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147205.768408:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.768473:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310178048 00000100:00100000:1.0:1746147205.768480:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310178048 00010000:00010000:1.0:1746147205.768509:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425061585 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2af expref: 28 pid: 16099 timeout: 843 lvb_type: 0 00000100:00100000:2.0:1746147205.768532:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099153480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311384960:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147205.768536:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8781 00000100:00100000:2.0:1746147205.768540:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311385088:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147205.768542:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2000:x1830967310178048:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147205.768546:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099152680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311385216:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147205.768554:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147205.768559:0:16099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16099:1830967311385344:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147205.768559:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425061585 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2af expref: 28 pid: 16099 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.768568:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425061585 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2af expref: 28 pid: 16099 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.768585:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425061585 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e2af expref: 28 pid: 16099 timeout: 843 lvb_type: 0 00010000:00010000:2.0:1746147205.768587:0:16099:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.768599:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147205.768602:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.768610:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.768652:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2000:x1830967310178048:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 110us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.768659:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8781 00000100:00100000:0.0:1746147205.768824:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.768890:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.768910:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310178304 00000100:00100000:0.0:1746147205.768913:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310178304 00000100:00100000:1.0:1746147205.768926:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310178176 00010000:00010000:0.0:1746147205.768926:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3e800/0x31399394250611cd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e05c expref: 27 pid: 7237 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.768930:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310178176 00010000:00010000:1.0:1746147205.768942:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x313993942506121a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e08d expref: 46 pid: 7237 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746147205.768960:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8782 00000100:00100000:1.0:1746147205.768972:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8783 00000100:00100000:1.0:1746147205.768978:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2000:x1830967310178176:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.768984:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.768988:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x313993942506121a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e08d expref: 46 pid: 7237 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.768996:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x313993942506121a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e08d expref: 46 pid: 7237 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.769007:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x313993942506121a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e08d expref: 46 pid: 7237 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.769016:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147205.769018:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.769023:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.769043:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967310178176:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 65us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.769049:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8783 00000100:00100000:0.0:1746147205.769365:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2000:x1830967310178304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147205.769373:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147205.769377:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3e800/0x31399394250611cd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e05c expref: 27 pid: 7237 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746147205.769389:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3e800/0x31399394250611cd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e05c expref: 27 pid: 7237 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746147205.769401:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3e800/0x31399394250611cd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e05c expref: 27 pid: 7237 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746147205.769417:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147205.769420:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147205.769425:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.769538:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2000:x1830967310178304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 571us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.769544:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8782 00000100:00100000:0.0:1746147205.770035:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.770165:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310178432 00000100:00100000:1.0:1746147205.770169:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310178432 00010000:00010000:1.0:1746147205.770187:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x313993942506146d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e21c expref: 45 pid: 7238 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.770217:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8784 00000100:00100000:1.0:1746147205.770223:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967310178432:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.770231:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.770235:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x313993942506146d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e21c expref: 45 pid: 7238 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.770244:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x313993942506146d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e21c expref: 45 pid: 7238 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.770255:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x313993942506146d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e21c expref: 45 pid: 7238 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.770264:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147205.770267:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.770274:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.770281:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.770307:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.770332:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967310178432:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 105us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.770339:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8784 00010000:00010000:2.0:1746147205.770428:0:16099:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.770436:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000040:00080000:2.0:1746147205.770966:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1163, 88 off110192 00000004:00080000:2.0:1746147205.770973:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743760883190ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147205.771192:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1173, 88 off111072 00000004:00080000:2.0:1746147205.771197:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743761107775ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147205.771214:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1174, 88 off111160 00000004:00080000:2.0:1746147205.771224:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743761134685ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147205.771233:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1164, 88 off110280 00000004:00080000:2.0:1746147205.771236:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743761146630ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147205.771243:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1165, 88 off110368 00000004:00080000:2.0:1746147205.771245:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743761155573ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147205.771251:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1175, 88 off111248 00000004:00080000:2.0:1746147205.771253:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743761163830ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147205.771260:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1176, 88 off111336 00000004:00080000:2.0:1746147205.771262:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743761172387ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147205.771268:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1177, 88 off111424 00000004:00080000:2.0:1746147205.771270:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743761180425ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147205.771276:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1166, 88 off110456 00000004:00080000:2.0:1746147205.771278:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743761188360ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147205.771284:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1178, 88 off111512 00000004:00080000:2.0:1746147205.771286:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743761196197ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147205.771291:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1167, 88 off110544 00000004:00080000:2.0:1746147205.771293:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743761203515ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147205.771298:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1179, 88 off111600 00000004:00080000:2.0:1746147205.771300:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743761210913ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147205.771398:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1168, 88 off110632 00000004:00080000:2.0:1746147205.771401:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743761311640ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147205.771409:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1169, 88 off110720 00000004:00080000:2.0:1746147205.771411:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743761321200ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147205.771416:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1170, 88 off110808 00000004:00080000:2.0:1746147205.771418:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743761328427ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147205.771424:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1171, 88 off110896 00000004:00080000:2.0:1746147205.771425:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743761335973ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147205.771432:0:16099:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1180, 88 off111688 00000004:00080000:2.0:1746147205.771434:0:16099:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743761344357ns, next at 694367916532ns, rc = 0 00000001:00080000:3.0:1746147205.773834:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937224 is committed 00000004:00080000:3.0:1746147205.773847:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1158 committed 00000004:00080000:3.0:1746147205.773864:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1152 committed 00000004:00080000:3.0:1746147205.773876:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1151 committed 00000004:00080000:3.0:1746147205.773878:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1150 committed 00000004:00080000:3.0:1746147205.773880:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1149 committed 00000004:00080000:3.0:1746147205.773881:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1157 committed 00000004:00080000:3.0:1746147205.773883:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1148 committed 00000004:00080000:3.0:1746147205.773884:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1156 committed 00000004:00080000:3.0:1746147205.773886:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1147 committed 00000004:00080000:3.0:1746147205.773888:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1155 committed 00000004:00080000:3.0:1746147205.773889:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1154 committed 00000004:00080000:3.0:1746147205.773891:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1153 committed 00000004:00080000:3.0:1746147205.773892:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1146 committed 00000004:00080000:3.0:1746147205.773894:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1145 committed 00000004:00080000:3.0:1746147205.773896:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1152 committed 00000004:00080000:3.0:1746147205.773897:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1151 committed 00000004:00080000:3.0:1746147205.773899:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1144 committed 00000001:00080000:3.0:1746147205.773915:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937221 is committed 00000001:00080000:3.0:1746147205.773919:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937220 is committed 00000100:00100000:3.0:1746147205.774005:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311385728:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147205.774005:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311385472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147205.774056:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311385600:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147205.774120:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311385856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147205.774364:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147205.774395:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311386112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147205.774411:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147205.774493:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311386624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147205.774513:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147205.774525:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311387136:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147205.774540:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147205.774552:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746147205.774555:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147205.774556:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311386752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147205.774571:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311386240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147205.774575:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147205.774585:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147205.774585:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311387264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147205.774598:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147205.774610:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311385600 00000100:00100000:1.0:1746147205.774616:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147205.774616:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311386112 00000100:00100000:3.0:1746147205.774617:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311385600 00000100:00100000:0.0:1746147205.774617:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311386112 00000100:00100000:1.0:1746147205.774634:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311385984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147205.774653:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147205.774660:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311386624 00000100:00100000:3.0:1746147205.774662:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311386624 00000100:00100000:1.0:1746147205.774670:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311386496:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147205.774674:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311387136 00000100:00100000:3.0:1746147205.774675:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311387136 00000100:00100000:3.0:1746147205.774682:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311385728 00000100:00100000:3.0:1746147205.774684:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311385728 00000100:00100000:1.0:1746147205.774687:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147205.774695:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311387008:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.774708:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147205.774719:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311386752 00000100:00100000:1.0:1746147205.774722:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311386752 00000100:00100000:2.0:1746147205.774727:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311386368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147205.774736:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311386240 00000100:00100000:1.0:1746147205.774737:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311386240 00000100:00100000:2.0:1746147205.774744:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147205.774768:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311386880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.774788:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147205.774796:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801322eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311387392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.774809:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147205.774827:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311387264 00000100:00100000:2.0:1746147205.774830:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311387264 00000100:00100000:2.0:1746147205.774843:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311385472 00000100:00100000:2.0:1746147205.774845:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311385472 00000100:00100000:0.0:1746147205.775348:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311385984 00000100:00100000:0.0:1746147205.775352:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311385984 00000100:00100000:0.0:1746147205.775359:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311386496 00000100:00100000:0.0:1746147205.775361:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311386496 00000100:00100000:0.0:1746147205.775372:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311385856 00000100:00100000:0.0:1746147205.775374:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311385856 00000100:00100000:3.0:1746147205.775379:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311386880 00000100:00100000:0.0:1746147205.775379:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311386368 00000100:00100000:3.0:1746147205.775381:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311386880 00000100:00100000:0.0:1746147205.775381:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311386368 00000100:00100000:0.0:1746147205.775386:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311387392 00000100:00100000:0.0:1746147205.775388:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311387392 00000100:00100000:3.0:1746147205.775391:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19318 00000100:00100000:3.0:1746147205.775397:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+36:3764:x1830967311385600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147205.775397:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19319 00000100:00100000:0.0:1746147205.775400:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:3764:x1830967311386624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147205.775558:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19320 00000100:00100000:2.0:1746147205.775565:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19321 00000100:00100000:1.0:1746147205.775566:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3764:x1830967311387136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.775570:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3764:x1830967311386752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.775624:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19322 00000100:00100000:2.0:1746147205.775633:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3764:x1830967311387264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147205.775684:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147205.775687:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147205.775689:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147205.775690:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147205.775692:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:3.0:1746147205.775786:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+37:3764:x1830967311385600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 388us (1422us total) trans 17179875110 rc 0/0 00000100:00100000:3.0:1746147205.775792:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19318 00000100:00100000:3.0:1746147205.775804:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19323 00000100:00100000:3.0:1746147205.775808:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+36:3764:x1830967311386112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147205.775844:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:3.0:1746147205.775846:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147205.775848:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147205.775850:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147205.775851:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:1.0:1746147205.776010:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+51:3764:x1830967311387136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 446us (1468us total) trans 21474842494 rc 0/0 00000100:00100000:0.0:1746147205.776010:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+51:3764:x1830967311386624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 608us (1495us total) trans 21474842493 rc 0/0 00000100:00100000:1.0:1746147205.776016:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19320 00000100:00100000:2.0:1746147205.776037:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3764:x1830967311387264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 408us (1438us total) trans 21474842496 rc 0/0 00000100:00100000:3.0:1746147205.776039:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+37:3764:x1830967311386112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 231us (1627us total) trans 17179875111 rc 0/0 00000100:00100000:0.0:1746147205.776055:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19319 00000100:00100000:1.0:1746147205.776069:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19324 00000100:00100000:1.0:1746147205.776074:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3767:x1830967311385984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147205.776075:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19325 00000100:00100000:0.0:1746147205.776080:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3767:x1830967311386496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147205.776315:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3767:x1830967311385984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (1488us total) trans 17179875112 rc 0/0 00000100:00100000:0.0:1746147205.776348:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3767:x1830967311386496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (1493us total) trans 21474842497 rc 0/0 00000100:00100000:2.0:1746147205.776376:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19322 00000100:00100000:3.0:1746147205.776386:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19323 00000100:00100000:2.0:1746147205.776391:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19326 00000100:00100000:3.0:1746147205.776395:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19327 00000100:00100000:2.0:1746147205.776396:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3765:x1830967311385728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147205.776399:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+37:3766:x1830967311385856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147205.776445:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19324 00000100:00100000:0.0:1746147205.776470:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19325 00002000:00010000:3.0:1746147205.776476:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147205.776479:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00000100:00100000:0.0:1746147205.776479:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19328 00002000:00010000:3.0:1746147205.776481:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147205.776483:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00000100:00100000:0.0:1746147205.776484:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3766:x1830967311386368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147205.776485:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746147205.776508:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+38:3766:x1830967311385856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (1799us total) trans 17179875113 rc 0/0 00000100:00100000:3.0:1746147205.776513:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19327 00000100:00100000:3.0:1746147205.776521:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19329 00000100:00100000:3.0:1746147205.776525:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+48:3766:x1830967311386880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147205.776534:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3766:x1830967311386368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (1788us total) trans 17179875115 rc 0/0 00000100:00100000:0.0:1746147205.776539:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19328 00000100:00100000:0.0:1746147205.776546:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19330 00000100:00100000:0.0:1746147205.776551:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3766:x1830967311387392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147205.776561:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746147205.776564:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147205.776565:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147205.776567:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147205.776569:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00002000:00010000:0.0:1746147205.776584:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:0.0:1746147205.776587:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147205.776588:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147205.776589:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147205.776591:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:0.0:1746147205.776609:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3766:x1830967311387392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (1799us total) trans 21474842499 rc 0/0 00000100:00100000:0.0:1746147205.776614:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19330 00000100:00100000:0.0:1746147205.776623:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19331 00000100:00100000:0.0:1746147205.776627:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3765:x1830967311386240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147205.776681:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3765:x1830967311386240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (2094us total) trans 17179875116 rc 0/0 00000100:00100000:0.0:1746147205.776686:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19331 00000100:00100000:0.0:1746147205.776695:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19332 00000100:00100000:0.0:1746147205.776699:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3767:x1830967311385472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147205.776759:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3767:x1830967311385472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (2143us total) trans 17179875117 rc 0/0 00000100:00100000:0.0:1746147205.776764:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19332 00000100:00100000:1.0:1746147205.776780:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147205.776805:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4395c00/2, rc 0, transno 17179875117 00000004:00080000:0.0:1746147205.776805:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f55c00/2, rc 0, transno 17179875116 00000100:00100000:1.0:1746147205.776810:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311385472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147205.776810:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311386240:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147205.776817:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4396a00/2, rc 0, transno 17179875112 00000100:00100000:1.0:1746147205.776819:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311385984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147205.776823:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311387008 00000100:00100000:0.0:1746147205.776826:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311387008 00000004:00080000:1.0:1746147205.776830:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca10a80/2, rc 0, transno 21474842497 00000100:00100000:1.0:1746147205.776836:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311386496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147205.776841:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19333 00000100:00100000:0.0:1746147205.776845:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c06c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3767:x1830967311387008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.776933:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3764:x1830967311386752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1362us (2356us total) trans 21474842495 rc 0/0 00000100:00100000:2.0:1746147205.776937:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19321 00000004:00080000:2.0:1746147205.776958:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801322eaa00/2, rc 0, transno 21474842499 00000100:00100000:2.0:1746147205.776961:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801322eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311387392:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147205.776969:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4397b80/2, rc 0, transno 17179875113 00000100:00100000:2.0:1746147205.776972:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311385856:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147205.776978:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5575180/2, rc 0, transno 17179875115 00000100:00100000:2.0:1746147205.776980:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311386368:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147205.777017:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3765:x1830967311385728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 621us (2461us total) trans 17179875114 rc 0/0 00000100:00100000:2.0:1746147205.777021:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19326 00000004:00010000:2.0:1746147205.777062:0:16099:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012ca13100 reply state ffff8800931c2800 transno 8589937224 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.777080:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.777104:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.777107:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746147205.777111:0:16099:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746147205.777179:0:16099:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746147205.777204:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2665:x1830967310177920:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 10939us (11069us total) trans 8589937224 rc 0/0 00000100:00100000:2.0:1746147205.777211:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16343 00000100:00100000:0.0:1746147205.777556:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c06c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3767:x1830967311387008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 709us (775us total) trans 21474842500 rc 0/0 00000100:00100000:0.0:1746147205.777563:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19333 00000100:00100000:3.0:1746147205.777581:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+49:3766:x1830967311386880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1055us (2792us total) trans 21474842498 rc 0/0 00000100:00100000:3.0:1746147205.777587:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19329 00000100:00080000:3.0:1746147205.777604:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746147205.777608:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746147205.777690:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.777701:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.777707:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.777712:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9ff400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147205.777716:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.777722:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.777731:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147205.777733:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147205.777736:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00000004:00080000:0.0:1746147205.777736:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258c000/2, rc 0, transno 21474842495 00000100:00100000:0.0:1746147205.777739:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311386752:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746147205.777741:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff400/0x31399394250617b5 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00000004:00080000:0.0:1746147205.777760:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258f100/2, rc 0, transno 21474842496 00000100:00100000:0.0:1746147205.777763:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311387264:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147205.777773:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca11880/2, rc 0, transno 21474842493 00000004:00080000:1.0:1746147205.777775:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4397480/2, rc 0, transno 17179875114 00000100:00100000:0.0:1746147205.777776:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311386624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147205.777779:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311385728:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147205.777782:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258ca80/2, rc 0, transno 21474842494 00000100:00100000:0.0:1746147205.777784:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311387136:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147205.777791:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801322ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311387520:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147205.777801:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4395180/2, rc 0, transno 17179875110 00000100:00100000:0.0:1746147205.777804:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311385600:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147205.777812:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147205.777812:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4397100/2, rc 0, transno 17179875111 00000100:00100000:0.0:1746147205.777815:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311386112:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147205.777827:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258ea00/2, rc 0, transno 21474842500 00000100:00100000:0.0:1746147205.777828:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311387520 00000100:00100000:1.0:1746147205.777830:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311387008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147205.777831:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311387520 00000100:00100000:0.0:1746147205.777847:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19334 00000100:00100000:0.0:1746147205.777852:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3767:x1830967311387520:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147205.777941:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801322ea300/2, rc 0, transno 21474842501 00000100:00100000:1.0:1746147205.777945:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801322ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311387520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147205.777976:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3767:x1830967311387520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (109us total) trans 21474842501 rc 0/0 00000100:00100000:0.0:1746147205.777982:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19334 00000004:00080000:2.0:1746147205.778183:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258d880/2, rc 0, transno 21474842498 00000100:00100000:2.0:1746147205.778188:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311386880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147205.779168:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.779819:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310178560 00000100:00100000:2.0:1746147205.779824:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310178560 00000100:00100000:2.0:1746147205.779868:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16344 00000100:00100000:2.0:1746147205.779874:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2665:x1830967310178560:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147205.779890:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147205.779906:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250617bc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e3ce expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.779953:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250617bc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ce expref: 8 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.779964:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250617bc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ce expref: 8 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.779978:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.779981:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147205.779983:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9ff600, rc 0) 00000100:00100000:2.0:1746147205.780363:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2665:x1830967310178560:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 488us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.780369:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16344 00000100:00100000:0.0:1746147205.783033:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.783121:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310178688 00000100:00100000:2.0:1746147205.783249:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310178688 00000100:00100000:2.0:1746147205.783309:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16345 00000100:00100000:2.0:1746147205.783318:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2665:x1830967310178688:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147205.783337:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147205.783357:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x31399394250617c3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e3d5 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.783446:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x31399394250617ca lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.783459:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x31399394250617ca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.783469:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x31399394250617ca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:2.0:1746147205.783500:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:2.0:1746147205.783504:0:16099:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147205.783519:0:16099:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x31399394250617ca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.783541:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ffc00/0x31399394250617c3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3d5 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.783591:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x31399394250617ca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3d5 expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.783599:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.783602:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147205.783605:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fe400, rc 0) 00000100:00100000:2.0:1746147205.783662:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2665:x1830967310178688:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 344us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.783668:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16345 00000100:00100000:3.0:1746147205.789445:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.789534:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.789610:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.789799:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.789856:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310178944 00000100:00100000:0.0:1746147205.789865:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310178944 00000100:00100000:0.0:1746147205.789909:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310179200 00000100:00100000:0.0:1746147205.789911:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310179200 00000100:00100000:0.0:1746147205.789922:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310179456 00000100:00100000:0.0:1746147205.789924:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310179456 00000100:00100000:0.0:1746147205.789939:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19335 00000100:00100000:0.0:1746147205.789948:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310178944:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147205.789966:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147205.789986:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092562600/0x31399394250617d1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e3e3 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147205.790009:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x96:0x0] initial LVB size: 2097152, mtime: 0x68141785, atime: 0x68141785, ctime: 0x68141785, blocks: 0x808 00010000:00010000:0.0:1746147205.790028:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147205.790035:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147205.790045:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092562600/0x31399394250617d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3e3 expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147205.790060:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092562600/0x31399394250617d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3e3 expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147205.790071:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092562600, rc 0) 00000100:00100000:0.0:1746147205.790131:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310178944:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 184us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147205.790137:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19335 00000100:00100000:0.0:1746147205.790152:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19336 00000100:00100000:0.0:1746147205.790157:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310179200:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147205.790164:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147205.790174:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x31399394250617d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e3f1 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147205.790187:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x68141785, atime: 0x68141785, ctime: 0x68141785, blocks: 0x808 00010000:00010000:0.0:1746147205.790195:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147205.790197:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147205.790201:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x31399394250617d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3f1 expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147205.790210:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x31399394250617d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3f1 expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147205.790216:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563400, rc 0) 00000100:00100000:0.0:1746147205.790231:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310179200:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 74us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147205.790236:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19336 00000100:00100000:0.0:1746147205.790245:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19337 00000100:00100000:0.0:1746147205.790249:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310179456:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147205.790255:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147205.790264:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x31399394250617df lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e3ff expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147205.790274:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x98:0x0] initial LVB size: 4194304, mtime: 0x68141784, atime: 0x68141783, ctime: 0x68141784, blocks: 0x1008 00010000:00010000:0.0:1746147205.790280:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147205.790282:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147205.790285:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x31399394250617df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ff expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147205.790298:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x31399394250617df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ff expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147205.790304:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563600, rc 0) 00000100:00100000:0.0:1746147205.790318:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310179456:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 69us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147205.790323:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19337 00000100:00100000:3.0:1746147205.790465:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310178816 00000100:00100000:3.0:1746147205.790469:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310178816 00000100:00100000:3.0:1746147205.790489:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19338 00000100:00100000:3.0:1746147205.790494:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310178816:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147205.790501:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.790510:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7200/0x31399394250617e6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e3dc expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147205.790522:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x93:0x0] initial LVB size: 1048576, mtime: 0x68141785, atime: 0x68141783, ctime: 0x68141785, blocks: 0x7e8 00010000:00010000:3.0:1746147205.790530:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.790532:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.790536:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7200/0x31399394250617e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3dc expref: 18 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.790545:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7200/0x31399394250617e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3dc expref: 18 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.790552:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e5c7200, rc 0) 00000100:00100000:3.0:1746147205.790569:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310178816:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 76us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.790574:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19338 00000100:00100000:3.0:1746147205.791047:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.791083:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310179072 00000100:00100000:0.0:1746147205.791087:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310179072 00000100:00100000:3.0:1746147205.791120:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.791145:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310179328 00000100:00100000:1.0:1746147205.791152:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310179328 00000100:00100000:1.0:1746147205.791182:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19339 00000100:00100000:1.0:1746147205.791188:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310179328:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147205.791195:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147205.791205:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f400/0x31399394250617ed lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e3f8 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147205.791217:0:13712:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4886560, mtime: 0x68141785, atime: 0x68141783, ctime: 0x68141785, blocks: 0x1558 00010000:00010000:1.0:1746147205.791225:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.791227:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.791231:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f400/0x31399394250617ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3f8 expref: 19 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.791241:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f400/0x31399394250617ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3f8 expref: 19 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.791248:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8f400, rc 0) 00000100:00100000:1.0:1746147205.791269:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310179328:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 82us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.791273:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19339 00000100:00100000:1.0:1746147205.792375:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19340 00000100:00100000:1.0:1746147205.792383:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310179072:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147205.792392:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147205.792405:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250617f4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e3ea expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147205.792424:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x97:0x0] initial LVB size: 2097152, mtime: 0x68141785, atime: 0x68141785, ctime: 0x68141785, blocks: 0x800 00010000:00010000:1.0:1746147205.792435:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.792437:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.792441:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250617f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ea expref: 18 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.792452:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250617f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ea expref: 18 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.792460:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8e000, rc 0) 00000100:00100000:1.0:1746147205.792485:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310179072:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 102us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.792490:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19340 00000100:00100000:1.0:1746147205.795543:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.795623:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.795649:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.795670:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310179584 00000100:00100000:1.0:1746147205.795678:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310179584 00000100:00100000:0.0:1746147205.795681:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310179712 00000100:00100000:0.0:1746147205.795686:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310179712 00000100:00100000:1.0:1746147205.795715:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310179840 00000100:00100000:1.0:1746147205.795717:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310179840 00000100:00100000:1.0:1746147205.795734:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19341 00000100:00100000:1.0:1746147205.795741:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2002:x1830967310179584:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147205.795744:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19342 00000100:00100000:0.0:1746147205.795760:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2002:x1830967310179712:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147205.795792:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19343 00000100:00100000:3.0:1746147205.795801:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2002:x1830967310179840:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147205.795860:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2002:x1830967310179712:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 101us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147205.795865:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19342 00000100:00100000:1.0:1746147205.795903:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2002:x1830967310179584:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 162us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.795964:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2002:x1830967310179840:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 164us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.795970:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19343 00000100:00100000:1.0:1746147205.796796:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19341 00000100:00100000:1.0:1746147205.796837:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.796888:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.797269:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.797755:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310179968 00000100:00100000:2.0:1746147205.797762:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310179968 00000100:00100000:2.0:1746147205.797794:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310180096 00000100:00100000:2.0:1746147205.797796:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310180096 00000100:00100000:2.0:1746147205.797811:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19344 00000100:00100000:2.0:1746147205.797817:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2002:x1830967310179968:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147205.797892:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2002:x1830967310179968:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 74us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.797897:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19344 00000100:00100000:2.0:1746147205.797906:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310180224 00000100:00100000:2.0:1746147205.797908:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310180224 00000100:00100000:2.0:1746147205.797919:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19345 00000100:00100000:2.0:1746147205.797923:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2002:x1830967310180096:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147205.797953:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2002:x1830967310180096:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 29us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.797957:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19345 00000100:00100000:2.0:1746147205.797966:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19346 00000100:00100000:2.0:1746147205.797970:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2002:x1830967310180224:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147205.798002:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2002:x1830967310180224:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 32us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.798007:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19346 00010000:00010000:1.0:1746147205.801304:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147205.801336:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.801357:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.801381:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310180352 00000100:00100000:0.0:1746147205.801381:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.801391:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310180352 00000100:00100000:0.0:1746147205.801657:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.801924:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310180608 00000100:00100000:2.0:1746147205.801928:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310180608 00000100:00100000:0.0:1746147205.801938:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.801950:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310180864 00000100:00100000:2.0:1746147205.801952:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310180864 00000100:00100000:2.0:1746147205.801962:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310180480 00000100:00100000:2.0:1746147205.801964:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310180480 00000100:00100000:0.0:1746147205.801974:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.801978:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310180736 00000100:00100000:2.0:1746147205.801980:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310180736 00000100:00100000:2.0:1746147205.801991:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310180992 00000100:00100000:2.0:1746147205.801997:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310180992 00000100:00100000:2.0:1746147205.802017:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19347 00000100:00100000:3.0:1746147205.802022:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19348 00000100:00100000:2.0:1746147205.802024:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2000:x1830967310180352:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147205.802029:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967310180608:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147205.802136:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2000:x1830967310180352:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 111us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.802145:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19347 00000100:00100000:0.0:1746147205.802160:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19349 00000100:00100000:2.0:1746147205.802163:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19350 00000100:00100000:2.0:1746147205.802167:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967310180736:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147205.802182:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967310180480:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147205.802227:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967310180608:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 199us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.802227:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967310180736:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 59us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.802232:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19350 00000100:00100000:3.0:1746147205.802237:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19348 00000100:00100000:2.0:1746147205.802241:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19351 00000100:00100000:2.0:1746147205.802245:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310180992:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147205.802275:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310180992:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 30us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.802280:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19351 00000100:00100000:0.0:1746147205.802327:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310180480:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 161us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147205.802333:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19349 00000100:00100000:2.0:1746147205.802585:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19352 00000100:00100000:2.0:1746147205.802590:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310180864:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147205.802630:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310180864:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 39us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.802635:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19352 00000100:00100000:0.0:1746147205.805049:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.805142:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310181120 00000100:00100000:2.0:1746147205.805152:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310181120 00000100:00100000:2.0:1746147205.805201:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19353 00000100:00100000:2.0:1746147205.805207:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310181120:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:2.0:1746147205.805395:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147205.805398:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147205.805399:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147205.805401:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147205.805403:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:2.0:1746147205.805459:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310181120:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 251us (419us total) trans 17179875118 rc 0/0 00000100:00100000:2.0:1746147205.805465:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19353 00000100:00100000:0.0:1746147205.809646:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.809734:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310181248 00000100:00100000:2.0:1746147205.809744:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310181248 00000100:00100000:2.0:1746147205.809792:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19354 00000100:00100000:2.0:1746147205.809799:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310181248:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:2.0:1746147205.809984:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147205.809987:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147205.809989:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147205.809991:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147205.809992:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:2.0:1746147205.810047:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967310181248:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 248us (411us total) trans 21474842502 rc 0/0 00000100:00100000:2.0:1746147205.810054:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19354 00000100:00100000:0.0:1746147205.815289:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.815406:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310181504 00000100:00100000:3.0:1746147205.815417:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310181504 00000100:00100000:3.0:1746147205.815490:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7110 00000100:00100000:3.0:1746147205.815499:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967310181504:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147205.815540:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x31399394250617fb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.815554:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.815556:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.815561:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x31399394250617fb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.815574:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x31399394250617fb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147205.820410:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.820454:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.820518:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310181760 00000100:00100000:2.0:1746147205.820528:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310181760 00000100:00100000:2.0:1746147205.820589:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310182016 00000100:00100000:2.0:1746147205.820592:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310182016 00000100:00100000:2.0:1746147205.820614:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7111 00000100:00100000:2.0:1746147205.820622:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967310181760:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147205.820660:0:29474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425061802 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.820675:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.820677:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.820682:0:29474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425061802 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.820695:0:29474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425061802 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147205.820769:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7112 00000100:00100000:0.0:1746147205.820777:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967310182016:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147205.820792:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425061809 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.821321:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147205.821323:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147205.821326:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425061809 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.821336:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425061809 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147205.823272:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.823310:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.823340:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.823365:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.823386:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310182528 00000100:00100000:0.0:1746147205.823386:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310182272 00000100:00100000:2.0:1746147205.823393:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310182528 00000100:00100000:0.0:1746147205.823393:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310182272 00000100:00100000:0.0:1746147205.823437:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310182784 00000100:00100000:0.0:1746147205.823440:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310182784 00000100:00100000:2.0:1746147205.823446:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310183040 00000100:00100000:2.0:1746147205.823449:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310183040 00000100:00100000:0.0:1746147205.823460:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7113 00000100:00100000:0.0:1746147205.823468:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2001:x1830967310182272:12345-192.168.204.25@tcp:3:lfs.0 00000100:00100000:2.0:1746147205.823475:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7114 00000100:00100000:2.0:1746147205.823480:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2001:x1830967310182528:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147205.823503:0:9589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x3139939425061810 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.823503:0:29476:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e260200/0x3139939425061817 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.823515:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147205.823515:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.823517:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147205.823517:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.823521:0:9589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x3139939425061810 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.823521:0:29476:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260200/0x3139939425061817 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.823531:0:9589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x3139939425061810 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.823531:0:29476:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e260200/0x3139939425061817 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147205.824016:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7115 00000100:00100000:1.0:1746147205.824025:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2001:x1830967310182784:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147205.824044:0:13302:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f03ce00/0x313993942506181e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.824053:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.824054:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.824057:0:13302:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03ce00/0x313993942506181e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.824066:0:13302:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f03ce00/0x313993942506181e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147205.824279:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7116 00000100:00100000:2.0:1746147205.824286:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+26:2001:x1830967310183040:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147205.824301:0:29478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091d99e00/0x3139939425061825 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.824309:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.824310:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.824312:0:29478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d99e00/0x3139939425061825 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.824320:0:29478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d99e00/0x3139939425061825 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147205.824343:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.824359:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310183296 00000100:00100000:0.0:1746147205.824362:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310183296 00000100:00100000:0.0:1746147205.824384:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7117 00000100:00100000:0.0:1746147205.824389:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+25:2001:x1830967310183296:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147205.824403:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x313993942506182c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.824410:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147205.824412:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147205.824414:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x313993942506182c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.824423:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x313993942506182c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.828058:0:29477:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x31399394250617fb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.828078:0:29477:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x31399394250617fb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.828086:0:29477:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x31399394250617fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.828109:0:29477:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e5c7800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147205.828115:0:29477:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x31399394250617fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.828123:0:29477:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x31399394250617fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.828143:0:29477:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x31399394250617fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.828149:0:29477:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x31399394250617fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147205.828232:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+26:2001:x1830967310181504:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 12728us (12949us total) trans 0 rc 1032192/1032192 00000100:00100000:3.0:1746147205.828243:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7110 00010000:00010000:0.0:1746147205.832461:0:29474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425061802 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.832483:0:29474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425061802 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.832490:0:29474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425061802 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.832497:0:29474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9ffc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147205.832501:0:29474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425061802 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.832509:0:29474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425061802 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.832528:0:29474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425061802 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.832534:0:29474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9ffc00/0x3139939425061802 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147205.832664:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+25:2000:x1830967310181760:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 12036us (12259us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147205.832676:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7111 00010000:00010000:1.0:1746147205.834769:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425061809 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.834786:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425061809 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.834798:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425061809 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.834805:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e261c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147205.834809:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425061809 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.834816:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425061809 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.834834:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425061809 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.834841:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425061809 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147205.834931:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2001:x1830967310182016:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 14149us (14469us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147205.834945:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7112 00010000:00010000:2.0:1746147205.838350:0:9589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x3139939425061810 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.838368:0:9589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x3139939425061810 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.838377:0:9589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x3139939425061810 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.838384:0:9589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d99600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147205.838389:0:9589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x3139939425061810 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.838397:0:9589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x3139939425061810 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.838418:0:9589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x3139939425061810 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.838425:0:9589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d99600/0x3139939425061810 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147205.838525:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2001:x1830967310182528:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 15039us (15209us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147205.838536:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7114 00010000:00010000:0.0:1746147205.844002:0:29476:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e260200/0x3139939425061817 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.844021:0:29476:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260200/0x3139939425061817 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.844030:0:29476:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e260200/0x3139939425061817 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.844042:0:29476:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e260200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147205.844046:0:29476:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e260200/0x3139939425061817 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.844054:0:29476:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e260200/0x3139939425061817 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.844073:0:29476:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e260200/0x3139939425061817 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.844078:0:29476:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e260200/0x3139939425061817 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147205.844191:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2001:x1830967310182272:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 20717us (20921us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147205.844200:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7113 00010000:00010000:1.0:1746147205.847388:0:13302:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f03ce00/0x313993942506181e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.847404:0:13302:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03ce00/0x313993942506181e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.847410:0:13302:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f03ce00/0x313993942506181e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.847419:0:13302:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f03ce00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147205.847422:0:13302:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f03ce00/0x313993942506181e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.847427:0:13302:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f03ce00/0x313993942506181e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.847443:0:13302:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f03ce00/0x313993942506181e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.847446:0:13302:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f03ce00/0x313993942506181e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147205.847556:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967310182784:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 23528us (24210us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147205.847565:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7115 00010000:00010000:2.0:1746147205.854300:0:29478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091d99e00/0x3139939425061825 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.854318:0:29478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091d99e00/0x3139939425061825 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.854326:0:29478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091d99e00/0x3139939425061825 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.854333:0:29478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d99e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147205.854336:0:29478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091d99e00/0x3139939425061825 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.854343:0:29478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091d99e00/0x3139939425061825 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.854361:0:29478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091d99e00/0x3139939425061825 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.854371:0:29478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d99e00/0x3139939425061825 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147205.854462:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967310183040:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 30170us (31089us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147205.854473:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7116 00010000:00010000:1.0:1746147205.857076:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x313993942506182c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.857124:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x313993942506182c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.857132:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x313993942506182c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.857140:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e261000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147205.857144:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x313993942506182c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.857153:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x313993942506182c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.857171:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x313993942506182c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.857177:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e261000/0x313993942506182c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147205.857249:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310183296:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 32854us (32901us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147205.857260:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7117 00000100:00100000:0.0:1746147205.864817:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.864928:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310183552 00000100:00100000:2.0:1746147205.864938:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310183552 00000100:00100000:2.0:1746147205.865003:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16346 00000100:00100000:2.0:1746147205.865011:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2665:x1830967310183552:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:2.0:1746147205.865065:0:16099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147205.865124:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x31399394250617ca lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3d5 expref: 9 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.865146:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.865151:0:16099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147205.865205:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061833 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.865217:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061833 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.865226:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061833 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00010000:2.0:1746147205.865334:0:16099:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099154a80 reply state ffff880098334000 transno 8589937225 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061833 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.865347:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061833 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.865353:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.865356:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746147205.865358:0:16099:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746147205.865435:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2665:x1830967310183552:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 424us (628us total) trans 8589937225 rc 0/0 00000100:00100000:2.0:1746147205.865441:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16346 00000100:00100000:0.0:1746147205.868995:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.869042:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.869207:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.869257:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310183680 00000100:00100000:2.0:1746147205.869266:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310183680 00000100:00100000:3.0:1746147205.869305:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310183808 00000100:00100000:3.0:1746147205.869310:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310183808 00000100:00100000:0.0:1746147205.870248:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.870413:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310184064 00000100:00100000:2.0:1746147205.870418:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310184064 00000100:00100000:3.0:1746147205.870424:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19355 00000100:00100000:3.0:1746147205.870434:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2000:x1830967310183680:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:2.0:1746147205.870445:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19356 00000100:00100000:2.0:1746147205.870452:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310183808:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:3.0:1746147205.870571:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746147205.870571:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147205.870574:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147205 -> 1746147205 00002000:00010000:2.0:1746147205.870575:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147205 -> 1746147205 00002000:00010000:3.0:1746147205.870576:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147203 -> 1746147205 00002000:00010000:2.0:1746147205.870577:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147205 -> 1746147205 00002000:00010000:3.0:1746147205.870578:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147205 -> 1746147205 00002000:00010000:2.0:1746147205.870579:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147205 -> 1746147205 00002000:00010000:3.0:1746147205.870580:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00002000:00010000:2.0:1746147205.870580:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147205.870729:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310184320 00000100:00100000:1.0:1746147205.870734:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310184320 00000100:00100000:1.0:1746147205.870765:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19357 00000100:00100000:1.0:1746147205.870771:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2001:x1830967310184064:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147205.870825:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147205.870827:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147205 -> 1746147205 00002000:00010000:1.0:1746147205.870829:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147205 -> 1746147205 00002000:00010000:1.0:1746147205.870830:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147205 -> 1746147205 00002000:00010000:1.0:1746147205.870832:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147205.870840:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2000:x1830967310183680:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 407us (1855us total) trans 21474842503 rc 0/0 00000100:00100000:3.0:1746147205.870846:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19355 00000100:00100000:3.0:1746147205.870862:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19358 00000100:00100000:3.0:1746147205.870866:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967310184320:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:3.0:1746147205.870905:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147205.870908:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147204 -> 1746147205 00002000:00010000:3.0:1746147205.870910:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147203 -> 1746147205 00002000:00010000:3.0:1746147205.870911:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147204 -> 1746147205 00002000:00010000:3.0:1746147205.870913:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746147205.870967:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2000:x1830967310183808:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 515us (1922us total) trans 17179875119 rc 0/0 00000100:00100000:2.0:1746147205.870972:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19356 00000100:00100000:0.0:1746147205.871010:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.871023:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310183936 00000100:00100000:2.0:1746147205.871026:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310183936 00000100:00100000:2.0:1746147205.871043:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19359 00000100:00100000:2.0:1746147205.871048:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2001:x1830967310183936:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:2.0:1746147205.871106:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147205.871109:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147205 -> 1746147205 00002000:00010000:2.0:1746147205.871110:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147205 -> 1746147205 00002000:00010000:2.0:1746147205.871112:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147205 -> 1746147205 00002000:00010000:2.0:1746147205.871114:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746147205.871132:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2001:x1830967310183936:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 84us (122us total) trans 17179875121 rc 0/0 00000100:00100000:2.0:1746147205.871137:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19359 00000100:00100000:0.0:1746147205.871276:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.871461:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2001:x1830967310184064:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 689us (2252us total) trans 21474842504 rc 0/0 00000100:00100000:3.0:1746147205.871467:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2001:x1830967310184320:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 598us (1219us total) trans 17179875120 rc 0/0 00000100:00100000:1.0:1746147205.871467:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19357 00000100:00100000:1.0:1746147205.871477:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310184192 00000100:00100000:1.0:1746147205.871480:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310184192 00000100:00100000:3.0:1746147205.872769:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19358 00000100:00100000:1.0:1746147205.873263:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19360 00000100:00100000:1.0:1746147205.873274:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2001:x1830967310184192:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147205.873378:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:1.0:1746147205.873381:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147205 -> 1746147205 00002000:00010000:1.0:1746147205.873383:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147203 -> 1746147205 00002000:00010000:1.0:1746147205.873385:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147205 -> 1746147205 00002000:00010000:1.0:1746147205.873386:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:1.0:1746147205.873429:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2001:x1830967310184192:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 159us (2153us total) trans 21474842505 rc 0/0 00000100:00100000:1.0:1746147205.873433:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19360 00000100:00100000:0.0:1746147205.876901:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.877011:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310184576 00000100:00100000:3.0:1746147205.877021:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310184576 00000100:00100000:3.0:1746147205.877492:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6088 00000100:00100000:3.0:1746147205.877501:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4d63850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2665:x1830967310184576:12345-192.168.204.25@tcp:35:lfs.0 00000004:00010000:3.0:1746147205.877564:0:7240:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x30:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942506177d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3c7 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.877614:0:7240:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x313993942506183a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7240 initiator: MDT0 00010000:00010000:3.0:1746147205.877628:0:7240:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250617bc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ce expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.880063:0:7240:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x313993942506183a lrc: 4/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7240 initiator: MDT0 00010000:00010000:3.0:1746147205.880150:0:7240:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250617bc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ce expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.880172:0:7240:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250617bc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ce expref: 10 pid: 16099 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.880188:0:7240:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7240:1830967311387648:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147205.880319:0:7240:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147205.882241:0:7240:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7240:1830967311387648:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147205.882265:0:7240:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x313993942506183a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7240 initiator: MDT0 00000100:00100000:0.0:1746147205.883804:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.883872:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310184704 00000100:00100000:3.0:1746147205.883882:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310184704 00010000:00010000:3.0:1746147205.883927:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250617bc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ce expref: 11 pid: 16099 timeout: 843 lvb_type: 0 00000100:00100000:3.0:1746147205.883976:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8785 00000100:00100000:3.0:1746147205.883984:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310184704:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147205.884001:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147205.884008:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250617bc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ce expref: 11 pid: 16099 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.884019:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250617bc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ce expref: 11 pid: 16099 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.884043:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250617bc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ce expref: 11 pid: 16099 timeout: 843 lvb_type: 0 00010000:00010000:3.0:1746147205.884077:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147205.884083:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x313993942506183a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7240 initiator: MDT0 00010000:00010000:3.0:1746147205.884112:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x313993942506183a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7240 initiator: MDT0 00010000:00010000:3.0:1746147205.884119:0:4349:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x313993942506183a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7240 initiator: MDT0 00010000:00010000:3.0:1746147205.884961:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147205.885109:0:7240:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x313993942506183a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147205.885119:0:7240:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x313993942506183a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7240 initiator: MDT0 00000040:00080000:0.0:1746147205.885396:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1172, 88 off110984 00000004:00080000:0.0:1746147205.885403:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743875312880ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147205.885429:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1181, 88 off111776 00000004:00080000:0.0:1746147205.885432:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743875342465ns, next at 694367916532ns, rc = 0 00000100:00100000:3.0:1746147205.885478:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310184704:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1491us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.885487:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8785 00000040:00080000:0.0:1746147205.886228:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1182, 88 off111864 00000004:00080000:0.0:1746147205.886233:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743876143225ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147205.886242:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1173, 88 off111072 00000004:00080000:0.0:1746147205.886244:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743876155095ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147205.886263:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1174, 88 off111160 00000004:00080000:0.0:1746147205.886266:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743876176365ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147205.886272:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1183, 88 off111952 00000004:00080000:0.0:1746147205.886274:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743876184695ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147205.886281:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1184, 88 off112040 00000004:00080000:0.0:1746147205.886283:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743876193540ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147205.886289:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1185, 88 off112128 00000004:00080000:0.0:1746147205.886292:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743876202930ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147205.886298:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1175, 88 off111248 00000004:00080000:0.0:1746147205.886300:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743876210950ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147205.886306:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1186, 88 off112216 00000004:00080000:0.0:1746147205.886308:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743876218185ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147205.886313:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1176, 88 off111336 00000004:00080000:0.0:1746147205.886315:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743876225350ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147205.886320:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1187, 88 off112304 00000004:00080000:0.0:1746147205.886323:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743876233502ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147205.886329:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1177, 88 off111424 00000004:00080000:0.0:1746147205.886331:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743876241960ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147205.886337:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1178, 88 off111512 00000004:00080000:0.0:1746147205.886339:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743876249870ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147205.886345:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1179, 88 off111600 00000004:00080000:0.0:1746147205.886347:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743876257562ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147205.886353:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1180, 88 off111688 00000004:00080000:0.0:1746147205.886355:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743876265375ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147205.886360:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1188, 88 off112392 00000004:00080000:0.0:1746147205.886362:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743876272560ns, next at 694367916532ns, rc = 0 00000001:00080000:2.0:1746147205.897598:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937226 is committed 00000004:00080000:2.0:1746147205.897612:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1166 committed 00000004:00080000:2.0:1746147205.897627:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1161 committed 00000004:00080000:2.0:1746147205.897642:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1160 committed 00000004:00080000:2.0:1746147205.897644:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1159 committed 00000004:00080000:2.0:1746147205.897646:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1158 committed 00000004:00080000:2.0:1746147205.897647:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1165 committed 00000004:00080000:2.0:1746147205.897648:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1157 committed 00000004:00080000:2.0:1746147205.897649:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1164 committed 00000004:00080000:2.0:1746147205.897651:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1156 committed 00000004:00080000:2.0:1746147205.897652:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1163 committed 00000004:00080000:2.0:1746147205.897653:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1162 committed 00000004:00080000:2.0:1746147205.897654:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1161 committed 00000004:00080000:2.0:1746147205.897655:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1155 committed 00000004:00080000:2.0:1746147205.897656:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1154 committed 00000004:00080000:2.0:1746147205.897657:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1160 committed 00000004:00080000:2.0:1746147205.897659:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1159 committed 00000004:00080000:2.0:1746147205.897660:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1153 committed 00010000:00010000:1.0:1746147205.897663:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061833 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.897677:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061833 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.897684:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061833 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.897690:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d98400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147205.897694:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061833 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.897701:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061833 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.897721:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147205.897724:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147205.897729:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061833 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147205.897735:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061833 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00000100:00100000:1.0:1746147205.898452:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311387776:0@lo:2:osp-syn-1-0.0 00000004:00010000:0.0:1746147205.898485:0:7240:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800b4d63850 reply state ffff88009b9cd800 transno 8589937226 ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x313993942506183a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7240 initiator: MDT0 00010000:00010000:0.0:1746147205.898501:0:7240:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x313993942506183a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7240 initiator: MDT0 00000100:00100000:1.0:1746147205.898527:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147205.898582:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311388288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147205.898600:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147205.898619:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746147205.898621:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311388032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147205.898624:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311387904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147205.898655:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147205.898671:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311388416:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147205.898673:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746147205.898834:0:7240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147205.898838:0:7240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746147205.898842:0:7240:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746147205.898847:0:7240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147205.898848:0:7240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147205.898854:0:7240:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x313993942506177d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3c7 expref: 7 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147205.898856:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147205.898860:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311388544:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147205.898877:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147205.898885:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311388160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147205.898906:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147205.898913:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311387776 00000100:00100000:2.0:1746147205.898919:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311387776 00010000:00080000:0.0:1746147205.898936:0:7240:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746147205.898947:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311388288 00000100:00100000:0.0:1746147205.898947:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4d63850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2665:x1830967310184576:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 21447us (22055us total) trans 8589937226 rc 0/0 00000100:00100000:2.0:1746147205.898949:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311388288 00000100:00100000:0.0:1746147205.898955:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6088 00000100:00100000:2.0:1746147205.898959:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311387904 00000100:00100000:2.0:1746147205.898960:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311387904 00000100:00100000:1.0:1746147205.898963:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311388672:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147205.898968:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311388032 00000100:00100000:2.0:1746147205.898970:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311388032 00000100:00100000:2.0:1746147205.898976:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311388416 00000100:00100000:2.0:1746147205.898978:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311388416 00000100:00100000:1.0:1746147205.898982:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147205.898996:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311388544 00000100:00100000:2.0:1746147205.898998:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311388544 00000100:00100000:2.0:1746147205.899006:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311388160 00000100:00100000:2.0:1746147205.899008:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311388160 00000100:00100000:2.0:1746147205.899014:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311388672 00010000:00010000:1.0:1746147205.899014:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x313993942506183a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7240 initiator: MDT0 00000100:00100000:2.0:1746147205.899016:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311388672 00010000:00010000:1.0:1746147205.899020:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x313993942506183a lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7240 initiator: MDT0 00000100:00100000:2.0:1746147205.899025:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19361 00010000:00010000:1.0:1746147205.899025:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x313993942506183a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7240 initiator: MDT0 00010000:00010000:1.0:1746147205.899029:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e5c7e00 already unused, calling callback (ffffffffa0efd690) 00000100:00100000:2.0:1746147205.899030:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3764:x1830967311387776:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746147205.899031:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x313993942506183a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7240 initiator: MDT0 00010000:00010000:1.0:1746147205.899037:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x313993942506183a lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7240 initiator: MDT0 00010000:00010000:1.0:1746147205.899045:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147205.899047:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147205.899049:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x313993942506183a lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7240 initiator: MDT0 00010000:00010000:1.0:1746147205.899053:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x313993942506183a lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7240 initiator: MDT0 00000100:00100000:1.0:1746147205.899076:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19362 00000100:00100000:1.0:1746147205.899085:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3764:x1830967311388288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147205.899117:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19363 00000100:00100000:0.0:1746147205.899124:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3764:x1830967311387904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147205.899155:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147205.899157:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147205 -> 1746147205 00002000:00010000:2.0:1746147205.899159:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147205 -> 1746147205 00002000:00010000:2.0:1746147205.899161:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147205 -> 1746147205 00002000:00010000:2.0:1746147205.899162:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:0.0:1746147205.899173:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147205.899176:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147205 -> 1746147205 00002000:00010000:0.0:1746147205.899177:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147205 -> 1746147205 00002000:00010000:0.0:1746147205.899179:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147205 -> 1746147205 00002000:00010000:0.0:1746147205.899181:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746147205.899191:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3764:x1830967311387776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 160us (664us total) trans 17179875122 rc 0/0 00000100:00100000:2.0:1746147205.899196:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19361 00000100:00100000:0.0:1746147205.899203:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3764:x1830967311387904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (547us total) trans 17179875123 rc 0/0 00000100:00100000:2.0:1746147205.899206:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19364 00000100:00100000:0.0:1746147205.899208:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19363 00000100:00100000:2.0:1746147205.899209:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3766:x1830967311388032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147205.899217:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19365 00000100:00100000:0.0:1746147205.899222:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3764:x1830967311388416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147205.899235:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3764:x1830967311388288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 152us (632us total) trans 17179875124 rc 0/0 00000100:00100000:1.0:1746147205.899242:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19362 00002000:00010000:2.0:1746147205.899248:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147205.899251:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147205 -> 1746147205 00002000:00010000:2.0:1746147205.899252:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147205 -> 1746147205 00002000:00010000:2.0:1746147205.899254:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147205 -> 1746147205 00002000:00010000:2.0:1746147205.899256:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746147205.899258:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19366 00002000:00010000:0.0:1746147205.899259:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:0.0:1746147205.899261:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:0.0:1746147205.899263:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1746147205.899264:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3766:x1830967311388544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147205.899265:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:0.0:1746147205.899266:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:2.0:1746147205.899275:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3766:x1830967311388032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (602us total) trans 17179875125 rc 0/0 00000100:00100000:2.0:1746147205.899280:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19364 00000100:00100000:0.0:1746147205.899285:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3764:x1830967311388416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (428us total) trans 17179875126 rc 0/0 00000100:00100000:0.0:1746147205.899290:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19365 00000100:00100000:2.0:1746147205.899293:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19367 00000100:00100000:2.0:1746147205.899297:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c06c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3767:x1830967311388160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147205.899301:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19368 00000100:00100000:0.0:1746147205.899305:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3767:x1830967311388672:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147205.899329:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d6dc00/2, rc 0, transno 17179875125 00000100:00100000:2.0:1746147205.899333:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311388032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147205.899334:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3766:x1830967311388544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (455us total) trans 17179875127 rc 0/0 00000100:00100000:1.0:1746147205.899339:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19366 00000004:00080000:2.0:1746147205.899343:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d6300/2, rc 0, transno 17179875127 00000100:00100000:2.0:1746147205.899345:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311388544:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147205.899353:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311389056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.899371:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147205.899673:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3767:x1830967311388672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 367us (689us total) trans 17179875128 rc 0/0 00000100:00100000:0.0:1746147205.899679:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19368 00000100:00100000:2.0:1746147205.899682:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746147205.899687:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311389184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147205.899689:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311389056 00000100:00100000:0.0:1746147205.899692:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311389056 00000100:00100000:3.0:1746147205.899701:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311388928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.899704:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147205.899708:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311389184 00002000:00010000:1.0:1746147205.899709:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746147205.899710:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311389184 00002000:00010000:1.0:1746147205.899713:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00000100:00100000:2.0:1746147205.899715:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311389568:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147205.899715:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147205.899717:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147205.899719:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746147205.899719:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19369 00000100:00100000:0.0:1746147205.899723:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+51:3766:x1830967311389056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147205.899726:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147205.899735:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311388928 00000100:00100000:2.0:1746147205.899738:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311388928 00000100:00100000:3.0:1746147205.899758:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011db17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311389440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147205.899758:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c06c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3767:x1830967311388160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 460us (850us total) trans 17179875129 rc 0/0 00000100:00100000:2.0:1746147205.899761:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19370 00000100:00100000:1.0:1746147205.899765:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19367 00000100:00100000:2.0:1746147205.899766:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:3766:x1830967311389184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147205.899774:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746147205.899789:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00000100:00100000:3.0:1746147205.899790:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00002000:00010000:0.0:1746147205.899792:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147205 -> 1746147205 00000100:00100000:3.0:1746147205.899794:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311388800:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147205.899794:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147205 -> 1746147205 00002000:00010000:0.0:1746147205.899796:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147205 -> 1746147205 00002000:00010000:0.0:1746147205.899797:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:3.0:1746147205.899810:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746147205.899811:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746147205.899813:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147205.899814:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147205.899816:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00000100:00100000:3.0:1746147205.899818:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311389312:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147205.899818:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:0.0:1746147205.899818:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+54:3766:x1830967311389056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (446us total) trans 21474842506 rc 0/0 00000100:00100000:0.0:1746147205.899824:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19369 00000100:00100000:3.0:1746147205.899831:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147205.899834:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311389440 00000100:00100000:0.0:1746147205.899836:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311389440 00000100:00100000:2.0:1746147205.899837:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+53:3766:x1830967311389184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (132us total) trans 21474842507 rc 0/0 00000100:00100000:2.0:1746147205.899841:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19370 00000100:00100000:0.0:1746147205.899846:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311388800 00000100:00100000:3.0:1746147205.899848:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311389312 00000100:00100000:0.0:1746147205.899848:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311388800 00000100:00100000:3.0:1746147205.899851:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311389312 00000100:00100000:2.0:1746147205.899854:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19371 00000100:00100000:2.0:1746147205.899858:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3765:x1830967311388928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147205.899859:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19372 00000100:00100000:0.0:1746147205.899863:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+55:3765:x1830967311389440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147205.899867:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19373 00000100:00100000:3.0:1746147205.899871:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+55:3765:x1830967311388800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147205.899888:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147205.899890:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147205 -> 1746147205 00002000:00010000:2.0:1746147205.899892:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147205 -> 1746147205 00002000:00010000:2.0:1746147205.899893:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147205 -> 1746147205 00002000:00010000:2.0:1746147205.899895:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147205.899898:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19374 00000100:00100000:1.0:1746147205.899904:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3765:x1830967311389312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.899914:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3765:x1830967311388928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (187us total) trans 21474842508 rc 0/0 00002000:00010000:3.0:1746147205.899917:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:2.0:1746147205.899919:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19371 00002000:00010000:3.0:1746147205.899920:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147205 -> 1746147205 00002000:00010000:3.0:1746147205.899921:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147205 -> 1746147205 00002000:00010000:3.0:1746147205.899923:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147205 -> 1746147205 00002000:00010000:3.0:1746147205.899924:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:3.0:1746147205.899942:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:3765:x1830967311388800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (131us total) trans 21474842509 rc 0/0 00000100:00100000:3.0:1746147205.899948:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19373 00000004:00080000:3.0:1746147205.899970:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099889c00/2, rc 0, transno 21474842509 00000100:00100000:3.0:1746147205.899977:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311388800:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147205.899986:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f085500/2, rc 0, transno 21474842510 00000100:00100000:3.0:1746147205.899988:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311389312:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147205.899994:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099888a80/2, rc 0, transno 21474842508 00000100:00100000:3.0:1746147205.899997:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311388928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147205.900001:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746147205.900006:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009689aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311389824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147205.900019:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3765:x1830967311389312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (185us total) trans 21474842510 rc 0/0 00000100:00100000:3.0:1746147205.900021:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147205.900026:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19374 00000100:00100000:2.0:1746147205.900036:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311389824 00000100:00100000:2.0:1746147205.900039:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311389824 00000100:00100000:3.0:1746147205.900041:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147205.900050:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311389696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.900053:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311389568 00000100:00100000:2.0:1746147205.900056:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311389568 00000004:00080000:3.0:1746147205.900057:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f085880/2, rc 0, transno 21474842507 00000100:00100000:3.0:1746147205.900060:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311389184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.900066:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19375 00000004:00080000:3.0:1746147205.900068:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009988bb80/2, rc 0, transno 21474842506 00000100:00100000:3.0:1746147205.900070:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311389056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.900070:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:3765:x1830967311389824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147205.900072:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147205.900085:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311389696 00000100:00100000:3.0:1746147205.900104:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311389696 00000100:00100000:3.0:1746147205.900123:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19376 00000100:00100000:3.0:1746147205.900127:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3766:x1830967311389568:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147205.900132:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d6df80/2, rc 0, transno 17179875129 00000100:00100000:1.0:1746147205.900137:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311388160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147205.900144:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3765:x1830967311389440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 280us (368us total) trans 21474842511 rc 0/0 00000100:00100000:2.0:1746147205.900146:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:3765:x1830967311389824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (123us total) trans 21474842512 rc 0/0 00000004:00080000:1.0:1746147205.900147:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947e4a80/2, rc 0, transno 17179875128 00000100:00100000:1.0:1746147205.900150:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311388672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147205.900150:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19372 00000100:00100000:2.0:1746147205.900154:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19375 00000100:00100000:0.0:1746147205.900160:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19377 00000100:00100000:0.0:1746147205.900164:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3767:x1830967311389696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147205.900168:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147205.900170:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00000004:00080000:1.0:1746147205.900171:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d6ed80/2, rc 0, transno 17179875123 00002000:00010000:3.0:1746147205.900172:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147205.900173:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147205.900174:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:1.0:1746147205.900175:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311387904:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147205.900182:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d5f80/2, rc 0, transno 17179875126 00000100:00100000:1.0:1746147205.900185:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311388416:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147205.900193:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d6d880/2, rc 0, transno 17179875122 00000100:00100000:1.0:1746147205.900195:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311387776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147205.900196:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3766:x1830967311389568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (155us total) trans 21474842513 rc 0/0 00000100:00100000:3.0:1746147205.900201:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19376 00000004:00080000:1.0:1746147205.900202:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d6fb80/2, rc 0, transno 17179875124 00000100:00100000:1.0:1746147205.900204:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311388288:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147205.900209:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db16a00/2, rc 0, transno 21474842513 00000100:00100000:2.0:1746147205.900213:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311389568:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147205.900213:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:0.0:1746147205.900215:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147205.900217:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147205.900219:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00000004:00080000:3.0:1746147205.900221:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009689aa00/2, rc 0, transno 21474842512 00002000:00010000:0.0:1746147205.900221:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:3.0:1746147205.900223:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009689aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311389824:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147205.900229:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011db17480/2, rc 0, transno 21474842511 00000100:00100000:3.0:1746147205.900232:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011db17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311389440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147205.900252:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3767:x1830967311389696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (180us total) trans 21474842514 rc 0/0 00000100:00100000:0.0:1746147205.900258:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19377 00000004:00080000:1.0:1746147205.900263:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d95880/2, rc 0, transno 21474842514 00000100:00100000:1.0:1746147205.900268:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311389696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.904956:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.905021:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310184832 00000100:00100000:1.0:1746147205.905033:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310184832 00000100:00100000:1.0:1746147205.905132:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16347 00000100:00100000:1.0:1746147205.905143:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+6:2665:x1830967310184832:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147205.905166:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147205.905186:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098226a00/0x3139939425061841 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e406 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.905245:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098226a00/0x3139939425061841 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e406 expref: 7 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.905264:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098226a00/0x3139939425061841 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e406 expref: 7 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.905283:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147205.905285:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147205.905288:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098226a00, rc 0) 00000100:00100000:1.0:1746147205.906476:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2665:x1830967310184832:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1330us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.906485:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16347 00000100:00100000:0.0:1746147205.910953:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.911066:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310185088 00000100:00100000:2.0:1746147205.911080:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310185088 00000100:00100000:2.0:1746147205.911171:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6089 00000100:00100000:2.0:1746147205.911180:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2665:x1830967310185088:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:2.0:1746147205.911419:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2665:x1830967310185088:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 239us (486us total) trans 8589937227 rc 0/0 00000100:00100000:2.0:1746147205.911425:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6089 00000100:00100000:0.0:1746147205.933453:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.933579:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310185344 00000100:00100000:1.0:1746147205.933589:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310185344 00000100:00100000:1.0:1746147205.933701:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16348 00000100:00100000:1.0:1746147205.933710:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2673:x1830967310185344:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147205.933739:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147205.933784:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425061848 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e40d expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.933872:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098226e00/0x313993942506184f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.933884:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098226e00/0x313993942506184f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.933895:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098226e00/0x313993942506184f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.933907:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098227800/0x3139939425061856 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.933912:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098227800/0x3139939425061856 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.933916:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098227800/0x3139939425061856 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.934016:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098227000/0x313993942506185d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.934024:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098227000/0x313993942506185d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.934030:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098227000/0x313993942506185d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147205.934038:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147205.934201:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098226e00/0x313993942506184f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.934208:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098226e00/0x313993942506184f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.934217:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098226e00/0x313993942506184f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.934223:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098226e00/0x313993942506184f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.934229:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098226e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147205.934232:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098226e00/0x313993942506184f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.934238:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098226e00/0x313993942506184f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.934249:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147205.934251:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147205.934256:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098226e00/0x313993942506184f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.934261:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098226e00/0x313993942506184f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.934288:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098227800/0x3139939425061856 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.934293:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098227800/0x3139939425061856 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.934297:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098227800/0x3139939425061856 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.934301:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098227800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147205.934303:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098227800/0x3139939425061856 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.934311:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098227800/0x3139939425061856 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00000100:00100000:2.0:1746147205.934314:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147205.934317:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012dc2b800) 00010000:00010000:1.0:1746147205.934319:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147205.934321:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098227800/0x3139939425061856 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.934325:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098227800/0x3139939425061856 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00000100:00100000:2.0:1746147205.934335:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310185600 00000100:00100000:2.0:1746147205.934338:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310185600 00010000:00010000:1.0:1746147205.934360:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425061848 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e40d expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147205.934362:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16349 00000100:00100000:2.0:1746147205.934368:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2675:x1830967310185600:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147205.934371:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098227000/0x313993942506185d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e40d expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.934376:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.934377:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147205.934378:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147205.934380:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098227000, rc 0) 00010000:00010000:2.0:1746147205.934383:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x313993942506186b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e414 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.934409:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061872 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934416:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061872 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934421:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061872 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000100:00100000:1.0:1746147205.934426:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2673:x1830967310185344:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 717us (984us total) trans 8589937228 rc 0/0 00000100:00100000:1.0:1746147205.934431:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16348 00010000:00010000:2.0:1746147205.934432:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061879 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934436:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061879 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934441:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061879 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934481:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x3139939425061880 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934493:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x3139939425061880 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934499:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x3139939425061880 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:2.0:1746147205.934505:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147205.934533:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061872 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934538:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061872 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934542:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061872 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934547:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d99a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147205.934549:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061872 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934553:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061872 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934560:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147205.934562:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147205.934564:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061872 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934568:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061872 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934579:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061879 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934584:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061879 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934587:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061879 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934591:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d98400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147205.934593:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061879 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934597:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061879 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934601:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880095a3e300) 00010000:00010000:2.0:1746147205.934603:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147205.934604:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061879 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934608:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x3139939425061879 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147205.934633:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x313993942506186b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e414 expref: 29 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.934643:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x3139939425061880 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e414 expref: 28 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.934648:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.934650:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147205.934652:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99200, rc 0) 00000100:00100000:2.0:1746147205.934683:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2675:x1830967310185600:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 315us (369us total) trans 8589937229 rc 0/0 00000100:00100000:2.0:1746147205.934689:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16349 00000100:00100000:0.0:1746147205.953309:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.953367:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.953398:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310185856 00000100:00100000:2.0:1746147205.953409:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310185856 00000100:00100000:2.0:1746147205.953514:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310186112 00000100:00100000:2.0:1746147205.953517:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310186112 00000100:00100000:2.0:1746147205.953541:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16350 00000100:00100000:2.0:1746147205.953549:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2677:x1830967310185856:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147205.953577:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147205.953598:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x313993942506188e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e41b expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147205.953697:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16351 00010000:00010000:2.0:1746147205.953704:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061895 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147205.953705:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2678:x1830967310186112:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147205.953715:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147205.953719:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061895 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147205.953723:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6800/0x313993942506189c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e422 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.953730:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061895 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:2.0:1746147205.953741:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147205.953779:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x31399394250618a3 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147205.953787:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x31399394250618a3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147205.953794:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x31399394250618a3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:0.0:1746147205.953800:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147205.953874:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x313993942506188e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e41b expref: 12 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.953880:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6800/0x313993942506189c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e422 expref: 31 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.953896:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061895 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e41b expref: 11 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.953903:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147205.953903:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x31399394250618a3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e422 expref: 30 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.953906:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746147205.953909:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147205.953910:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99a00, rc 0) 00010000:00010000:0.0:1746147205.953911:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746147205.953913:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974a6000, rc 0) 00000100:00100000:2.0:1746147205.954023:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2677:x1830967310185856:12345-192.168.204.25@tcp:101:cat.0 Request processed in 474us (724us total) trans 8589937230 rc 0/0 00000100:00100000:2.0:1746147205.954029:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16350 00000100:00100000:1.0:1746147205.955336:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2678:x1830967310186112:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1624us (1961us total) trans 8589937231 rc 0/0 00000100:00100000:1.0:1746147205.955345:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16351 00000100:00100000:0.0:1746147205.956354:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.957713:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310186368 00000100:00100000:1.0:1746147205.957723:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310186368 00000100:00100000:0.0:1746147205.957766:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.958039:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310186496 00000100:00100000:1.0:1746147205.958043:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310186496 00000100:00100000:1.0:1746147205.958077:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16352 00000100:00100000:1.0:1746147205.958085:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2673:x1830967310186368:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147205.958128:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147205.958132:0:7239:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:0.0:1746147205.958141:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16353 00000100:00100000:0.0:1746147205.958148:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2677:x1830967310186496:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147205.958158:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098227000/0x313993942506185d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e40d expref: 12 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.958160:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147205.958174:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x31399394250618b8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e430 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.958183:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147205.958187:0:7239:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147205.958193:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098226200/0x31399394250618bf lrc: 2/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e429 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.958225:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147205.958235:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x3139939425061880 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e414 expref: 29 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.958242:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098226a00/0x3139939425061841 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e406 expref: 7 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.958246:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.958249:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061895 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e41b expref: 13 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.958255:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x31399394250618a3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e422 expref: 29 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.958450:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147205.958486:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147205.958492:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147205.958502:0:7238:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7239 initiator: MDT0 00010000:00010000:0.0:1746147205.958513:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.958515:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x31399394250618a3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e422 expref: 29 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.958527:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x31399394250618a3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e422 expref: 29 pid: 7239 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.958539:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311389952:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147205.958777:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.958794:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310186624 00000100:00100000:0.0:1746147205.958796:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310186624 00000100:00100000:0.0:1746147205.958821:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19378 00000100:00100000:0.0:1746147205.958826:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2678:x1830967310186624:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147205.958835:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147205.958846:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250618d4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e437 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.958862:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147205.958863:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147205.958870:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250618d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e437 expref: 42 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.958880:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250618d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e437 expref: 42 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147205.958889:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f588c00, rc 0) 00000100:00100000:0.0:1746147205.958911:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2678:x1830967310186624:12345-192.168.204.25@tcp:101:cat.0 Request processed in 85us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147205.958917:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19378 00010000:00010000:1.0:1746147205.958924:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061895 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e41b expref: 13 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.958932:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061895 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e41b expref: 13 pid: 16099 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.958940:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311390080:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147205.958973:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098226a00/0x3139939425061841 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e406 expref: 7 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.958981:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098226a00/0x3139939425061841 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e406 expref: 7 pid: 7238 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.959196:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311390208:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147205.959875:0:7239:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x3139939425061880 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e414 expref: 29 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.959883:0:7239:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x3139939425061880 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e414 expref: 29 pid: 16099 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.959900:0:7239:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095149180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311390336:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147205.959924:0:7239:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147205.960221:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311389952:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147205.961609:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.961693:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.961778:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310186752 00000100:00100000:1.0:1746147205.961788:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310186752 00010000:00010000:1.0:1746147205.961821:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x31399394250618a3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e422 expref: 30 pid: 7239 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.961858:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310186880 00000100:00100000:1.0:1746147205.961860:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310186880 00010000:00010000:1.0:1746147205.961871:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061895 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e41b expref: 14 pid: 16099 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.961887:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8786 00000100:00100000:1.0:1746147205.961893:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967310186752:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.961904:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.961910:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x31399394250618a3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e422 expref: 30 pid: 7239 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.961919:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x31399394250618a3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e422 expref: 30 pid: 7239 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.961946:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6000/0x31399394250618a3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e422 expref: 30 pid: 7239 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.961961:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147205.961967:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.961974:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147205.961979:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147205.961983:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.961987:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.962022:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967310186752:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 128us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.962028:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8786 00000100:00100000:1.0:1746147205.962043:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8787 00000100:00100000:1.0:1746147205.962048:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2003:x1830967310186880:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.962056:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.962060:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061895 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e41b expref: 14 pid: 16099 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.962067:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061895 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e41b expref: 14 pid: 16099 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.962077:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147205.962080:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.962085:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147205.962109:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147205.962114:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.962118:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.962596:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2003:x1830967310186880:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 546us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.962602:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8787 00010000:00010000:1.0:1746147205.962671:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x3139939425061895 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e41b expref: 13 pid: 16099 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.962681:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311390080:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147205.965724:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311390208:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147205.965735:0:7239:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095149180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7239:1830967311390336:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147205.965782:0:7239:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7239 initiator: MDT0 00000100:00100000:0.0:1746147205.965941:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.965958:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147205.966668:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.966828:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310187008 00000100:00100000:1.0:1746147205.966835:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310187008 00010000:00010000:1.0:1746147205.966870:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x3139939425061880 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e414 expref: 29 pid: 16099 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.966912:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310187136 00000100:00100000:1.0:1746147205.966915:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310187136 00010000:00010000:1.0:1746147205.966927:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098226a00/0x3139939425061841 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e406 expref: 8 pid: 7238 timeout: 843 lvb_type: 0 00000100:00100000:1.0:1746147205.966948:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8788 00000100:00100000:1.0:1746147205.966955:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310187008:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.966969:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.966974:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x3139939425061880 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e414 expref: 29 pid: 16099 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.966984:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x3139939425061880 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e414 expref: 29 pid: 16099 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.967006:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99200/0x3139939425061880 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e414 expref: 29 pid: 16099 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.967021:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147205.967026:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.967033:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147205.967038:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147205.967043:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.967048:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.967109:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310187008:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 155us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.967119:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8788 00000100:00100000:1.0:1746147205.967135:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8789 00000100:00100000:1.0:1746147205.967140:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2001:x1830967310187136:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147205.967147:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147205.967151:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098226a00/0x3139939425061841 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e406 expref: 8 pid: 7238 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.967159:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098226a00/0x3139939425061841 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e406 expref: 8 pid: 7238 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.967171:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098226a00/0x3139939425061841 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e406 expref: 8 pid: 7238 timeout: 843 lvb_type: 0 00010000:00010000:1.0:1746147205.967178:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147205.967182:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.967186:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147205.967192:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147205.967199:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147205.967205:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.967210:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.967227:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147205.967242:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2001:x1830967310187136:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 101us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.967247:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8789 00000100:00100000:1.0:1746147205.967267:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310187392 00000100:00100000:1.0:1746147205.967276:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310187392 00002000:00100000:1.0:1746147205.967305:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880094184000 x1830967310187392/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/0 e 0 to 0 dl 1746147216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147205.967315:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094184000 with x1830967310187392 ext(0->1048575) 00002000:00010000:1.0:1746147205.967320:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094184000 00000100:00100000:1.0:1746147205.967334:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7118 00000100:00100000:1.0:1746147205.967338:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967310187392:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:3.0:1746147205.967574:0:7239:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7239 initiator: MDT0 00010000:00010000:3.0:1746147205.967582:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7239 initiator: MDT0 00000040:00080000:3.0:1746147205.968870:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1181, 88 off111776 00000004:00080000:3.0:1746147205.968878:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743958788280ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147205.969702:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1189, 88 off112480 00000004:00080000:3.0:1746147205.969714:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743959623902ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147205.969728:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1190, 88 off112568 00000004:00080000:3.0:1746147205.969731:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743959641657ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147205.969741:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1182, 88 off111864 00000004:00080000:3.0:1746147205.969755:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743959665143ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147205.969765:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1183, 88 off111952 00000004:00080000:3.0:1746147205.969767:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743959677945ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147205.969775:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1191, 88 off112656 00000004:00080000:3.0:1746147205.969778:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743959688430ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147205.969785:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1192, 88 off112744 00000004:00080000:3.0:1746147205.969788:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743959698373ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147205.969795:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1193, 88 off112832 00000004:00080000:3.0:1746147205.969799:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743959709280ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147205.969806:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1184, 88 off112040 00000004:00080000:3.0:1746147205.969809:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743959719892ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147205.969817:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1194, 88 off112920 00000004:00080000:3.0:1746147205.969819:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743959729987ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147205.969827:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1185, 88 off112128 00000004:00080000:3.0:1746147205.969829:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743959740115ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147205.969839:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1195, 88 off113008 00000004:00080000:3.0:1746147205.969842:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743959752725ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147205.969849:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1186, 88 off112216 00000004:00080000:3.0:1746147205.969852:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743959762415ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147205.969859:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1187, 88 off112304 00000004:00080000:3.0:1746147205.969862:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743959773045ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147205.969870:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1188, 88 off112392 00000004:00080000:3.0:1746147205.969872:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743959782800ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147205.969879:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1189, 88 off112480 00000004:00080000:3.0:1746147205.969882:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743959792473ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147205.969890:0:7239:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1196, 88 off113096 00000004:00080000:3.0:1746147205.969892:0:7239:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743959802935ns, next at 694367916532ns, rc = 0 00000001:00080000:3.0:1746147205.975279:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937232 is committed 00000004:00080000:3.0:1746147205.975291:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1174 committed 00000004:00080000:3.0:1746147205.975330:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1170 committed 00000004:00080000:3.0:1746147205.975343:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1169 committed 00000004:00080000:3.0:1746147205.975345:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1168 committed 00000004:00080000:3.0:1746147205.975347:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1167 committed 00000004:00080000:3.0:1746147205.975350:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1173 committed 00000004:00080000:3.0:1746147205.975352:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1166 committed 00000004:00080000:3.0:1746147205.975355:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1172 committed 00000004:00080000:3.0:1746147205.975357:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1165 committed 00000004:00080000:3.0:1746147205.975358:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1171 committed 00000004:00080000:3.0:1746147205.975360:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1170 committed 00000004:00080000:3.0:1746147205.975361:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1169 committed 00000004:00080000:3.0:1746147205.975362:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1164 committed 00000004:00080000:3.0:1746147205.975364:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1163 committed 00000004:00080000:3.0:1746147205.975365:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1168 committed 00000004:00080000:3.0:1746147205.975366:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1167 committed 00000004:00080000:3.0:1746147205.975368:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1162 committed 00000001:00080000:3.0:1746147205.975373:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937231 is committed 00000001:00080000:3.0:1746147205.975385:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937227 is committed 00010000:00010000:3.0:1746147205.975453:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e429 expref: 11 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.975466:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147205.975468:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746147205.975472:0:7239:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.975480:0:7239:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.975486:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147205.976493:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098226200/0x31399394250618bf lrc: 0/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e429 expref: 11 pid: 7239 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746147205.976512:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e429 expref: 10 pid: 7239 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147205.976549:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311390464:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147205.976614:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147205.976678:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311390464 00000100:00100000:3.0:1746147205.976685:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311390464 00000100:00100000:3.0:1746147205.976721:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19379 00000100:00100000:3.0:1746147205.976728:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3765:x1830967311390464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147205.976880:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147205.976883:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147205 -> 1746147205 00002000:00010000:3.0:1746147205.976885:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147205 -> 1746147205 00002000:00010000:3.0:1746147205.976888:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147205 -> 1746147205 00002000:00010000:3.0:1746147205.976890:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147205.976916:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3765:x1830967311390464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 187us (301us total) trans 17179875130 rc 0/0 00000100:00100000:3.0:1746147205.976922:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19379 00000004:00080000:3.0:1746147205.976958:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094184380/2, rc 0, transno 17179875130 00000100:00100000:3.0:1746147205.976963:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311390464:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147205.976981:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098226800, rc 0) 00000100:00100000:3.0:1746147205.977022:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2673:x1830967310186368:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 18938us (20671us total) trans 8589937232 rc 0/0 00000100:00100000:3.0:1746147205.977033:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16352 00010000:00010000:1.0:1746147205.978917:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.978932:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147205.978989:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:1.0:1746147205.978994:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147205.979015:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147205.979052:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x31399394250618b8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e430 expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.979078:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e430 expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.979104:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147205.979107:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746147205.979109:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974a7c00, rc 0) 00000100:00100000:1.0:1746147205.979152:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2677:x1830967310186496:12345-192.168.204.25@tcp:101:cat.0 Request processed in 21004us (21388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.979159:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16353 00000100:00100000:3.0:1746147205.983301:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311390592:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147205.983369:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147205.983430:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311390592 00000100:00100000:3.0:1746147205.983438:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311390592 00000100:00100000:3.0:1746147205.983475:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19380 00000100:00100000:3.0:1746147205.983482:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3766:x1830967311390592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.983724:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00002000:00010000:3.0:1746147205.983730:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:2.0:1746147205.983731:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009689ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311390720:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147205.983734:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147205 -> 1746147205 00002000:00010000:3.0:1746147205.983736:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147205 -> 1746147205 00002000:00010000:3.0:1746147205.983738:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147205 -> 1746147205 00002000:00010000:3.0:1746147205.983740:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:2.0:1746147205.983763:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147205.984029:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3766:x1830967311390592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 547us (659us total) trans 21474842515 rc 0/0 00000100:00100000:3.0:1746147205.984036:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19380 00000100:00100000:3.0:1746147205.984050:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311390720 00000100:00100000:3.0:1746147205.984053:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311390720 00000100:00100000:3.0:1746147205.984068:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19381 00000100:00100000:3.0:1746147205.984072:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3766:x1830967311390720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147205.984135:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147205.984137:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147205 -> 1746147205 00002000:00010000:3.0:1746147205.984139:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147205 -> 1746147205 00002000:00010000:3.0:1746147205.984141:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147205 -> 1746147205 00002000:00010000:3.0:1746147205.984143:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147205.984161:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:3766:x1830967311390720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (396us total) trans 21474842516 rc 0/0 00000100:00100000:3.0:1746147205.984166:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19381 00000004:00080000:2.0:1746147205.984334:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009689ad80/2, rc 0, transno 21474842516 00000100:00100000:2.0:1746147205.984340:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009689ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311390720:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147205.984347:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096898e00/2, rc 0, transno 21474842515 00000100:00100000:2.0:1746147205.984349:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311390592:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147205.984361:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746147205.984368:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311390848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147205.984391:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147205.984395:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311391104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147205.984411:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311390976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.984414:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147205.984429:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311391616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147205.984431:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147205.984703:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311391488:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.984705:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147205.984720:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147205.984723:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746147205.984727:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311391232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147205.984733:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746147205.984737:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311391360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.984751:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147205.984764:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311390848 00000100:00100000:3.0:1746147205.984767:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311390848 00000100:00100000:2.0:1746147205.984776:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311391104 00000100:00100000:2.0:1746147205.984779:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311391104 00000100:00100000:3.0:1746147205.984781:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311390976 00000100:00100000:3.0:1746147205.984783:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311390976 00000100:00100000:3.0:1746147205.984793:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311391616 00000100:00100000:3.0:1746147205.984795:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311391616 00000100:00100000:2.0:1746147205.984798:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311391488 00000100:00100000:2.0:1746147205.984800:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311391488 00000100:00100000:3.0:1746147205.984805:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311391232 00000100:00100000:3.0:1746147205.984807:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311391232 00000100:00100000:2.0:1746147205.984813:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19382 00000100:00100000:2.0:1746147205.984818:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+66:3765:x1830967311390848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147205.984819:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19383 00000100:00100000:3.0:1746147205.984823:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3765:x1830967311390976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147205.984860:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19384 00000100:00100000:3.0:1746147205.984864:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+66:3766:x1830967311391104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.984864:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19385 00000100:00100000:2.0:1746147205.984869:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+66:3766:x1830967311391616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147205.984890:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19386 00000100:00100000:3.0:1746147205.984894:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3765:x1830967311391488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.984903:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19387 00000100:00100000:2.0:1746147205.984908:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3766:x1830967311391232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147205.984932:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147205.984950:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311391360 00000100:00100000:3.0:1746147205.984952:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311391360 00000100:00100000:3.0:1746147205.984967:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19388 00000100:00100000:3.0:1746147205.984971:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+67:3765:x1830967311391360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147205.985689:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:0.0:1746147205.985693:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147205.985695:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147205.985696:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147205.985698:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:0.0:1746147205.985726:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3765:x1830967311391488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 831us (1004us total) trans 21474842517 rc 0/0 00000100:00100000:0.0:1746147205.985732:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19386 00000100:00100000:1.0:1746147205.986129:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311391872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147205.986163:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147205.986196:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311391872 00000100:00100000:0.0:1746147205.986201:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311391872 00000100:00100000:1.0:1746147205.986202:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311392384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147205.986219:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147205.986224:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311392384 00000100:00100000:0.0:1746147205.986226:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311392384 00000100:00100000:1.0:1746147205.986232:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746147205.986236:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311392000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147205.986237:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19389 00000100:00100000:0.0:1746147205.986241:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+47:3764:x1830967311391872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147205.986249:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147205.986257:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311392512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147205.986270:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147205.986286:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311392000 00000100:00100000:1.0:1746147205.986289:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311392000 00000100:00100000:1.0:1746147205.986305:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311392512 00000100:00100000:1.0:1746147205.986307:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311392512 00000100:00100000:1.0:1746147205.986314:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19390 00000100:00100000:1.0:1746147205.986319:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3764:x1830967311392384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147205.986319:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147205.986322:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147205 -> 1746147205 00002000:00010000:0.0:1746147205.986324:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147205 -> 1746147205 00002000:00010000:0.0:1746147205.986325:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147205 -> 1746147205 00002000:00010000:0.0:1746147205.986327:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746147205.986350:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3764:x1830967311391872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (187us total) trans 17179875131 rc 0/0 00000100:00100000:0.0:1746147205.986355:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19389 00000100:00100000:0.0:1746147205.986366:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19391 00000100:00100000:0.0:1746147205.986370:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3764:x1830967311392000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147205.986373:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3764:x1830967311392384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (153us total) trans 17179875132 rc 0/0 00000100:00100000:1.0:1746147205.986379:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19390 00000100:00100000:1.0:1746147205.986386:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19392 00000100:00100000:1.0:1746147205.986390:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3764:x1830967311392512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147205.986413:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147205.986415:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147205.986417:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147205.986419:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147205.986420:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746147205.986433:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3764:x1830967311392000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (184us total) trans 17179875133 rc 0/0 00000100:00100000:0.0:1746147205.986438:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19391 00000100:00100000:1.0:1746147205.986444:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3764:x1830967311392512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (159us total) trans 17179875134 rc 0/0 00000100:00100000:1.0:1746147205.986449:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19392 00000004:00080000:1.0:1746147205.986475:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b6f100/2, rc 0, transno 17179875133 00000100:00100000:1.0:1746147205.986480:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311392000:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147205.986486:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b6c380/2, rc 0, transno 17179875134 00000100:00100000:1.0:1746147205.986488:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311392512:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147205.986493:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094185c00/2, rc 0, transno 17179875131 00000100:00100000:1.0:1746147205.986496:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094185c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311391872:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147205.986500:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b6c700/2, rc 0, transno 17179875132 00000100:00100000:1.0:1746147205.986502:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311392384:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147205.986970:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+68:3766:x1830967311391232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2061us (2226us total) trans 21474842518 rc 0/0 00000100:00100000:2.0:1746147205.986977:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19387 00000100:00100000:2.0:1746147205.987035:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+69:3766:x1830967311391616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2166us (2329us total) trans 21474842520 rc 0/0 00000100:00100000:3.0:1746147205.987036:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+69:3766:x1830967311391104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2171us (2620us total) trans 21474842519 rc 0/0 00000100:00100000:2.0:1746147205.987040:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19385 00000100:00100000:3.0:1746147205.987536:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19384 00000100:00100000:3.0:1746147205.987577:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094187800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311391744:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147205.987590:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:2.0:1746147205.987593:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147205 -> 1746147205 00002000:00010000:2.0:1746147205.987594:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147205 -> 1746147205 00002000:00010000:2.0:1746147205.987596:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147205 -> 1746147205 00002000:00010000:2.0:1746147205.987598:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:3.0:1746147205.987601:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147205.987616:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+69:3765:x1830967311390848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2798us (3225us total) trans 21474842521 rc 0/0 00000100:00100000:2.0:1746147205.987622:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19382 00000100:00100000:2.0:1746147205.987631:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311391744 00000100:00100000:2.0:1746147205.987635:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311391744 00000100:00100000:3.0:1746147205.987637:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311392256:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147205.987654:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19393 00000100:00100000:3.0:1746147205.987655:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147205.987659:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3767:x1830967311391744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147205.987667:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746147205.987671:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311392128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147205.987684:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147205.987700:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311392256 00000100:00100000:3.0:1746147205.987702:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311392256 00002000:00010000:2.0:1746147205.987714:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:3.0:1746147205.987715:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311392128 00002000:00010000:2.0:1746147205.987716:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147205 -> 1746147205 00000100:00100000:3.0:1746147205.987717:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311392128 00002000:00010000:2.0:1746147205.987718:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147205 -> 1746147205 00002000:00010000:2.0:1746147205.987720:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147205 -> 1746147205 00002000:00010000:2.0:1746147205.987722:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746147205.987726:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19394 00000100:00100000:3.0:1746147205.987730:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3767:x1830967311392256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147205.987741:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+53:3767:x1830967311391744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (139us total) trans 17179875135 rc 0/0 00000100:00100000:2.0:1746147205.987758:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19393 00000100:00100000:2.0:1746147205.987767:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19395 00000100:00100000:2.0:1746147205.987771:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+52:3767:x1830967311392128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147205.987786:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:3.0:1746147205.987789:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147205.987791:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147205.987792:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147205.987794:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:3.0:1746147205.987812:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3767:x1830967311392256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (157us total) trans 17179875136 rc 0/0 00000100:00100000:2.0:1746147205.987812:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+54:3767:x1830967311392128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (127us total) trans 17179875137 rc 0/0 00000100:00100000:2.0:1746147205.987817:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19395 00000100:00100000:3.0:1746147205.987819:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19394 00000004:00080000:3.0:1746147205.987838:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b6ca80/2, rc 0, transno 17179875137 00000004:00080000:2.0:1746147205.987841:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e58a80/2, rc 0, transno 21474842517 00000100:00100000:3.0:1746147205.987842:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311392128:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147205.987844:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311391488:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147205.987847:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094187800/2, rc 0, transno 17179875135 00000100:00100000:3.0:1746147205.987849:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094187800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311391744:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147205.987851:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e59880/2, rc 0, transno 21474842521 00000004:00080000:3.0:1746147205.987854:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b6ea00/2, rc 0, transno 17179875136 00000100:00100000:2.0:1746147205.987854:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311390848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147205.987857:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311392256:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147205.987869:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e5a680/2, rc 0, transno 21474842518 00000100:00100000:2.0:1746147205.987871:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311391232:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147205.987878:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e5b100/2, rc 0, transno 21474842519 00000100:00100000:2.0:1746147205.987880:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311391104:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147205.987885:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8b2300/2, rc 0, transno 21474842520 00000100:00100000:2.0:1746147205.987888:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311391616:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147205.987894:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147205.987897:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147205.987898:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147205.987899:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147205.987901:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:3.0:1746147205.987986:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+69:3765:x1830967311391360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3014us (3052us total) trans 21474842523 rc 0/0 00000100:00100000:3.0:1746147205.987991:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19388 00000004:00080000:2.0:1746147205.988063:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e58e00/2, rc 0, transno 21474842523 00000100:00100000:2.0:1746147205.988066:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311391360:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147205.988218:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147205.988220:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147205.988222:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147205.988224:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147205.988226:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:0.0:1746147205.988705:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3765:x1830967311390976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3879us (4272us total) trans 21474842522 rc 0/0 00000100:00100000:0.0:1746147205.988711:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19383 00000004:00080000:2.0:1746147205.988826:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e5b800/2, rc 0, transno 21474842522 00000100:00100000:2.0:1746147205.988831:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311390976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147205.988849:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967310187392:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21508us (22179us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147205.988861:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7118 00002000:00100000:1.0:1746147205.988871:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880094184000 x1830967310187392/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:581/0 lens 488/440 e 0 to 0 dl 1746147216 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147205.988884:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094184000 with x1830967310187392 ext(0->1048575) 00002000:00010000:1.0:1746147205.988890:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094184000 00000001:00080000:0.0:1746147205.989354:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842516 is committed 00000001:00080000:0.0:1746147205.989381:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842505 is committed 00000001:00080000:0.0:1746147205.989401:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842492 is committed 00000001:00080000:0.0:1746147205.989407:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842491 is committed 00000100:00100000:0.0:1746147205.989864:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.991362:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310187520 00000100:00100000:2.0:1746147205.991373:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310187520 00000100:00100000:2.0:1746147205.991416:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19396 00000100:00100000:2.0:1746147205.991424:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2673:x1830967310187520:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147205.991440:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147205.991459:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x31399394250618db lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e43e expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.991489:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x31399394250617df lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ff expref: 21 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147205.991496:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.991498:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147205.991502:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x31399394250618db lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3289088->3645439] (req 3289088->3645439) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e43e expref: 20 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.991531:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x31399394250617df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ff expref: 21 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147205.991542:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x31399394250617df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ff expref: 21 pid: 9585 timeout: 843 lvb_type: 1 00000100:00100000:2.0:1746147205.991558:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311392640:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147205.991626:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147205.995675:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.995714:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310187648 00000100:00100000:3.0:1746147205.995723:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310187648 00000100:00100000:3.0:1746147205.995787:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19397 00000100:00100000:3.0:1746147205.995796:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+5:2000:x1830967310187648:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147205.995820:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.995841:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093714e00/0x31399394250618e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e445 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.995960:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.995963:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.995975:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093714e00/0x31399394250618e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e445 expref: 6 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.995997:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093714e00/0x31399394250618e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e445 expref: 6 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.996009:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093714e00, rc 0) 00000100:00100000:3.0:1746147205.996072:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+6:2000:x1830967310187648:12345-192.168.204.25@tcp:101:cat.0 Request processed in 277us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147205.996078:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19397 00000100:00100000:3.0:1746147205.996140:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.996465:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.996479:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.996708:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147205.996899:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147205.996922:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310187776 00000100:00100000:1.0:1746147205.996926:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310187776 00000100:00100000:1.0:1746147205.996959:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310187904 00000100:00100000:1.0:1746147205.996961:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310187904 00000100:00100000:1.0:1746147205.996971:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310188032 00000100:00100000:1.0:1746147205.996973:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310188032 00000100:00100000:1.0:1746147205.996982:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310188160 00000100:00100000:1.0:1746147205.996983:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310188160 00000100:00100000:1.0:1746147205.996995:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19398 00000100:00100000:1.0:1746147205.997001:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310187776:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147205.997010:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147205.997022:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093709a00/0x31399394250618e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e44c expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.997036:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.997038:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.997044:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093709a00/0x31399394250618e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e44c expref: 23 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.997054:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093709a00/0x31399394250618e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e44c expref: 23 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.997062:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093709a00, rc 0) 00000100:00100000:1.0:1746147205.997085:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310187776:12345-192.168.204.25@tcp:101:cat.0 Request processed in 84us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.997109:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19398 00000100:00100000:1.0:1746147205.997121:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19399 00000100:00100000:1.0:1746147205.997125:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310187904:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147205.997131:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147205.997138:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250618f0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e453 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.997150:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.997151:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.997156:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250618f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e453 expref: 23 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.997165:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250618f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e453 expref: 23 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.997172:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093709c00, rc 0) 00000100:00100000:1.0:1746147205.997186:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310187904:12345-192.168.204.25@tcp:101:cat.0 Request processed in 61us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.997191:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19399 00000100:00100000:1.0:1746147205.997199:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19400 00000100:00100000:1.0:1746147205.997203:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2000:x1830967310188032:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147205.997209:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147205.997216:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093709600/0x31399394250618f7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e45a expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.997226:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.997227:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.997230:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093709600/0x31399394250618f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e45a expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.997239:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093709600/0x31399394250618f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e45a expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.997246:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093709600, rc 0) 00000100:00100000:1.0:1746147205.997257:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310188032:12345-192.168.204.25@tcp:101:cat.0 Request processed in 53us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.997264:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19400 00000100:00100000:1.0:1746147205.997272:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19401 00000100:00100000:1.0:1746147205.997276:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2000:x1830967310188160:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147205.997280:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147205.997285:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093709000/0x31399394250618fe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e461 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147205.997294:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.997295:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147205.997298:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093709000/0x31399394250618fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e461 expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.997307:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093709000/0x31399394250618fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e461 expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147205.997313:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093709000, rc 0) 00000100:00100000:1.0:1746147205.997324:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310188160:12345-192.168.204.25@tcp:101:cat.0 Request processed in 48us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147205.997328:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19401 00000100:00100000:3.0:1746147205.998440:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310188288 00000100:00100000:3.0:1746147205.998446:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310188288 00000100:00100000:3.0:1746147205.998482:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19402 00000100:00100000:3.0:1746147205.998489:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310188288:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147205.998498:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147205.998507:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x3139939425061905 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e468 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147205.998520:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147205.998528:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x3139939425061905 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e468 expref: 24 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.998536:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x3139939425061905 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e468 expref: 24 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147205.998554:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093714c00, rc 0) 00000100:00100000:3.0:1746147205.998579:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310188288:12345-192.168.204.25@tcp:101:cat.0 Request processed in 91us (1680us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147205.998584:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19402 00000100:00100000:0.0:1746147205.999699:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147205.999800:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311392640:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147205.999826:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x31399394250618db lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3289088->3645439] (req 3289088->3645439) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e43e expref: 22 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147205.999838:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38e600, rc 0) 00000100:00100000:2.0:1746147205.999866:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2673:x1830967310187520:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8443us (10004us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147205.999873:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19396 00000100:00100000:3.0:1746147205.999882:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310188416 00000100:00100000:3.0:1746147205.999887:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310188416 00010000:00010000:3.0:1746147205.999911:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x31399394250617df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ff expref: 22 pid: 9585 timeout: 843 lvb_type: 1 00000100:00100000:0.0:1746147205.999967:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.000173:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310188544 00000100:00100000:2.0:1746147206.000177:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310188544 00000100:00100000:2.0:1746147206.000206:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19403 00000100:00100000:2.0:1746147206.000212:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2678:x1830967310188544:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.000221:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.000231:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x313993942506190c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e46f expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.000247:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.000249:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.000255:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x313993942506190c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e46f expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.000266:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x313993942506190c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e46f expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.000277:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38fe00, rc 0) 00000100:00100000:2.0:1746147206.000292:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2678:x1830967310188544:12345-192.168.204.25@tcp:101:cat.0 Request processed in 81us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.000296:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19403 00000100:00080000:2.0:1746147206.000309:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147206.000381:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8790 00000100:00100000:3.0:1746147206.000387:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2003:x1830967310188416:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147206.000397:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147206.000416:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x31399394250617df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ff expref: 22 pid: 9585 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746147206.000428:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x31399394250617df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ff expref: 22 pid: 9585 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746147206.000445:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x31399394250617df lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ff expref: 22 pid: 9585 timeout: 843 lvb_type: 1 00010000:00010000:3.0:1746147206.000455:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.000457:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.000461:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x31399394250618db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->3645439) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e43e expref: 21 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.000472:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x31399394250618db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->3645439) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e43e expref: 21 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.000499:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x31399394250618db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->3645439) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e43e expref: 21 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.000512:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095060700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311392768:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147206.000572:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.002290:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.002345:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310188672 00000100:00100000:1.0:1746147206.002352:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310188672 00000100:00100000:1.0:1746147206.002406:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16354 00000100:00100000:1.0:1746147206.002413:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2678:x1830967310188672:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147206.002433:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147206.002452:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093708600/0x3139939425061913 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e476 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.002519:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093708600/0x3139939425061913 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e476 expref: 27 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.002532:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093708600/0x3139939425061913 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e476 expref: 27 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.002548:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147206.002552:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147206.002555:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093708600, rc 0) 00000100:00100000:1.0:1746147206.002589:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2678:x1830967310188672:12345-192.168.204.25@tcp:101:cat.0 Request processed in 176us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147206.002594:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16354 00000100:00100000:0.0:1746147206.002645:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.002674:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310188928 00000100:00100000:1.0:1746147206.002677:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310188928 00002000:00100000:1.0:1746147206.003012:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (3289088->3293183) req@ffff88009514c380 x1830967310188928/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.003021:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514c380 with x1830967310188928 ext(3289088->3293183) 00002000:00010000:1.0:1746147206.003025:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009514c380 00000100:00100000:2.0:1746147206.003247:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095060700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311392768:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147206.003262:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147206.003288:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2003:x1830967310188416:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2901us (3594us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.003295:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8790 00000100:00100000:1.0:1746147206.003529:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7119 00000100:00100000:1.0:1746147206.003535:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2002:x1830967310188928:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147206.003661:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2002:x1830967310188928:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 125us (1015us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147206.003667:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7119 00002000:00100000:1.0:1746147206.003672:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (3289088->3293183) req@ffff88009514c380 x1830967310188928/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/4536 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.003684:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514c380 with x1830967310188928 ext(3289088->3293183) 00002000:00010000:1.0:1746147206.003686:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009514c380 00000100:00100000:0.0:1746147206.008003:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.008130:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310189184 00000100:00100000:3.0:1746147206.008140:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310189184 00002000:00100000:3.0:1746147206.008190:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88009514c700 x1830967310189184/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.008199:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514c700 with x1830967310189184 ext(1048576->2097151) 00002000:00010000:3.0:1746147206.008204:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009514c700 00000100:00100000:3.0:1746147206.008401:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7120 00000100:00100000:3.0:1746147206.008409:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310189184:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147206.012788:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.012987:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310189440 00000100:00100000:2.0:1746147206.012997:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310189440 00002000:00100000:2.0:1746147206.013046:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (3641344->3645439) req@ffff880095149500 x1830967310189440/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.013057:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095149500 with x1830967310189440 ext(3641344->3645439) 00002000:00010000:2.0:1746147206.013063:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095149500 00000100:00100000:2.0:1746147206.013501:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7121 00000100:00100000:2.0:1746147206.013509:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2002:x1830967310189440:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147206.014469:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2002:x1830967310189440:12345-192.168.204.25@tcp:3:cat.0 Request processed in 957us (1690us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147206.014478:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7121 00002000:00100000:2.0:1746147206.014485:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (3641344->3645439) req@ffff880095149500 x1830967310189440/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/4536 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.014492:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095149500 with x1830967310189440 ext(3641344->3645439) 00002000:00010000:2.0:1746147206.014496:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095149500 00000100:00100000:3.0:1746147206.014602:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.014650:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310189696 00000100:00100000:2.0:1746147206.014654:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310189696 00000100:00080000:2.0:1746147206.014675:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1746147206.014694:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880095060a80 x1830967310189696/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.014701:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095060a80 with x1830967310189696 ext(0->1048575) 00002000:00010000:2.0:1746147206.014704:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095060a80 00000100:00100000:2.0:1746147206.014725:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7122 00000100:00100000:2.0:1746147206.014731:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310189696:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147206.015049:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.015077:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.015103:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310189952 00000100:00100000:1.0:1746147206.015107:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310189952 00000100:00100000:3.0:1746147206.015113:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:1.0:1746147206.015125:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880095062680 x1830967310189952/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.015132:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095062680 with x1830967310189952 ext(1048576->2097151) 00002000:00010000:1.0:1746147206.015136:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095062680 00000100:00100000:1.0:1746147206.015145:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310190208 00000100:00100000:3.0:1746147206.015146:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310190464 00000100:00100000:1.0:1746147206.015147:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310190208 00000100:00100000:3.0:1746147206.015148:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310190464 00002000:00100000:1.0:1746147206.015157:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880095060700 x1830967310190208/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.015160:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800975a6680 x1830967310190464/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.015163:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095060700 with x1830967310190208 ext(1048576->2097151) 00002000:00010000:1.0:1746147206.015166:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095060700 00002000:00100000:3.0:1746147206.015172:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a6680 with x1830967310190464 ext(1048576->2097151) 00000100:00100000:1.0:1746147206.015174:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7123 00002000:00010000:3.0:1746147206.015176:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800975a6680 00000100:00100000:1.0:1746147206.015179:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310189952:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147206.015185:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7124 00000100:00100000:3.0:1746147206.015189:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310190208:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147206.016362:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7125 00000100:00100000:0.0:1746147206.016374:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310190464:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147206.022030:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310189184:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13609us (14025us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147206.022044:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7120 00002000:00100000:3.0:1746147206.022056:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88009514c700 x1830967310189184/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.022065:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514c700 with x1830967310189184 ext(1048576->2097151) 00002000:00010000:3.0:1746147206.022072:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009514c700 00000100:00100000:0.0:1746147206.023683:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.025996:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310190720 00000100:00100000:2.0:1746147206.026010:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310190720 00000100:00100000:2.0:1746147206.026661:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6090 00000100:00100000:2.0:1746147206.026670:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2673:x1830967310190720:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147206.026915:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2673:x1830967310190720:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 246us (3239us total) trans 8589937233 rc 0/0 00000100:00100000:2.0:1746147206.026922:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6090 00000100:00080000:3.0:1746147206.027106:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147206.028904:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2000:x1830967310190208:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13704us (13816us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147206.028915:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7124 00002000:00100000:3.0:1746147206.028927:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880095060700 x1830967310190208/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.028936:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095060700 with x1830967310190208 ext(1048576->2097151) 00002000:00010000:3.0:1746147206.028942:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095060700 00000100:00100000:1.0:1746147206.036592:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310189952:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21398us (21529us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147206.036605:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7123 00002000:00100000:1.0:1746147206.036618:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880095062680 x1830967310189952/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.036628:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095062680 with x1830967310189952 ext(1048576->2097151) 00002000:00010000:1.0:1746147206.036635:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095062680 00000100:00100000:0.0:1746147206.040574:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.040664:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310190848 00000100:00100000:2.0:1746147206.040675:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310190848 00000100:00100000:2.0:1746147206.040726:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19404 00000100:00100000:2.0:1746147206.040735:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2678:x1830967310190848:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.040766:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.040787:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x313993942506191a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e47d expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.040812:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.040814:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147206.040822:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310189696:12345-192.168.204.25@tcp:3:cat.0 Request processed in 26090us (26219us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746147206.040822:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x313993942506191a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e47d expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.040833:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7122 00010000:00010000:2.0:1746147206.040838:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x313993942506191a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e47d expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147206.040842:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880095060a80 x1830967310189696/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147206.040848:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9e00, rc 0) 00002000:00100000:3.0:1746147206.040852:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095060a80 with x1830967310189696 ext(0->1048575) 00002000:00010000:3.0:1746147206.040857:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095060a80 00000100:00100000:2.0:1746147206.040869:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2678:x1830967310190848:12345-192.168.204.25@tcp:101:cat.0 Request processed in 136us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.040874:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19404 00000100:00100000:3.0:1746147206.041244:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311393024:0@lo:400:kworker.0 00000100:00100000:3.0:1746147206.041283:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147206.041322:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746147206.041327:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3767:1830967311392896:0@lo:400:kworker.0 00000100:00100000:3.0:1746147206.041349:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147206.041942:0:9510:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311393024 00000100:00100000:3.0:1746147206.041946:0:9510:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311393024 00000100:00100000:3.0:1746147206.041973:0:9510:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:3.0:1746147206.041978:0:9510:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3767:x1830967311393024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147206.042009:0:9510:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3767:x1830967311393024:12345-0@lo:400:kworker.0 Request processed in 31us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.042014:0:9510:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:3.0:1746147206.042042:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311393024:0@lo:400:kworker.0 00000100:00100000:1.0:1746147206.042278:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3764:1830967311393152:0@lo:400:kworker.0 00000100:00100000:1.0:1746147206.042309:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147206.042597:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311393152 00000100:00100000:3.0:1746147206.042601:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311393152 00000100:00100000:3.0:1746147206.042626:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:3.0:1746147206.042631:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3764:x1830967311393152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.043541:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967311393280:0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.043581:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147206.043600:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3765:1830967311393792:0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.043618:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147206.043631:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311394304:0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.043647:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147206.043662:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746147206.043667:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3765:1830967311393664:0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.043682:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147206.043693:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311394176:0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.043706:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147206.043728:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311393792 00000100:00100000:2.0:1746147206.043732:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311393792 00000100:00100000:2.0:1746147206.043773:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311393664 00000100:00100000:2.0:1746147206.043775:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311393664 00000100:00100000:2.0:1746147206.043792:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:2.0:1746147206.043798:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3765:x1830967311393792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.043828:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3765:x1830967311393792:12345-0@lo:400:kworker.0 Request processed in 29us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.043834:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00000100:00100000:2.0:1746147206.043846:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:2.0:1746147206.043850:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3765:x1830967311393664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.043868:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3765:x1830967311393664:12345-0@lo:400:kworker.0 Request processed in 18us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.043873:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00100000:2.0:1746147206.043897:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3765:1830967311393664:0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.043905:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3765:1830967311393792:0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.043926:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311393280 00000100:00100000:2.0:1746147206.043928:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311393280 00000100:00100000:2.0:1746147206.043949:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311394304 00000100:00100000:2.0:1746147206.043951:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311394304 00000100:00100000:2.0:1746147206.043961:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311394176 00000100:00100000:2.0:1746147206.043963:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311394176 00000100:00100000:2.0:1746147206.043975:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:2.0:1746147206.043979:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c06c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3765:x1830967311393280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.044004:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c06c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3765:x1830967311393280:12345-0@lo:400:kworker.0 Request processed in 25us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.044009:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:2.0:1746147206.044152:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1746147206.044157:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+53:3765:x1830967311394304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.044181:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+53:3765:x1830967311394304:12345-0@lo:400:kworker.0 Request processed in 24us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.044186:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1746147206.044194:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:2.0:1746147206.044199:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3765:x1830967311394176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.044216:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3765:x1830967311394176:12345-0@lo:400:kworker.0 Request processed in 17us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.044220:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:2.0:1746147206.044246:0:3765:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474842516 gen 2 00000004:00080000:2.0:1746147206.044252:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db14380, transno 21474842435 00000004:00080000:2.0:1746147206.044259:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db17800, transno 21474842436 00000004:00080000:2.0:1746147206.044262:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db15f80, transno 21474842437 00000004:00080000:2.0:1746147206.044265:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db14700, transno 21474842438 00000004:00080000:2.0:1746147206.044268:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db14000, transno 21474842439 00000004:00080000:2.0:1746147206.044270:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db14e00, transno 21474842440 00000004:00080000:2.0:1746147206.044272:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db14a80, transno 21474842441 00000004:00080000:2.0:1746147206.044273:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db15500, transno 21474842442 00000004:00080000:2.0:1746147206.044276:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258ed80, transno 21474842443 00000004:00080000:2.0:1746147206.044278:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258fb80, transno 21474842445 00000004:00080000:2.0:1746147206.044280:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258dc00, transno 21474842446 00000004:00080000:2.0:1746147206.044282:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258f480, transno 21474842447 00000004:00080000:2.0:1746147206.044284:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cfb800, transno 21474842448 00000004:00080000:2.0:1746147206.044286:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258e680, transno 21474842449 00000004:00080000:2.0:1746147206.044288:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258ce00, transno 21474842450 00000004:00080000:2.0:1746147206.044290:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258f800, transno 21474842451 00000004:00080000:2.0:1746147206.044292:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258df80, transno 21474842452 00000004:00080000:2.0:1746147206.044294:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258c700, transno 21474842453 00000004:00080000:2.0:1746147206.044297:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cf9500, transno 21474842460 00000004:00080000:2.0:1746147206.044299:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cf8000, transno 21474842461 00000004:00080000:2.0:1746147206.044301:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cf9180, transno 21474842462 00000004:00080000:2.0:1746147206.044303:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cf8700, transno 21474842463 00000004:00080000:2.0:1746147206.044306:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cfb480, transno 21474842464 00000004:00080000:2.0:1746147206.044308:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cf9880, transno 21474842465 00000004:00080000:2.0:1746147206.044309:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cfbb80, transno 21474842466 00000004:00080000:2.0:1746147206.044311:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096cfad80, transno 21474842467 00000004:00080000:2.0:1746147206.044314:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fb100, transno 21474842468 00000004:00080000:2.0:1746147206.044316:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e487480, transno 21474842470 00000004:00080000:2.0:1746147206.044318:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e485f80, transno 21474842471 00000004:00080000:2.0:1746147206.044321:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e485500, transno 21474842472 00000004:00080000:2.0:1746147206.044323:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d74380, transno 21474842473 00000004:00080000:2.0:1746147206.044325:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e485c00, transno 21474842474 00000004:00080000:2.0:1746147206.044327:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312edc00, transno 21474842475 00000004:00080000:2.0:1746147206.044330:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e487b80, transno 21474842476 00000004:00080000:2.0:1746147206.044332:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e484380, transno 21474842477 00000004:00080000:2.0:1746147206.044334:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbc0e00, transno 21474842478 00000004:00080000:2.0:1746147206.044337:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca11880, transno 21474842493 00000004:00080000:2.0:1746147206.044340:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258ca80, transno 21474842494 00000004:00080000:2.0:1746147206.044342:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258c000, transno 21474842495 00000004:00080000:2.0:1746147206.044344:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258f100, transno 21474842496 00000004:00080000:2.0:1746147206.044346:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca10a80, transno 21474842497 00000004:00080000:2.0:1746147206.044348:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258d880, transno 21474842498 00000004:00080000:2.0:1746147206.044350:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801322eaa00, transno 21474842499 00000004:00080000:2.0:1746147206.044351:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258ea00, transno 21474842500 00000004:00080000:2.0:1746147206.044354:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801322ea300, transno 21474842501 00000004:00080000:2.0:1746147206.044356:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009988bb80, transno 21474842506 00000004:00080000:2.0:1746147206.044359:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f085880, transno 21474842507 00000004:00080000:2.0:1746147206.044361:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099888a80, transno 21474842508 00000004:00080000:2.0:1746147206.044364:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099889c00, transno 21474842509 00000004:00080000:2.0:1746147206.044366:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f085500, transno 21474842510 00000004:00080000:2.0:1746147206.044368:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db17480, transno 21474842511 00000004:00080000:2.0:1746147206.044371:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009689aa00, transno 21474842512 00000004:00080000:2.0:1746147206.044373:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011db16a00, transno 21474842513 00000004:00080000:2.0:1746147206.044375:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d95880, transno 21474842514 00000004:00080000:2.0:1746147206.044377:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096898e00, transno 21474842515 00000004:00080000:2.0:1746147206.044379:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009689ad80, transno 21474842516 00000100:00100000:2.0:1746147206.044386:0:3765:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880094e58a80 x1830967311391488/t21474842517(21474842517) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147221 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000100:00100000:2.0:1746147206.044394:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311394176:0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.044404:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967311393280:0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.044413:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311394304:0@lo:400:kworker.0 00000004:00080000:2.0:1746147206.044754:0:8110:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 7 in progress, 0 in flight, 56 done 00000100:00080000:2.0:1746147206.044784:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746147206.044788:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1746147206.044790:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147206.044805:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3767:1830967311393536:0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.044830:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147206.044845:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311394048:0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.044862:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147206.044878:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1746147206.044883:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311393408:0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.044898:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147206.044908:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3767:1830967311393920:0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.044921:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147206.044930:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3767:1830967311394432:0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.044945:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147206.044961:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311393408 00000100:00100000:2.0:1746147206.044964:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311393408 00000100:00100000:2.0:1746147206.044982:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:2.0:1746147206.044986:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311393408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.045012:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311393408:12345-0@lo:400:kworker.0 Request processed in 25us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.045016:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:2.0:1746147206.045030:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311393536 00000100:00100000:2.0:1746147206.045033:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311393536 00000100:00100000:2.0:1746147206.045048:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311393920 00000100:00100000:2.0:1746147206.045050:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311393920 00000100:00100000:2.0:1746147206.045058:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311394432 00000100:00100000:2.0:1746147206.045059:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311394432 00000100:00100000:2.0:1746147206.045068:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:2.0:1746147206.045072:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3767:x1830967311393536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.045113:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3767:x1830967311393536:12345-0@lo:400:kworker.0 Request processed in 41us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.045118:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:2.0:1746147206.045126:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:2.0:1746147206.045130:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3767:x1830967311393920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.045148:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3767:x1830967311393920:12345-0@lo:400:kworker.0 Request processed in 18us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.045152:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:2.0:1746147206.045158:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:2.0:1746147206.045163:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3767:x1830967311394432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.045179:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3767:x1830967311394432:12345-0@lo:400:kworker.0 Request processed in 18us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.045183:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:2.0:1746147206.045202:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311393408:0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.045209:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3767:1830967311393920:0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.045215:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3767:1830967311394432:0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.045220:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3767:1830967311393536:0@lo:400:kworker.0 00000100:00080000:2.0:1746147206.045232:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1746147206.045234:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147206.045249:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311394048 00000100:00100000:2.0:1746147206.045251:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311394048 00000100:00100000:2.0:1746147206.045268:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:2.0:1746147206.045272:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3767:x1830967311394048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.045298:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3767:x1830967311394048:12345-0@lo:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.045303:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:2.0:1746147206.045322:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311394048:0@lo:400:kworker.0 00000100:00100000:3.0:1746147206.045418:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3764:x1830967311393152:12345-0@lo:400:kworker.0 Request processed in 2785us (3106us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.045425:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:1.0:1746147206.045442:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3764:1830967311393152:0@lo:400:kworker.0 00000100:00100000:1.0:1746147206.045465:0:8099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311392896 00000100:00100000:1.0:1746147206.045468:0:8099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311392896 00000100:00100000:1.0:1746147206.045493:0:8099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1746147206.045498:0:8099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3767:x1830967311392896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147206.045541:0:8099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3767:x1830967311392896:12345-0@lo:400:kworker.0 Request processed in 42us (4190us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147206.045546:0:8099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1746147206.045583:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3767:1830967311392896:0@lo:400:kworker.0 00000100:00100000:2.0:1746147206.047999:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310190464:12345-192.168.204.25@tcp:3:cat.0 Request processed in 31614us (32870us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147206.048014:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7125 00002000:00100000:2.0:1746147206.048029:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800975a6680 x1830967310190464/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.048039:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a6680 with x1830967310190464 ext(1048576->2097151) 00002000:00010000:2.0:1746147206.048047:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800975a6680 00000100:00100000:0.0:1746147206.052185:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.052733:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310191104 00000100:00100000:2.0:1746147206.052755:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310191104 00002000:00100000:2.0:1746147206.052813:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88009514d180 x1830967310191104/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.052823:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514d180 with x1830967310191104 ext(1048576->2097151) 00002000:00010000:2.0:1746147206.052830:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009514d180 00000100:00100000:2.0:1746147206.052957:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7126 00000100:00100000:2.0:1746147206.052968:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310191104:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147206.066259:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310191104:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13271us (14064us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147206.066273:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7126 00002000:00100000:2.0:1746147206.066285:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88009514d180 x1830967310191104/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.066295:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514d180 with x1830967310191104 ext(1048576->2097151) 00002000:00010000:2.0:1746147206.066301:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009514d180 00000100:00100000:0.0:1746147206.066694:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.066731:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.066957:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310191360 00000100:00100000:3.0:1746147206.066966:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310191360 00002000:00100000:3.0:1746147206.067000:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009514d500 x1830967310191360/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.067007:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514d500 with x1830967310191360 ext(2097152->4194303) 00002000:00010000:3.0:1746147206.067011:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514d500 00000100:00100000:3.0:1746147206.067038:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310191616 00000100:00100000:3.0:1746147206.067041:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310191616 00002000:00100000:3.0:1746147206.067053:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88009514d880 x1830967310191616/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 504/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147206.067055:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7127 00002000:00100000:3.0:1746147206.067059:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514d880 with x1830967310191616 ext(2097152->4194303) 00002000:00010000:3.0:1746147206.067062:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009514d880 00000100:00100000:2.0:1746147206.067063:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310191360:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147206.067079:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7128 00000100:00100000:3.0:1746147206.067083:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310191616:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147206.071765:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.071995:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310191744 00000100:00100000:2.0:1746147206.072005:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310191744 00000100:00080000:3.0:1746147206.072075:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147206.072079:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19405 00000100:00100000:2.0:1746147206.072103:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+20:2678:x1830967310191744:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.072124:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.072143:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x3139939425061921 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e484 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.072169:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.072171:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.072180:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x3139939425061921 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e484 expref: 21 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.072203:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x3139939425061921 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e484 expref: 21 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.072214:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9800, rc 0) 00000100:00100000:2.0:1746147206.072255:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2678:x1830967310191744:12345-192.168.204.25@tcp:101:cat.0 Request processed in 169us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.072261:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19405 00000100:00100000:1.0:1746147206.073280:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746147206.073298:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311394560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746147206.073346:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147206.074525:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746147206.074535:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967311394688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746147206.074565:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147206.074591:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311394560 00000100:00100000:2.0:1746147206.074596:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311394560 00000100:00100000:2.0:1746147206.074630:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311394688 00000100:00100000:2.0:1746147206.074632:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311394688 00000100:00100000:3.0:1746147206.074638:0:9510:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:2.0:1746147206.074645:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1746147206.074647:0:9510:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3766:x1830967311394560:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1746147206.074648:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3765:x1830967311394688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1746147206.074675:0:9510:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445597184 avail 1316134912 00000004:00000024:2.0:1746147206.074675:0:7244:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445543936 avail 1316081664 00000100:00100000:2.0:1746147206.074706:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3765:x1830967311394688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.074712:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:2.0:1746147206.074756:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967311394688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746147206.074788:0:9510:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3766:x1830967311394560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.074793:0:9510:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:1.0:1746147206.074844:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311394560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746147206.084646:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.085161:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310192000 00000100:00100000:2.0:1746147206.085172:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310192000 00002000:00100000:2.0:1746147206.085218:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009514df80 x1830967310192000/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.085229:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514df80 with x1830967310192000 ext(1048576->2097151) 00002000:00010000:2.0:1746147206.085234:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514df80 00000100:00100000:2.0:1746147206.085269:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7129 00000100:00100000:2.0:1746147206.085277:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2000:x1830967310192000:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147206.086633:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310191360:12345-192.168.204.25@tcp:3:cat.0 Request processed in 19565us (19934us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147206.086643:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7127 00002000:00100000:3.0:1746147206.086651:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009514d500 x1830967310191360/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.086666:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514d500 with x1830967310191360 ext(2097152->4194303) 00002000:00010000:3.0:1746147206.086670:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514d500 00000100:00100000:3.0:1746147206.090230:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310191616:12345-192.168.204.25@tcp:3:cat.0 Request processed in 23133us (23486us total) trans 0 rc 1740800/1740800 00000100:00100000:3.0:1746147206.090244:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7128 00002000:00100000:3.0:1746147206.090256:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88009514d880 x1830967310191616/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 504/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1740800/1740800 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.090265:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514d880 with x1830967310191616 ext(2097152->4194303) 00002000:00010000:3.0:1746147206.090271:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009514d880 00000100:00100000:2.0:1746147206.091701:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2000:x1830967310192000:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6420us (7062us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147206.091712:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7129 00002000:00100000:2.0:1746147206.091719:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009514df80 x1830967310192000/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.091727:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514df80 with x1830967310192000 ext(1048576->2097151) 00002000:00010000:2.0:1746147206.091731:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514df80 00000100:00100000:0.0:1746147206.106528:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.106585:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.108634:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310192256 00000100:00100000:3.0:1746147206.108647:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310192256 00000100:00100000:3.0:1746147206.108695:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310192128 00000100:00100000:3.0:1746147206.108697:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310192128 00000100:00100000:3.0:1746147206.108716:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19406 00000100:00100000:3.0:1746147206.108723:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310192256:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147206.108768:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.108788:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425061928 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e492 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.108845:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311394816:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147206.110077:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19407 00000100:00100000:2.0:1746147206.110102:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2000:x1830967310192128:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.110116:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.110131:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506192f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e48b expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.110146:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.110148:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.110157:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506192f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e48b expref: 22 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.110177:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506192f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e48b expref: 22 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.110187:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9a00, rc 0) 00000100:00100000:3.0:1746147206.110913:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.111952:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.112024:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310192512 00000100:00100000:3.0:1746147206.112032:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310192512 00002000:00100000:3.0:1746147206.112073:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88009514ea00 x1830967310192512/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.112103:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514ea00 with x1830967310192512 ext(4194304->4890623) 00002000:00010000:3.0:1746147206.112109:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514ea00 00000100:00100000:3.0:1746147206.112133:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7130 00000100:00100000:3.0:1746147206.112141:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310192512:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147206.112710:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2000:x1830967310192128:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2620us (6120us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.112717:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19407 00002000:00010000:3.0:1746147206.118014:0:9585:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime: 1746147205 -> 1746147206 00000100:00100000:3.0:1746147206.118047:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311394816:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147206.118119:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425061928 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e492 expref: 31 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.118136:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425061928 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e492 expref: 31 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.118345:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715e00, rc 0) 00000100:00100000:3.0:1746147206.118403:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310192256:12345-192.168.204.25@tcp:101:cat.0 Request processed in 9679us (11884us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147206.118412:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19406 00000100:00100000:2.0:1746147206.118559:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310192512:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6418us (6611us total) trans 0 rc 696320/696320 00000100:00100000:2.0:1746147206.118568:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7130 00002000:00100000:2.0:1746147206.118577:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88009514ea00 x1830967310192512/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.118586:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514ea00 with x1830967310192512 ext(4194304->4890623) 00002000:00010000:2.0:1746147206.118590:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514ea00 00000100:00100000:0.0:1746147206.123009:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.123116:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310192768 00000100:00100000:2.0:1746147206.123126:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310192768 00002000:00100000:2.0:1746147206.123170:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88009514ed80 x1830967310192768/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.123179:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514ed80 with x1830967310192768 ext(2097152->3145727) 00002000:00010000:2.0:1746147206.123184:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514ed80 00000100:00100000:2.0:1746147206.123292:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7131 00000100:00100000:2.0:1746147206.123299:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967310192768:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147206.124045:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.124380:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310193024 00000100:00100000:1.0:1746147206.124384:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310193024 00000100:00100000:1.0:1746147206.124977:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6091 00000100:00100000:1.0:1746147206.124984:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2677:x1830967310193024:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147206.125197:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2677:x1830967310193024:12345-192.168.204.25@tcp:35:cat.0 Request processed in 212us (1152us total) trans 8589937234 rc 0/0 00000100:00100000:1.0:1746147206.125203:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6091 00000100:00100000:2.0:1746147206.134194:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967310192768:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10883us (11186us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147206.134207:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7131 00002000:00100000:2.0:1746147206.134219:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88009514ed80 x1830967310192768/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.134228:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514ed80 with x1830967310192768 ext(2097152->3145727) 00002000:00010000:2.0:1746147206.134234:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514ed80 00000100:00100000:3.0:1746147206.137272:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311394944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746147206.137342:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147206.138115:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098822d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311395072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746147206.138116:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311394944 00000100:00100000:1.0:1746147206.138124:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311394944 00000100:00100000:0.0:1746147206.138146:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147206.138161:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311395072 00000100:00100000:1.0:1746147206.138163:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311395072 00000100:00100000:1.0:1746147206.138178:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1746147206.138185:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+12:3765:x1830967311394944:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147206.138206:0:16752:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1746147206.138212:0:16752:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3766:x1830967311395072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746147206.138216:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1311630400 pending 0 free 3905277952 avail 3673755648 00002000:00000024:0.0:1746147206.138223:0:16752:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 380928 granted 1145807936 pending 3989504 free 3911233536 avail 3679711232 00000100:00100000:0.0:1746147206.138254:0:16752:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3766:x1830967311395072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147206.138260:0:16752:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1746147206.138304:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098822d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311395072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746147206.138658:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+12:3765:x1830967311394944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 472us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147206.138664:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1746147206.138693:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311394944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147206.142341:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.142392:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.142447:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310193152 00000100:00100000:3.0:1746147206.142448:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310193280 00000100:00100000:3.0:1746147206.142457:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310193280 00000100:00100000:2.0:1746147206.142457:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310193152 00000100:00100000:2.0:1746147206.142516:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19408 00000100:00100000:3.0:1746147206.142524:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19409 00000100:00100000:2.0:1746147206.142524:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2678:x1830967310193152:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:3.0:1746147206.142531:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2675:x1830967310193280:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147206.142540:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.142542:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.142559:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x3139939425061936 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e4a0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.142559:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x313993942506193d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e499 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.142586:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f400/0x31399394250617ed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3f8 expref: 10 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.142586:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x31399394250618db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->3645439) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e43e expref: 21 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.142594:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506192f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e48b expref: 23 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.142594:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147206.142596:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147206.142599:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x313993942506193d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e499 expref: 31 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.142601:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093709000/0x31399394250618fe lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e461 expref: 7 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.142606:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.142608:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.142610:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x3139939425061936 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [4063232->4194303] (req 4063232->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a0 expref: 23 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.142627:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x31399394250618db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->3645439) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e43e expref: 21 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.142629:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093709000/0x31399394250618fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e461 expref: 7 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.142640:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093709000/0x31399394250618fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e461 expref: 7 pid: 1854 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746147206.142640:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x31399394250618db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->3645439) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e43e expref: 21 pid: 9585 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.142651:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311395328:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.142653:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311395200:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147206.143176:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506192f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e48b expref: 23 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.143190:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506192f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e48b expref: 23 pid: 13695 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746147206.143199:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311395456:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147206.143228:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f400/0x31399394250617ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3f8 expref: 10 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.143236:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f400/0x31399394250617ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3f8 expref: 10 pid: 13712 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746147206.143244:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311395584:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147206.143262:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.143382:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.145676:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098820e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311395200:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.145708:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x313993942506193d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e499 expref: 31 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.145724:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9200, rc 0) 00000100:00100000:2.0:1746147206.145788:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2678:x1830967310193152:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3265us (3457us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.145797:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19408 00000100:00100000:3.0:1746147206.145875:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311395328:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147206.145885:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311395456:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147206.145894:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311395584:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147206.145921:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x3139939425061936 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [4063232->4194303] (req 4063232->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a0 expref: 23 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.145932:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715c00, rc 0) 00000100:00100000:3.0:1746147206.145954:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2675:x1830967310193280:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3424us (3561us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.145960:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19409 00000100:00100000:0.0:1746147206.148057:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.148187:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.148221:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.148293:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.148435:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310193536 00000100:00100000:3.0:1746147206.148446:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310193536 00010000:00010000:3.0:1746147206.148483:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506192f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e48b expref: 23 pid: 13695 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746147206.148508:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310193664 00000100:00100000:3.0:1746147206.148510:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310193664 00000100:00100000:1.0:1746147206.148525:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310193792 00000100:00100000:1.0:1746147206.148529:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310193792 00010000:00010000:3.0:1746147206.148531:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f400/0x31399394250617ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3f8 expref: 11 pid: 13712 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746147206.148547:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093709000/0x31399394250618fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e461 expref: 8 pid: 1854 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746147206.148549:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8791 00000100:00100000:3.0:1746147206.148556:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967310193536:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147206.148567:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8792 00010000:00010000:3.0:1746147206.148568:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147206.148573:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2002:x1830967310193664:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147206.148580:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147206.148588:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506192f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e48b expref: 23 pid: 13695 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746147206.148589:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f400/0x31399394250617ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3f8 expref: 11 pid: 13712 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746147206.148599:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506192f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e48b expref: 23 pid: 13695 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746147206.148653:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8793 00000100:00100000:2.0:1746147206.148660:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310193792:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147206.148668:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147206.148690:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f400/0x31399394250617ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3f8 expref: 11 pid: 13712 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746147206.148715:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506192f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e48b expref: 23 pid: 13695 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746147206.148735:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147206.148783:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2002:x1830967310193536:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 227us (595us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147206.148788:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093709000/0x31399394250618fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e461 expref: 8 pid: 1854 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746147206.148789:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8791 00010000:00010000:2.0:1746147206.148798:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093709000/0x31399394250618fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e461 expref: 8 pid: 1854 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746147206.148810:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093709000/0x31399394250618fe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e461 expref: 8 pid: 1854 timeout: 844 lvb_type: 1 00000100:00080000:3.0:1746147206.148815:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746147206.148824:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147206.148842:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2000:x1830967310193792:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 183us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.148848:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8793 00000100:00100000:2.0:1746147206.148875:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310193408 00000100:00100000:2.0:1746147206.148879:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310193408 00002000:00100000:2.0:1746147206.148907:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (3289088->3645439) req@ffff88009514c000 x1830967310193408/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.148916:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514c000 with x1830967310193408 ext(3289088->3645439) 00010000:00010000:2.0:1746147206.148923:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x31399394250618db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e43e expref: 22 pid: 9585 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.148933:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x31399394250618db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e43e expref: 22 pid: 9585 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746147206.148939:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009514c000 00000100:00100000:2.0:1746147206.148960:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1660 00000100:00100000:2.0:1746147206.148965:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310193408:12345-192.168.204.25@tcp:4:cat.0 00010000:00010000:1.0:1746147206.149247:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8f400/0x31399394250617ed lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3f8 expref: 11 pid: 13712 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746147206.149260:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147206.149261:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147206.149268:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x3139939425061936 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a0 expref: 21 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.149281:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x3139939425061936 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a0 expref: 21 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.149311:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x3139939425061936 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a0 expref: 21 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147206.149321:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311395712:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147206.149377:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147206.154208:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311395712:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147206.154235:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147206.154276:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2002:x1830967310193664:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5701us (6052us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147206.154288:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8792 00000100:00100000:2.0:1746147206.155172:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2001:x1830967310193408:12345-192.168.204.25@tcp:4:cat.0 Request processed in 6203us (7121us total) trans 17179875138 rc 0/0 00000100:00100000:2.0:1746147206.155182:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1660 00002000:00100000:2.0:1746147206.155192:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (3289088->3645439) req@ffff88009514c000 x1830967310193408/t17179875138(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/448 e 0 to 0 dl 1746147217 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.155202:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514c000 with x1830967310193408 ext(3289088->3645439) 00010000:00010000:2.0:1746147206.155213:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x31399394250618db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e43e expref: 24 pid: 9585 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.155232:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x31399394250618db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e43e expref: 24 pid: 9585 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746147206.155239:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009514c000 00000100:00100000:0.0:1746147206.155469:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.156483:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.156525:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310193920 00000100:00100000:3.0:1746147206.156533:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310193920 00000100:00100000:3.0:1746147206.156579:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19410 00000100:00100000:3.0:1746147206.156587:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2675:x1830967310193920:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147206.156604:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.156621:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57c1a00/0x3139939425061944 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e4a7 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.156646:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147206.156648:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147206.156652:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57c1a00/0x3139939425061944 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4030463] (req 3145728->4030463) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a7 expref: 32 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.156663:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57c1a00/0x3139939425061944 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4030463] (req 3145728->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a7 expref: 32 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.156674:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57c1a00, rc 0) 00000100:00100000:3.0:1746147206.156699:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2675:x1830967310193920:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 113us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.156705:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19410 00000100:00100000:1.0:1746147206.156946:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310194176 00000100:00100000:1.0:1746147206.156950:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310194176 00000100:00100000:1.0:1746147206.156976:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16355 00000100:00100000:1.0:1746147206.156980:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2682:x1830967310194176:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147206.156993:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147206.157005:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x313993942506194b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e4ae expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.157067:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425061952 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157078:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425061952 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157102:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425061952 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157111:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81800/0x3139939425061959 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157116:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81800/0x3139939425061959 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157121:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81800/0x3139939425061959 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157204:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81c00/0x3139939425061960 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157211:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81c00/0x3139939425061960 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157216:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81c00/0x3139939425061960 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147206.157223:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147206.157285:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425061952 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157290:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425061952 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157295:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425061952 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157299:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425061952 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157304:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096b81a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147206.157307:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425061952 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157313:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425061952 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157322:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147206.157324:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147206.157327:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425061952 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157332:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81a00/0x3139939425061952 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157341:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81800/0x3139939425061959 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157346:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81800/0x3139939425061959 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157351:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81800/0x3139939425061959 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157355:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096b81800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147206.157357:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81800/0x3139939425061959 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157362:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81800/0x3139939425061959 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157367:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093211400) 00010000:00010000:1.0:1746147206.157370:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147206.157371:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81800/0x3139939425061959 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157379:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81800/0x3139939425061959 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.157412:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80600/0x313993942506194b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ae expref: 14 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.157421:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81c00/0x3139939425061960 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ae expref: 13 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.157427:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147206.157429:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147206.157431:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81c00, rc 0) 00000100:00100000:1.0:1746147206.157454:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2682:x1830967310194176:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 473us (973us total) trans 8589937235 rc 0/0 00000100:00100000:1.0:1746147206.157460:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16355 00000100:00100000:0.0:1746147206.161505:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.161552:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310194304 00000100:00100000:1.0:1746147206.161561:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310194304 00010000:00010000:1.0:1746147206.161596:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x31399394250618db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3289088->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e43e expref: 24 pid: 9585 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746147206.161630:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8794 00000100:00100000:1.0:1746147206.161635:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2003:x1830967310194304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147206.161648:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147206.161664:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x31399394250618db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3289088->3645439) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e43e expref: 24 pid: 9585 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.161673:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x31399394250618db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3289088->3645439) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e43e expref: 24 pid: 9585 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.161691:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x31399394250618db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3289088->3645439) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e43e expref: 24 pid: 9585 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.161719:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147206.161721:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147206.161729:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x313993942506193d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e499 expref: 31 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.161737:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x313993942506193d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e499 expref: 31 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.161756:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147206.161757:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147206.161760:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57c1a00/0x3139939425061944 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a7 expref: 31 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.161766:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57c1a00/0x3139939425061944 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a7 expref: 31 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.161797:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57c1a00/0x3139939425061944 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a7 expref: 31 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147206.161857:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311395840:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147206.161960:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x313993942506193d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e499 expref: 31 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147206.161972:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311395968:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147206.161992:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147206.171534:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311395840:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147206.171546:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311395968:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147206.171572:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147206.171625:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2003:x1830967310194304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 9988us (10129us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147206.171638:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8794 00000100:00100000:0.0:1746147206.176013:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.176485:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.176819:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310194560 00000100:00100000:2.0:1746147206.176830:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310194560 00002000:00100000:2.0:1746147206.176878:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (4026368->4030463) req@ffff88012b8b0a80 x1830967310194560/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.176888:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b0a80 with x1830967310194560 ext(4026368->4030463) 00002000:00010000:2.0:1746147206.176894:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8b0a80 00000100:00100000:2.0:1746147206.176915:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310194944 00000100:00100000:2.0:1746147206.176917:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310194944 00002000:00100000:2.0:1746147206.176926:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3145727) req@ffff88012b8b3480 x1830967310194944/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.176933:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b3480 with x1830967310194944 ext(2097152->3145727) 00002000:00010000:2.0:1746147206.176935:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8b3480 00000100:00100000:2.0:1746147206.176957:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7132 00000100:00100000:2.0:1746147206.176963:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967310194560:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147206.176984:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7133 00000100:00100000:0.0:1746147206.176992:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967310194944:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147206.177114:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967310194560:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 150us (1111us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147206.177120:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7132 00002000:00100000:2.0:1746147206.177125:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (4026368->4030463) req@ffff88012b8b0a80 x1830967310194560/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/4536 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.177137:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b0a80 with x1830967310194560 ext(4026368->4030463) 00002000:00010000:2.0:1746147206.177140:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8b0a80 00000100:00100000:2.0:1746147206.177183:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.177302:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.177317:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310195072 00000100:00100000:2.0:1746147206.177319:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310195072 00000100:00100000:2.0:1746147206.177344:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19411 00000100:00100000:2.0:1746147206.177349:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2682:x1830967310195072:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147206.177360:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.177377:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506196e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e4b5 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.177401:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7200/0x31399394250617e6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3dc expref: 9 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.177410:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093714e00/0x31399394250618e2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e445 expref: 8 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.177417:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250618d4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e437 expref: 21 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.177423:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.177425:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.177429:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506196e lrc: 6/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [36864->290815] (req 36864->290815) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4b5 expref: 8 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.177463:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250618d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e437 expref: 21 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.177476:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250618d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e437 expref: 21 pid: 1136 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.177487:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098823480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311396096:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.177549:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093714e00/0x31399394250618e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e445 expref: 8 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.177557:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093714e00/0x31399394250618e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e445 expref: 8 pid: 1398 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746147206.177564:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098822d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311396224:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.177588:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7200/0x31399394250617e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3dc expref: 9 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.177595:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7200/0x31399394250617e6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3dc expref: 9 pid: 1853 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746147206.177602:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e487480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311396352:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.177616:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.177633:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310195200 00000100:00100000:2.0:1746147206.177635:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310195200 00002000:00100000:2.0:1746147206.177650:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4063231) req@ffff880098820a80 x1830967310195200/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.177657:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820a80 with x1830967310195200 ext(3145728->4063231) 00002000:00010000:2.0:1746147206.177660:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098820a80 00000100:00100000:2.0:1746147206.177670:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7134 00000100:00100000:2.0:1746147206.177674:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967310195200:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147206.184709:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.184780:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.184856:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310195328 00000100:00100000:3.0:1746147206.184865:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310195328 00000100:00100000:2.0:1746147206.184901:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098823480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311396096:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147206.184903:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7200/0x31399394250617e6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3dc expref: 10 pid: 1853 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746147206.184913:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098822d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311396224:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.184921:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e487480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311396352:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147206.184931:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310195456 00000100:00100000:3.0:1746147206.184933:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310195456 00010000:00010000:2.0:1746147206.184952:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506196e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [36864->290815] (req 36864->290815) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4b5 expref: 8 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.184967:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9a00, rc 0) 00000100:00100000:2.0:1746147206.185014:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2682:x1830967310195072:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7663us (7828us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.185022:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19411 00000100:00100000:2.0:1746147206.185068:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8795 00000100:00100000:2.0:1746147206.185075:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2003:x1830967310195328:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147206.185109:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147206.185129:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7200/0x31399394250617e6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3dc expref: 10 pid: 1853 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746147206.185139:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7200/0x31399394250617e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3dc expref: 10 pid: 1853 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746147206.185164:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7200/0x31399394250617e6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3dc expref: 10 pid: 1853 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746147206.185181:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147206.185197:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2003:x1830967310195328:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 123us (502us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147206.185203:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250618d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e437 expref: 24 pid: 1136 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.185203:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8795 00000100:00100000:0.0:1746147206.185385:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.186822:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310195584 00000100:00100000:3.0:1746147206.186827:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310195584 00010000:00010000:3.0:1746147206.186846:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093714e00/0x31399394250618e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e445 expref: 8 pid: 1398 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746147206.186866:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8796 00000100:00100000:3.0:1746147206.186872:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310195456:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147206.186881:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147206.186894:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250618d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e437 expref: 24 pid: 1136 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.186903:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250618d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e437 expref: 24 pid: 1136 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.186917:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f588c00/0x31399394250618d4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e437 expref: 24 pid: 1136 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746147206.186934:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8797 00010000:00010000:3.0:1746147206.186940:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147206.186943:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2002:x1830967310195584:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147206.186951:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147206.186959:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093714e00/0x31399394250618e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e445 expref: 8 pid: 1398 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746147206.186964:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967310195456:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 91us (2184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.186969:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8796 00010000:00010000:1.0:1746147206.186969:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093714e00/0x31399394250618e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e445 expref: 8 pid: 1398 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746147206.186982:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093714e00/0x31399394250618e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e445 expref: 8 pid: 1398 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746147206.186996:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147206.186998:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147206.187004:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506196e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->290815) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4b5 expref: 7 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.187017:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506196e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->290815) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4b5 expref: 7 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.187051:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506196e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->290815) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4b5 expref: 7 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147206.187064:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311396480:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147206.188105:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.188520:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.189107:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310195840 00000100:00100000:3.0:1746147206.189113:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310195840 00000100:00100000:3.0:1746147206.189151:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6092 00000100:00100000:3.0:1746147206.189158:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2675:x1830967310195840:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147206.189182:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310194944:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 12190us (12695us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147206.189190:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7133 00002000:00100000:2.0:1746147206.189199:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3145727) req@ffff88012b8b3480 x1830967310194944/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.189208:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b3480 with x1830967310194944 ext(2097152->3145727) 00002000:00010000:2.0:1746147206.189213:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8b3480 00000100:00100000:2.0:1746147206.189286:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310195200:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 11611us (11983us total) trans 0 rc 917504/917504 00000100:00100000:2.0:1746147206.189292:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7134 00002000:00100000:2.0:1746147206.189296:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4063231) req@ffff880098820a80 x1830967310195200/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 917504/917504 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.189302:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820a80 with x1830967310195200 ext(3145728->4063231) 00002000:00010000:2.0:1746147206.189305:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098820a80 00000100:00100000:3.0:1746147206.189364:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2675:x1830967310195840:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 205us (844us total) trans 8589937236 rc 0/0 00000100:00100000:3.0:1746147206.189369:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6092 00000100:00100000:1.0:1746147206.191771:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311396480:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147206.191798:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147206.191839:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2002:x1830967310195584:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4897us (6452us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147206.191848:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8797 00000100:00100000:2.0:1746147206.196257:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.196394:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310196096 00000100:00100000:0.0:1746147206.196404:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310196096 00002000:00100000:0.0:1746147206.196450:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (4030464->4194303) req@ffff88011e487480 x1830967310196096/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147206.196461:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e487480 with x1830967310196096 ext(4030464->4194303) 00002000:00010000:0.0:1746147206.196466:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e487480 00000100:00100000:0.0:1746147206.196498:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7135 00000100:00100000:0.0:1746147206.196506:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967310196096:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147206.198222:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.198355:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310196352 00000100:00100000:2.0:1746147206.198363:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310196352 00002000:00100000:2.0:1746147206.198396:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x93:0x0] (286720->290815) req@ffff88009689b800 x1830967310196352/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.198405:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689b800 with x1830967310196352 ext(286720->290815) 00002000:00010000:2.0:1746147206.198410:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009689b800 00000100:00100000:2.0:1746147206.198439:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7136 00000100:00100000:2.0:1746147206.198444:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2001:x1830967310196352:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147206.198552:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2001:x1830967310196352:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 107us (336us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147206.198558:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7136 00002000:00100000:2.0:1746147206.198563:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x93:0x0] (286720->290815) req@ffff88009689b800 x1830967310196352/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/4536 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.198569:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689b800 with x1830967310196352 ext(286720->290815) 00002000:00010000:2.0:1746147206.198572:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009689b800 00000100:00100000:2.0:1746147206.199175:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967310196096:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 2669us (2930us total) trans 0 rc 163840/163840 00000100:00100000:2.0:1746147206.199181:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7135 00002000:00100000:2.0:1746147206.199186:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (4030464->4194303) req@ffff88011e487480 x1830967310196096/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 163840/163840 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.199193:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e487480 with x1830967310196096 ext(4030464->4194303) 00002000:00010000:2.0:1746147206.199196:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e487480 00000100:00100000:0.0:1746147206.201206:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.201271:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310196608 00000100:00100000:3.0:1746147206.201280:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310196608 00000100:00100000:3.0:1746147206.201335:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6093 00000100:00100000:3.0:1746147206.201343:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2682:x1830967310196608:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147206.201536:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2682:x1830967310196608:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 193us (336us total) trans 8589937237 rc 0/0 00000100:00100000:3.0:1746147206.201542:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6093 00000100:00100000:1.0:1746147206.202842:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.202900:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310196736 00000100:00100000:2.0:1746147206.202905:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310196736 00000100:00100000:2.0:1746147206.202937:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19412 00000100:00100000:2.0:1746147206.202944:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2003:x1830967310196736:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.202956:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.202974:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425061975 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e4bc expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147206.203025:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311396608:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147206.203073:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.203107:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.203300:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310196864 00000100:00100000:0.0:1746147206.203304:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310196864 00000100:00100000:0.0:1746147206.203360:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19413 00000100:00100000:0.0:1746147206.203366:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967310196864:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147206.203374:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147206.203384:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009400ac00/0x313993942506197c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e4c3 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147206.203412:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311396736:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147206.203453:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff9c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746147206.205607:0:13695:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime: 1746147205 -> 1746147206 00002000:00010000:2.0:1746147206.205612:0:13695:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime: 1746147205 -> 1746147206 00002000:00010000:2.0:1746147206.205614:0:13695:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime: 1746147205 -> 1746147206 00000100:00100000:2.0:1746147206.205633:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311396608:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147206.205662:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425061975 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4bc expref: 22 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.205674:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425061975 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4bc expref: 22 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.205694:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1a00, rc 0) 00000100:00100000:2.0:1746147206.205929:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2003:x1830967310196736:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2984us (3089us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147206.205938:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19412 00002000:00010000:2.0:1746147206.206476:0:1398:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime: 1746147205 -> 1746147206 00002000:00010000:2.0:1746147206.206479:0:1398:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime: 1746147205 -> 1746147206 00000100:00100000:2.0:1746147206.206492:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311396736:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147206.206512:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009400ac00/0x313993942506197c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4c3 expref: 33 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.206526:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009400ac00/0x313993942506197c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4c3 expref: 33 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.206538:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400ac00, rc 0) 00000100:00100000:2.0:1746147206.206572:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967310196864:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3206us (3499us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147206.206578:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19413 00000100:00100000:0.0:1746147206.211512:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.211684:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310197120 00000100:00100000:2.0:1746147206.211694:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310197120 00002000:00100000:2.0:1746147206.211755:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88009455c700 x1830967310197120/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.211766:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455c700 with x1830967310197120 ext(4194304->4890623) 00002000:00010000:2.0:1746147206.211772:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009455c700 00000100:00100000:2.0:1746147206.211795:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7137 00000100:00100000:2.0:1746147206.211803:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310197120:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147206.216402:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310197120:12345-192.168.204.25@tcp:3:cat.0 Request processed in 4585us (4886us total) trans 0 rc 696320/696320 00000100:00100000:2.0:1746147206.216415:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7137 00002000:00100000:2.0:1746147206.216428:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88009455c700 x1830967310197120/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.216437:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455c700 with x1830967310197120 ext(4194304->4890623) 00002000:00010000:2.0:1746147206.216443:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009455c700 00000100:00100000:0.0:1746147206.220325:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.220384:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.220488:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310197376 00000100:00100000:2.0:1746147206.220499:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310197376 00000100:00100000:2.0:1746147206.220712:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310197248 00000100:00100000:2.0:1746147206.220715:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310197248 00000100:00100000:2.0:1746147206.220819:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19414 00000100:00100000:3.0:1746147206.220827:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19415 00000100:00100000:2.0:1746147206.220828:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310197376:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:3.0:1746147206.220836:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310197248:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.220847:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.220849:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.220866:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x3139939425061983 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e4ca expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.220866:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b1000/0x313993942506198a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e4d1 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.220917:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311396864:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147206.220917:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311396992:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147206.220995:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.221781:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147206.223037:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311396864:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147206.223068:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x3139939425061983 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ca expref: 22 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.223082:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x3139939425061983 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ca expref: 22 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.223128:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715200, rc 0) 00000100:00100000:3.0:1746147206.223168:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310197248:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2333us (2782us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147206.223176:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19415 00000100:00100000:2.0:1746147206.224619:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311396992:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147206.224643:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1000/0x313993942506198a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4d1 expref: 33 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.224654:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1000/0x313993942506198a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4d1 expref: 33 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.224666:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1000, rc 0) 00000100:00100000:2.0:1746147206.224702:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310197376:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3875us (4391us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147206.224709:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19414 00000100:00100000:1.0:1746147206.229519:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.229626:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.230077:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310197632 00000100:00100000:2.0:1746147206.230115:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310197632 00000100:00100000:2.0:1746147206.230167:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310197504 00000100:00100000:2.0:1746147206.230170:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310197504 00000100:00100000:2.0:1746147206.230192:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19416 00000100:00100000:2.0:1746147206.230200:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310197632:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.230219:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.230237:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x3139939425061991 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e4df expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147206.230293:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311397120:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147206.230373:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147206.230432:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19417 00000100:00100000:1.0:1746147206.230441:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310197504:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147206.230449:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147206.230465:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011f212600/0x3139939425061998 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e4d8 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147206.230494:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311397248:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147206.230520:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147206.233154:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311397248:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147206.233190:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011f212600/0x3139939425061998 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4d8 expref: 22 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147206.233205:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f212600/0x3139939425061998 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4d8 expref: 22 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147206.233225:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f212600, rc 0) 00000100:00100000:1.0:1746147206.233266:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310197504:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2826us (3639us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147206.233274:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19417 00000100:00100000:2.0:1746147206.234574:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311397120:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147206.234599:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x3139939425061991 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4df expref: 33 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.234610:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1e00/0x3139939425061991 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4df expref: 33 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.234623:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1e00, rc 0) 00000100:00100000:2.0:1746147206.234651:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310197632:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4451us (5142us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147206.234658:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19416 00000100:00100000:0.0:1746147206.237526:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.237601:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310197888 00000100:00100000:1.0:1746147206.237611:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310197888 00000100:00100000:1.0:1746147206.238386:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6094 00000100:00100000:1.0:1746147206.238395:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4d61c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2678:x1830967310197888:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147206.238608:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4d61c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2678:x1830967310197888:12345-192.168.204.25@tcp:35:cat.0 Request processed in 214us (1092us total) trans 8589937238 rc 0/0 00000100:00100000:1.0:1746147206.238615:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6094 00000100:00100000:0.0:1746147206.314356:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.314488:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310198144 00000100:00100000:3.0:1746147206.314497:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310198144 00000100:00100000:3.0:1746147206.317339:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16356 00000100:00100000:3.0:1746147206.317361:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2687:x1830967310198144:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147206.317388:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.317412:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506199f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e4e6 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.317501:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x31399394250619a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317515:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x31399394250619a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317526:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x31399394250619a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317541:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250619ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317547:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250619ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317553:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250619ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317668:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x31399394250619b4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317678:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x31399394250619b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317684:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x31399394250619b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147206.317693:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147206.317787:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x31399394250619a6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317794:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x31399394250619a6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317800:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x31399394250619a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317806:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x31399394250619a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317813:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093714c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147206.317817:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x31399394250619a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317824:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x31399394250619a6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317836:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147206.317839:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147206.317844:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x31399394250619a6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317853:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x31399394250619a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317880:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250619ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317885:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250619ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317890:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250619ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317895:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093715200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147206.317897:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250619ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317902:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250619ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317909:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800930f4f00) 00010000:00010000:3.0:1746147206.317911:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147206.317913:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250619ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317918:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250619ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147206.317958:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506199f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4e6 expref: 32 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.317969:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x31399394250619b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4e6 expref: 31 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.317980:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147206.317982:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147206.317985:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c200, rc 0) 00000100:00100000:3.0:1746147206.318060:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2687:x1830967310198144:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 708us (3714us total) trans 8589937239 rc 0/0 00000100:00100000:3.0:1746147206.318067:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16356 00000100:00100000:0.0:1746147206.321274:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.321544:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310198400 00000100:00100000:1.0:1746147206.321555:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310198400 00000100:00100000:1.0:1746147206.321617:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16357 00000100:00100000:1.0:1746147206.321626:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2689:x1830967310198400:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147206.321650:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147206.321672:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097035800/0x31399394250619c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e4ed expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.321791:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097034000/0x31399394250619c9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.321806:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e430 expref: 15 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.321814:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81c00/0x3139939425061960 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ae expref: 15 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.321821:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x31399394250619b4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4e6 expref: 30 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.321829:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097034000/0x31399394250619c9 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.321862:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x31399394250619b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4e6 expref: 30 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.321875:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x31399394250619b4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4e6 expref: 30 pid: 7238 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746147206.321888:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311397376:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147206.322001:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81c00/0x3139939425061960 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ae expref: 15 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.322009:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81c00/0x3139939425061960 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ae expref: 15 pid: 9138 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746147206.322029:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311397504:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147206.322055:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e430 expref: 15 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.322061:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e430 expref: 15 pid: 7238 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746147206.322067:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311397632:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147206.322082:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.324261:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.324284:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311397376:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147206.326458:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.326485:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311397504:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147206.326494:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311397632:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147206.326515:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147206.326522:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097034000/0x31399394250619c9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147206.326554:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310198528 00000100:00100000:0.0:1746147206.326559:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310198528 00010000:00010000:0.0:1746147206.326595:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x31399394250619b4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4e6 expref: 31 pid: 7238 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.326596:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310198656 00000100:00100000:3.0:1746147206.326601:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310198656 00010000:00010000:3.0:1746147206.326619:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81c00/0x3139939425061960 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ae expref: 16 pid: 9138 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746147206.326621:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310198784 00000100:00100000:0.0:1746147206.326623:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310198784 00010000:00010000:0.0:1746147206.326632:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e430 expref: 17 pid: 7238 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.326640:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8798 00000100:00100000:3.0:1746147206.326647:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967310198528:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147206.326660:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147206.326666:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x31399394250619b4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4e6 expref: 31 pid: 7238 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.326675:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x31399394250619b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4e6 expref: 31 pid: 7238 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.326699:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x31399394250619b4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4e6 expref: 31 pid: 7238 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.326725:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147206.326730:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097034000/0x31399394250619c9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.326753:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880097034000/0x31399394250619c9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.326759:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147206.326808:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967310198528:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 161us (2555us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.327183:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8799 00000100:00100000:3.0:1746147206.327191:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8798 00000100:00100000:2.0:1746147206.327193:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2002:x1830967310198656:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147206.327195:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8800 00000100:00100000:0.0:1746147206.327199:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310198784:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147206.327202:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147206.327204:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147206.327207:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81c00/0x3139939425061960 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ae expref: 17 pid: 9138 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746147206.327207:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e430 expref: 17 pid: 7238 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746147206.327215:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e430 expref: 17 pid: 7238 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.327222:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81c00/0x3139939425061960 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ae expref: 17 pid: 9138 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746147206.327238:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x31399394250618cd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e430 expref: 17 pid: 7238 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.327240:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b81c00/0x3139939425061960 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ae expref: 17 pid: 9138 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746147206.327261:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147206.327265:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097034000/0x31399394250619c9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147206.327273:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097034000/0x31399394250619c9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147206.327279:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097034000/0x31399394250619c9 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147206.328004:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147206.328032:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310198784:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 831us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147206.328039:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8800 00010000:00010000:1.0:1746147206.328505:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097034000/0x31399394250619c9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.328512:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097034000/0x31399394250619c9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147206.328531:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147206.328665:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097035800/0x31399394250619c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ed expref: 16 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.328685:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097034000/0x31399394250619c9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ed expref: 15 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.328692:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147206.328695:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147206.328697:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097034000, rc 0) 00010000:00010000:2.0:1746147206.328780:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147206.328783:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147206.328809:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2002:x1830967310198656:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1617us (2358us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.328815:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8799 00000100:00100000:1.0:1746147206.328900:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2689:x1830967310198400:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7275us (7635us total) trans 8589937240 rc 0/0 00000100:00100000:1.0:1746147206.328907:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16357 00000100:00100000:0.0:1746147206.354390:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.355496:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310198912 00000100:00100000:2.0:1746147206.355506:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310198912 00000100:00100000:2.0:1746147206.355560:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19418 00000100:00100000:2.0:1746147206.355568:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2687:x1830967310198912:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147206.355589:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.355608:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x31399394250619d7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e4f4 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.355638:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092562600/0x31399394250617d1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3e3 expref: 20 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.355646:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x313993942506190c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e46f expref: 33 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.355654:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093709a00/0x31399394250618e9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e44c expref: 22 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.355661:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.355663:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.355667:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x31399394250619d7 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [1945600->2097151] (req 1945600->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4f4 expref: 33 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.355697:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093709a00/0x31399394250618e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e44c expref: 22 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.355710:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093709a00/0x31399394250618e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e44c expref: 22 pid: 1854 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746147206.355723:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311397760:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.357404:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x313993942506190c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e46f expref: 33 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.357420:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x313993942506190c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e46f expref: 33 pid: 9585 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.357432:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311397888:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.357485:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092562600/0x31399394250617d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3e3 expref: 20 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.357494:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092562600/0x31399394250617d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3e3 expref: 20 pid: 9585 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746147206.357503:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311398016:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.357530:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.358035:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.358314:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310199168 00000100:00100000:1.0:1746147206.358322:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310199168 00000100:00100000:1.0:1746147206.358400:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16358 00000100:00100000:1.0:1746147206.358407:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2692:x1830967310199168:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147206.358425:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147206.358446:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42200/0x31399394250619de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e4fb expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.358532:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250619e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358548:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250619e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358561:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250619e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358575:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250619ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358582:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250619ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358592:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250619ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358708:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250619f3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358719:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250619f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358726:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250619f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147206.358747:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147206.358830:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250619e5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358835:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250619e5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358841:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250619e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358846:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250619e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358851:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d42000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147206.358854:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250619e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358860:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250619e5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358870:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147206.358873:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147206.358877:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250619e5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358882:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250619e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358896:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250619ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358901:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250619ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358906:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250619ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358909:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d43800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147206.358911:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250619ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358915:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250619ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358921:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f2c5a00) 00010000:00010000:1.0:1746147206.358923:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147206.358925:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250619ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358929:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43800/0x31399394250619ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.358962:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42200/0x31399394250619de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4fb expref: 17 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.358970:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250619f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4fb expref: 16 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.358976:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147206.358978:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746147206.358980:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43000, rc 0) 00000100:00100000:1.0:1746147206.359014:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2692:x1830967310199168:12345-192.168.204.25@tcp:101:cat.0 Request processed in 603us (977us total) trans 8589937241 rc 0/0 00000100:00100000:1.0:1746147206.359019:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16358 00000100:00100000:2.0:1746147206.364806:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.364844:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.364891:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.364908:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310199296 00000100:00100000:2.0:1746147206.364915:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310199552 00000100:00100000:3.0:1746147206.364918:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310199296 00000100:00100000:2.0:1746147206.364918:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310199552 00010000:00010000:2.0:1746147206.364954:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x313993942506190c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e46f expref: 34 pid: 9585 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.364963:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310199424 00000100:00100000:3.0:1746147206.364965:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310199424 00000100:00100000:2.0:1746147206.364988:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8801 00000100:00100000:3.0:1746147206.364989:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19419 00000100:00100000:3.0:1746147206.364996:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2001:x1830967310199296:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147206.364996:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967310199552:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147206.365012:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147206.365013:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.365030:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0ca00/0x3139939425061a01 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e502 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.365039:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x313993942506190c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e46f expref: 34 pid: 9585 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.365052:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x313993942506190c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e46f expref: 34 pid: 9585 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.365076:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147206.365102:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311398144:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147206.365705:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19420 00000100:00100000:1.0:1746147206.365716:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310199424:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147206.365728:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147206.365751:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061a08 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e509 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147206.365788:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311398272:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147206.365864:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311397760:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147206.365889:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38fe00/0x313993942506190c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e46f expref: 34 pid: 9585 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746147206.365911:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311397888:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147206.365924:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311398016:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147206.365953:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x31399394250619d7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1945600->2097151] (req 1945600->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4f4 expref: 33 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.365965:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1a00, rc 0) 00000100:00100000:2.0:1746147206.366049:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2002:x1830967310199552:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1050us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.366057:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.366057:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8801 00000100:00100000:1.0:1746147206.366581:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.366764:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2687:x1830967310198912:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 11193us (12384us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147206.366770:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19418 00000100:00100000:3.0:1746147206.367083:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.367237:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.367367:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310199680 00000100:00100000:0.0:1746147206.367372:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310199680 00010000:00010000:0.0:1746147206.367391:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092562600/0x31399394250617d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3e3 expref: 21 pid: 9585 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746147206.367410:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310199808 00000100:00100000:0.0:1746147206.367412:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310199808 00010000:00010000:0.0:1746147206.367421:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093709a00/0x31399394250618e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e44c expref: 25 pid: 1854 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746147206.367434:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8802 00000100:00100000:0.0:1746147206.367439:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2002:x1830967310199680:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147206.367448:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147206.367463:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092562600/0x31399394250617d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3e3 expref: 21 pid: 9585 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746147206.367473:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092562600/0x31399394250617d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3e3 expref: 21 pid: 9585 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746147206.367489:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092562600/0x31399394250617d1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3e3 expref: 21 pid: 9585 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746147206.367499:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147206.367517:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2002:x1830967310199680:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 78us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147206.367525:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8802 00000100:00100000:0.0:1746147206.367534:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8803 00000100:00100000:0.0:1746147206.367538:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2002:x1830967310199808:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147206.367543:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147206.367548:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093709a00/0x31399394250618e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e44c expref: 25 pid: 1854 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746147206.367557:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093709a00/0x31399394250618e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e44c expref: 25 pid: 1854 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746147206.367567:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093709a00/0x31399394250618e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e44c expref: 25 pid: 1854 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746147206.367574:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.367576:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.367582:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x31399394250619d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4f4 expref: 31 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.367590:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x31399394250619d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4f4 expref: 31 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.367611:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x31399394250619d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4f4 expref: 31 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147206.367618:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311398400:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147206.367655:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095affd80 going to sleep for 11 seconds 00002000:00010000:3.0:1746147206.369726:0:10340:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746147205 -> 1746147206 00002000:00010000:3.0:1746147206.369732:0:10340:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746147205 -> 1746147206 00002000:00010000:3.0:1746147206.369742:0:10340:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime: 1746147205 -> 1746147206 00000100:00100000:3.0:1746147206.369762:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311398144:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147206.369790:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0ca00/0x3139939425061a01 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e502 expref: 8 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.369802:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0ca00/0x3139939425061a01 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e502 expref: 8 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.369815:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0ca00, rc 0) 00000100:00100000:1.0:1746147206.369922:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311398272:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147206.369939:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061a08 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e509 expref: 24 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147206.369948:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061a08 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e509 expref: 24 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147206.369959:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43c00, rc 0) 00000100:00100000:3.0:1746147206.370560:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2001:x1830967310199296:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5562us (5763us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147206.370570:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19419 00000100:00100000:1.0:1746147206.370753:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310199424:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5037us (5905us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147206.370763:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19420 00000100:00100000:0.0:1746147206.371971:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095063100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311398400:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147206.371989:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147206.372027:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2002:x1830967310199808:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4487us (4789us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147206.372035:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8803 00000100:00100000:0.0:1746147206.373197:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.373278:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310200064 00000100:00100000:2.0:1746147206.373285:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310200064 00002000:00100000:2.0:1746147206.373322:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x96:0x0] (1945600->1949695) req@ffff880095063100 x1830967310200064/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.373331:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095063100 with x1830967310200064 ext(1945600->1949695) 00002000:00010000:2.0:1746147206.373336:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095063100 00000100:00100000:2.0:1746147206.373444:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7138 00000100:00100000:2.0:1746147206.373451:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310200064:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147206.373930:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310200064:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 477us (733us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147206.373936:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7138 00002000:00100000:2.0:1746147206.373943:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x96:0x0] (1945600->1949695) req@ffff880095063100 x1830967310200064/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/4536 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.373950:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095063100 with x1830967310200064 ext(1945600->1949695) 00002000:00010000:2.0:1746147206.373953:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095063100 00000100:00100000:1.0:1746147206.379514:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.380857:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310200320 00000100:00100000:2.0:1746147206.380871:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310200320 00002000:00100000:2.0:1746147206.380931:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88009514bb80 x1830967310200320/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 504/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.380942:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514bb80 with x1830967310200320 ext(0->1048575) 00002000:00010000:2.0:1746147206.380949:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514bb80 00000100:00100000:2.0:1746147206.380993:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7139 00000100:00100000:2.0:1746147206.381003:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2000:x1830967310200320:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147206.382800:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.382897:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310200448 00000100:00100000:0.0:1746147206.382904:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310200448 00000100:00100000:0.0:1746147206.382960:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19421 00000100:00100000:0.0:1746147206.382968:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2687:x1830967310200448:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147206.382982:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147206.383009:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425061a0f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e510 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.383038:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250617f4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ea expref: 19 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.383046:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x313993942506191a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e47d expref: 33 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.383052:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250618f0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e453 expref: 21 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.383058:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.383060:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.383063:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425061a0f lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [1048576->1339391] (req 1048576->1339391) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e510 expref: 33 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.383124:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250618f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e453 expref: 21 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.383136:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250618f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e453 expref: 21 pid: 1854 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746147206.383148:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095062a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311398528:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147206.383227:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x313993942506191a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e47d expref: 33 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.383233:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x313993942506191a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e47d expref: 33 pid: 12225 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746147206.383241:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095060380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311398656:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147206.383267:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250617f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ea expref: 19 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.383275:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250617f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ea expref: 19 pid: 9585 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746147206.383282:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095060000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311398784:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147206.383299:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095affd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.386434:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2000:x1830967310200320:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5422us (6919us total) trans 0 rc 794624/794624 00000100:00100000:2.0:1746147206.386447:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7139 00002000:00100000:2.0:1746147206.386459:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88009514bb80 x1830967310200320/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 504/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 794624/794624 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.386467:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514bb80 with x1830967310200320 ext(0->1048575) 00002000:00010000:2.0:1746147206.386473:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514bb80 00000100:00100000:2.0:1746147206.387914:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095062a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311398528:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.387928:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095060380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311398656:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.387937:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095060000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311398784:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.387969:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425061a0f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [1048576->1339391] (req 1048576->1339391) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e510 expref: 33 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.387987:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400b800, rc 0) 00000100:00100000:2.0:1746147206.388032:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2687:x1830967310200448:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5064us (5237us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.388040:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19421 00000100:00100000:0.0:1746147206.388303:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.388435:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.388768:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310200576 00000100:00100000:1.0:1746147206.388777:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310200576 00010000:00010000:1.0:1746147206.388813:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x313993942506191a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e47d expref: 33 pid: 12225 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746147206.388842:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310200704 00000100:00100000:1.0:1746147206.388846:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310200704 00010000:00010000:1.0:1746147206.388860:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250617f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ea expref: 20 pid: 9585 timeout: 844 lvb_type: 1 00000100:00100000:1.0:1746147206.388881:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8804 00000100:00100000:1.0:1746147206.388890:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2002:x1830967310200576:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147206.388903:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147206.388923:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x313993942506191a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e47d expref: 33 pid: 12225 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.388933:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x313993942506191a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e47d expref: 33 pid: 12225 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.388958:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x313993942506191a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e47d expref: 33 pid: 12225 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.388980:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147206.389016:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967310200576:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 126us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147206.389023:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8804 00000100:00100000:1.0:1746147206.389042:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8805 00000100:00100000:1.0:1746147206.389048:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2002:x1830967310200704:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147206.389057:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147206.389066:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250617f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ea expref: 20 pid: 9585 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746147206.389075:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250617f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ea expref: 20 pid: 9585 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746147206.389129:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250617f4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3ea expref: 20 pid: 9585 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746147206.389141:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147206.389164:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2002:x1830967310200704:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 117us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147206.389170:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8805 00000100:00100000:0.0:1746147206.389337:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.389352:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310200832 00000100:00100000:0.0:1746147206.389355:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310200832 00010000:00010000:0.0:1746147206.389369:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250618f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e453 expref: 22 pid: 1854 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746147206.389383:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8806 00000100:00100000:0.0:1746147206.389388:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310200832:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147206.389394:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147206.389401:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250618f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e453 expref: 22 pid: 1854 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746147206.389410:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250618f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e453 expref: 22 pid: 1854 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746147206.389421:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250618f0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e453 expref: 22 pid: 1854 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746147206.389434:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.389436:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.389442:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425061a0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e510 expref: 31 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.389449:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425061a0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e510 expref: 31 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.389476:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425061a0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e510 expref: 31 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147206.389493:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095063480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311398912:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147206.389548:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095afff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.391407:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095063480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311398912:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147206.391434:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147206.391504:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310200832:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2111us (2162us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.391515:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8806 00000100:00100000:0.0:1746147206.392177:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.392267:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310200960 00000100:00100000:2.0:1746147206.392272:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310200960 00000100:00100000:2.0:1746147206.392308:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19422 00000100:00100000:2.0:1746147206.392314:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2692:x1830967310200960:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.392332:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.392350:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x3139939425061a16 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e517 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.392377:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x31399394250619d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4f4 expref: 31 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.392389:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147206.392391:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147206.392394:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x3139939425061a16 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e517 expref: 22 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.392419:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x31399394250619d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4f4 expref: 31 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.392430:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x31399394250619d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4f4 expref: 31 pid: 1398 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.392443:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311399040:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.393174:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.394007:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311399040:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.394032:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x3139939425061a16 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e517 expref: 22 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.394046:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b0400, rc 0) 00000100:00100000:2.0:1746147206.394079:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2692:x1830967310200960:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1764us (1903us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.394086:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19422 00000100:00100000:0.0:1746147206.394347:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.394442:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310201344 00000100:00100000:3.0:1746147206.394448:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310201344 00002000:00100000:3.0:1746147206.394483:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1335296->1339391) req@ffff880134b6d500 x1830967310201344/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.394491:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b6d500 with x1830967310201344 ext(1335296->1339391) 00002000:00010000:3.0:1746147206.394495:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b6d500 00000100:00100000:3.0:1746147206.394514:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7140 00000100:00100000:3.0:1746147206.394520:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310201344:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147206.394881:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310201344:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 360us (534us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147206.394887:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7140 00002000:00100000:3.0:1746147206.394892:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1335296->1339391) req@ffff880134b6d500 x1830967310201344/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/4536 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.394899:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b6d500 with x1830967310201344 ext(1335296->1339391) 00002000:00010000:3.0:1746147206.394902:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b6d500 00000100:00100000:1.0:1746147206.395032:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.395397:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310201088 00000100:00100000:0.0:1746147206.395401:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310201088 00002000:00100000:0.0:1746147206.395422:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1945600->2097151) req@ffff88009514b480 x1830967310201088/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147206.395429:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514b480 with x1830967310201088 ext(1945600->2097151) 00010000:00010000:0.0:1746147206.395436:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x31399394250619d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4f4 expref: 32 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746147206.395449:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x31399394250619d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4f4 expref: 32 pid: 1398 timeout: 844 lvb_type: 0 00002000:00010000:0.0:1746147206.395455:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009514b480 00000100:00100000:0.0:1746147206.395468:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1661 00000100:00100000:0.0:1746147206.395474:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967310201088:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147206.398862:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2002:x1830967310201088:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 3374us (3817us total) trans 17179875139 rc 0/0 00000100:00100000:2.0:1746147206.398875:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1661 00002000:00100000:2.0:1746147206.398888:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1945600->2097151) req@ffff88009514b480 x1830967310201088/t17179875139(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/448 e 0 to 0 dl 1746147217 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.398897:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514b480 with x1830967310201088 ext(1945600->2097151) 00010000:00010000:2.0:1746147206.398907:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x31399394250619d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4f4 expref: 34 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.398922:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x31399394250619d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4f4 expref: 34 pid: 1398 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746147206.398928:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009514b480 00000100:00100000:0.0:1746147206.400540:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.400588:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.400866:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310201600 00000100:00100000:3.0:1746147206.400877:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310201600 00000100:00100000:2.0:1746147206.400918:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310201728 00000100:00100000:2.0:1746147206.400922:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310201728 00000100:00100000:3.0:1746147206.400935:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6095 00000100:00100000:3.0:1746147206.400943:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2687:x1830967310201600:12345-192.168.204.25@tcp:35:multiop.0 00010000:00010000:2.0:1746147206.400948:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x31399394250619d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4f4 expref: 34 pid: 1398 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.400973:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8807 00000100:00100000:2.0:1746147206.400978:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967310201728:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147206.400992:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147206.401009:0:16749:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147205 -> 1746147206 00002000:00010000:2.0:1746147206.401012:0:16749:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147205 -> 1746147206 00010000:00010000:2.0:1746147206.401017:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x31399394250619d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4f4 expref: 34 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.401029:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x31399394250619d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4f4 expref: 34 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.401059:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x31399394250619d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4f4 expref: 34 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.401076:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.401078:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.401085:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x3139939425061a16 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e517 expref: 21 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.401114:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x3139939425061a16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e517 expref: 21 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.401144:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x3139939425061a16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e517 expref: 21 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147206.401156:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311399168:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147206.401173:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2687:x1830967310201600:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 230us (640us total) trans 8589937242 rc 0/0 00000100:00100000:3.0:1746147206.401180:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6095 00000100:00100000:2.0:1746147206.401212:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.404548:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311399168:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147206.404578:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147206.404644:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967310201728:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3663us (4052us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.404656:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8807 00000100:00100000:0.0:1746147206.410074:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.410225:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310201984 00000100:00100000:2.0:1746147206.410237:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310201984 00002000:00100000:2.0:1746147206.410286:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88012f3cc000 x1830967310201984/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.410302:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cc000 with x1830967310201984 ext(1048576->2097151) 00002000:00010000:2.0:1746147206.410308:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cc000 00000100:00100000:2.0:1746147206.410350:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7141 00000100:00100000:2.0:1746147206.410358:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310201984:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147206.421260:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310201984:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10894us (11187us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147206.421272:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7141 00002000:00100000:2.0:1746147206.421283:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88012f3cc000 x1830967310201984/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.421292:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cc000 with x1830967310201984 ext(1048576->2097151) 00002000:00010000:2.0:1746147206.421297:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cc000 00000100:00100000:0.0:1746147206.432627:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.432772:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310202112 00000100:00100000:2.0:1746147206.432781:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310202112 00000100:00100000:2.0:1746147206.432871:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19423 00000100:00100000:2.0:1746147206.432879:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2692:x1830967310202112:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.432895:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.432909:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425061a1d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e51e expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.432937:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425061a0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e510 expref: 32 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.432944:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147206.432946:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147206.432950:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425061a1d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e51e expref: 23 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.432977:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425061a0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e510 expref: 32 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.432987:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425061a0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e510 expref: 32 pid: 17600 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.432998:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311399296:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.433283:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.439103:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311399296:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.439131:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425061a1d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e51e expref: 23 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.439146:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b0a00, rc 0) 00000100:00100000:2.0:1746147206.439197:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2692:x1830967310202112:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6318us (6576us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.439205:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19423 00000100:00100000:0.0:1746147206.442079:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.442481:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310202240 00000100:00100000:2.0:1746147206.442489:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310202240 00002000:00100000:2.0:1746147206.442521:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1339391) req@ffff88012f3cca80 x1830967310202240/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.442530:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cca80 with x1830967310202240 ext(1048576->1339391) 00010000:00010000:2.0:1746147206.442537:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425061a0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e510 expref: 33 pid: 17600 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.442553:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425061a0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e510 expref: 33 pid: 17600 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746147206.442560:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f3cca80 00000100:00100000:2.0:1746147206.442586:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1662 00000100:00100000:2.0:1746147206.442591:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967310202240:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147206.451911:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967310202240:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 9310us (9829us total) trans 17179875140 rc 0/0 00000100:00100000:2.0:1746147206.451922:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1662 00002000:00100000:2.0:1746147206.451933:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1339391) req@ffff88012f3cca80 x1830967310202240/t17179875140(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/448 e 0 to 0 dl 1746147217 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.451942:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cca80 with x1830967310202240 ext(1048576->1339391) 00010000:00010000:2.0:1746147206.451951:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425061a0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e510 expref: 35 pid: 17600 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.451966:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425061a0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e510 expref: 35 pid: 17600 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746147206.451972:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f3cca80 00000100:00100000:0.0:1746147206.459243:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.459360:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310202368 00000100:00100000:2.0:1746147206.459371:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310202368 00010000:00010000:2.0:1746147206.459409:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425061a0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e510 expref: 35 pid: 17600 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.459445:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8808 00000100:00100000:2.0:1746147206.459453:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967310202368:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147206.459468:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147206.459487:0:16749:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147205 -> 1746147206 00002000:00010000:2.0:1746147206.459490:0:16749:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147205 -> 1746147206 00010000:00010000:2.0:1746147206.459496:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425061a0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e510 expref: 35 pid: 17600 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.459509:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425061a0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e510 expref: 35 pid: 17600 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.459532:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009400b800/0x3139939425061a0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e510 expref: 35 pid: 17600 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.459568:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.459570:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.459577:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425061a1d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e51e expref: 22 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.459585:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425061a1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e51e expref: 22 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.459786:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425061a1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e51e expref: 22 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147206.459805:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311399424:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147206.459894:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.464805:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.464948:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310202624 00000100:00100000:2.0:1746147206.464957:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310202624 00000100:00100000:2.0:1746147206.465003:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16359 00000100:00100000:2.0:1746147206.465010:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2696:x1830967310202624:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.465032:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.465052:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425061a24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e525 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.465148:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x3139939425061a2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.465161:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x3139939425061a2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.465171:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x3139939425061a2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.465183:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x3139939425061a32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.465188:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x3139939425061a32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.465192:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x3139939425061a32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.465286:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425061a39 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.465296:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425061a39 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.465301:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425061a39 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:2.0:1746147206.465308:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000100:00100000:3.0:1746147206.465449:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311399424:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147206.465468:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147206.465508:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310202368:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6056us (6277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.465517:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8808 00010000:00010000:2.0:1746147206.467241:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x3139939425061a2b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.467252:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x3139939425061a2b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.467257:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x3139939425061a2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.467263:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x3139939425061a2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.467269:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800909c0600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147206.467273:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x3139939425061a2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.467279:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x3139939425061a2b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.467293:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147206.467296:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147206.467301:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x3139939425061a2b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.467305:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909c0600/0x3139939425061a2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.467321:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x3139939425061a32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.467325:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x3139939425061a32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.467330:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x3139939425061a32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.467338:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b1adb600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147206.467341:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x3139939425061a32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.467345:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x3139939425061a32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.467350:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012b447000) 00010000:00010000:2.0:1746147206.467352:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147206.467354:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x3139939425061a32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.467358:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x3139939425061a32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.467407:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425061a24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e525 expref: 34 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.467422:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425061a39 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e525 expref: 33 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.467428:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147206.467430:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147206.467433:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d5bb600, rc 0) 00000100:00100000:2.0:1746147206.467484:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2696:x1830967310202624:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2473us (2689us total) trans 8589937243 rc 0/0 00000100:00100000:2.0:1746147206.467491:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16359 00000100:00100000:0.0:1746147206.469162:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.469222:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310202880 00000100:00100000:2.0:1746147206.469231:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310202880 00002000:00100000:2.0:1746147206.469275:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88012f3cce00 x1830967310202880/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.469284:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cce00 with x1830967310202880 ext(1048576->2097151) 00002000:00010000:2.0:1746147206.469289:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cce00 00000100:00100000:2.0:1746147206.469322:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7142 00000100:00100000:2.0:1746147206.469329:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310202880:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147206.470300:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.470642:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310203136 00000100:00100000:3.0:1746147206.470647:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310203136 00000100:00100000:3.0:1746147206.470687:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19424 00000100:00100000:3.0:1746147206.470693:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310203136:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147206.470704:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.470723:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425061a47 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e533 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.470756:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.470758:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.470770:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425061a47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e533 expref: 35 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.470786:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425061a47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e533 expref: 35 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.470804:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0ce00, rc 0) 00000100:00100000:3.0:1746147206.470846:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967310203136:12345-192.168.204.25@tcp:101:cat.0 Request processed in 153us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.470853:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19424 00000100:00100000:1.0:1746147206.471478:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.471507:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.471537:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.471580:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310203392 00000100:00100000:3.0:1746147206.471584:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310203392 00000100:00100000:3.0:1746147206.471601:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310203008 00000100:00100000:3.0:1746147206.471603:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310203008 00000100:00100000:3.0:1746147206.471614:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310203264 00000100:00100000:3.0:1746147206.471616:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310203264 00000100:00100000:3.0:1746147206.471627:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19425 00000100:00100000:3.0:1746147206.471633:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310203392:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147206.471642:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.471652:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425061a4e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e541 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.471694:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311399552:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147206.471760:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147206.471779:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19426 00000100:00100000:3.0:1746147206.471784:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2000:x1830967310203008:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147206.471792:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.471802:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061a55 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e52c expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.471824:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093147480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311399680:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147206.471842:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147206.471853:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19427 00000100:00100000:3.0:1746147206.471858:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310203264:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147206.471863:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.471869:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425061a5c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e53a expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.471878:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.471880:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.471885:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425061a5c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e53a expref: 38 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.471896:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425061a5c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e53a expref: 38 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.471905:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1c00, rc 0) 00000100:00100000:3.0:1746147206.471919:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310203264:12345-192.168.204.25@tcp:101:cat.0 Request processed in 60us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.471924:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19427 00000100:00100000:2.0:1746147206.476909:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310202880:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7568us (7741us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147206.476921:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7142 00002000:00100000:2.0:1746147206.476932:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88012f3cce00 x1830967310202880/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.476943:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cce00 with x1830967310202880 ext(1048576->2097151) 00002000:00010000:2.0:1746147206.476949:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3cce00 00000100:00100000:3.0:1746147206.480924:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311399552:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147206.480966:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425061a4e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e541 expref: 37 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.480982:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425061a4e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e541 expref: 37 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.481002:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0de00, rc 0) 00000100:00100000:3.0:1746147206.481059:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310203392:12345-192.168.204.25@tcp:101:cat.0 Request processed in 9424us (9580us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147206.481069:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19425 00000100:00100000:2.0:1746147206.481178:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093147480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311399680:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147206.481197:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061a55 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e52c expref: 22 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.481206:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061a55 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e52c expref: 22 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.481218:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c200, rc 0) 00000100:00100000:2.0:1746147206.481234:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2000:x1830967310203008:12345-192.168.204.25@tcp:101:cat.0 Request processed in 9450us (9727us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147206.481240:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19426 00000100:00100000:0.0:1746147206.486150:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.486444:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310203520 00000100:00100000:2.0:1746147206.486455:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310203520 00000100:00100000:2.0:1746147206.486520:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19428 00000100:00100000:2.0:1746147206.486531:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2696:x1830967310203520:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.486549:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.486572:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009822ac00/0x3139939425061a63 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e548 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.486609:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506196e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->290815) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4b5 expref: 6 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.486618:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147206.486620:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147206.486623:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009822ac00/0x3139939425061a63 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e548 expref: 22 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.486661:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506196e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->290815) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4b5 expref: 6 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.486675:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506196e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->290815) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4b5 expref: 6 pid: 13695 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.486693:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311399808:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.486801:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147206.487468:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.487658:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310203648 00000100:00100000:3.0:1746147206.487665:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310203648 00000100:00100000:3.0:1746147206.488160:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19429 00000100:00100000:3.0:1746147206.488169:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2000:x1830967310203648:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147206.488178:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.488191:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425061a6a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e54f expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.488235:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311399936:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147206.488304:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147206.488609:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.489131:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311399808:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147206.489153:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009822ac00/0x3139939425061a63 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e548 expref: 22 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147206.489257:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310203776 00000100:00100000:0.0:1746147206.489262:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310203776 00000100:00100000:0.0:1746147206.489385:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19430 00000100:00100000:0.0:1746147206.489395:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2001:x1830967310203776:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147206.489407:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147206.489422:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d42200/0x3139939425061a71 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e556 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147206.489476:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311400064:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147206.489541:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095afff00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147206.489729:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.489804:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310203904 00000100:00100000:2.0:1746147206.489808:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310203904 00002000:00100000:2.0:1746147206.489836:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x93:0x0] (36864->290815) req@ffff880095148e00 x1830967310203904/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.489845:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095148e00 with x1830967310203904 ext(36864->290815) 00010000:00010000:2.0:1746147206.489852:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506196e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->290815) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4b5 expref: 9 pid: 13695 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.489866:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506196e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->290815) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4b5 expref: 9 pid: 13695 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746147206.489872:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095148e00 00000100:00100000:2.0:1746147206.489894:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1663 00000100:00100000:2.0:1746147206.489902:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310203904:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147206.490177:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311399936:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147206.490201:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425061a6a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e54f expref: 10 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.490212:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425061a6a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e54f expref: 10 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.490223:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1600, rc 0) 00000100:00100000:2.0:1746147206.490270:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310203648:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2100us (2802us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147206.490276:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19429 00010000:00010000:3.0:1746147206.490361:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822ac00, rc 0) 00000100:00100000:3.0:1746147206.490381:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2696:x1830967310203520:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3853us (4241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.490386:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19428 00000100:00100000:0.0:1746147206.494086:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311400064:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147206.494159:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d42200/0x3139939425061a71 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e556 expref: 24 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.494173:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d42200/0x3139939425061a71 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e556 expref: 24 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.494206:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d42200, rc 0) 00000100:00100000:0.0:1746147206.494255:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2001:x1830967310203776:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4861us (5644us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147206.494264:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19430 00000100:00100000:2.0:1746147206.496218:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310203904:12345-192.168.204.25@tcp:4:cat.0 Request processed in 6308us (6479us total) trans 21474842524 rc 0/0 00000100:00100000:2.0:1746147206.496229:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1663 00002000:00100000:2.0:1746147206.496240:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x93:0x0] (36864->290815) req@ffff880095148e00 x1830967310203904/t21474842524(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/448 e 0 to 0 dl 1746147217 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.496249:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095148e00 with x1830967310203904 ext(36864->290815) 00010000:00010000:2.0:1746147206.496260:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506196e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->290815) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4b5 expref: 9 pid: 13695 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.496274:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506196e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->290815) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4b5 expref: 9 pid: 13695 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746147206.496280:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095148e00 00000100:00100000:0.0:1746147206.518771:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.518834:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.518841:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310204032 00000100:00100000:2.0:1746147206.518851:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310204032 00000100:00100000:2.0:1746147206.518898:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19431 00000100:00100000:2.0:1746147206.518905:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2692:x1830967310204032:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.518924:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.518944:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009822b400/0x3139939425061a78 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e55d expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.518973:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x3139939425061936 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a0 expref: 21 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.518986:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147206.518987:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147206.518991:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009822b400/0x3139939425061a78 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e55d expref: 10 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.519022:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x3139939425061936 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a0 expref: 21 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.519033:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x3139939425061936 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a0 expref: 21 pid: 1398 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.519045:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311400192:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.519164:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147206.519185:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310204160 00000100:00100000:3.0:1746147206.519190:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310204160 00010000:00010000:3.0:1746147206.519211:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506196e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->290815) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4b5 expref: 11 pid: 13695 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.519230:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8809 00000100:00100000:3.0:1746147206.519235:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2000:x1830967310204160:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147206.519245:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147206.519264:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506196e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 36864->290815) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4b5 expref: 11 pid: 13695 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.519274:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506196e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 36864->290815) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4b5 expref: 11 pid: 13695 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.519291:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x313993942506196e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 36864->290815) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4b5 expref: 11 pid: 13695 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.519312:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.519314:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.519321:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009822ac00/0x3139939425061a63 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e548 expref: 21 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.519329:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009822ac00/0x3139939425061a63 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e548 expref: 21 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.519347:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009822ac00/0x3139939425061a63 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e548 expref: 21 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.519353:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311400320:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147206.519376:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.523036:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311400192:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.523070:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009822b400/0x3139939425061a78 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e55d expref: 10 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.523112:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822b400, rc 0) 00000100:00100000:3.0:1746147206.523125:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311400320:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147206.523138:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147206.523166:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2692:x1830967310204032:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4260us (4408us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.523175:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19431 00000100:00100000:0.0:1746147206.523791:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.523824:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310204160:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4586us (4987us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.523833:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8809 00000100:00100000:2.0:1746147206.524027:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310204288 00000100:00100000:2.0:1746147206.524033:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310204288 00002000:00100000:2.0:1746147206.524067:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (4063232->4194303) req@ffff88012f3cf480 x1830967310204288/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.524082:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cf480 with x1830967310204288 ext(4063232->4194303) 00010000:00010000:2.0:1746147206.524112:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x3139939425061936 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a0 expref: 22 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.524126:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x3139939425061936 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a0 expref: 22 pid: 1398 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746147206.524133:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f3cf480 00000100:00100000:2.0:1746147206.524151:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1664 00000100:00100000:2.0:1746147206.524157:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2000:x1830967310204288:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147206.530792:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.531137:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310204544 00000100:00100000:3.0:1746147206.531145:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310204544 00000100:00100000:3.0:1746147206.531196:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16360 00000100:00100000:3.0:1746147206.531204:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2698:x1830967310204544:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147206.531229:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.531248:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x3139939425061a7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e564 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.531315:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425061a86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531326:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425061a86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531334:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425061a86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531342:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425061a8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531346:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425061a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531349:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425061a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531569:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425061a94 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531579:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425061a94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531584:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425061a94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147206.531592:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147206.531642:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425061a86 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531648:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425061a86 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531653:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425061a86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531659:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425061a86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531664:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0c600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147206.531668:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425061a86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531674:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425061a86 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531683:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147206.531686:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147206.531689:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425061a86 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531697:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425061a86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531721:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425061a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531725:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425061a8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531730:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425061a8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531744:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0ca00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147206.531746:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425061a8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531750:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425061a8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531756:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800930f4500) 00010000:00010000:3.0:1746147206.531758:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147206.531760:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425061a8d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531765:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425061a8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.531796:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0da00/0x3139939425061a7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e564 expref: 36 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.531806:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425061a94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e564 expref: 35 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.531817:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147206.531819:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147206.531821:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0d200, rc 0) 00000100:00100000:3.0:1746147206.531941:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2698:x1830967310204544:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 736us (1159us total) trans 8589937244 rc 0/0 00000100:00100000:3.0:1746147206.531947:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16360 00000100:00100000:2.0:1746147206.532363:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310204288:12345-192.168.204.25@tcp:4:cat.0 Request processed in 8204us (8571us total) trans 21474842525 rc 0/0 00000100:00100000:2.0:1746147206.532372:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1664 00002000:00100000:2.0:1746147206.532380:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (4063232->4194303) req@ffff88012f3cf480 x1830967310204288/t21474842525(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/448 e 0 to 0 dl 1746147217 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.532388:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3cf480 with x1830967310204288 ext(4063232->4194303) 00010000:00010000:2.0:1746147206.532397:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x3139939425061936 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a0 expref: 24 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.532408:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x3139939425061936 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a0 expref: 24 pid: 1398 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746147206.532414:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f3cf480 00000100:00100000:1.0:1746147206.532592:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.532744:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.532774:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.532850:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310204800 00000100:00100000:0.0:1746147206.532855:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310204800 00000100:00100000:3.0:1746147206.532873:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310205184 00000100:00100000:3.0:1746147206.532877:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310205184 00002000:00100000:0.0:1746147206.532879:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880095148a80 x1830967310204800/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147206.532886:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095148a80 with x1830967310204800 ext(0->1048575) 00002000:00010000:0.0:1746147206.532889:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095148a80 00000100:00100000:0.0:1746147206.532902:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310205056 00000100:00100000:0.0:1746147206.532904:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310205056 00002000:00100000:0.0:1746147206.532916:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880095148380 x1830967310205056/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147206.532923:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095148380 with x1830967310205056 ext(1048576->2097151) 00002000:00010000:0.0:1746147206.532926:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095148380 00000100:00100000:0.0:1746147206.532937:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7143 00000100:00100000:0.0:1746147206.532942:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310204800:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147206.532995:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16361 00000100:00100000:3.0:1746147206.533000:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+6:2699:x1830967310205184:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147206.533012:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.533023:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425061aa2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e56b expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.533062:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x3139939425061aa9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.533071:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x3139939425061aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.533078:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x3139939425061aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.533106:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x3139939425061ab0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.533113:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x3139939425061ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.533122:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x3139939425061ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:2.0:1746147206.533139:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7144 00000100:00100000:2.0:1746147206.533147:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310205056:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:3.0:1746147206.533166:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.533175:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097034000/0x31399394250619c9 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ed expref: 15 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.533182:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.533210:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097034000/0x31399394250619c9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ed expref: 15 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.533220:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097034000/0x31399394250619c9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ed expref: 15 pid: 9138 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.533233:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311400448:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147206.533283:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147206.533889:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.533945:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310205440 00000100:00100000:3.0:1746147206.533948:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310205440 00002000:00100000:3.0:1746147206.533963:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88009689aa00 x1830967310205440/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.533969:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689aa00 with x1830967310205440 ext(1048576->2097151) 00002000:00010000:3.0:1746147206.533971:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009689aa00 00000100:00100000:3.0:1746147206.533984:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7145 00000100:00100000:3.0:1746147206.533987:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310205440:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147206.534674:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.534693:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310205568 00000100:00100000:2.0:1746147206.534696:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310205568 00000100:00100000:2.0:1746147206.534723:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 981 00000100:00100000:2.0:1746147206.534728:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967310205568:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147206.534744:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147206.534762:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425061a94 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e564 expref: 35 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.534780:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147206.534784:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.534791:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.534795:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.534799:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147206.534816:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967310205568:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 88us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.534821:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 981 00000100:00100000:2.0:1746147206.534885:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311400448:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.534903:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147206.538508:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.538556:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.538851:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310205696 00000100:00100000:2.0:1746147206.538861:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310205696 00010000:00010000:2.0:1746147206.538898:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097034000/0x31399394250619c9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ed expref: 16 pid: 9138 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.538925:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310205824 00000100:00100000:3.0:1746147206.538930:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310205824 00000100:00100000:2.0:1746147206.538930:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8810 00000100:00100000:2.0:1746147206.538937:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310205696:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147206.538950:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x3139939425061936 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a0 expref: 26 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.538950:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147206.538955:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097034000/0x31399394250619c9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ed expref: 16 pid: 9138 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.538966:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097034000/0x31399394250619c9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ed expref: 16 pid: 9138 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.538968:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8811 00000100:00100000:3.0:1746147206.538973:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310205824:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147206.538980:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147206.538988:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097034000/0x31399394250619c9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4ed expref: 16 pid: 9138 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.539000:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x3139939425061936 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a0 expref: 26 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.539003:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147206.539007:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.539014:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x3139939425061936 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a0 expref: 26 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.539015:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.539022:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.539028:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093715c00/0x3139939425061936 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a0 expref: 26 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.539041:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.539042:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.539043:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147206.539049:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009822b400/0x3139939425061a78 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e55d expref: 8 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.539056:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009822b400/0x3139939425061a78 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e55d expref: 8 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.539081:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009822b400/0x3139939425061a78 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e55d expref: 8 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147206.539109:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310205696:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 172us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.539112:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311400576:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147206.539116:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8810 00010000:00010000:2.0:1746147206.539139:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.539145:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:3.0:1746147206.539158:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e000 going to sleep for 11 seconds 00000004:00200000:2.0:1746147206.539193:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:2.0:1746147206.539197:0:9138:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147206.539214:0:9138:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.539224:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.539235:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x3139939425061aa9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.539240:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x3139939425061aa9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.539245:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x3139939425061aa9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.539250:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x3139939425061aa9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.539256:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0de00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147206.539259:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x3139939425061aa9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.539265:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x3139939425061aa9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.539272:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147206.539275:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147206.539278:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x3139939425061aa9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.539283:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x3139939425061aa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.539293:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x3139939425061ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.539298:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x3139939425061ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.539302:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x3139939425061ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.539305:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093715000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147206.539306:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x3139939425061ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.539310:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x3139939425061ab0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.539316:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800930f4a00) 00010000:00010000:2.0:1746147206.539318:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147206.539320:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x3139939425061ab0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.539324:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x3139939425061ab0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.539353:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x3139939425061aa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e56b expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.539365:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e56b expref: 7 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.539372:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147206.539373:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147206.539375:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715200, rc 0) 00000100:00100000:2.0:1746147206.539412:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2699:x1830967310205184:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 6411us (6637us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.539417:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16361 00000100:00100000:2.0:1746147206.541401:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310204800:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8447us (8798us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147206.541414:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7143 00002000:00100000:2.0:1746147206.541428:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880095148a80 x1830967310204800/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.541438:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095148a80 with x1830967310204800 ext(0->1048575) 00002000:00010000:2.0:1746147206.541443:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095148a80 00000100:00100000:3.0:1746147206.546980:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311400576:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147206.547004:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147206.547515:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310205056:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14364us (14776us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147206.547526:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7144 00002000:00100000:0.0:1746147206.547540:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880095148380 x1830967310205056/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147206.547550:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095148380 with x1830967310205056 ext(1048576->2097151) 00002000:00010000:0.0:1746147206.547555:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095148380 00000100:00100000:3.0:1746147206.547660:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2000:x1830967310205824:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8684us (9101us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.547669:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8811 00000100:00100000:1.0:1746147206.551979:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.552115:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310206080 00000100:00100000:0.0:1746147206.552124:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310206080 00002000:00100000:0.0:1746147206.552165:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880096898e00 x1830967310206080/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147206.552176:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096898e00 with x1830967310206080 ext(2097152->3145727) 00002000:00010000:0.0:1746147206.552181:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096898e00 00000100:00100000:0.0:1746147206.552209:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7146 00000100:00100000:0.0:1746147206.552215:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310206080:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147206.557327:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.557361:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.557396:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310206208 00000100:00100000:2.0:1746147206.557406:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310206208 00000100:00100000:2.0:1746147206.557446:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310206336 00000100:00100000:2.0:1746147206.557447:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310206336 00000100:00100000:2.0:1746147206.557463:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19432 00000100:00100000:2.0:1746147206.557471:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2698:x1830967310206208:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147206.557493:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.557514:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061abe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e572 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.557545:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009822ac00/0x3139939425061a63 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e548 expref: 24 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.557557:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.557559:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.557562:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061abe lrc: 4/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [909312->1048575] (req 909312->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e572 expref: 24 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.557596:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009822ac00/0x3139939425061a63 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e548 expref: 24 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.557609:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009822ac00/0x3139939425061a63 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e548 expref: 24 pid: 13695 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.557622:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311400704:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.557706:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094154c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.557730:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19433 00000100:00100000:2.0:1746147206.557749:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2689:x1830967310206336:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147206.557757:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.557773:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425061ac5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e579 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.557793:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x3139939425061a16 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e517 expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.557800:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425061a47 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e533 expref: 37 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.557810:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.557812:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.557814:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425061ac5 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1425408->2097151] (req 1425408->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e579 expref: 24 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.557931:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425061a47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e533 expref: 36 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.557940:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425061a47 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e533 expref: 36 pid: 10340 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746147206.557947:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310205440:12345-192.168.204.25@tcp:3:cat.0 Request processed in 23956us (24056us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147206.557949:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311400832:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147206.557959:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7145 00002000:00100000:3.0:1746147206.557968:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88009689aa00 x1830967310205440/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.557978:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689aa00 with x1830967310205440 ext(1048576->2097151) 00010000:00010000:2.0:1746147206.557981:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x3139939425061a16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e517 expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147206.557983:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009689aa00 00010000:00010000:2.0:1746147206.557989:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x3139939425061a16 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e517 expref: 24 pid: 17600 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.557996:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311400960:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.558013:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.561267:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.561305:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.561329:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.561358:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.561371:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.561397:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310206464 00000100:00100000:0.0:1746147206.561405:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310206464 00000100:00100000:2.0:1746147206.561422:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310206592 00000100:00100000:2.0:1746147206.561426:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310206592 00000100:00100000:0.0:1746147206.561443:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310206720 00000100:00100000:0.0:1746147206.561445:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310206720 00000100:00100000:2.0:1746147206.561449:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310206848 00000100:00100000:2.0:1746147206.561452:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310206848 00000100:00100000:0.0:1746147206.561457:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310206976 00000100:00100000:0.0:1746147206.561459:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310206976 00000100:00100000:2.0:1746147206.561468:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19434 00000100:00100000:2.0:1746147206.561475:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310206464:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:0.0:1746147206.561692:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19435 00000100:00100000:0.0:1746147206.561698:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967310206592:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147206.561713:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147206.561740:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d42000/0x3139939425061acc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e587 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.561766:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.561776:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d42000/0x3139939425061acc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e587 expref: 22 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.561787:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d42000/0x3139939425061acc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e587 expref: 22 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.561800:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d42000, rc 0) 00000100:00100000:0.0:1746147206.561839:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967310206592:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 142us (534us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147206.561845:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19435 00010000:00010000:2.0:1746147206.561858:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147206.561859:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19436 00000100:00100000:0.0:1746147206.561863:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967310206720:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147206.561868:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.561871:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093715800/0x3139939425061ad3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e580 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.561874:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425061ada lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e58e expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.561883:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.561884:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.561887:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.561892:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425061ada lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e58e expref: 21 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.561893:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093715800/0x3139939425061ad3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e580 expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.561900:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093715800/0x3139939425061ad3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e580 expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.561905:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425061ada lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e58e expref: 21 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.561912:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715800, rc 0) 00010000:00010000:0.0:1746147206.561913:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43600, rc 0) 00000100:00100000:0.0:1746147206.561925:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2000:x1830967310206720:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 62us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147206.561930:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19436 00000100:00100000:2.0:1746147206.561932:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310206464:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 457us (676us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147206.561938:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19434 00000100:00100000:0.0:1746147206.561941:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19437 00000100:00100000:0.0:1746147206.561946:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310206848:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:2.0:1746147206.561950:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19438 00010000:00010000:0.0:1746147206.561952:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147206.561955:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967310206976:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147206.561958:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425061ae1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e595 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.561961:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147206.561968:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.561969:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425061ae8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e59c expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.561970:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.561974:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425061ae1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e595 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.561983:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425061ae1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e595 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.561990:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d42c00, rc 0) 00000100:00100000:0.0:1746147206.562004:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310206848:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 58us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.562008:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311401088:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147206.562008:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19437 00000100:00100000:2.0:1746147206.562057:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989856c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.562148:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310206080:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9932us (10177us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147206.562156:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7146 00002000:00100000:0.0:1746147206.562166:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880096898e00 x1830967310206080/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147206.562182:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096898e00 with x1830967310206080 ext(2097152->3145727) 00002000:00010000:0.0:1746147206.562186:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096898e00 00000100:00100000:3.0:1746147206.564595:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311400832:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147206.564672:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311400704:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147206.564703:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061abe lrc: 3/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [909312->1048575] (req 909312->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e572 expref: 24 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.564720:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c200, rc 0) 00000100:00100000:0.0:1746147206.564769:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2698:x1830967310206208:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7297us (7452us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147206.564777:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19432 00000100:00100000:3.0:1746147206.566358:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.566427:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311400960:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147206.566456:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425061ac5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1425408->2097151] (req 1425408->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e579 expref: 24 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.566468:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0ca00, rc 0) 00000100:00100000:0.0:1746147206.566496:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2689:x1830967310206336:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8748us (9133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147206.566502:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19433 00000100:00100000:3.0:1746147206.566688:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.567264:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.567774:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310207104 00000100:00100000:2.0:1746147206.567783:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310207104 00010000:00010000:2.0:1746147206.567816:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009822ac00/0x3139939425061a63 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e548 expref: 24 pid: 13695 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.567845:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310207232 00000100:00100000:2.0:1746147206.567848:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310207232 00010000:00010000:2.0:1746147206.567860:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x3139939425061a16 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e517 expref: 24 pid: 17600 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.567875:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310207360 00000100:00100000:2.0:1746147206.567877:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310207360 00010000:00010000:2.0:1746147206.567887:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425061a47 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e533 expref: 36 pid: 10340 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746147206.567919:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8812 00000100:00100000:3.0:1746147206.567927:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2002:x1830967310207104:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147206.567943:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147206.567968:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009822ac00/0x3139939425061a63 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e548 expref: 24 pid: 13695 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.567985:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009822ac00/0x3139939425061a63 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e548 expref: 24 pid: 13695 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.568011:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009822ac00/0x3139939425061a63 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e548 expref: 24 pid: 13695 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.568415:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8813 00000100:00100000:2.0:1746147206.568422:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2003:x1830967310207232:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147206.568430:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147206.568444:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x3139939425061a16 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e517 expref: 24 pid: 17600 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.568451:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x3139939425061a16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e517 expref: 24 pid: 17600 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.568464:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b0400/0x3139939425061a16 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e517 expref: 24 pid: 17600 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.568478:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147206.568511:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2003:x1830967310207232:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 91us (1823us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.568516:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8813 00000100:00100000:2.0:1746147206.568532:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8814 00000100:00100000:2.0:1746147206.568537:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310207360:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147206.568543:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147206.568549:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425061a47 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e533 expref: 36 pid: 10340 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746147206.568558:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425061a47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e533 expref: 36 pid: 10340 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746147206.568568:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ce00/0x3139939425061a47 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e533 expref: 36 pid: 10340 timeout: 844 lvb_type: 1 00010000:00010000:2.0:1746147206.568575:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.568577:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.568584:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425061ac5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e579 expref: 22 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.568591:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425061ac5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e579 expref: 22 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.568622:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425061ac5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e579 expref: 22 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147206.568634:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311401216:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147206.568680:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985540 going to sleep for 11 seconds 00010000:00010000:3.0:1746147206.568740:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.568741:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.568746:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061abe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e572 expref: 23 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.568752:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061abe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e572 expref: 23 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.568772:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061abe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e572 expref: 23 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.568780:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093147b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311401344:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147206.568802:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.570517:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311401088:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147206.570555:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425061ae8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e59c expref: 21 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.570568:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093715c00/0x3139939425061ae8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e59c expref: 21 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.570581:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715c00, rc 0) 00000100:00100000:0.0:1746147206.570621:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967310206976:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 8664us (9247us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147206.570629:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19438 00000100:00100000:0.0:1746147206.570703:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.570867:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.570889:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310207488 00000100:00100000:0.0:1746147206.570895:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310207488 00000100:00100000:0.0:1746147206.570924:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310207616 00000100:00100000:0.0:1746147206.570927:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310207616 00000100:00100000:0.0:1746147206.570942:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19439 00000100:00100000:0.0:1746147206.570948:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2692:x1830967310207488:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147206.570964:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147206.570979:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061aef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e5a3 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147206.571119:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19440 00000100:00100000:1.0:1746147206.571127:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2696:x1830967310207616:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147206.571135:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147206.571148:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936b7200/0x3139939425061af6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e5aa expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.571165:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147206.571168:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147206.571174:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800936b7200/0x3139939425061af6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5aa expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.571187:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800936b7200/0x3139939425061af6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5aa expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.571196:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936b7200, rc 0) 00000100:00100000:1.0:1746147206.571215:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2696:x1830967310207616:12345-192.168.204.25@tcp:101:cat.0 Request processed in 89us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147206.571220:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19440 00010000:00010000:0.0:1746147206.571870:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.571873:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.571879:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061aef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5a3 expref: 24 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.571889:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061aef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5a3 expref: 24 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.571897:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d42600, rc 0) 00000100:00100000:0.0:1746147206.571913:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2692:x1830967310207488:12345-192.168.204.25@tcp:101:cat.0 Request processed in 965us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147206.571918:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19439 00000100:00100000:3.0:1746147206.574475:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093147b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311401344:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147206.574502:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147206.574538:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2002:x1830967310207104:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6612us (8184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.574549:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8812 00000100:00100000:2.0:1746147206.574897:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311401216:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147206.574918:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147206.574939:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967310207360:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6402us (7674us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.574946:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8814 00000100:00100000:0.0:1746147206.576193:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.576233:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.576271:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.576335:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310207872 00000100:00100000:3.0:1746147206.576342:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310207872 00000100:00100000:3.0:1746147206.576390:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16362 00000100:00100000:3.0:1746147206.576397:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2699:x1830967310207872:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147206.576416:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.576434:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0400/0x3139939425061afd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e5b1 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.576541:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0e00/0x3139939425061b04 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.576556:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e56b expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.576564:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0e00/0x3139939425061b04 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.576594:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e56b expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.576607:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e56b expref: 8 pid: 9138 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.576619:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093147b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311401472:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147206.576684:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147206.576706:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310208128 00000100:00100000:3.0:1746147206.576709:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310208128 00002000:00100000:3.0:1746147206.576744:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x93:0x0] (909312->913407) req@ffff8800909f9880 x1830967310208128/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.576753:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f9880 with x1830967310208128 ext(909312->913407) 00002000:00010000:3.0:1746147206.576759:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909f9880 00000100:00100000:3.0:1746147206.578423:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310208384 00000100:00100000:3.0:1746147206.578431:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310208384 00002000:00100000:3.0:1746147206.578459:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x96:0x0] (1425408->1429503) req@ffff8800909fa680 x1830967310208384/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.578467:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fa680 with x1830967310208384 ext(1425408->1429503) 00002000:00010000:3.0:1746147206.578472:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909fa680 00000100:00100000:3.0:1746147206.578486:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7147 00000100:00100000:3.0:1746147206.578492:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967310208128:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147206.578722:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7148 00000100:00100000:1.0:1746147206.578730:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2003:x1830967310208384:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147206.578892:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967310208128:12345-192.168.204.25@tcp:3:cat.0 Request processed in 399us (2656us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147206.578900:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7147 00002000:00100000:3.0:1746147206.578905:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x93:0x0] (909312->913407) req@ffff8800909f9880 x1830967310208128/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/4536 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.578913:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f9880 with x1830967310208128 ext(909312->913407) 00002000:00010000:3.0:1746147206.578916:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909f9880 00000100:00100000:1.0:1746147206.579173:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2003:x1830967310208384:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 443us (2901us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147206.579183:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7148 00002000:00100000:1.0:1746147206.579188:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x96:0x0] (1425408->1429503) req@ffff8800909fa680 x1830967310208384/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/4536 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.579195:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fa680 with x1830967310208384 ext(1425408->1429503) 00002000:00010000:1.0:1746147206.579197:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909fa680 00000100:00100000:0.0:1746147206.580940:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.580974:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.581171:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310208768 00000100:00100000:2.0:1746147206.581178:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310208768 00002000:00100000:2.0:1746147206.581219:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800909f8000 x1830967310208768/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.581229:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8000 with x1830967310208768 ext(3145728->4194303) 00002000:00010000:2.0:1746147206.581233:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909f8000 00000100:00100000:3.0:1746147206.581349:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093147b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311401472:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147206.581374:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0e00/0x3139939425061b04 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147206.581448:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.581968:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310208896 00000100:00100000:2.0:1746147206.581971:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310208896 00002000:00100000:2.0:1746147206.581990:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3145727) req@ffff88011e485f80 x1830967310208896/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.581998:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e485f80 with x1830967310208896 ext(2097152->3145727) 00002000:00010000:2.0:1746147206.582002:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e485f80 00000100:00100000:1.0:1746147206.582624:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7149 00000100:00100000:1.0:1746147206.582634:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310208768:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147206.583531:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7150 00000100:00100000:2.0:1746147206.583541:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2000:x1830967310208896:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147206.585318:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310209024 00000100:00100000:3.0:1746147206.585328:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310209024 00010000:00010000:3.0:1746147206.585365:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e56b expref: 9 pid: 9138 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.585395:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8815 00000100:00100000:3.0:1746147206.585402:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310209024:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147206.585414:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147206.585419:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e56b expref: 9 pid: 9138 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.585431:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e56b expref: 9 pid: 9138 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.585461:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425061ab7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e56b expref: 9 pid: 9138 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.585483:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147206.585488:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0e00/0x3139939425061b04 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.585501:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0e00/0x3139939425061b04 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.585508:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0e00/0x3139939425061b04 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.585528:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147206.585560:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967310209024:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 157us (4112us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.585568:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8815 00010000:00010000:3.0:1746147206.585589:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0e00/0x3139939425061b04 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.585596:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0e00/0x3139939425061b04 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147206.585618:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147206.585768:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0400/0x3139939425061afd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b1 expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.585783:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0e00/0x3139939425061b04 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b1 expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.585789:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147206.585791:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147206.585793:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57a0e00, rc 0) 00000100:00100000:3.0:1746147206.585813:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2699:x1830967310207872:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 9416us (9625us total) trans 8589937245 rc 0/0 00000100:00100000:3.0:1746147206.585820:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16362 00000100:00100000:2.0:1746147206.587002:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.587059:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310209152 00000100:00100000:0.0:1746147206.587065:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310209152 00000100:00100000:2.0:1746147206.587069:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.587104:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310209408 00000100:00100000:2.0:1746147206.587108:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310209408 00000100:00100000:0.0:1746147206.587111:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19441 00000100:00100000:0.0:1746147206.587118:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2698:x1830967310209152:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147206.587132:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746147206.587140:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009455d180 x1830967310209408/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.587148:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455d180 with x1830967310209408 ext(2097152->4194303) 00010000:00010000:0.0:1746147206.587149:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061b12 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e5b8 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147206.587154:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009455d180 00010000:00010000:0.0:1746147206.587178:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425061ac5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e579 expref: 25 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.587185:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147206.587187:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147206.587191:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061b12 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->1290239] (req 1048576->1290239) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b8 expref: 36 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.587217:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425061ac5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e579 expref: 25 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.587228:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425061ac5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e579 expref: 25 pid: 10340 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746147206.587240:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311401600:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147206.587299:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095afff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.587498:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7151 00000100:00100000:2.0:1746147206.587504:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310209408:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147206.589739:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.589772:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310209536 00000100:00100000:0.0:1746147206.589781:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310209536 00000100:00100000:0.0:1746147206.589829:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19442 00000100:00100000:0.0:1746147206.589837:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2689:x1830967310209536:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147206.589855:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147206.589872:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425061b19 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e5bf expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.589901:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425061a1d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e51e expref: 27 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.589911:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425061ada lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e58e expref: 19 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.589918:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425061a5c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e53a expref: 36 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.589925:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.589926:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.589930:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425061b19 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [1048576->1421311] (req 1048576->1421311) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5bf expref: 27 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.589961:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425061a5c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e53a expref: 36 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.589974:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425061a5c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e53a expref: 36 pid: 17600 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746147206.589986:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311401728:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147206.590122:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425061ada lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e58e expref: 19 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.590131:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425061ada lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e58e expref: 19 pid: 9586 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746147206.590139:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311401856:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.592193:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311401600:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.592223:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061b12 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->1290239] (req 1048576->1290239) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b8 expref: 36 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.592237:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43c00, rc 0) 00000100:00100000:2.0:1746147206.592267:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2698:x1830967310209152:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5149us (5268us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.592276:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19441 00000100:00100000:1.0:1746147206.593172:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310208768:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 10536us (12234us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147206.593182:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7149 00002000:00100000:1.0:1746147206.593198:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800909f8000 x1830967310208768/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.593207:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8000 with x1830967310208768 ext(3145728->4194303) 00002000:00010000:1.0:1746147206.593211:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909f8000 00010000:00010000:0.0:1746147206.593478:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425061a1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e51e expref: 27 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.593492:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425061a1d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e51e expref: 27 pid: 17600 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746147206.593503:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311401984:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147206.593536:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095affd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.599455:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311401728:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147206.600583:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.600699:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.600815:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310209664 00000100:00100000:1.0:1746147206.600824:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310209664 00002000:00100000:1.0:1746147206.600872:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x96:0x0] (1425408->2097151) req@ffff8800769adf80 x1830967310209664/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.600883:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769adf80 with x1830967310209664 ext(1425408->2097151) 00010000:00010000:1.0:1746147206.600893:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425061ac5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e579 expref: 28 pid: 10340 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.600907:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425061ac5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e579 expref: 28 pid: 10340 timeout: 844 lvb_type: 0 00002000:00010000:1.0:1746147206.600914:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800769adf80 00000100:00100000:1.0:1746147206.600951:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1665 00000100:00100000:1.0:1746147206.600959:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2003:x1830967310209664:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:3.0:1746147206.601893:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310209792 00000100:00100000:3.0:1746147206.601903:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310209792 00010000:00010000:3.0:1746147206.601936:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425061a5c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e53a expref: 36 pid: 17600 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746147206.601981:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8816 00000100:00100000:3.0:1746147206.601989:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310209792:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147206.602001:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147206.602017:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425061a5c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e53a expref: 36 pid: 17600 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746147206.602027:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425061a5c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e53a expref: 36 pid: 17600 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746147206.602050:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425061a5c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e53a expref: 36 pid: 17600 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746147206.602072:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147206.602078:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311401856:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.602109:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311401984:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.602141:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425061b19 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->1421311] (req 1048576->1421311) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5bf expref: 29 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.602142:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967310209792:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 154us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.602148:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8816 00010000:00010000:2.0:1746147206.602154:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1600, rc 0) 00000100:00100000:2.0:1746147206.602181:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2689:x1830967310209536:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 12344us (12459us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.602188:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19442 00000100:00100000:2.0:1746147206.603896:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.604250:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.604370:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310209920 00000100:00100000:1.0:1746147206.604370:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310210048 00000100:00100000:3.0:1746147206.604378:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310209920 00000100:00100000:1.0:1746147206.604378:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310210048 00010000:00010000:3.0:1746147206.604409:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425061ada lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e58e expref: 20 pid: 9586 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746147206.604409:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425061a1d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e51e expref: 29 pid: 17600 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.604435:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8817 00000100:00100000:1.0:1746147206.604440:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8818 00000100:00100000:3.0:1746147206.604442:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967310209920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147206.604446:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2000:x1830967310210048:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147206.604453:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147206.604453:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147206.604471:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425061ada lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e58e expref: 20 pid: 9586 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746147206.604471:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425061a1d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e51e expref: 29 pid: 17600 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.604481:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425061ada lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e58e expref: 20 pid: 9586 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746147206.604565:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425061a1d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e51e expref: 28 pid: 17600 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.604586:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425061a1d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e51e expref: 28 pid: 17600 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.604587:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2000:x1830967310208896:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 21048us (23611us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147206.604599:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7150 00010000:00010000:1.0:1746147206.604603:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746147206.604609:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3145727) req@ffff88011e485f80 x1830967310208896/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.604618:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e485f80 with x1830967310208896 ext(2097152->3145727) 00002000:00010000:2.0:1746147206.604622:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e485f80 00000100:00100000:1.0:1746147206.604622:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2000:x1830967310210048:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 176us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147206.604628:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8818 00010000:00010000:3.0:1746147206.604985:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x3139939425061ada lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e58e expref: 20 pid: 9586 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746147206.604996:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.604999:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.605006:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425061b19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1421311) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5bf expref: 25 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.605014:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425061b19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1421311) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5bf expref: 25 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.605043:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425061b19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1421311) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5bf expref: 25 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.605056:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093147b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311402112:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147206.605606:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.606171:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.606292:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310210176 00000100:00100000:3.0:1746147206.606299:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310210176 00000100:00100000:3.0:1746147206.606337:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16363 00000100:00100000:3.0:1746147206.606344:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2699:x1830967310210176:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147206.606455:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.606473:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425061b20 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e5c6 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.606572:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425061b27 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.606585:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0e00/0x3139939425061b04 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b1 expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.606592:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425061b27 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.606616:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0e00/0x3139939425061b04 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b1 expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.606627:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0e00/0x3139939425061b04 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b1 expref: 9 pid: 9138 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.606636:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311402240:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147206.606694:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147206.612639:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093147b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311402112:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147206.612663:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147206.612726:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310209920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8282us (8834us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.612745:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8817 00000100:00100000:3.0:1746147206.612799:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311402240:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147206.612814:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425061b27 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:2.0:1746147206.612875:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.612932:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310210304 00000100:00100000:3.0:1746147206.612938:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310210304 00010000:00010000:3.0:1746147206.612962:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0e00/0x3139939425061b04 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b1 expref: 10 pid: 9138 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.612992:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8819 00000100:00100000:3.0:1746147206.612998:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2003:x1830967310210304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147206.613010:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147206.613015:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0e00/0x3139939425061b04 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b1 expref: 10 pid: 9138 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.613030:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0e00/0x3139939425061b04 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b1 expref: 10 pid: 9138 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.613052:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0e00/0x3139939425061b04 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b1 expref: 10 pid: 9138 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.613066:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147206.613070:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425061b27 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.613080:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425061b27 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.613142:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425061b27 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.613592:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147206.614162:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2003:x1830967310210304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1162us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.614169:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8819 00000100:00100000:2.0:1746147206.614470:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2003:x1830967310209664:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 13510us (13890us total) trans 17179875141 rc 0/0 00010000:00010000:0.0:1746147206.614476:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425061b27 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:2.0:1746147206.614479:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1665 00010000:00010000:0.0:1746147206.614485:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425061b27 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00002000:00100000:2.0:1746147206.614489:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x96:0x0] (1425408->2097151) req@ffff8800769adf80 x1830967310209664/t17179875141(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/448 e 0 to 0 dl 1746147217 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.614498:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769adf80 with x1830967310209664 ext(1425408->2097151) 00010000:00010000:2.0:1746147206.614506:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425061ac5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e579 expref: 26 pid: 10340 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.614520:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425061ac5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e579 expref: 26 pid: 10340 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746147206.614527:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800769adf80 00000004:00200000:0.0:1746147206.614539:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:0.0:1746147206.614543:0:9138:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1746147206.614544:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000004:00010000:0.0:1746147206.614560:0:9138:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425061b27 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:2.0:1746147206.614563:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310210560 00000100:00100000:2.0:1746147206.614567:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310210560 00002000:00100000:2.0:1746147206.614590:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x97:0x0] (1417216->1421311) req@ffff88009689ad80 x1830967310210560/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746147206.614592:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425061b20 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5c6 expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147206.614597:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689ad80 with x1830967310210560 ext(1417216->1421311) 00002000:00010000:2.0:1746147206.614601:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009689ad80 00010000:00010000:0.0:1746147206.614609:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425061b27 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5c6 expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147206.614615:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7152 00010000:00010000:0.0:1746147206.614616:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147206.614619:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:2.0:1746147206.614621:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2002:x1830967310210560:12345-192.168.204.25@tcp:3:multiop.0 00010000:00010000:0.0:1746147206.614622:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d6c00, rc 0) 00000100:00100000:0.0:1746147206.614643:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2699:x1830967310210176:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 8300us (8475us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147206.614650:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16363 00000100:00100000:2.0:1746147206.614720:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2002:x1830967310210560:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 99us (176us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147206.614726:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7152 00002000:00100000:2.0:1746147206.614744:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x97:0x0] (1417216->1421311) req@ffff88009689ad80 x1830967310210560/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/4536 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.614752:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689ad80 with x1830967310210560 ext(1417216->1421311) 00002000:00010000:2.0:1746147206.614755:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009689ad80 00000100:00100000:2.0:1746147206.614842:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310209408:12345-192.168.204.25@tcp:3:cat.0 Request processed in 27338us (27772us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147206.614849:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7151 00002000:00100000:2.0:1746147206.614854:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009455d180 x1830967310209408/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.614861:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455d180 with x1830967310209408 ext(2097152->4194303) 00002000:00010000:2.0:1746147206.614864:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009455d180 00000100:00100000:0.0:1746147206.616930:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.616968:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.616994:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310210816 00000100:00100000:0.0:1746147206.616997:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.617002:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310210816 00000100:00100000:0.0:1746147206.617019:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.617024:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310211072 00000100:00100000:3.0:1746147206.617029:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310211072 00000100:00100000:2.0:1746147206.617038:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310210688 00000100:00100000:2.0:1746147206.617040:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310210688 00000100:00100000:0.0:1746147206.617046:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.617047:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310210944 00000100:00100000:3.0:1746147206.617049:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310210944 00000100:00100000:2.0:1746147206.617056:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19443 00000100:00100000:2.0:1746147206.617062:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967310210816:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:0.0:1746147206.617064:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310211200 00000100:00100000:0.0:1746147206.617067:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310211200 00010000:00010000:2.0:1746147206.617076:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147206.617104:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425061ac5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e579 expref: 26 pid: 10340 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.617109:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425061b2e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e5d4 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147206.617133:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8820 00000100:00100000:0.0:1746147206.617139:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2003:x1830967310211200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147206.617143:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19444 00000100:00100000:3.0:1746147206.617148:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2001:x1830967310211072:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147206.617148:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147206.617155:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147206.617160:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311402368:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147206.617163:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d7c00/0x3139939425061b35 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e5e2 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.617169:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425061ac5 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1425408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e579 expref: 26 pid: 10340 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746147206.617181:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425061ac5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1425408->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e579 expref: 26 pid: 10340 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.617194:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311402496:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147206.617213:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.617215:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.617222:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061b12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b8 expref: 34 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.617227:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19445 00000100:00100000:2.0:1746147206.617228:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989856c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746147206.617231:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061b12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b8 expref: 34 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.617232:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310210688:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147206.617239:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147206.617246:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19446 00010000:00010000:3.0:1746147206.617249:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x3139939425061b3c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e5cd expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147206.617251:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2001:x1830967310210944:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147206.617252:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061b12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b8 expref: 34 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.617257:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147206.617260:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311402624:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147206.617265:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425061b43 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e5db expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.617269:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093147b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311402752:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147206.617278:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147206.617284:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.617286:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311402880:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147206.617292:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.617306:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa150540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.619461:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.619559:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.619575:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310211584 00000100:00100000:1.0:1746147206.619583:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310211584 00000100:00100000:1.0:1746147206.619629:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19447 00000100:00100000:1.0:1746147206.619638:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2692:x1830967310211584:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147206.619654:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147206.619669:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310211456 00000100:00100000:2.0:1746147206.619674:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310211456 00010000:00010000:1.0:1746147206.619674:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x3139939425061b4a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e5e9 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.619702:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57c1a00/0x3139939425061944 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a7 expref: 34 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.619710:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147206.619712:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1746147206.619714:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6096 00010000:00010000:1.0:1746147206.619715:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x3139939425061b4a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5e9 expref: 28 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147206.619720:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2689:x1830967310211456:12345-192.168.204.25@tcp:35:multiop.0 00010000:00010000:1.0:1746147206.619758:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57c1a00/0x3139939425061944 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a7 expref: 34 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.619772:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a57c1a00/0x3139939425061944 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a7 expref: 34 pid: 1398 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746147206.619785:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096899c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311403008:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147206.619861:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.619935:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2689:x1830967310211456:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 214us (374us total) trans 8589937246 rc 0/0 00000100:00100000:2.0:1746147206.619942:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6096 00000100:00100000:0.0:1746147206.622026:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.622065:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.622114:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310211712 00000100:00100000:3.0:1746147206.622120:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310211712 00000100:00100000:3.0:1746147206.622156:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310211840 00000100:00100000:3.0:1746147206.622158:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310211840 00000100:00100000:3.0:1746147206.622172:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19448 00000100:00100000:3.0:1746147206.622179:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310211712:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147206.622193:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.622208:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d9b200/0x3139939425061b51 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e5f0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147206.622208:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096899c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311403008:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147206.622234:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x3139939425061b4a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5e9 expref: 28 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.622247:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49800, rc 0) 00000100:00100000:3.0:1746147206.622253:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311403136:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147206.622265:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19449 00000100:00100000:2.0:1746147206.622280:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e21bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310211840:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.622286:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.622297:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092542200/0x3139939425061b58 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e5f7 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147206.622331:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098822d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311403264:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147206.622455:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311402624:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147206.622470:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147206.622474:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2692:x1830967310211584:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2837us (3024us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147206.622481:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19447 00000100:00100000:3.0:1746147206.622485:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.622490:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2003:x1830967310211200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5351us (5442us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147206.622499:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8820 00000100:00100000:3.0:1746147206.622526:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311402496:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147206.622546:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7c00/0x3139939425061b35 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5e2 expref: 24 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.622557:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7c00/0x3139939425061b35 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5e2 expref: 24 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.622567:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7c00, rc 0) 00000100:00100000:2.0:1746147206.622569:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147206.622587:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2001:x1830967310211072:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5438us (5617us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147206.622592:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19444 00010000:00010000:2.0:1746147206.622886:0:10340:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff88012f3cf800 x1830967311402368) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425061ac5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1425408->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e579 expref: 26 pid: 10340 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.622905:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x3139939425061ac5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1425408->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e579 expref: 26 pid: 10340 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746147206.623386:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.623391:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093147b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311402752:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147206.623412:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.623467:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310212096 00000100:00100000:1.0:1746147206.623472:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310212096 00002000:00100000:1.0:1746147206.623500:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4030463) req@ffff880096cf8700 x1830967310212096/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.623510:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf8700 with x1830967310212096 ext(3145728->4030463) 00010000:00010000:1.0:1746147206.623516:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a57c1a00/0x3139939425061944 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a7 expref: 39 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.623528:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a57c1a00/0x3139939425061944 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a7 expref: 39 pid: 1398 timeout: 844 lvb_type: 0 00002000:00010000:1.0:1746147206.623535:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096cf8700 00000100:00100000:2.0:1746147206.623548:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311402368:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147206.623549:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1666 00000100:00100000:1.0:1746147206.623555:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967310212096:12345-192.168.204.25@tcp:4:cat.0 00010000:00010000:2.0:1746147206.623569:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425061b2e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5d4 expref: 22 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.623579:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425061b2e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5d4 expref: 22 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.623585:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542800, rc 0) 00000100:00100000:2.0:1746147206.623610:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967310210816:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 6547us (6688us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147206.623615:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19443 00000100:00100000:2.0:1746147206.623629:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310211968 00000100:00100000:2.0:1746147206.623632:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310211968 00000100:00100000:2.0:1746147206.623644:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19450 00000100:00100000:2.0:1746147206.623648:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967310211968:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.623657:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.623664:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092543e00/0x3139939425061b5f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e5fe expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147206.623689:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098823480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311403392:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147206.623698:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x3139939425061b3c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5cd expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.623707:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d7000/0x3139939425061b3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5cd expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.623715:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7000, rc 0) 00000100:00100000:2.0:1746147206.623718:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147206.623741:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310210688:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 6509us (6743us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147206.623747:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19445 00002000:00010000:2.0:1746147206.623752:0:17600:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime: 1746147205 -> 1746147206 00000100:00100000:2.0:1746147206.623760:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311402880:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147206.624290:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425061b43 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5db expref: 20 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.624301:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x3139939425061b43 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5db expref: 20 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.624308:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092543a00, rc 0) 00000100:00100000:2.0:1746147206.624325:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310210944:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 7075us (7305us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147206.624332:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19446 00000100:00100000:2.0:1746147206.627848:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.627882:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310212352 00000100:00100000:0.0:1746147206.627891:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310212352 00002000:00100000:0.0:1746147206.627940:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x96:0x0] (1286144->1290239) req@ffff880097d74380 x1830967310212352/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147206.627982:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098822d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311403264:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147206.628016:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092542200/0x3139939425061b58 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5f7 expref: 43 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.628029:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092542200/0x3139939425061b58 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5f7 expref: 43 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.628045:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542200, rc 0) 00000100:00100000:2.0:1746147206.628085:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e21bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967310211840:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5808us (6018us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147206.628112:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19449 00002000:00010000:3.0:1746147206.628225:0:12225:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime: 1746147205 -> 1746147206 00000100:00100000:3.0:1746147206.628235:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311403136:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147206.628252:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d9b200/0x3139939425061b51 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5f0 expref: 41 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.628260:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d9b200/0x3139939425061b51 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5f0 expref: 41 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.628269:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9b200, rc 0) 00000100:00100000:3.0:1746147206.628289:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967310211712:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6111us (6269us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147206.628294:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19448 00002000:00100000:0.0:1746147206.628728:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d74380 with x1830967310212352 ext(1286144->1290239) 00002000:00010000:0.0:1746147206.628743:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d74380 00000100:00100000:3.0:1746147206.628972:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7153 00000100:00100000:3.0:1746147206.628979:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967310212352:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147206.629083:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967310212352:12345-192.168.204.25@tcp:3:cat.0 Request processed in 104us (1407us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147206.629104:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7153 00002000:00100000:3.0:1746147206.629109:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x96:0x0] (1286144->1290239) req@ffff880097d74380 x1830967310212352/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/4536 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.629115:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d74380 with x1830967310212352 ext(1286144->1290239) 00002000:00010000:3.0:1746147206.629117:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d74380 00000100:00100000:3.0:1746147206.631467:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098823480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311403392:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147206.631502:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092543e00/0x3139939425061b5f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5fe expref: 38 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.631516:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092543e00/0x3139939425061b5f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5fe expref: 38 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.631527:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092543e00, rc 0) 00000100:00100000:3.0:1746147206.631564:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310211968:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7914us (8178us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147206.631575:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19450 00000100:00100000:0.0:1746147206.632500:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.633393:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310212608 00000100:00100000:2.0:1746147206.633402:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310212608 00000100:00100000:2.0:1746147206.633455:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16364 00000100:00100000:2.0:1746147206.633462:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2699:x1830967310212608:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147206.633480:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.633501:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542c00/0x3139939425061b66 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e605 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.633597:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x3139939425061b6d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.633612:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x3139939425061b6d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.633624:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x3139939425061b6d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.633635:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x3139939425061b6d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.633641:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x3139939425061b6d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.633647:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x3139939425061b6d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.633655:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092543c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147206.633659:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x3139939425061b6d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.633665:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x3139939425061b6d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.633675:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147206.633678:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147206.633683:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x3139939425061b6d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.633687:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x3139939425061b6d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.633712:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542c00/0x3139939425061b66 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e605 expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.633718:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542c00/0x3139939425061b66 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e605 expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.633726:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542c00, rc 0) 00000100:00100000:2.0:1746147206.633778:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2699:x1830967310212608:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 316us (1282us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147206.633784:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16364 00000100:00100000:0.0:1746147206.635746:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.635891:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.635903:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967310212096:12345-192.168.204.25@tcp:4:cat.0 Request processed in 12346us (12488us total) trans 17179875142 rc 0/0 00000100:00100000:1.0:1746147206.635915:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1666 00002000:00100000:1.0:1746147206.636025:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4030463) req@ffff880096cf8700 x1830967310212096/t17179875142(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/448 e 0 to 0 dl 1746147217 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.636040:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf8700 with x1830967310212096 ext(3145728->4030463) 00010000:00010000:1.0:1746147206.636051:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a57c1a00/0x3139939425061944 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a7 expref: 37 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.636065:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a57c1a00/0x3139939425061944 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a7 expref: 37 pid: 1398 timeout: 844 lvb_type: 0 00002000:00010000:1.0:1746147206.636072:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096cf8700 00000100:00100000:1.0:1746147206.636183:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310213120 00000100:00100000:1.0:1746147206.636189:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310213120 00000100:00100000:0.0:1746147206.636206:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:1.0:1746147206.636219:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880096cfbb80 x1830967310213120/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.636226:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfbb80 with x1830967310213120 ext(4194304->4890623) 00002000:00010000:1.0:1746147206.636229:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cfbb80 00000100:00100000:1.0:1746147206.636252:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7154 00000100:00100000:1.0:1746147206.636259:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310213120:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147206.636842:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310212864 00000100:00100000:3.0:1746147206.636847:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310212864 00000100:00100000:3.0:1746147206.636909:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310213376 00000100:00100000:3.0:1746147206.636912:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310213376 00000100:00100000:2.0:1746147206.636946:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6097 00000100:00100000:2.0:1746147206.636955:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2698:x1830967310212864:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147206.637142:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2698:x1830967310212864:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 188us (1413us total) trans 8589937247 rc 0/0 00000100:00100000:2.0:1746147206.637149:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6097 00000100:00100000:2.0:1746147206.637161:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6098 00000100:00100000:2.0:1746147206.637166:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2699:x1830967310213376:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:2.0:1746147206.637217:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2699:x1830967310213376:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 51us (1010us total) trans 8589937248 rc 0/0 00000100:00100000:2.0:1746147206.637223:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6098 00000100:00100000:0.0:1746147206.639048:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.639328:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310213504 00000100:00100000:2.0:1746147206.639335:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310213504 00010000:00010000:2.0:1746147206.639370:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57c1a00/0x3139939425061944 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a7 expref: 37 pid: 1398 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.639411:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8821 00000100:00100000:2.0:1746147206.639418:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310213504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147206.639823:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147206.639847:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a57c1a00/0x3139939425061944 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a7 expref: 37 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.639860:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a57c1a00/0x3139939425061944 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a7 expref: 37 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.639886:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57c1a00/0x3139939425061944 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4a7 expref: 37 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.639904:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.639906:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.639914:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x3139939425061b4a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5e9 expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.639922:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x3139939425061b4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5e9 expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.639957:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x3139939425061b4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5e9 expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147206.639970:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311403520:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147206.640057:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147206.642300:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310213120:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6034us (6400us total) trans 0 rc 696320/696320 00000100:00100000:1.0:1746147206.642312:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7154 00002000:00100000:1.0:1746147206.642322:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880096cfbb80 x1830967310213120/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.642332:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfbb80 with x1830967310213120 ext(4194304->4890623) 00002000:00010000:1.0:1746147206.642338:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cfbb80 00000100:00100000:1.0:1746147206.645584:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.645636:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311403520:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147206.645656:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310213760 00010000:00010000:2.0:1746147206.645658:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147206.645663:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310213760 00000100:00100000:2.0:1746147206.645695:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310213504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6276us (6653us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.645705:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8821 00002000:00100000:0.0:1746147206.645705:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff880096899c00 x1830967310213760/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147206.645713:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096899c00 with x1830967310213760 ext(3145728->4194303) 00002000:00010000:0.0:1746147206.645718:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096899c00 00000100:00100000:0.0:1746147206.645743:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7155 00000100:00100000:0.0:1746147206.645750:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2000:x1830967310213760:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147206.649160:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.649205:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.649407:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310214016 00000100:00100000:3.0:1746147206.649416:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310214016 00000100:00100000:3.0:1746147206.649455:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310213888 00000100:00100000:3.0:1746147206.649457:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310213888 00000100:00100000:3.0:1746147206.649472:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19451 00000100:00100000:3.0:1746147206.649479:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967310214016:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147206.649498:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.649517:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425061b74 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e613 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.649541:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.649544:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.649553:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425061b74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e613 expref: 38 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.649568:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425061b74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e613 expref: 38 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.649578:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9b400, rc 0) 00000100:00100000:3.0:1746147206.649629:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967310214016:12345-192.168.204.25@tcp:101:cat.0 Request processed in 150us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.649635:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19451 00000100:00100000:3.0:1746147206.649651:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19452 00000100:00100000:3.0:1746147206.649657:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967310213888:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147206.649662:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.649669:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d9b200/0x3139939425061b7b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e60c expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.649714:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311403648:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147206.649776:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.651831:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2000:x1830967310213760:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 6073us (6254us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147206.651842:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7155 00002000:00100000:2.0:1746147206.651854:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff880096899c00 x1830967310213760/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.651865:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096899c00 with x1830967310213760 ext(3145728->4194303) 00002000:00010000:2.0:1746147206.651870:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096899c00 00000100:00100000:3.0:1746147206.652129:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311403648:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147206.652160:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d9b200/0x3139939425061b7b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e60c expref: 38 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.652173:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d9b200/0x3139939425061b7b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e60c expref: 38 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.652184:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9b200, rc 0) 00000100:00100000:3.0:1746147206.652246:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967310213888:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2587us (3040us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147206.652253:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19452 00000100:00100000:0.0:1746147206.654699:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.654770:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310214144 00000100:00100000:3.0:1746147206.654777:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310214144 00000100:00100000:3.0:1746147206.654826:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19453 00000100:00100000:3.0:1746147206.654833:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967310214144:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147206.654850:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.654869:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d9ba00/0x3139939425061b82 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e61a expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.654928:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311403776:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147206.655217:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.658218:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.658251:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.658418:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310214400 00000100:00100000:3.0:1746147206.658426:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310214400 00000100:00100000:3.0:1746147206.658465:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310214272 00000100:00100000:3.0:1746147206.658467:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310214272 00000100:00100000:3.0:1746147206.658481:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19454 00000100:00100000:3.0:1746147206.658489:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2001:x1830967310214400:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147206.658511:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.658535:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d9ae00/0x3139939425061b89 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e628 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147206.658543:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19455 00000100:00100000:2.0:1746147206.658553:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310214272:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.658565:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.658577:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d91a00/0x3139939425061b90 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e621 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.658592:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093147b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311403904:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147206.658606:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311404032:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147206.659243:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147206.659301:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311403776:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147206.659326:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d9ba00/0x3139939425061b82 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e61a expref: 38 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.659336:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d9ba00/0x3139939425061b82 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e61a expref: 38 pid: 10340 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147206.659368:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00010000:00010000:3.0:1746147206.660556:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9ba00, rc 0) 00000100:00100000:3.0:1746147206.660612:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967310214144:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5776us (5919us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147206.660619:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19453 00000100:00100000:3.0:1746147206.662072:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093147b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311403904:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147206.662640:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d9ae00/0x3139939425061b89 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e628 expref: 27 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.662654:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d9ae00/0x3139939425061b89 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e628 expref: 27 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.662663:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9ae00, rc 0) 00000100:00100000:3.0:1746147206.662702:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2001:x1830967310214400:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4212us (4493us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147206.662709:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19454 00000100:00100000:2.0:1746147206.662996:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311404032:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147206.663015:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d91a00/0x3139939425061b90 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e621 expref: 10 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.663023:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d91a00/0x3139939425061b90 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e621 expref: 10 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.663046:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d91a00, rc 0) 00000100:00100000:2.0:1746147206.663068:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310214272:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4516us (4815us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147206.663073:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19455 00000100:00100000:0.0:1746147206.667045:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.667154:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310214656 00000100:00100000:2.0:1746147206.667164:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310214656 00000100:00100000:2.0:1746147206.667338:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6099 00000100:00100000:2.0:1746147206.667348:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2696:x1830967310214656:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147206.667544:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2696:x1830967310214656:12345-192.168.204.25@tcp:35:cat.0 Request processed in 197us (509us total) trans 8589937249 rc 0/0 00000100:00100000:2.0:1746147206.667551:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6099 00000100:00100000:0.0:1746147206.668026:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.668117:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310214912 00000100:00100000:2.0:1746147206.668121:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310214912 00002000:00100000:2.0:1746147206.668153:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880094525500 x1830967310214912/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.668162:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094525500 with x1830967310214912 ext(4194304->4890623) 00002000:00010000:2.0:1746147206.668167:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094525500 00000100:00100000:2.0:1746147206.668193:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7156 00000100:00100000:2.0:1746147206.668199:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310214912:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147206.673362:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310214912:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5144us (5317us total) trans 0 rc 696320/696320 00000100:00100000:0.0:1746147206.673377:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7156 00002000:00100000:0.0:1746147206.673391:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880094525500 x1830967310214912/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147206.673402:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094525500 with x1830967310214912 ext(4194304->4890623) 00002000:00010000:0.0:1746147206.673408:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094525500 00000100:00100000:0.0:1746147206.676463:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.676513:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.676576:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310215040 00000100:00100000:3.0:1746147206.676586:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310215040 00000100:00100000:3.0:1746147206.676630:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310215168 00000100:00100000:3.0:1746147206.676631:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310215168 00000100:00100000:3.0:1746147206.676647:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19456 00000100:00100000:3.0:1746147206.676654:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967310215040:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147206.676673:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.676700:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d9b000/0x3139939425061b97 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e62f expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147206.676701:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19457 00000100:00100000:0.0:1746147206.676708:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2003:x1830967310215168:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147206.676714:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147206.676724:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d7200/0x3139939425061b9e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e636 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.676770:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093147b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311404160:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147206.676773:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311404288:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147206.677126:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147206.677202:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.678569:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311404288:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147206.678599:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7200/0x3139939425061b9e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e636 expref: 27 pid: 10340 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147206.678605:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093147b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311404160:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147206.678610:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7200/0x3139939425061b9e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e636 expref: 27 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.678618:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d9b000/0x3139939425061b97 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e62f expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.678622:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7200, rc 0) 00010000:00010000:3.0:1746147206.678630:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d9b000/0x3139939425061b97 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e62f expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147206.678653:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2003:x1830967310215168:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1945us (2138us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147206.678660:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19457 00010000:00010000:3.0:1746147206.679206:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9b000, rc 0) 00000100:00100000:3.0:1746147206.679264:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967310215040:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2609us (2811us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147206.679270:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19456 00000100:00100000:0.0:1746147206.680702:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.680814:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310215296 00000100:00100000:3.0:1746147206.680821:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310215296 00000100:00100000:0.0:1746147206.680824:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.680850:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310215424 00000100:00100000:3.0:1746147206.680852:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310215424 00000100:00100000:3.0:1746147206.680867:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19458 00000100:00100000:3.0:1746147206.680877:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2002:x1830967310215296:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147206.680890:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.680907:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d9b800/0x3139939425061ba5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e63d expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147206.680911:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19459 00000100:00100000:0.0:1746147206.680917:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2002:x1830967310215424:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147206.680924:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147206.680932:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d7a00/0x3139939425061bac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e644 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.680950:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093147b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311404416:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147206.680954:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311404544:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147206.681011:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147206.681012:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.682394:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311404544:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147206.682423:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7a00/0x3139939425061bac lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e644 expref: 27 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.682435:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7a00/0x3139939425061bac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e644 expref: 27 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.682466:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7a00, rc 0) 00000100:00100000:2.0:1746147206.682499:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2002:x1830967310215424:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1581us (1673us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147206.682505:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19459 00000100:00100000:3.0:1746147206.682720:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093147b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311404416:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147206.682743:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d9b800/0x3139939425061ba5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e63d expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.682753:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d9b800/0x3139939425061ba5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e63d expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.682766:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9b800, rc 0) 00000100:00100000:3.0:1746147206.682799:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2002:x1830967310215296:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1921us (2100us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147206.682804:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19458 00000100:00100000:0.0:1746147206.687367:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.687474:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310215680 00000100:00100000:3.0:1746147206.687483:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310215680 00000100:00100000:3.0:1746147206.687573:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6100 00000100:00100000:3.0:1746147206.687582:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880070cd7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2692:x1830967310215680:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147206.687814:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880070cd7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2692:x1830967310215680:12345-192.168.204.25@tcp:35:cat.0 Request processed in 232us (457us total) trans 8589937250 rc 0/0 00000100:00100000:3.0:1746147206.687821:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6100 00010000:00010000:1.0:1746147206.803361:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147206.806548:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.806807:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310215936 00000100:00100000:2.0:1746147206.806817:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310215936 00000100:00100000:2.0:1746147206.806864:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16365 00000100:00100000:2.0:1746147206.806873:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2707:x1830967310215936:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.806899:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.806918:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90600/0x3139939425061bb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e64b expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.806994:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90800/0x3139939425061bba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807006:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90800/0x3139939425061bba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807017:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90800/0x3139939425061bba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807029:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91e00/0x3139939425061bc1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807034:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91e00/0x3139939425061bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807040:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91e00/0x3139939425061bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807173:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061bc8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807182:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807188:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147206.807196:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147206.807268:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90800/0x3139939425061bba lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807273:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90800/0x3139939425061bba lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807278:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90800/0x3139939425061bba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807283:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90800/0x3139939425061bba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807288:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d90800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147206.807291:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90800/0x3139939425061bba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807298:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90800/0x3139939425061bba lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807308:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147206.807311:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147206.807314:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90800/0x3139939425061bba lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807321:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90800/0x3139939425061bba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807352:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91e00/0x3139939425061bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807357:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91e00/0x3139939425061bc1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807361:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91e00/0x3139939425061bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807365:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d91e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147206.807367:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91e00/0x3139939425061bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807371:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91e00/0x3139939425061bc1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807377:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88013362d300) 00010000:00010000:2.0:1746147206.807379:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147206.807381:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91e00/0x3139939425061bc1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807385:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91e00/0x3139939425061bc1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147206.807418:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90600/0x3139939425061bb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e64b expref: 20 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.807428:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e64b expref: 19 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.807437:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147206.807439:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147206.807441:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d91400, rc 0) 00000100:00100000:2.0:1746147206.807490:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2707:x1830967310215936:12345-192.168.204.25@tcp:101:cat.0 Request processed in 618us (951us total) trans 8589937251 rc 0/0 00000100:00100000:2.0:1746147206.807497:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16365 00000100:00100000:0.0:1746147206.809820:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.809866:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.809894:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310216192 00000100:00100000:3.0:1746147206.809901:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310216192 00000100:00100000:2.0:1746147206.809948:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310216064 00000100:00100000:2.0:1746147206.809951:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310216064 00000100:00100000:3.0:1746147206.809953:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19460 00000100:00100000:3.0:1746147206.809962:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2001:x1830967310216192:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147206.809976:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19461 00010000:00010000:3.0:1746147206.809978:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147206.809981:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310216064:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.809988:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.809995:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d9a400/0x3139939425061bd6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e659 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.809999:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d91a00/0x3139939425061bdd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e652 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.810039:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093147b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311404672:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147206.810039:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311404800:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147206.811485:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.811490:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147206.813651:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093147b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311404672:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147206.813651:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311404800:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147206.813680:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d9a400/0x3139939425061bd6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e659 expref: 27 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.813680:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d91a00/0x3139939425061bdd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e652 expref: 10 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.813692:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d91a00/0x3139939425061bdd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e652 expref: 10 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.813697:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d9a400/0x3139939425061bd6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e659 expref: 27 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.813703:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d91a00, rc 0) 00010000:00010000:3.0:1746147206.813724:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9a400, rc 0) 00000100:00100000:3.0:1746147206.813769:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2001:x1830967310216192:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3807us (3955us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147206.813777:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19460 00000100:00100000:2.0:1746147206.814034:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310216064:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4051us (4166us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147206.814041:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19461 00000100:00100000:0.0:1746147206.816152:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.816509:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310216320 00000100:00100000:2.0:1746147206.816516:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310216320 00000100:00100000:2.0:1746147206.816563:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19462 00000100:00100000:2.0:1746147206.816570:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2707:x1830967310216320:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.816584:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.816600:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425061be4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e660 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.816627:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061abe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e572 expref: 23 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.816634:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147206.816637:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147206.816640:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425061be4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e660 expref: 10 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.816668:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061abe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e572 expref: 23 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.816680:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061abe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e572 expref: 23 pid: 1398 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.816691:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311404928:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.816769:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.818873:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.819067:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311404928:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.819126:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425061be4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e660 expref: 10 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.819142:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1c00, rc 0) 00000100:00100000:2.0:1746147206.819182:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2707:x1830967310216320:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2612us (3034us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.819191:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19462 00000100:00100000:1.0:1746147206.819332:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310216448 00000100:00100000:1.0:1746147206.819339:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310216448 00002000:00100000:1.0:1746147206.819377:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x93:0x0] (909312->1048575) req@ffff8800769d9c00 x1830967310216448/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.819386:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769d9c00 with x1830967310216448 ext(909312->1048575) 00010000:00010000:1.0:1746147206.819393:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061abe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e572 expref: 24 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.819409:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061abe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e572 expref: 24 pid: 1398 timeout: 844 lvb_type: 0 00002000:00010000:1.0:1746147206.819415:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800769d9c00 00000100:00100000:1.0:1746147206.819431:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1667 00000100:00100000:1.0:1746147206.819437:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310216448:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147206.822207:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310216448:12345-192.168.204.25@tcp:4:cat.0 Request processed in 2759us (3331us total) trans 21474842526 rc 0/0 00000100:00100000:1.0:1746147206.822220:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1667 00002000:00100000:1.0:1746147206.822230:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x93:0x0] (909312->1048575) req@ffff8800769d9c00 x1830967310216448/t21474842526(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/448 e 0 to 0 dl 1746147217 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.822239:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769d9c00 with x1830967310216448 ext(909312->1048575) 00010000:00010000:1.0:1746147206.822248:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061abe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e572 expref: 26 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.822262:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061abe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e572 expref: 26 pid: 1398 timeout: 844 lvb_type: 0 00002000:00010000:1.0:1746147206.822270:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800769d9c00 00000100:00100000:0.0:1746147206.824310:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.824398:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310216576 00000100:00100000:2.0:1746147206.824407:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310216576 00010000:00010000:2.0:1746147206.824440:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061abe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e572 expref: 26 pid: 1398 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.824466:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8822 00000100:00100000:2.0:1746147206.824473:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967310216576:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147206.824486:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147206.824505:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061abe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e572 expref: 26 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.824516:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061abe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e572 expref: 26 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.824536:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0c200/0x3139939425061abe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e572 expref: 26 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.825187:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.825189:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.825198:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425061be4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e660 expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.825207:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425061be4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e660 expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.825237:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425061be4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e660 expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147206.825247:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311405056:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147206.825324:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.827290:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311405056:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147206.827311:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147206.827376:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310216576:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2902us (3072us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.827386:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8822 00000100:00100000:0.0:1746147206.833344:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.833429:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310216832 00000100:00100000:1.0:1746147206.833438:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310216832 00002000:00100000:1.0:1746147206.833482:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff8800769da300 x1830967310216832/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.833492:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769da300 with x1830967310216832 ext(0->1048575) 00002000:00010000:1.0:1746147206.833498:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769da300 00000100:00100000:1.0:1746147206.833526:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7157 00000100:00100000:1.0:1746147206.833532:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310216832:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147206.847738:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310216832:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14183us (14380us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147206.847752:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7157 00002000:00100000:1.0:1746147206.847765:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff8800769da300 x1830967310216832/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.847775:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769da300 with x1830967310216832 ext(0->1048575) 00002000:00010000:1.0:1746147206.847781:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769da300 00000100:00100000:0.0:1746147206.853448:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.853541:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310217088 00000100:00100000:2.0:1746147206.853551:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310217088 00000100:00100000:2.0:1746147206.853595:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16366 00000100:00100000:2.0:1746147206.853603:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2709:x1830967310217088:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147206.853627:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.853646:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x3139939425061beb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e667 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.853749:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0400/0x3139939425061bf2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.853763:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425061b27 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5c6 expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.853770:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061bc8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e64b expref: 20 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.853776:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0400/0x3139939425061bf2 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.853804:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e64b expref: 20 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.853814:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061bc8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e64b expref: 20 pid: 7238 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.853823:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311405184:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.853928:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425061b27 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5c6 expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.853935:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425061b27 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5c6 expref: 8 pid: 9138 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.853942:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097094000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311405312:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.853960:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.855246:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.855312:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310217216 00000100:00100000:2.0:1746147206.855317:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310217216 00000100:00100000:2.0:1746147206.855363:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19463 00000100:00100000:2.0:1746147206.855369:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2707:x1830967310217216:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.855379:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.855393:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d42200/0x3139939425061bf9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e66e expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.855424:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061b12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b8 expref: 36 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.855430:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147206.855432:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147206.855435:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d42200/0x3139939425061bf9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e66e expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.855454:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061b12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b8 expref: 36 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.855462:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061b12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b8 expref: 36 pid: 1398 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.855470:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098823480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311405440:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.856142:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1500c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147206.856983:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311405184:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147206.856994:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097094000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311405312:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147206.857018:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0400/0x3139939425061bf2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147206.857277:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.857458:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.857484:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310217344 00000100:00100000:2.0:1746147206.857490:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310217344 00010000:00010000:2.0:1746147206.857542:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061bc8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e64b expref: 21 pid: 7238 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.857565:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310217472 00000100:00100000:2.0:1746147206.857568:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310217472 00010000:00010000:2.0:1746147206.857577:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425061b27 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5c6 expref: 9 pid: 9138 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.857592:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8823 00000100:00100000:2.0:1746147206.857598:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967310217344:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147206.857609:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147206.857614:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061bc8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e64b expref: 21 pid: 7238 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.857623:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e64b expref: 21 pid: 7238 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746147206.857627:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8824 00000100:00100000:1.0:1746147206.857634:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310217472:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147206.857640:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147206.857642:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d91400/0x3139939425061bc8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e64b expref: 21 pid: 7238 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.857643:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425061b27 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5c6 expref: 9 pid: 9138 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.857649:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425061b27 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5c6 expref: 9 pid: 9138 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.857660:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425061b27 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5c6 expref: 9 pid: 9138 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.857676:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147206.857680:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0400/0x3139939425061bf2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.857690:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0400/0x3139939425061bf2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147206.857695:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0400/0x3139939425061bf2 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147206.857877:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147206.857880:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147206.857967:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147206.857972:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0400/0x3139939425061bf2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.857978:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0400/0x3139939425061bf2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147206.857995:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000100:00100000:2.0:1746147206.858302:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310217344:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 702us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147206.858302:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2001:x1830967310217472:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 668us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.858308:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8823 00000100:00100000:1.0:1746147206.858311:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8824 00000100:00100000:0.0:1746147206.859072:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.859174:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310217600 00000100:00100000:1.0:1746147206.859179:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310217600 00002000:00100000:1.0:1746147206.859214:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->1290239) req@ffff8800769db480 x1830967310217600/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.859225:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769db480 with x1830967310217600 ext(1048576->1290239) 00010000:00010000:1.0:1746147206.859233:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061b12 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b8 expref: 37 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.859247:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061b12 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b8 expref: 37 pid: 1398 timeout: 844 lvb_type: 0 00002000:00010000:1.0:1746147206.859258:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800769db480 00000100:00100000:1.0:1746147206.859286:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1668 00000100:00100000:1.0:1746147206.859292:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310217600:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147206.859469:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098823480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311405440:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.859492:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d42200/0x3139939425061bf9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e66e expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.859505:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d42200, rc 0) 00000100:00100000:2.0:1746147206.859526:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2707:x1830967310217216:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4157us (4287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.859533:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19463 00010000:00010000:3.0:1746147206.859778:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b1a00/0x3139939425061beb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e667 expref: 21 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.859796:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0400/0x3139939425061bf2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e667 expref: 20 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.859803:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147206.859806:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147206.859809:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b0400, rc 0) 00000100:00100000:3.0:1746147206.859842:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2709:x1830967310217088:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6241us (6404us total) trans 8589937252 rc 0/0 00000100:00100000:3.0:1746147206.859848:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16366 00000100:00100000:1.0:1746147206.864779:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967310217600:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5473us (5696us total) trans 17179875143 rc 0/0 00000100:00100000:1.0:1746147206.864792:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1668 00002000:00100000:1.0:1746147206.864805:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->1290239) req@ffff8800769db480 x1830967310217600/t17179875143(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/448 e 0 to 0 dl 1746147217 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.864816:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769db480 with x1830967310217600 ext(1048576->1290239) 00010000:00010000:1.0:1746147206.864827:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061b12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b8 expref: 39 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.864843:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061b12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b8 expref: 39 pid: 1398 timeout: 844 lvb_type: 0 00002000:00010000:1.0:1746147206.864851:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800769db480 00000100:00100000:0.0:1746147206.868708:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.869227:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310217728 00000100:00100000:1.0:1746147206.869238:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310217728 00010000:00010000:1.0:1746147206.869281:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061b12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b8 expref: 39 pid: 1398 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746147206.869327:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8825 00000100:00100000:1.0:1746147206.869335:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967310217728:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147206.869354:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147206.869375:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061b12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b8 expref: 39 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.869389:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061b12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b8 expref: 39 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.869413:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x3139939425061b12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1290239) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5b8 expref: 39 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147206.869448:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147206.869450:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147206.869458:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d42200/0x3139939425061bf9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e66e expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.869468:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d42200/0x3139939425061bf9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e66e expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.869504:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d42200/0x3139939425061bf9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e66e expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147206.869517:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311405568:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147206.870622:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.871056:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.871226:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310217984 00000100:00100000:3.0:1746147206.871232:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310217984 00000100:00100000:3.0:1746147206.871279:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16367 00000100:00100000:3.0:1746147206.871286:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2711:x1830967310217984:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147206.871307:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.871324:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9a400/0x3139939425061c07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e675 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.871401:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b800/0x3139939425061c0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871414:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b800/0x3139939425061c0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871424:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b800/0x3139939425061c0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871436:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b000/0x3139939425061c15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871440:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b000/0x3139939425061c15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871445:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b000/0x3139939425061c15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871539:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9be00/0x3139939425061c1c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871550:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9be00/0x3139939425061c1c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871555:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9be00/0x3139939425061c1c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147206.871563:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147206.871647:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b800/0x3139939425061c0e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871653:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b800/0x3139939425061c0e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871659:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b800/0x3139939425061c0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871665:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b800/0x3139939425061c0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871670:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d9b800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147206.871674:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b800/0x3139939425061c0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871680:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b800/0x3139939425061c0e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871689:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147206.871692:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147206.871696:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b800/0x3139939425061c0e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871700:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b800/0x3139939425061c0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871720:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b000/0x3139939425061c15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871724:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b000/0x3139939425061c15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871737:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b000/0x3139939425061c15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871740:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d9b000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147206.871742:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b000/0x3139939425061c15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871746:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b000/0x3139939425061c15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871752:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800930f4500) 00010000:00010000:3.0:1746147206.871754:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147206.871756:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b000/0x3139939425061c15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871759:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b000/0x3139939425061c15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147206.871794:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9a400/0x3139939425061c07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e675 expref: 39 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.871804:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9be00/0x3139939425061c1c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e675 expref: 38 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.871810:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147206.871812:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147206.871814:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9be00, rc 0) 00000100:00100000:3.0:1746147206.871849:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2711:x1830967310217984:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 563us (796us total) trans 8589937253 rc 0/0 00000100:00100000:3.0:1746147206.871854:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16367 00000100:00100000:1.0:1746147206.874819:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311405568:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147206.874843:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147206.874923:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310217728:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5588us (6224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147206.874934:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8825 00000100:00100000:0.0:1746147206.879428:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.879537:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310218112 00000100:00100000:1.0:1746147206.879546:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310218112 00000100:00100000:1.0:1746147206.879615:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 982 00000100:00100000:1.0:1746147206.879624:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967310218112:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147206.879639:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147206.879664:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9be00/0x3139939425061c1c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e675 expref: 38 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.879694:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147206.879699:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147206.879753:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967310218112:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 130us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147206.879760:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 982 00000100:00100000:0.0:1746147206.883822:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.884667:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.884761:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310218368 00000100:00100000:2.0:1746147206.884770:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310218368 00002000:00100000:2.0:1746147206.884821:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8800769d8000 x1830967310218368/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.884830:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769d8000 with x1830967310218368 ext(1048576->2097151) 00002000:00010000:2.0:1746147206.884835:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769d8000 00000100:00100000:1.0:1746147206.885724:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310218496 00000100:00100000:1.0:1746147206.885739:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310218496 00002000:00100000:1.0:1746147206.885763:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x97:0x0] (1421312->2097151) req@ffff8800968a0000 x1830967310218496/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.885771:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a0000 with x1830967310218496 ext(1421312->2097151) 00002000:00010000:1.0:1746147206.885776:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968a0000 00000100:00100000:1.0:1746147206.885797:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7158 00000100:00100000:1.0:1746147206.885804:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2000:x1830967310218368:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147206.885968:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7159 00000100:00100000:2.0:1746147206.885975:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2001:x1830967310218496:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147206.886941:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.890317:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310218752 00000100:00100000:2.0:1746147206.890330:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310218752 00000100:00100000:2.0:1746147206.890382:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19464 00000100:00100000:2.0:1746147206.890389:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2709:x1830967310218752:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147206.890407:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.890429:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425061c2a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e67c expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.890460:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x31399394250617d8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3f1 expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.890468:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x3139939425061921 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e484 expref: 24 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.890474:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093709600/0x31399394250618f7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e45a expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.890480:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.890481:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.890484:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425061c2a lrc: 6/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1789952->2097151] (req 1789952->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e67c expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.890522:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093709600/0x31399394250618f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e45a expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.890533:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093709600/0x31399394250618f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e45a expref: 11 pid: 1854 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746147206.890544:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098823480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311405696:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.890638:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x3139939425061921 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e484 expref: 24 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.890646:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x3139939425061921 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e484 expref: 24 pid: 9585 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.890653:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098823800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311405824:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.890678:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x31399394250617d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3f1 expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.890684:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x31399394250617d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3f1 expref: 9 pid: 9585 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746147206.890692:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311405952:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.890709:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1500c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147206.895379:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310218496:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9392us (10701us total) trans 0 rc 675840/675840 00000100:00100000:2.0:1746147206.895395:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7159 00002000:00100000:2.0:1746147206.895408:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1421312->2097151) req@ffff8800968a0000 x1830967310218496/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.895418:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a0000 with x1830967310218496 ext(1421312->2097151) 00002000:00010000:2.0:1746147206.895423:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968a0000 00000100:00100000:0.0:1746147206.898708:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.898792:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310219008 00000100:00100000:3.0:1746147206.898802:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310219008 00010000:00010000:3.0:1746147206.898841:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x31399394250617d8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3f1 expref: 10 pid: 9585 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746147206.898882:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8826 00000100:00100000:3.0:1746147206.898889:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310219008:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147206.898903:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147206.898928:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x31399394250617d8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3f1 expref: 10 pid: 9585 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746147206.898941:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x31399394250617d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3f1 expref: 10 pid: 9585 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746147206.898968:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147206.899020:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310219008:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 131us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.899026:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8826 00000100:00100000:2.0:1746147206.900764:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098823480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311405696:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.900779:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098823800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311405824:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.900792:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092563400/0x31399394250617d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e3f1 expref: 9 pid: 9585 timeout: 844 lvb_type: 1 00000100:00100000:2.0:1746147206.900813:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098821500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311405952:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.900844:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425061c2a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1789952->2097151] (req 1789952->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e67c expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.900857:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbeee00, rc 0) 00000100:00100000:2.0:1746147206.902288:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2709:x1830967310218752:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 11892us (15347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.902298:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19464 00000100:00100000:3.0:1746147206.902547:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2000:x1830967310218368:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16742us (18735us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147206.902556:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7158 00002000:00100000:3.0:1746147206.902565:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8800769d8000 x1830967310218368/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.902575:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769d8000 with x1830967310218368 ext(1048576->2097151) 00002000:00010000:3.0:1746147206.902580:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769d8000 00000100:00100000:3.0:1746147206.902628:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.902669:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.902686:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310218880 00000100:00100000:3.0:1746147206.902691:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310218880 00010000:00010000:3.0:1746147206.902715:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093709600/0x31399394250618f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e45a expref: 11 pid: 1854 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746147206.902747:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8827 00000100:00100000:3.0:1746147206.902754:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2003:x1830967310218880:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147206.902766:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147206.902783:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093709600/0x31399394250618f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e45a expref: 11 pid: 1854 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746147206.902794:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093709600/0x31399394250618f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e45a expref: 11 pid: 1854 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746147206.902816:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093709600/0x31399394250618f7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e45a expref: 11 pid: 1854 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746147206.902830:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147206.902844:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2003:x1830967310218880:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 92us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.902850:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8827 00000100:00100000:3.0:1746147206.902958:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.902970:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310219392 00000100:00100000:3.0:1746147206.902973:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310219392 00010000:00010000:3.0:1746147206.902983:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x3139939425061921 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e484 expref: 25 pid: 9585 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.902997:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8828 00000100:00100000:3.0:1746147206.903002:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967310219392:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147206.903008:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147206.903014:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x3139939425061921 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e484 expref: 25 pid: 9585 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.903023:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x3139939425061921 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e484 expref: 25 pid: 9585 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.903034:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9800/0x3139939425061921 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e484 expref: 25 pid: 9585 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.903042:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.903045:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.903052:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425061c2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e67c expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.903059:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425061c2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e67c expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.903107:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425061c2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e67c expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.903128:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311406080:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147206.903223:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310219264 00000100:00100000:0.0:1746147206.903226:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310219264 00000100:00100000:0.0:1746147206.903250:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16368 00000100:00100000:0.0:1746147206.903255:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2715:x1830967310219264:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147206.903273:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147206.903287:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425061c31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e683 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.903504:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00010000:00010000:0.0:1746147206.903598:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6400/0x3139939425061c38 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903618:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6400/0x3139939425061c38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903628:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6400/0x3139939425061c38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903640:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x3139939425061c3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903649:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x3139939425061c3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903654:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x3139939425061c3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903770:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x3139939425061c46 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903780:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x3139939425061c46 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903787:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x3139939425061c46 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:0.0:1746147206.903795:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147206.903879:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6400/0x3139939425061c38 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903886:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6400/0x3139939425061c38 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903891:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6400/0x3139939425061c38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903896:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6400/0x3139939425061c38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903902:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e6400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147206.903906:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6400/0x3139939425061c38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903912:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6400/0x3139939425061c38 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903920:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147206.903923:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147206.903927:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6400/0x3139939425061c38 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903932:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6400/0x3139939425061c38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903958:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x3139939425061c3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903966:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x3139939425061c3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903971:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x3139939425061c3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903975:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e7400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147206.903978:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x3139939425061c3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903982:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x3139939425061c3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903988:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f2c5300) 00010000:00010000:0.0:1746147206.903990:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147206.903992:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x3139939425061c3f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.903996:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x3139939425061c3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147206.904030:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425061c31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e683 expref: 40 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.904041:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x3139939425061c46 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e683 expref: 39 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.904047:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147206.904049:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147206.904051:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e6000, rc 0) 00000100:00100000:0.0:1746147206.904102:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2715:x1830967310219264:12345-192.168.204.25@tcp:101:cat.0 Request processed in 831us (1458us total) trans 8589937254 rc 0/0 00000100:00100000:0.0:1746147206.904109:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16368 00000100:00100000:3.0:1746147206.905809:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311406080:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147206.905827:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147206.905871:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967310219392:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2867us (2912us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.905880:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8828 00000100:00100000:0.0:1746147206.906432:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.906577:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310219648 00000100:00100000:3.0:1746147206.906583:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310219648 00002000:00100000:3.0:1746147206.906619:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1789952->1794047) req@ffff8800968a0a80 x1830967310219648/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.906629:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a0a80 with x1830967310219648 ext(1789952->1794047) 00002000:00010000:3.0:1746147206.906634:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968a0a80 00000100:00100000:3.0:1746147206.906662:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7160 00000100:00100000:3.0:1746147206.906669:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310219648:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147206.906790:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310219648:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 121us (359us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147206.906796:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7160 00002000:00100000:3.0:1746147206.906800:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1789952->1794047) req@ffff8800968a0a80 x1830967310219648/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/4536 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.906806:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a0a80 with x1830967310219648 ext(1789952->1794047) 00002000:00010000:3.0:1746147206.906809:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968a0a80 00000100:00100000:0.0:1746147206.910176:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.910558:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310219776 00000100:00100000:3.0:1746147206.910568:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310219776 00000100:00100000:1.0:1746147206.910596:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.910621:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 983 00000100:00100000:3.0:1746147206.910629:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2002:x1830967310219776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147206.910644:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147206.910672:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x3139939425061c46 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e683 expref: 39 pid: 7238 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147206.910679:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147206.910692:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147206.910697:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147206.910743:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310219904 00000100:00100000:2.0:1746147206.910747:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310219904 00000100:00100000:3.0:1746147206.910756:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967310219776:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 127us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.910763:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 983 00000100:00100000:2.0:1746147206.910768:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310220032 00000100:00100000:2.0:1746147206.910770:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310220032 00000100:00100000:2.0:1746147206.910792:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19465 00000100:00100000:2.0:1746147206.910796:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310219904:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:3.0:1746147206.910803:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19466 00000100:00100000:3.0:1746147206.910810:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310220032:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147206.910811:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.910819:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147206.910825:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d43c00/0x3139939425061c54 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e68a expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.910830:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d9a800/0x3139939425061c5b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e691 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.910842:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.910844:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.910844:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.910846:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.910852:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d9a800/0x3139939425061c5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e691 expref: 39 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.910852:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d43c00/0x3139939425061c54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e68a expref: 25 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.910865:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d9a800/0x3139939425061c5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e691 expref: 39 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.910865:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d43c00/0x3139939425061c54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e68a expref: 25 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147206.910873:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43c00, rc 0) 00010000:00010000:3.0:1746147206.910877:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9a800, rc 0) 00000100:00100000:2.0:1746147206.910892:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310219904:12345-192.168.204.25@tcp:101:cat.0 Request processed in 96us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.910896:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967310220032:12345-192.168.204.25@tcp:101:cat.0 Request processed in 87us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.910897:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19465 00000100:00100000:3.0:1746147206.910901:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19466 00000100:00100000:0.0:1746147206.917031:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.917110:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310220288 00000100:00100000:2.0:1746147206.917119:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310220288 00002000:00100000:2.0:1746147206.917163:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1789951) req@ffff8800968a1180 x1830967310220288/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.917173:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a1180 with x1830967310220288 ext(1048576->1789951) 00002000:00010000:2.0:1746147206.917179:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968a1180 00000100:00100000:2.0:1746147206.917215:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7161 00000100:00100000:1.0:1746147206.917216:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.917222:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310220288:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147206.917240:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.917327:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.917400:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310220416 00000100:00100000:3.0:1746147206.917404:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310220416 00000100:00100000:3.0:1746147206.917427:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310220544 00000100:00100000:3.0:1746147206.917429:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310220544 00000100:00100000:3.0:1746147206.917442:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310220672 00000100:00100000:3.0:1746147206.917444:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310220672 00000100:00100000:3.0:1746147206.917457:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19467 00000100:00100000:3.0:1746147206.917462:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2709:x1830967310220416:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147206.917471:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.917491:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e698 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.917515:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009822b400/0x3139939425061a78 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e55d expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.917523:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800936b7200/0x3139939425061af6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5aa expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.917530:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425061ae1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e595 expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.917536:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.917538:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.917541:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->2134015] (req 2097152->2134015) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 12 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147206.917553:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19468 00000100:00100000:0.0:1746147206.917560:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967310220544:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147206.917569:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.917572:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425061ae1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e595 expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.917579:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x3139939425061c69 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e69f expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.917583:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425061ae1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e595 expref: 8 pid: 9586 timeout: 844 lvb_type: 1 00000100:00100000:3.0:1746147206.917595:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311406208:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147206.917606:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311406336:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147206.917750:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19469 00000100:00100000:1.0:1746147206.917756:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310220672:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147206.917764:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147206.917771:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d90800/0x3139939425061c70 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e6a6 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147206.917792:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311406464:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147206.917855:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800936b7200/0x3139939425061af6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5aa expref: 26 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.917863:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800936b7200/0x3139939425061af6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5aa expref: 26 pid: 13712 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.917870:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311406592:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147206.918070:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147206.918436:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147206.918522:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009822b400/0x3139939425061a78 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e55d expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.918532:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009822b400/0x3139939425061a78 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e55d expref: 13 pid: 1398 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.918540:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311406720:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147206.918557:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147206.923357:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311406208:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147206.923381:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.923411:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310220800 00000100:00100000:3.0:1746147206.923418:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310220800 00010000:00010000:3.0:1746147206.923457:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425061ae1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e595 expref: 9 pid: 9586 timeout: 844 lvb_type: 1 00002000:00010000:1.0:1746147206.923509:0:9585:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746147205 -> 1746147206 00002000:00010000:1.0:1746147206.923513:0:9585:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746147205 -> 1746147206 00002000:00010000:1.0:1746147206.923515:0:9585:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746147205 -> 1746147206 00000100:00100000:1.0:1746147206.923531:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311406464:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147206.923544:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8829 00000100:00100000:3.0:1746147206.923552:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310220800:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147206.923563:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d90800/0x3139939425061c70 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6a6 expref: 26 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.923566:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147206.923575:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d90800/0x3139939425061c70 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6a6 expref: 26 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147206.923577:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425061ae1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e595 expref: 9 pid: 9586 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746147206.923588:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425061ae1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e595 expref: 9 pid: 9586 timeout: 844 lvb_type: 1 00010000:00010000:1.0:1746147206.923589:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d90800, rc 0) 00010000:00010000:3.0:1746147206.923608:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425061ae1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e595 expref: 9 pid: 9586 timeout: 844 lvb_type: 1 00010000:00010000:3.0:1746147206.923625:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147206.923631:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310220672:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5876us (6304us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147206.923638:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19469 00000100:00100000:3.0:1746147206.923644:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967310220800:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 92us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.923649:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8829 00000100:00100000:1.0:1746147206.923683:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311406336:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147206.923704:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x3139939425061c69 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e69f expref: 40 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147206.923711:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6000/0x3139939425061c69 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e69f expref: 40 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147206.923718:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e6000, rc 0) 00000100:00100000:1.0:1746147206.923741:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967310220544:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6183us (6500us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147206.923745:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19468 00000100:00100000:2.0:1746147206.925758:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310220288:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 8528us (9927us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746147206.925773:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7161 00002000:00100000:2.0:1746147206.925783:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1789951) req@ffff8800968a1180 x1830967310220288/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 741376/741376 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.925793:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a1180 with x1830967310220288 ext(1048576->1789951) 00002000:00010000:2.0:1746147206.925798:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968a1180 00000100:00100000:3.0:1746147206.926995:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311406592:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147206.927008:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311406720:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147206.927039:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2134015] (req 2097152->2134015) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.927061:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9b200, rc 0) 00000100:00100000:3.0:1746147206.927149:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2709:x1830967310220416:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 9685us (9931us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.927156:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19467 00000100:00100000:0.0:1746147206.932190:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.932311:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310220928 00000100:00100000:2.0:1746147206.932321:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310220928 00010000:00010000:2.0:1746147206.932358:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009822b400/0x3139939425061a78 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e55d expref: 11 pid: 1398 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.932402:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8830 00000100:00100000:2.0:1746147206.932583:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2000:x1830967310220928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147206.932598:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147206.932620:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009822b400/0x3139939425061a78 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e55d expref: 11 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.932631:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009822b400/0x3139939425061a78 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e55d expref: 11 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.932654:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009822b400/0x3139939425061a78 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e55d expref: 11 pid: 1398 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.932673:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147206.932734:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310220928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 317us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.932745:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8830 00000100:00100000:0.0:1746147206.934530:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.934623:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310221056 00000100:00100000:2.0:1746147206.934628:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310221056 00010000:00010000:2.0:1746147206.934654:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800936b7200/0x3139939425061af6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5aa expref: 25 pid: 13712 timeout: 844 lvb_type: 0 00000100:00100000:2.0:1746147206.934690:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8831 00000100:00100000:2.0:1746147206.934696:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310221056:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147206.934705:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147206.934719:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800936b7200/0x3139939425061af6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5aa expref: 25 pid: 13712 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.934741:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800936b7200/0x3139939425061af6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5aa expref: 25 pid: 13712 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.934758:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936b7200/0x3139939425061af6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5aa expref: 25 pid: 13712 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.934770:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.934772:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147206.934779:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 9 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.934787:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 9 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.934820:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 9 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147206.934831:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311406848:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147206.936254:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1500c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.936867:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.936907:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.937429:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.938058:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310221312 00000100:00100000:2.0:1746147206.938067:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310221312 00002000:00100000:2.0:1746147206.938143:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff8800968a2300 x1830967310221312/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147206.938147:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310221568 00000100:00100000:3.0:1746147206.938151:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310221568 00002000:00100000:2.0:1746147206.938154:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a2300 with x1830967310221312 ext(0->1048575) 00002000:00010000:2.0:1746147206.938160:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968a2300 00000100:00100000:3.0:1746147206.938163:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310221696 00000100:00100000:3.0:1746147206.938165:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310221696 00000100:00100000:2.0:1746147206.938185:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7162 00000100:00100000:3.0:1746147206.938189:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19470 00000100:00100000:2.0:1746147206.938193:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310221312:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147206.938194:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2707:x1830967310221696:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147206.938206:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.938224:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425061c77 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e6ad expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.938251:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.938257:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147206.938259:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147206.938262:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425061c77 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6ad expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.938289:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.938301:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 11 pid: 10340 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.938313:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311406976:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147206.938381:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00002000:00100000:3.0:1746147206.938403:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8800968a2680 x1830967310221568/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.938410:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a2680 with x1830967310221568 ext(1048576->2097151) 00002000:00010000:3.0:1746147206.938413:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968a2680 00000100:00100000:3.0:1746147206.938431:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7163 00000100:00100000:3.0:1746147206.938437:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967310221568:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147206.939421:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098821500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311406848:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147206.939438:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147206.939463:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310221056:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4767us (4937us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.939473:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8831 00000100:00100000:0.0:1746147206.940546:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.940597:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310221952 00000100:00100000:3.0:1746147206.940603:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310221952 00002000:00100000:3.0:1746147206.940638:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2129920->2134015) req@ffff8800968a2d80 x1830967310221952/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.940647:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a2d80 with x1830967310221952 ext(2129920->2134015) 00010000:00010000:3.0:1746147206.940656:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 12 pid: 10340 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.940670:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 12 pid: 10340 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746147206.940681:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800968a2d80 00000100:00100000:3.0:1746147206.940708:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1669 00000100:00100000:3.0:1746147206.940715:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310221952:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147206.940840:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310221952:12345-192.168.204.25@tcp:3:cat.0 Request processed in 125us (299us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147206.940845:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1669 00002000:00100000:3.0:1746147206.940851:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2129920->2134015) req@ffff8800968a2d80 x1830967310221952/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/4536 e 0 to 0 dl 1746147217 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.940858:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a2d80 with x1830967310221952 ext(2129920->2134015) 00010000:00010000:3.0:1746147206.940862:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 12 pid: 10340 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.940870:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 12 pid: 10340 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746147206.940876:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800968a2d80 00000100:00100000:3.0:1746147206.945900:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311406976:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147206.945934:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425061c77 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6ad expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.945951:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b0a00, rc 0) 00000100:00100000:3.0:1746147206.945994:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2707:x1830967310221696:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7798us (8564us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.946005:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19470 00000100:00100000:2.0:1746147206.946176:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967310221568:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7739us (9268us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147206.946184:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7163 00002000:00100000:2.0:1746147206.946193:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8800968a2680 x1830967310221568/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.946201:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a2680 with x1830967310221568 ext(1048576->2097151) 00002000:00010000:2.0:1746147206.946206:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968a2680 00000100:00100000:0.0:1746147206.951173:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.951430:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310222208 00000100:00100000:2.0:1746147206.951440:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310222208 00002000:00100000:2.0:1746147206.951487:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2134015) req@ffff8800968a3100 x1830967310222208/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.951498:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a3100 with x1830967310222208 ext(2097152->2134015) 00010000:00010000:2.0:1746147206.951507:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 11 pid: 10340 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.951522:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 11 pid: 10340 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746147206.951529:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800968a3100 00000100:00100000:2.0:1746147206.951559:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1670 00000100:00100000:2.0:1746147206.951565:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2002:x1830967310222208:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147206.952711:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310221312:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14514us (15843us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147206.952720:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7162 00002000:00100000:3.0:1746147206.952734:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff8800968a2300 x1830967310221312/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.952742:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a2300 with x1830967310221312 ext(0->1048575) 00002000:00010000:3.0:1746147206.952746:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968a2300 00000100:00100000:2.0:1746147206.954602:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2002:x1830967310222208:12345-192.168.204.25@tcp:4:cat.0 Request processed in 3029us (3431us total) trans 21474842527 rc 0/0 00000100:00100000:2.0:1746147206.954612:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1670 00002000:00100000:2.0:1746147206.954620:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2134015) req@ffff8800968a3100 x1830967310222208/t21474842527(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/448 e 0 to 0 dl 1746147217 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.954629:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a3100 with x1830967310222208 ext(2097152->2134015) 00010000:00010000:2.0:1746147206.954639:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 13 pid: 10340 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.954653:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 13 pid: 10340 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746147206.954659:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800968a3100 00000100:00100000:0.0:1746147206.958474:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.958580:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310222336 00000100:00100000:3.0:1746147206.958590:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310222336 00010000:00010000:3.0:1746147206.958629:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 13 pid: 10340 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.958659:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8832 00000100:00100000:3.0:1746147206.958667:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2003:x1830967310222336:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147206.958681:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147206.958702:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 13 pid: 10340 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.958714:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 13 pid: 10340 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.958751:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425061c62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e698 expref: 13 pid: 10340 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.958787:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.958789:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.958797:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425061c77 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6ad expref: 12 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.958805:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425061c77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6ad expref: 12 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.958838:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425061c77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6ad expref: 12 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.958851:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311407104:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147206.958934:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.959484:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.959522:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310222464 00000100:00100000:3.0:1746147206.959526:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310222464 00000100:00100000:3.0:1746147206.959549:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19471 00000100:00100000:3.0:1746147206.959554:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2715:x1830967310222464:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147206.959568:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147206.959582:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425061c7e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e6b4 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.959599:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425061b19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1421311) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5bf expref: 26 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.959605:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147206.959607:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147206.959609:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425061c7e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6b4 expref: 40 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.959626:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425061b19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1421311) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5bf expref: 26 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.959636:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425061b19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1421311) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5bf expref: 26 pid: 10340 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.959645:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311407232:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147206.959695:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.963531:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.963600:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310222592 00000100:00100000:2.0:1746147206.963607:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310222592 00000100:00100000:3.0:1746147206.963611:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311407104:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147206.963632:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746147206.963650:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1421311) req@ffff8800968a3b80 x1830967310222592/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.963659:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a3b80 with x1830967310222592 ext(1048576->1421311) 00010000:00010000:2.0:1746147206.963669:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425061b19 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1421311) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5bf expref: 27 pid: 10340 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.963683:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425061b19 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1421311) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5bf expref: 27 pid: 10340 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746147206.963689:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968a3b80 00000100:00100000:2.0:1746147206.963709:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1671 00000100:00100000:2.0:1746147206.963716:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2001:x1830967310222592:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147206.964275:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311407232:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147206.964294:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425061c7e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6b4 expref: 40 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147206.964308:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1a00, rc 0) 00000100:00100000:3.0:1746147206.964389:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2003:x1830967310222336:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5721us (5926us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.964397:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8832 00000100:00100000:2.0:1746147206.964620:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2715:x1830967310222464:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5064us (5134us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.964627:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19471 00000100:00100000:0.0:1746147206.969073:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.969179:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310222848 00000100:00100000:1.0:1746147206.969187:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310222848 00002000:00100000:1.0:1746147206.969628:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff8800968a1500 x1830967310222848/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.969638:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a1500 with x1830967310222848 ext(2097152->4194303) 00002000:00010000:1.0:1746147206.969644:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968a1500 00000100:00100000:1.0:1746147206.969674:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7164 00000100:00100000:1.0:1746147206.969682:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310222848:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147206.972912:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310222592:12345-192.168.204.25@tcp:4:cat.0 Request processed in 9184us (9377us total) trans 17179875144 rc 0/0 00000100:00100000:3.0:1746147206.972925:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1671 00002000:00100000:3.0:1746147206.972937:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1421311) req@ffff8800968a3b80 x1830967310222592/t17179875144(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/448 e 0 to 0 dl 1746147217 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147206.972947:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a3b80 with x1830967310222592 ext(1048576->1421311) 00010000:00010000:3.0:1746147206.972957:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425061b19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1421311) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5bf expref: 29 pid: 10340 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.972975:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425061b19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1421311) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5bf expref: 29 pid: 10340 timeout: 844 lvb_type: 0 00002000:00010000:3.0:1746147206.972982:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968a3b80 00000100:00100000:1.0:1746147206.980595:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.980682:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.980806:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310222976 00000100:00100000:3.0:1746147206.980815:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310222976 00010000:00010000:3.0:1746147206.980850:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425061b19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1421311) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5bf expref: 29 pid: 10340 timeout: 844 lvb_type: 0 00000100:00100000:3.0:1746147206.980891:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8833 00000100:00100000:3.0:1746147206.980899:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310222976:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147206.980912:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147206.980932:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425061b19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1421311) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5bf expref: 29 pid: 10340 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.980944:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425061b19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1421311) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5bf expref: 29 pid: 10340 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.980967:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1600/0x3139939425061b19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1421311) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5bf expref: 29 pid: 10340 timeout: 844 lvb_type: 0 00010000:00010000:3.0:1746147206.980993:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.980995:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147206.981002:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425061c7e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6b4 expref: 39 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.981107:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425061c7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6b4 expref: 39 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147206.981140:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425061c7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6b4 expref: 39 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147206.981152:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311407360:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147206.981682:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310223104 00000100:00100000:2.0:1746147206.981686:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310223104 00000100:00100000:3.0:1746147206.981721:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147206.981785:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19472 00000100:00100000:0.0:1746147206.981793:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2711:x1830967310223104:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147206.981809:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147206.981821:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e6bb expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.981840:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x3139939425061b4a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5e9 expref: 28 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.981847:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425061b74 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e613 expref: 41 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.981852:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.981853:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.981856:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3461120->4149247] (req 3461120->4149247) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.981873:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425061b74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e613 expref: 41 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147206.981885:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425061b74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e613 expref: 41 pid: 10340 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746147206.981893:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311407488:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147206.981930:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x3139939425061b4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5e9 expref: 28 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.981937:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x3139939425061b4a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5e9 expref: 28 pid: 13712 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746147206.981950:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097094000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311407616:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147206.981966:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095affd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147206.982968:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310222848:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13284us (14277us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147206.982977:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7164 00002000:00100000:1.0:1746147206.982985:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff8800968a1500 x1830967310222848/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.983000:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a1500 with x1830967310222848 ext(2097152->4194303) 00002000:00010000:1.0:1746147206.983004:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968a1500 00000100:00100000:1.0:1746147206.987738:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.987759:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147206.987792:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147206.988467:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311407360:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147206.988487:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147206.988529:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2001:x1830967310222976:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7631us (7945us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147206.988540:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8833 00000100:00100000:0.0:1746147206.988597:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311407488:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147206.988606:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097094000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311407616:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147206.988637:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3461120->4149247] (req 3461120->4149247) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 41 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.988654:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e7e00, rc 0) 00000100:00100000:0.0:1746147206.988673:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2711:x1830967310223104:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6882us (7991us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147206.988679:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19472 00000100:00100000:3.0:1746147206.989060:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310223232 00000100:00100000:3.0:1746147206.989067:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310223232 00010000:00010000:3.0:1746147206.989103:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425061b74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e613 expref: 41 pid: 10340 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746147206.989201:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310223616 00000100:00100000:0.0:1746147206.989204:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310223616 00010000:00010000:0.0:1746147206.989216:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x3139939425061b4a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5e9 expref: 28 pid: 13712 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746147206.989238:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8834 00000100:00100000:0.0:1746147206.989244:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967310223232:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147206.989254:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147206.989272:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425061b74 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e613 expref: 41 pid: 10340 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746147206.989281:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425061b74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e613 expref: 41 pid: 10340 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746147206.989303:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x3139939425061b74 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e613 expref: 41 pid: 10340 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746147206.989317:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147206.989332:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967310223232:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 89us (1613us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147206.989336:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8834 00000100:00100000:0.0:1746147206.989345:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8835 00000100:00100000:0.0:1746147206.989349:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2001:x1830967310223616:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147206.989354:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147206.989359:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x3139939425061b4a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5e9 expref: 28 pid: 13712 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746147206.989367:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x3139939425061b4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5e9 expref: 28 pid: 13712 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746147206.989377:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x3139939425061b4a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5e9 expref: 28 pid: 13712 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746147206.989384:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.989386:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147206.989392:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 39 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.989399:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 39 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147206.989424:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 39 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147206.989434:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097094000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311407744:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147206.989473:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095affd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147206.989709:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310223488 00000100:00100000:1.0:1746147206.989712:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310223488 00002000:00100000:1.0:1746147206.989747:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88009514ce00 x1830967310223488/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147206.989755:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514ce00 with x1830967310223488 ext(1048576->2097151) 00002000:00010000:1.0:1746147206.989759:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009514ce00 00000100:00100000:1.0:1746147206.989771:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7165 00000100:00100000:1.0:1746147206.989775:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967310223488:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147206.994827:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097094000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311407744:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147206.994860:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147206.994903:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2001:x1830967310223616:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5551us (7107us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147206.994913:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8835 00000100:00100000:0.0:1746147206.996344:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147206.996450:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147206.996922:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310223872 00000100:00100000:2.0:1746147206.996930:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310223872 00002000:00100000:2.0:1746147206.996974:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (3461120->3465215) req@ffff880097094000 x1830967310223872/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/0 e 0 to 0 dl 1746147217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.996983:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097094000 with x1830967310223872 ext(3461120->3465215) 00002000:00010000:2.0:1746147206.996989:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097094000 00000100:00100000:2.0:1746147206.997020:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7166 00000100:00100000:2.0:1746147206.997027:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967310223872:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147206.997683:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310224000 00000100:00100000:1.0:1746147206.997686:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310224000 00000100:00100000:1.0:1746147206.997719:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19473 00000100:00100000:1.0:1746147206.997733:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2707:x1830967310224000:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147206.997742:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147206.997759:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425061c8c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e6c2 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.997785:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 42 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.997793:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147206.997795:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147206.997798:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425061c8c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c2 expref: 28 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.997824:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 42 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147206.997834:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 42 pid: 17600 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746147206.997845:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311407872:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147206.997929:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967310223872:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 902us (1590us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147206.997935:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7166 00002000:00100000:2.0:1746147206.997940:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (3461120->3465215) req@ffff880097094000 x1830967310223872/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/4536 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.997947:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097094000 with x1830967310223872 ext(3461120->3465215) 00010000:00010000:2.0:1746147206.997951:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 42 pid: 17600 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147206.997960:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 42 pid: 17600 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746147206.997966:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097094000 00000100:00100000:2.0:1746147206.998624:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967310223488:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 8847us (10862us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147206.998631:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7165 00002000:00100000:2.0:1746147206.998636:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88009514ce00 x1830967310223488/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:582/0 lens 488/440 e 0 to 0 dl 1746147217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147206.998649:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514ce00 with x1830967310223488 ext(1048576->2097151) 00002000:00010000:2.0:1746147206.998652:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009514ce00 00000100:00100000:1.0:1746147206.998973:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147207.000678:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311407872:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147207.000703:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425061c8c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c2 expref: 28 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.000717:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0ae600, rc 0) 00000100:00100000:1.0:1746147207.000781:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2707:x1830967310224000:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3055us (4330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.000787:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19473 00000100:00100000:0.0:1746147207.006932:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.007731:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310224128 00000100:00100000:1.0:1746147207.007741:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310224128 00000100:00100000:1.0:1746147207.007799:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19474 00000100:00100000:1.0:1746147207.007807:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2715:x1830967310224128:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147207.007825:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147207.007844:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x3139939425061c93 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e6c9 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.007875:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425061c2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e67c expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.007883:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147207.007885:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147207.007888:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x3139939425061c93 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c9 expref: 25 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.007920:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425061c2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e67c expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.007930:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425061c2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e67c expref: 11 pid: 1854 timeout: 844 lvb_type: 0 00000100:00100000:1.0:1746147207.007941:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311408000:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147207.008029:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.008468:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.008531:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310224384 00000100:00100000:2.0:1746147207.008535:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310224384 00002000:00100000:2.0:1746147207.008566:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (4145152->4149247) req@ffff8800968a1c00 x1830967310224384/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.008574:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a1c00 with x1830967310224384 ext(4145152->4149247) 00010000:00010000:2.0:1746147207.008581:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 40 pid: 17600 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147207.008590:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 40 pid: 17600 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746147207.008597:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968a1c00 00000100:00100000:2.0:1746147207.008611:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1672 00000100:00100000:2.0:1746147207.008617:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2002:x1830967310224384:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147207.009164:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2002:x1830967310224384:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 545us (695us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147207.009171:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1672 00002000:00100000:2.0:1746147207.009182:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (4145152->4149247) req@ffff8800968a1c00 x1830967310224384/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/4536 e 0 to 0 dl 1746147218 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.009189:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a1c00 with x1830967310224384 ext(4145152->4149247) 00010000:00010000:2.0:1746147207.009194:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 40 pid: 17600 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147207.009202:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 40 pid: 17600 timeout: 844 lvb_type: 0 00002000:00010000:2.0:1746147207.009207:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968a1c00 00000100:00100000:2.0:1746147207.010171:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311408000:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.010195:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x3139939425061c93 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c9 expref: 25 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.010208:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0aec00, rc 0) 00000100:00100000:2.0:1746147207.010236:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2715:x1830967310224128:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2430us (3314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.010243:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19474 00000100:00100000:0.0:1746147207.010755:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.010916:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310224512 00000100:00100000:2.0:1746147207.010921:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310224512 00002000:00100000:2.0:1746147207.010945:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1789952->2097151) req@ffff8800968a1f80 x1830967310224512/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.010954:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a1f80 with x1830967310224512 ext(1789952->2097151) 00010000:00010000:2.0:1746147207.010960:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425061c2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e67c expref: 12 pid: 1854 timeout: 844 lvb_type: 0 00010000:00010000:2.0:1746147207.010970:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425061c2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e67c expref: 12 pid: 1854 timeout: 845 lvb_type: 0 00002000:00010000:2.0:1746147207.010976:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800968a1f80 00000100:00100000:2.0:1746147207.011173:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1673 00000100:00100000:2.0:1746147207.011180:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967310224512:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147207.014911:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.015654:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.015722:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310225024 00000100:00100000:3.0:1746147207.015739:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310225024 00000100:00100000:3.0:1746147207.015800:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6101 00000100:00100000:3.0:1746147207.015808:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2711:x1830967310225024:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147207.015977:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2711:x1830967310225024:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 169us (1075us total) trans 8589937255 rc 0/0 00000100:00100000:3.0:1746147207.015987:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6101 00000100:00100000:1.0:1746147207.016185:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310224768 00000100:00100000:1.0:1746147207.016190:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310224768 00002000:00100000:1.0:1746147207.016216:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (3461120->4149247) req@ffff8800968a0700 x1830967310224768/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.016226:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a0700 with x1830967310224768 ext(3461120->4149247) 00010000:00010000:1.0:1746147207.016235:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 40 pid: 17600 timeout: 844 lvb_type: 0 00010000:00010000:1.0:1746147207.016248:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 40 pid: 17600 timeout: 845 lvb_type: 0 00002000:00010000:1.0:1746147207.016254:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968a0700 00000100:00100000:1.0:1746147207.016267:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1674 00000100:00100000:1.0:1746147207.016272:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967310224768:12345-192.168.204.25@tcp:4:multiop.0 00000100:00080000:2.0:1746147207.016447:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147207.016647:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310224512:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5466us (5891us total) trans 21474842528 rc 0/0 00000100:00100000:2.0:1746147207.016652:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1673 00002000:00100000:2.0:1746147207.016657:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1789952->2097151) req@ffff8800968a1f80 x1830967310224512/t21474842528(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/448 e 0 to 0 dl 1746147218 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.016665:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a1f80 with x1830967310224512 ext(1789952->2097151) 00010000:00010000:2.0:1746147207.016671:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425061c2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e67c expref: 14 pid: 1854 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.016987:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425061c2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e67c expref: 14 pid: 1854 timeout: 845 lvb_type: 0 00002000:00010000:2.0:1746147207.016995:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800968a1f80 00000100:00100000:0.0:1746147207.020443:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.020606:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310225152 00000100:00100000:3.0:1746147207.020615:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310225152 00010000:00010000:3.0:1746147207.020651:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425061c2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e67c expref: 14 pid: 1854 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.020679:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8836 00000100:00100000:3.0:1746147207.020686:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310225152:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.020704:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.020734:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425061c2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e67c expref: 14 pid: 1854 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.020746:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425061c2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e67c expref: 14 pid: 1854 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.020828:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbeee00/0x3139939425061c2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e67c expref: 14 pid: 1854 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.020846:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.020848:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.020885:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x3139939425061c93 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c9 expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.020893:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x3139939425061c93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c9 expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.020928:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x3139939425061c93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c9 expref: 24 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.020941:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311408128:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147207.021322:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147207.023961:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311408128:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147207.023987:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147207.024079:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310225152:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3391us (3644us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.024279:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8836 00000100:00100000:1.0:1746147207.024991:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967310224768:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 8716us (9336us total) trans 17179875145 rc 0/0 00000100:00100000:1.0:1746147207.025000:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1674 00002000:00100000:1.0:1746147207.025009:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (3461120->4149247) req@ffff8800968a0700 x1830967310224768/t17179875145(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/448 e 0 to 0 dl 1746147218 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.025019:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a0700 with x1830967310224768 ext(3461120->4149247) 00010000:00010000:1.0:1746147207.025029:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 42 pid: 17600 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.025044:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 42 pid: 17600 timeout: 845 lvb_type: 0 00002000:00010000:1.0:1746147207.025054:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968a0700 00000100:00100000:0.0:1746147207.026812:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.026902:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310225280 00000100:00100000:3.0:1746147207.026910:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310225280 00010000:00010000:3.0:1746147207.026939:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 42 pid: 17600 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746147207.027343:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.027410:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8837 00000100:00100000:3.0:1746147207.027418:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967310225280:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.027430:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147207.027449:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310225536 00010000:00010000:3.0:1746147207.027450:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 42 pid: 17600 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.027452:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310225536 00002000:00100000:1.0:1746147207.027482:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880096cfad80 x1830967310225536/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.027491:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfad80 with x1830967310225536 ext(1048576->2097151) 00002000:00010000:1.0:1746147207.027494:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cfad80 00010000:00010000:3.0:1746147207.027763:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 42 pid: 17600 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.027789:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x3139939425061c85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3461120->18446744073709551615] (req 3461120->4149247) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6bb expref: 42 pid: 17600 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.027808:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.027810:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.027817:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425061c8c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c2 expref: 27 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.027826:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425061c8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c2 expref: 27 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.027854:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7167 00010000:00010000:3.0:1746147207.027858:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425061c8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c2 expref: 27 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.027861:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310225536:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147207.027870:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311408256:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147207.027924:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147207.031780:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311408256:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147207.031807:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147207.031862:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2003:x1830967310225280:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4444us (5055us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.031872:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8837 00000100:00100000:1.0:1746147207.032907:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310225536:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 5043us (5561us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147207.032916:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7167 00002000:00100000:1.0:1746147207.032927:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880096cfad80 x1830967310225536/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.032936:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfad80 with x1830967310225536 ext(1048576->2097151) 00002000:00010000:1.0:1746147207.032941:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cfad80 00000100:00100000:0.0:1746147207.038623:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.038670:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.038787:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310225792 00000100:00100000:2.0:1746147207.038797:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310225792 00000100:00100000:3.0:1746147207.038825:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310225920 00000100:00100000:3.0:1746147207.038830:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310225920 00000100:00100000:2.0:1746147207.038857:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19475 00000100:00100000:0.0:1746147207.038861:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.038866:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310225792:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.038885:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.038904:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x3139939425061c9a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e6d0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.038928:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.038929:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.038939:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x3139939425061c9a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6d0 expref: 26 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.038954:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x3139939425061c9a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6d0 expref: 26 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.038965:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c11400, rc 0) 00000100:00100000:3.0:1746147207.038982:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19476 00000100:00100000:3.0:1746147207.038988:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967310225920:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147207.038997:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.039008:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0400/0x3139939425061ca1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e6d7 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.039024:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310225792:12345-192.168.204.25@tcp:101:cat.0 Request processed in 158us (410us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147207.039027:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.039029:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147207.039029:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19475 00010000:00010000:3.0:1746147207.039034:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0400/0x3139939425061ca1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6d7 expref: 42 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.039043:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0400/0x3139939425061ca1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6d7 expref: 42 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.039049:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57a0400, rc 0) 00000100:00100000:3.0:1746147207.039067:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967310225920:12345-192.168.204.25@tcp:101:cat.0 Request processed in 80us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.039073:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19476 00000100:00100000:1.0:1746147207.039119:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310226048 00000100:00100000:1.0:1746147207.039123:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310226048 00002000:00100000:1.0:1746147207.039161:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff880097d76680 x1830967310226048/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.039170:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d76680 with x1830967310226048 ext(3145728->4194303) 00002000:00010000:1.0:1746147207.039175:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d76680 00000100:00100000:1.0:1746147207.039200:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7168 00000100:00100000:1.0:1746147207.039206:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2001:x1830967310226048:12345-192.168.204.25@tcp:3:cat.0 00000100:00080000:2.0:1746147207.039631:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147207.048309:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2001:x1830967310226048:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9090us (9434us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147207.048322:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7168 00002000:00100000:1.0:1746147207.048335:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff880097d76680 x1830967310226048/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.048346:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d76680 with x1830967310226048 ext(3145728->4194303) 00002000:00010000:1.0:1746147207.048352:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d76680 00000100:00100000:0.0:1746147207.052496:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.052550:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.052647:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310226432 00000100:00100000:3.0:1746147207.052656:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310226432 00002000:00100000:3.0:1746147207.052704:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88012b8b2a00 x1830967310226432/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.052713:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b2a00 with x1830967310226432 ext(2097152->4194303) 00002000:00010000:3.0:1746147207.052720:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8b2a00 00000100:00100000:1.0:1746147207.052734:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310226560 00000100:00100000:1.0:1746147207.052738:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310226560 00002000:00100000:1.0:1746147207.052758:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff88009514aa00 x1830967310226560/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.052764:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514aa00 with x1830967310226560 ext(3145728->4194303) 00002000:00010000:1.0:1746147207.052767:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009514aa00 00000100:00100000:3.0:1746147207.052986:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7169 00000100:00100000:3.0:1746147207.052993:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310226432:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147207.053363:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7170 00000100:00100000:1.0:1746147207.053370:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967310226560:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147207.054164:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.055190:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310226688 00000100:00100000:1.0:1746147207.055198:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310226688 00000100:00100000:1.0:1746147207.056262:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19477 00000100:00100000:1.0:1746147207.056272:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2001:x1830967310226688:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147207.056290:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147207.056309:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800990c7600/0x3139939425061ca8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e6de expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.056334:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.056336:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.056345:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800990c7600/0x3139939425061ca8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6de expref: 29 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.056362:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800990c7600/0x3139939425061ca8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6de expref: 29 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.056373:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7600, rc 0) 00000100:00100000:1.0:1746147207.056405:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310226688:12345-192.168.204.25@tcp:101:cat.0 Request processed in 135us (2241us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.056415:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19477 00000100:00100000:0.0:1746147207.057012:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.057265:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310226816 00000100:00100000:3.0:1746147207.057270:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310226816 00000100:00100000:3.0:1746147207.057299:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19478 00000100:00100000:3.0:1746147207.057304:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310226816:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147207.057312:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.057326:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425061caf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e6e5 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.057340:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.057341:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.057346:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425061caf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6e5 expref: 14 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.057356:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425061caf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6e5 expref: 14 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.057364:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822bc00, rc 0) 00000100:00100000:3.0:1746147207.057382:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310226816:12345-192.168.204.25@tcp:101:cat.0 Request processed in 78us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.057387:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19478 00000100:00100000:1.0:1746147207.067391:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967310226560:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14009us (14827us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147207.067404:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7170 00002000:00100000:1.0:1746147207.067415:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff88009514aa00 x1830967310226560/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.067424:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514aa00 with x1830967310226560 ext(3145728->4194303) 00002000:00010000:1.0:1746147207.067430:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009514aa00 00000100:00100000:0.0:1746147207.068195:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.068274:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310227072 00000100:00100000:1.0:1746147207.068281:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310227072 00002000:00100000:1.0:1746147207.068314:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88009514ad80 x1830967310227072/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.068322:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514ad80 with x1830967310227072 ext(4194304->4890623) 00002000:00010000:1.0:1746147207.068326:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514ad80 00000100:00100000:1.0:1746147207.068341:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7171 00000100:00100000:1.0:1746147207.068348:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310227072:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147207.071364:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310226432:12345-192.168.204.25@tcp:3:cat.0 Request processed in 18360us (18868us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147207.071376:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7169 00002000:00100000:3.0:1746147207.071389:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88012b8b2a00 x1830967310226432/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.071398:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b2a00 with x1830967310226432 ext(2097152->4194303) 00002000:00010000:3.0:1746147207.071403:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8b2a00 00000100:00100000:1.0:1746147207.073361:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310227072:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5004us (5158us total) trans 0 rc 696320/696320 00000100:00100000:1.0:1746147207.073373:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7171 00002000:00100000:1.0:1746147207.073383:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88009514ad80 x1830967310227072/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.073392:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514ad80 with x1830967310227072 ext(4194304->4890623) 00002000:00010000:1.0:1746147207.073397:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514ad80 00000100:00100000:0.0:1746147207.077375:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.077928:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310227328 00000100:00100000:2.0:1746147207.077938:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310227328 00000100:00100000:2.0:1746147207.077997:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16369 00000100:00100000:2.0:1746147207.078005:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2719:x1830967310227328:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147207.078035:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.078055:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11200/0x3139939425061cb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e6ec expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.078158:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10c00/0x3139939425061cbd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078171:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10c00/0x3139939425061cbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078185:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10c00/0x3139939425061cbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078197:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425061cc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078207:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425061cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078212:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425061cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078311:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10e00/0x3139939425061ccb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078321:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10e00/0x3139939425061ccb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078327:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10e00/0x3139939425061ccb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147207.078336:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147207.078419:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10c00/0x3139939425061cbd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078425:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10c00/0x3139939425061cbd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078431:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10c00/0x3139939425061cbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078435:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10c00/0x3139939425061cbd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078440:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c10c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147207.078444:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10c00/0x3139939425061cbd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078450:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10c00/0x3139939425061cbd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078464:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147207.078467:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147207.078471:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10c00/0x3139939425061cbd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078476:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10c00/0x3139939425061cbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078501:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425061cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078506:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425061cc4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078511:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425061cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078515:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c10400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147207.078517:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425061cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078520:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425061cc4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078525:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a570d900) 00010000:00010000:2.0:1746147207.078527:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147207.078529:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425061cc4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078532:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425061cc4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147207.078564:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11200/0x3139939425061cb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6ec expref: 23 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.078575:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10e00/0x3139939425061ccb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6ec expref: 22 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.078581:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.078583:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147207.078585:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c10e00, rc 0) 00000100:00100000:2.0:1746147207.078648:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2719:x1830967310227328:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 642us (1283us total) trans 8589937256 rc 0/0 00000100:00100000:2.0:1746147207.078654:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16369 00000100:00100000:1.0:1746147207.080279:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.080340:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310227584 00000100:00100000:3.0:1746147207.080347:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310227584 00000100:00100000:3.0:1746147207.080399:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6102 00000100:00100000:3.0:1746147207.080406:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2707:x1830967310227584:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147207.080568:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2707:x1830967310227584:12345-192.168.204.25@tcp:35:cat.0 Request processed in 162us (294us total) trans 8589937257 rc 0/0 00000100:00100000:3.0:1746147207.080575:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6102 00000100:00100000:0.0:1746147207.081077:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.081333:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310227840 00000100:00100000:1.0:1746147207.081336:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310227840 00002000:00100000:1.0:1746147207.081369:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880095148700 x1830967310227840/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.081378:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095148700 with x1830967310227840 ext(4194304->4890623) 00002000:00010000:1.0:1746147207.081384:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095148700 00000100:00100000:1.0:1746147207.081411:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7172 00000100:00100000:1.0:1746147207.081417:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967310227840:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147207.088488:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967310227840:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7057us (7398us total) trans 0 rc 696320/696320 00000100:00100000:1.0:1746147207.088501:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7172 00002000:00100000:1.0:1746147207.088514:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880095148700 x1830967310227840/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.088523:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095148700 with x1830967310227840 ext(4194304->4890623) 00002000:00010000:1.0:1746147207.088529:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095148700 00000100:00100000:0.0:1746147207.090309:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.091482:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310228096 00000100:00100000:2.0:1746147207.091495:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310228096 00000100:00100000:2.0:1746147207.091566:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6103 00000100:00100000:2.0:1746147207.091574:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2719:x1830967310228096:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147207.091810:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2719:x1830967310228096:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 237us (1510us total) trans 8589937258 rc 0/0 00000100:00100000:2.0:1746147207.091817:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6103 00000100:00100000:3.0:1746147207.091952:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.092577:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310228224 00000100:00100000:2.0:1746147207.092580:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310228224 00000100:00100000:2.0:1746147207.092618:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 984 00000100:00100000:2.0:1746147207.092623:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2002:x1830967310228224:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.092633:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.092657:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10e00/0x3139939425061ccb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6ec expref: 24 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.092672:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.092677:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.092707:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2002:x1830967310228224:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 83us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.092712:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 984 00000100:00100000:0.0:1746147207.095783:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.095833:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310228480 00000100:00100000:3.0:1746147207.095845:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310228480 00000100:00100000:3.0:1746147207.095896:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6104 00000100:00100000:3.0:1746147207.095904:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2715:x1830967310228480:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147207.096428:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2715:x1830967310228480:12345-192.168.204.25@tcp:35:cat.0 Request processed in 523us (654us total) trans 8589937259 rc 0/0 00000100:00100000:3.0:1746147207.096434:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6104 00000100:00100000:0.0:1746147207.114550:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.114682:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310228608 00000100:00100000:3.0:1746147207.114692:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310228608 00000100:00100000:3.0:1746147207.114850:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19479 00000100:00100000:3.0:1746147207.114859:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2719:x1830967310228608:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147207.114879:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.114901:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ffb000/0x3139939425061cd9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e6f3 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.114934:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425061c7e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6b4 expref: 41 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.114943:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800990c7600/0x3139939425061ca8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6de expref: 30 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.114949:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.114951:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.114954:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffb000/0x3139939425061cd9 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1220608->1617919] (req 1220608->1617919) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6f3 expref: 30 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.114994:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800990c7600/0x3139939425061ca8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6de expref: 30 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.115006:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800990c7600/0x3139939425061ca8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6de expref: 30 pid: 9585 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746147207.115019:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311408384:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.115157:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425061c7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6b4 expref: 41 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.115166:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425061c7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6b4 expref: 41 pid: 10340 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.115174:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311408512:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.116256:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147207.117711:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311408384:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.117736:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311408512:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.117765:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ffb000/0x3139939425061cd9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1220608->1617919] (req 1220608->1617919) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6f3 expref: 30 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.117783:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffb000, rc 0) 00000100:00100000:3.0:1746147207.117823:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2719:x1830967310228608:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2965us (3283us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.117835:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19479 00000100:00100000:0.0:1746147207.118250:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.118893:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.118962:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310228736 00000100:00100000:1.0:1746147207.118969:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310228736 00010000:00010000:1.0:1746147207.118999:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800990c7600/0x3139939425061ca8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6de expref: 30 pid: 9585 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.119031:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310228864 00000100:00100000:1.0:1746147207.119033:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310228864 00010000:00010000:1.0:1746147207.119044:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425061c7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6b4 expref: 42 pid: 10340 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.119061:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8838 00000100:00100000:1.0:1746147207.119068:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2001:x1830967310228736:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.119081:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147207.119121:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800990c7600/0x3139939425061ca8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6de expref: 30 pid: 9585 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.119131:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800990c7600/0x3139939425061ca8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6de expref: 30 pid: 9585 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.119152:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800990c7600/0x3139939425061ca8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6de expref: 30 pid: 9585 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.119171:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147207.119195:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310228736:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 128us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.119201:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8838 00000100:00100000:1.0:1746147207.119212:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8839 00000100:00100000:1.0:1746147207.119216:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2000:x1830967310228864:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.119225:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147207.119231:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425061c7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6b4 expref: 42 pid: 10340 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.119238:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425061c7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6b4 expref: 42 pid: 10340 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.119254:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425061c7e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6b4 expref: 42 pid: 10340 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.119262:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.119263:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.119269:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ffb000/0x3139939425061cd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1617919) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6f3 expref: 28 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.119276:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffb000/0x3139939425061cd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1617919) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6f3 expref: 28 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.119304:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097ffb000/0x3139939425061cd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1617919) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6f3 expref: 28 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.119322:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f57480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311408640:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147207.119367:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.123104:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.123136:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f57480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311408640:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147207.123158:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310229120 00010000:00010000:1.0:1746147207.123162:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.123166:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310229120 00002000:00100000:2.0:1746147207.123210:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x97:0x0] (1220608->1224703) req@ffff88011e485c00 x1830967310229120/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746147207.123214:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967310228864:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3995us (4430us total) trans 0 rc 0/0 00002000:00100000:2.0:1746147207.123220:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e485c00 with x1830967310229120 ext(1220608->1224703) 00002000:00010000:2.0:1746147207.123224:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e485c00 00000100:00100000:1.0:1746147207.123225:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8839 00000100:00100000:2.0:1746147207.123255:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7173 00000100:00100000:2.0:1746147207.123261:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2000:x1830967310229120:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147207.123390:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2000:x1830967310229120:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 128us (311us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147207.123395:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7173 00002000:00100000:2.0:1746147207.123400:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x97:0x0] (1220608->1224703) req@ffff88011e485c00 x1830967310229120/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/4536 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.123407:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e485c00 with x1830967310229120 ext(1220608->1224703) 00002000:00010000:2.0:1746147207.123410:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e485c00 00000100:00100000:0.0:1746147207.128194:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.128546:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310229376 00000100:00100000:3.0:1746147207.128556:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310229376 00002000:00100000:3.0:1746147207.128603:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1613824->1617919) req@ffff88011e485500 x1830967310229376/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.128613:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e485500 with x1830967310229376 ext(1613824->1617919) 00002000:00010000:3.0:1746147207.128618:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e485500 00000100:00100000:3.0:1746147207.128652:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7174 00000100:00100000:3.0:1746147207.128660:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310229376:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147207.128820:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310229376:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 161us (636us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147207.128827:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7174 00002000:00100000:3.0:1746147207.128832:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1613824->1617919) req@ffff88011e485500 x1830967310229376/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/4536 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.128839:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e485500 with x1830967310229376 ext(1613824->1617919) 00002000:00010000:3.0:1746147207.128842:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e485500 00000100:00100000:0.0:1746147207.156943:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.157247:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310229504 00000100:00100000:3.0:1746147207.157267:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310229504 00000100:00080000:2.0:1746147207.157340:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147207.157342:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16370 00000100:00100000:3.0:1746147207.157350:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2724:x1830967310229504:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147207.157376:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.157396:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb600/0x3139939425061ce0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e6fa expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.157470:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061ce7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.157484:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.157494:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.157506:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa200/0x3139939425061cee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.157511:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa200/0x3139939425061cee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.157516:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa200/0x3139939425061cee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.157583:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425061cf5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.157592:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0400/0x3139939425061bf2 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e667 expref: 22 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.157598:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425061cf5 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.157628:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0400/0x3139939425061bf2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e667 expref: 22 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.157638:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0400/0x3139939425061bf2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e667 expref: 22 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.157654:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311408768:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.157753:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147207.159218:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311408768:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.159235:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425061cf5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147207.159570:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.159744:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310229760 00000100:00100000:3.0:1746147207.159750:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310229760 00000100:00100000:2.0:1746147207.161318:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6105 00000100:00100000:2.0:1746147207.161333:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:30601:x1830967310229760:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147207.161655:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:30601:x1830967310229760:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 327us (2086us total) trans 8589937260 rc 0/0 00000100:00100000:2.0:1746147207.161667:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6105 00000100:00100000:0.0:1746147207.163688:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.163998:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310229888 00000100:00100000:1.0:1746147207.164008:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310229888 00010000:00010000:1.0:1746147207.164044:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0400/0x3139939425061bf2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e667 expref: 24 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.165284:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8840 00000100:00100000:1.0:1746147207.165295:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2001:x1830967310229888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.165309:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147207.165317:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0400/0x3139939425061bf2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e667 expref: 24 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.165329:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0400/0x3139939425061bf2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e667 expref: 24 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.165349:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800993b0400/0x3139939425061bf2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e667 expref: 24 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.165366:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147207.165370:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425061cf5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147207.165379:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425061cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147207.165385:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425061cf5 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147207.165414:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147207.165453:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2001:x1830967310229888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 162us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.165459:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8840 00010000:00010000:3.0:1746147207.165520:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425061cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.165527:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425061cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147207.165578:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147207.165583:0:9138:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147207.165599:0:9138:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425061cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.165610:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425061cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.165620:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061ce7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.165625:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061ce7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.165630:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.165635:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061ce7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.165641:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ffa000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147207.165644:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061ce7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.165651:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061ce7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.165659:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147207.165662:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147207.165665:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061ce7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.165669:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061ce7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.165683:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa200/0x3139939425061cee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.165687:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa200/0x3139939425061cee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.165691:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa200/0x3139939425061cee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.165695:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ffa200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147207.165697:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa200/0x3139939425061cee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.165701:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa200/0x3139939425061cee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.165707:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800930f4000) 00010000:00010000:3.0:1746147207.165709:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147207.165712:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa200/0x3139939425061cee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.165716:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa200/0x3139939425061cee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.165760:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb600/0x3139939425061ce0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6fa expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.165772:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425061cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6fa expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.165778:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147207.165780:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147207.165782:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffbc00, rc 0) 00000100:00100000:3.0:1746147207.165807:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2724:x1830967310229504:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 8458us (8876us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.165813:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16370 00000100:00100000:0.0:1746147207.168361:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.168397:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.168805:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310230016 00000100:00100000:0.0:1746147207.168810:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.168814:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310230016 00000100:00100000:3.0:1746147207.168870:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310230144 00000100:00100000:3.0:1746147207.168873:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310230144 00000100:00100000:0.0:1746147207.168883:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.168896:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.168900:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310230272 00000100:00100000:3.0:1746147207.168902:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310230272 00000100:00100000:3.0:1746147207.168912:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310230400 00000100:00100000:3.0:1746147207.168913:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310230400 00000100:00100000:0.0:1746147207.168924:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.169181:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310230528 00000100:00100000:3.0:1746147207.169183:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310230528 00000100:00100000:0.0:1746147207.169193:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310230656 00000100:00100000:0.0:1746147207.169195:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310230656 00000100:00100000:3.0:1746147207.169201:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19480 00000100:00100000:3.0:1746147207.169208:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310230016:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:0.0:1746147207.169211:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19481 00000100:00100000:0.0:1746147207.169215:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2000:x1830967310230144:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147207.169226:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147207.169226:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.169244:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ffb800/0x3139939425061cfc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e701 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.169244:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061d03 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e708 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.169266:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.169266:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.169268:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.169268:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.169277:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffb800/0x3139939425061cfc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e701 expref: 11 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.169277:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061d03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e708 expref: 22 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.169292:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ffb800/0x3139939425061cfc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e701 expref: 11 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.169292:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061d03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e708 expref: 22 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.169302:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffb800, rc 0) 00010000:00010000:0.0:1746147207.169302:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e572a00, rc 0) 00000100:00100000:3.0:1746147207.169337:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310230016:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 129us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.169337:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2000:x1830967310230144:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 120us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.169342:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19481 00000100:00100000:0.0:1746147207.169926:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19482 00000100:00100000:0.0:1746147207.169931:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2000:x1830967310230272:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147207.169938:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147207.169948:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094182400/0x3139939425061d0a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e70f expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.169987:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311408896:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147207.170022:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19480 00000100:00100000:3.0:1746147207.170042:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19483 00000100:00100000:0.0:1746147207.170043:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147207.170047:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310230400:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147207.170053:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.170060:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425061d11 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e716 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.170063:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19484 00000100:00100000:0.0:1746147207.170068:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310230528:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147207.170070:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.170071:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.170073:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.170075:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425061d11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e716 expref: 11 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.170079:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c11e00/0x3139939425061d18 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e71d expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.170084:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425061d11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e716 expref: 11 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.170109:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.170110:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.170115:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c11e00/0x3139939425061d18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e71d expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.170116:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffbe00, rc 0) 00010000:00010000:0.0:1746147207.170124:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c11e00/0x3139939425061d18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e71d expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.170131:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c11e00, rc 0) 00000100:00100000:3.0:1746147207.170132:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310230400:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 84us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.170136:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19483 00000100:00100000:0.0:1746147207.170144:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310230528:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 76us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.170146:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19485 00000100:00100000:0.0:1746147207.170149:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19484 00000100:00100000:3.0:1746147207.170150:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2000:x1830967310230656:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147207.170155:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.170162:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ffac00/0x3139939425061d1f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e724 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.170170:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.170171:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.170175:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffac00/0x3139939425061d1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e724 expref: 23 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.170194:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ffac00/0x3139939425061d1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e724 expref: 23 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.170200:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffac00, rc 0) 00000100:00100000:3.0:1746147207.170404:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2000:x1830967310230656:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 253us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.170409:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19485 00000100:00080000:3.0:1746147207.170426:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1746147207.176940:0:9584:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime: 1746147206 -> 1746147207 00002000:00010000:2.0:1746147207.176949:0:9584:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime: 1746147206 -> 1746147207 00000100:00100000:2.0:1746147207.176974:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311408896:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147207.177015:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094182400/0x3139939425061d0a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e70f expref: 22 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.177028:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094182400/0x3139939425061d0a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e70f expref: 22 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.177059:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094182400, rc 0) 00000100:00100000:2.0:1746147207.177149:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2000:x1830967310230272:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 7216us (8336us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147207.177158:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19482 00000100:00100000:1.0:1746147207.180300:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.180389:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310230912 00000100:00100000:3.0:1746147207.180397:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310230912 00000100:00100000:3.0:1746147207.180527:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16371 00000100:00100000:3.0:1746147207.180536:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2724:x1830967310230912:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147207.180555:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.180576:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa200/0x3139939425061d26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e72b expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.180686:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061d2d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.180702:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425061cf5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6fa expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.180709:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061d2d lrc: 4/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.180750:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425061cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6fa expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.180761:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425061cf5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6fa expref: 10 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.180772:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311409024:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.180864:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147207.184426:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.184516:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311409024:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147207.184539:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061d2d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:2.0:1746147207.184636:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310231040 00000100:00100000:2.0:1746147207.184642:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310231040 00010000:00010000:2.0:1746147207.184675:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425061cf5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6fa expref: 11 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.184797:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8841 00000100:00100000:2.0:1746147207.184806:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310231040:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.184820:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.184826:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425061cf5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6fa expref: 11 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.184837:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425061cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6fa expref: 11 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.184861:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffbc00/0x3139939425061cf5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6fa expref: 11 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.184887:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.184891:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061d2d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.184900:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061d2d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.184906:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061d2d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.184934:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.184971:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310231040:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 167us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.184977:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8841 00010000:00010000:1.0:1746147207.185260:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061d2d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147207.185267:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061d2d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147207.185290:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147207.185421:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa200/0x3139939425061d26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e72b expref: 11 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.185451:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061d2d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e72b expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.185457:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147207.185459:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147207.185461:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffa000, rc 0) 00000100:00100000:1.0:1746147207.186001:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2724:x1830967310230912:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5466us (5709us total) trans 8589937261 rc 0/0 00000100:00100000:1.0:1746147207.186009:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16371 00000100:00100000:0.0:1746147207.188515:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.188754:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310231168 00000100:00100000:1.0:1746147207.188763:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310231168 00000100:00100000:1.0:1746147207.188814:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16372 00000100:00100000:1.0:1746147207.188821:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2724:x1830967310231168:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147207.188845:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147207.188863:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093731e00/0x3139939425061d3b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e732 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.188950:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093730a00/0x3139939425061d42 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147207.189810:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061d2d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e72b expref: 11 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.189819:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093730a00/0x3139939425061d42 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147207.189853:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061d2d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e72b expref: 11 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.189864:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061d2d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e72b expref: 11 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.189876:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f57480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311409152:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147207.189977:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.193572:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.193979:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f57480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311409152:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147207.194005:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093730a00/0x3139939425061d42 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:2.0:1746147207.194073:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310231296 00000100:00100000:2.0:1746147207.194080:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310231296 00010000:00010000:2.0:1746147207.194136:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061d2d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e72b expref: 12 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.194170:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8842 00000100:00100000:2.0:1746147207.194176:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310231296:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.194190:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.194194:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061d2d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e72b expref: 12 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.194208:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061d2d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e72b expref: 12 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.194227:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffa000/0x3139939425061d2d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e72b expref: 12 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.194242:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.194246:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093730a00/0x3139939425061d42 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.194254:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093730a00/0x3139939425061d42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.194261:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093730a00/0x3139939425061d42 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.194275:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.194313:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310231296:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 137us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.194319:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8842 00010000:00010000:1.0:1746147207.194381:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093730a00/0x3139939425061d42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147207.194386:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093730a00/0x3139939425061d42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147207.194436:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:1.0:1746147207.194440:0:9138:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147207.194456:0:9138:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093730a00/0x3139939425061d42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147207.194489:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093731e00/0x3139939425061d3b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e732 expref: 11 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.194521:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093730a00/0x3139939425061d42 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e732 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.194528:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147207.194530:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147207.194533:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093730a00, rc 0) 00000100:00100000:1.0:1746147207.194671:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2724:x1830967310231168:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5849us (6166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.194677:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16372 00000100:00100000:0.0:1746147207.200774:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.200850:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310231424 00000100:00100000:2.0:1746147207.200862:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310231424 00000100:00100000:2.0:1746147207.200950:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19486 00000100:00100000:2.0:1746147207.200959:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967310231424:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147207.200980:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.200999:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x3139939425061d49 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e739 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.201055:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098823800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311409280:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147207.201175:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.207045:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098823800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311409280:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147207.207084:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x3139939425061d49 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e739 expref: 22 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.207122:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db80a00/0x3139939425061d49 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e739 expref: 22 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.207140:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80a00, rc 0) 00000100:00100000:2.0:1746147207.207198:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967310231424:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 6239us (6431us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147207.207207:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19486 00000100:00100000:1.0:1746147207.215464:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.216076:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310231680 00000100:00100000:2.0:1746147207.216086:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310231680 00000100:00100000:2.0:1746147207.216166:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16373 00000100:00100000:2.0:1746147207.216175:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2724:x1830967310231680:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147207.216196:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.216216:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80600/0x3139939425061d50 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e740 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.216333:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425061d57 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.216351:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425061d57 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.216362:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425061d57 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:2.0:1746147207.216377:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147207.216481:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80600/0x3139939425061d50 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e740 expref: 13 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.216512:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425061d57 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e740 expref: 12 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.216520:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.216522:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147207.216525:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81a00, rc 0) 00000100:00100000:2.0:1746147207.216571:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2724:x1830967310231680:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 397us (1119us total) trans 8589937262 rc 0/0 00000100:00100000:2.0:1746147207.216577:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16373 00000100:00100000:2.0:1746147207.221790:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.223248:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.223346:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.223362:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310231936 00000100:00100000:0.0:1746147207.223370:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310231936 00000100:00100000:0.0:1746147207.223419:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310232192 00000100:00100000:0.0:1746147207.223421:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310232192 00000100:00100000:0.0:1746147207.223439:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19487 00000100:00100000:0.0:1746147207.223447:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967310231936:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147207.223494:0:9584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098c11200/0x3139939425061d65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.223513:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d42200/0x3139939425061bf9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e66e expref: 28 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.223524:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061d03 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e708 expref: 21 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.223530:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d9a800/0x3139939425061c5b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e691 expref: 40 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.223536:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.223538:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.223541:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c11200/0x3139939425061d65 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.223575:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d9a800/0x3139939425061c5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e691 expref: 40 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.223588:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d9a800/0x3139939425061c5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e691 expref: 40 pid: 12225 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746147207.223603:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311409408:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147207.223825:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061d03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e708 expref: 21 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.223833:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061d03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e708 expref: 21 pid: 9584 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746147207.223841:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311409536:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.223885:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310232448 00000100:00100000:2.0:1746147207.223888:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310232448 00000100:00100000:2.0:1746147207.223910:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19488 00000100:00100000:2.0:1746147207.223915:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310232192:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147207.223936:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061d6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.223946:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x3139939425061c93 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c9 expref: 25 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.223952:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425061d11 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e716 expref: 11 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.223959:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425061caf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6e5 expref: 13 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.223964:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.223965:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.223967:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061d6c lrc: 6/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.223983:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425061caf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6e5 expref: 13 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.223991:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425061caf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6e5 expref: 13 pid: 10340 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746147207.223999:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311409664:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.224028:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425061d11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e716 expref: 11 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.224035:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425061d11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e716 expref: 11 pid: 10340 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746147207.224042:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098822d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311409792:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.224060:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x3139939425061c93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c9 expref: 25 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.224071:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x3139939425061c93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c9 expref: 25 pid: 17600 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.224077:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311409920:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.224103:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.224125:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19489 00000100:00100000:2.0:1746147207.224130:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2001:x1830967310232448:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147207.224144:0:1398:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011db81c00/0x3139939425061d73 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.224153:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x313993942506193d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e499 expref: 40 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.224160:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425061c8c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c2 expref: 28 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.224165:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ffac00/0x3139939425061d1f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e724 expref: 22 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.224171:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0400/0x3139939425061ca1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6d7 expref: 40 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.224177:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061aef lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5a3 expref: 28 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.224186:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147207.224188:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147207.224189:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db81c00/0x3139939425061d73 lrc: 8/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.224203:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061aef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5a3 expref: 28 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.224210:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061aef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5a3 expref: 28 pid: 10340 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.224216:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311410048:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.224237:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0400/0x3139939425061ca1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6d7 expref: 40 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.224243:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0400/0x3139939425061ca1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6d7 expref: 40 pid: 10340 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746147207.224249:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311410176:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.224264:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097ffac00/0x3139939425061d1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e724 expref: 22 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.224269:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097ffac00/0x3139939425061d1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e724 expref: 22 pid: 10340 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746147207.224279:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311410304:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.224294:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425061c8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c2 expref: 28 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.224300:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425061c8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c2 expref: 28 pid: 17600 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.224307:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311410432:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.224323:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x313993942506193d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e499 expref: 40 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.224330:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x313993942506193d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e499 expref: 40 pid: 13695 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.224337:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311410560:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.224347:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989856c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.224416:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.224430:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310231808 00000100:00100000:2.0:1746147207.224433:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310231808 00000100:00100000:2.0:1746147207.224450:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19490 00000100:00100000:2.0:1746147207.224454:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310231808:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147207.224470:0:1853:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425061d7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.224484:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425061be4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e660 expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.224491:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ffb800/0x3139939425061cfc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e701 expref: 12 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.224497:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d43c00/0x3139939425061c54 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e68a expref: 25 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.224503:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.224504:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.224506:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425061d7a lrc: 6/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.224522:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d43c00/0x3139939425061c54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e68a expref: 25 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.224530:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d43c00/0x3139939425061c54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e68a expref: 25 pid: 10340 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746147207.224537:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311410688:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.224558:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ffb800/0x3139939425061cfc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e701 expref: 12 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.224565:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ffb800/0x3139939425061cfc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e701 expref: 12 pid: 10340 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746147207.224576:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311410816:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.224591:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425061be4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e660 expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.224598:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425061be4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e660 expref: 13 pid: 1854 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.224604:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311410944:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.224614:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ec10cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.224654:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.224665:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310232064 00000100:00100000:2.0:1746147207.224668:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310232064 00000100:00100000:2.0:1746147207.224684:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19491 00000100:00100000:2.0:1746147207.224689:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2001:x1830967310232064:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147207.224704:0:12225:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425061d81 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.224715:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ffb000/0x3139939425061cd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1617919) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6f3 expref: 28 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.224729:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147207.224730:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147207.224732:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425061d81 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.224751:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097ffb000/0x3139939425061cd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1617919) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6f3 expref: 28 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.224758:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097ffb000/0x3139939425061cd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1617919) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6f3 expref: 28 pid: 10340 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.224766:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311411072:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.224781:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ec10300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.224826:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.224838:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310232320 00000100:00100000:2.0:1746147207.224840:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310232320 00010000:00010000:0.0:1746147207.225176:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d42200/0x3139939425061bf9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e66e expref: 28 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.225184:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d42200/0x3139939425061bf9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e66e expref: 28 pid: 1854 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746147207.225191:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311411200:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147207.225204:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095afff00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147207.225526:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.225544:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.225564:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.225580:0:8098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310232576 00000100:00100000:1.0:1746147207.225583:0:8098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310232576 00000100:00100000:1.0:1746147207.225609:0:8098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 235 00000100:00100000:1.0:1746147207.225614:0:8098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2003:x1830967310232576:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1746147207.225637:0:8098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2003:x1830967310232576:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 23us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.225643:0:8098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 235 00000100:00100000:1.0:1746147207.225682:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.225795:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310232704 00000100:00100000:0.0:1746147207.225798:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310232704 00000100:00100000:0.0:1746147207.225833:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310232960 00000100:00100000:0.0:1746147207.225835:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310232960 00000100:00100000:0.0:1746147207.225846:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310232832 00000100:00100000:0.0:1746147207.225848:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310232832 00000100:00100000:0.0:1746147207.225859:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 979 00000100:00100000:0.0:1746147207.225863:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+375:2003:x1830967310232704:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1746147207.225884:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+375:2003:x1830967310232704:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 21us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.225888:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 979 00000100:00100000:0.0:1746147207.225896:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 980 00000100:00100000:0.0:1746147207.225899:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+5:2003:x1830967310232960:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1746147207.225910:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+5:2003:x1830967310232960:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 10us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.225914:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 980 00000100:00100000:0.0:1746147207.225919:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 981 00000100:00100000:0.0:1746147207.225923:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+5:2003:x1830967310232832:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1746147207.225934:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+5:2003:x1830967310232832:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 11us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.225938:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 981 00000100:00100000:3.0:1746147207.230373:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19492 00000100:00100000:3.0:1746147207.230397:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310232320:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147207.230449:0:10340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425061d88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.230471:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425061c77 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6ad expref: 13 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.230479:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c11e00/0x3139939425061d18 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e71d expref: 13 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.230486:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x3139939425061c9a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6d0 expref: 25 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.230491:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.230492:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.230495:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425061d88 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.230526:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x3139939425061c9a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6d0 expref: 25 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.230536:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x3139939425061c9a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6d0 expref: 25 pid: 17600 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746147207.230548:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093147480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311411328:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.230626:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098c11e00/0x3139939425061d18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e71d expref: 13 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.230632:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098c11e00/0x3139939425061d18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e71d expref: 13 pid: 1136 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746147207.230645:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311411456:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.230666:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425061c77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6ad expref: 13 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.230673:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425061c77 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6ad expref: 13 pid: 10340 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.230681:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311411584:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.230695:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900e480 going to sleep for 11 seconds 00000100:00080000:3.0:1746147207.230737:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746147207.237868:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311409408:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.238069:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311410688:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147207.238335:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.238336:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311410816:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.238347:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311410944:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147207.238359:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147207.238379:0:1853:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425061d7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.238386:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310233088 00000100:00100000:0.0:1746147207.238393:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310233088 00000100:00100000:2.0:1746147207.238404:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098820e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311409664:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.238412:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098822d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311409792:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.238420:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098821500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311409920:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147207.238430:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425061caf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6e5 expref: 14 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746147207.238437:0:1854:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061d6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.238456:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310233216 00000100:00100000:2.0:1746147207.238458:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311411072:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147207.238458:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310233216 00010000:00010000:2.0:1746147207.238467:0:12225:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425061d81 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.238467:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425061d11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e716 expref: 14 pid: 10340 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746147207.238486:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311409536:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147207.238490:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8843 00000100:00100000:2.0:1746147207.238493:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311411200:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147207.238498:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310233088:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.238507:0:9584:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098c11200/0x3139939425061d65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.238511:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147207.238533:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425061caf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6e5 expref: 14 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.238543:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425061caf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6e5 expref: 14 pid: 10340 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746147207.238544:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8844 00000100:00100000:2.0:1746147207.238554:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310233216:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147207.238565:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x3139939425061caf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6e5 expref: 14 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746147207.238568:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.238587:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425061d11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e716 expref: 14 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.238596:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147207.238599:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425061d11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e716 expref: 14 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746147207.238616:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ffbe00/0x3139939425061d11 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e716 expref: 14 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746147207.238635:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147207.238639:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310233088:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 142us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.238646:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8843 00000100:00100000:2.0:1746147207.238686:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310233216:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 134us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.238693:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8844 00000100:00100000:2.0:1746147207.238754:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093147480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311411328:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.238762:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311411456:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.239608:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311410048:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.239621:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311410176:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.239630:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311410304:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.239638:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311410432:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.239645:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311410560:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.239673:0:1398:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011db81c00/0x3139939425061d73 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.239766:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.239883:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310233344 00000100:00100000:2.0:1746147207.239888:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310233344 00010000:00010000:2.0:1746147207.239908:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d9a800/0x3139939425061c5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e691 expref: 41 pid: 12225 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746147207.239927:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8845 00000100:00100000:2.0:1746147207.239932:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2003:x1830967310233344:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.239945:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.239959:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d9a800/0x3139939425061c5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e691 expref: 41 pid: 12225 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746147207.239967:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d9a800/0x3139939425061c5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e691 expref: 41 pid: 12225 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746147207.239983:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d9a800/0x3139939425061c5b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e691 expref: 41 pid: 12225 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746147207.240258:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311411584:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.240280:0:10340:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425061d88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.240338:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.240364:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967310233344:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 431us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.240370:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8845 00000100:00100000:0.0:1746147207.240996:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.241020:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.241042:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.241054:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.241107:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.241122:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310233856 00000100:00100000:0.0:1746147207.241125:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310233856 00010000:00010000:0.0:1746147207.241147:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x3139939425061c93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c9 expref: 26 pid: 17600 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746147207.241164:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310234112 00000100:00100000:0.0:1746147207.241166:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310234112 00000100:00100000:2.0:1746147207.241170:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310233984 00000100:00100000:2.0:1746147207.241174:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310233984 00010000:00010000:0.0:1746147207.241175:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x313993942506193d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e499 expref: 40 pid: 13695 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746147207.241185:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310234368 00000100:00100000:0.0:1746147207.241187:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310234368 00010000:00010000:2.0:1746147207.241188:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffb800/0x3139939425061cfc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e701 expref: 13 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.241195:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425061be4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e660 expref: 13 pid: 1854 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.241204:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8846 00000100:00100000:0.0:1746147207.241208:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8847 00000100:00100000:2.0:1746147207.241210:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310233856:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147207.241214:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2003:x1830967310234112:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.241219:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147207.241222:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147207.241233:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x313993942506193d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e499 expref: 40 pid: 13695 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.241234:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x3139939425061c93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c9 expref: 26 pid: 17600 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.241242:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x313993942506193d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e499 expref: 40 pid: 13695 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.241243:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x3139939425061c93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c9 expref: 26 pid: 17600 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.241256:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0aec00/0x3139939425061c93 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c9 expref: 26 pid: 17600 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.241256:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9200/0x313993942506193d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e499 expref: 40 pid: 13695 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.241266:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147207.241267:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.241269:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.241273:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061d6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.241280:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061d6c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.241285:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967310234112:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 72us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.241291:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8847 00010000:00010000:2.0:1746147207.241299:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147207.241301:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8848 00000100:00100000:0.0:1746147207.241306:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2003:x1830967310233984:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147207.241312:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147207.241314:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967310233856:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 104us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.241319:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8846 00010000:00010000:0.0:1746147207.241321:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ffb800/0x3139939425061cfc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e701 expref: 13 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.241329:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ffb800/0x3139939425061cfc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e701 expref: 13 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.241342:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ffb800/0x3139939425061cfc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e701 expref: 13 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.241354:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.241356:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8849 00000100:00100000:2.0:1746147207.241360:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2003:x1830967310234368:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.241365:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147207.241370:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310233984:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 64us (314us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147207.241371:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425061be4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e660 expref: 13 pid: 1854 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746147207.241376:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8848 00010000:00010000:2.0:1746147207.241379:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425061be4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e660 expref: 13 pid: 1854 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.241388:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425061be4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e660 expref: 13 pid: 1854 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.241394:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.241405:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2003:x1830967310234368:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 45us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.241409:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8849 00010000:00010000:2.0:1746147207.241426:0:1854:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061d6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.241433:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061d6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.241447:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061d6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.241454:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061d6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.241466:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061d6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.241471:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db81400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147207.241474:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061d6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.241481:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061d6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.241488:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061d6c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.241493:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061d6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.241505:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310234496 00000100:00100000:3.0:1746147207.241508:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310234496 00000100:00100000:2.0:1746147207.241526:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310232192:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 17611us (18284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.241533:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19488 00002000:00100000:3.0:1746147207.241536:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1220608->1617919) req@ffff8800769ad180 x1830967310234496/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.241546:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ad180 with x1830967310234496 ext(1220608->1617919) 00010000:00010000:3.0:1746147207.241552:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097ffb000/0x3139939425061cd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6f3 expref: 29 pid: 10340 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.241561:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097ffb000/0x3139939425061cd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6f3 expref: 29 pid: 10340 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746147207.241566:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800769ad180 00000100:00100000:3.0:1746147207.241580:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1675 00000100:00100000:3.0:1746147207.241585:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2003:x1830967310234496:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147207.246744:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.246784:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.246799:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.246815:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.246919:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.247014:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.247030:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310233600 00000100:00100000:1.0:1746147207.247039:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310233600 00010000:00010000:1.0:1746147207.247080:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffac00/0x3139939425061d1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e724 expref: 24 pid: 10340 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.247132:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310234240 00000100:00100000:1.0:1746147207.247135:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310234240 00010000:00010000:1.0:1746147207.247150:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0400/0x3139939425061ca1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6d7 expref: 39 pid: 10340 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.247159:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310235008 00000100:00100000:1.0:1746147207.247161:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310235008 00010000:00010000:1.0:1746147207.247171:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d43c00/0x3139939425061c54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e68a expref: 25 pid: 10340 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.247179:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310233472 00000100:00100000:1.0:1746147207.247181:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310233472 00010000:00010000:1.0:1746147207.247189:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061aef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5a3 expref: 31 pid: 10340 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.247197:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310233728 00000100:00100000:1.0:1746147207.247199:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310233728 00010000:00010000:1.0:1746147207.247206:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425061c8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c2 expref: 32 pid: 17600 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.247217:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8850 00000100:00100000:1.0:1746147207.247223:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2001:x1830967310233600:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.247237:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147207.247269:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8851 00000100:00100000:3.0:1746147207.247276:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967310234240:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.247283:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.247306:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0400/0x3139939425061ca1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6d7 expref: 39 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.247316:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0400/0x3139939425061ca1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6d7 expref: 39 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.247339:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57a0400/0x3139939425061ca1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6d7 expref: 39 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.247363:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147207.247411:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310234240:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 135us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.247418:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8851 00000100:00100000:3.0:1746147207.247433:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8852 00000100:00100000:3.0:1746147207.247438:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310235008:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.247447:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.247459:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d43c00/0x3139939425061c54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e68a expref: 25 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.247467:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d43c00/0x3139939425061c54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e68a expref: 25 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.247480:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d43c00/0x3139939425061c54 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e68a expref: 25 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.247490:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.247492:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.247497:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425061d7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.247505:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425061d7a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.247540:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ffac00/0x3139939425061d1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e724 expref: 24 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.247548:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ffac00/0x3139939425061d1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e724 expref: 24 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.247560:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ffac00/0x3139939425061d1f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e724 expref: 24 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.247572:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147207.247588:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2001:x1830967310233600:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 366us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.247593:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8850 00000100:00100000:1.0:1746147207.247604:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8853 00000100:00100000:1.0:1746147207.247608:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2001:x1830967310233472:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.247617:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147207.247622:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061aef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5a3 expref: 32 pid: 10340 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.247629:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061aef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5a3 expref: 32 pid: 10340 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.247639:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x3139939425061aef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e5a3 expref: 32 pid: 10340 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.247646:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147207.247658:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2001:x1830967310233472:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 50us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.247663:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8853 00000100:00100000:1.0:1746147207.247672:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8854 00000100:00100000:1.0:1746147207.247676:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2001:x1830967310233728:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.247683:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147207.247688:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425061c8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c2 expref: 30 pid: 17600 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.247696:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425061c8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c2 expref: 30 pid: 17600 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.247705:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae600/0x3139939425061c8c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6c2 expref: 30 pid: 17600 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.247712:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.247714:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.247716:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db81c00/0x3139939425061d73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.247733:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db81c00/0x3139939425061d73 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.247759:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147207.247775:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310233728:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 98us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.247780:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8854 00000100:00100000:2.0:1746147207.247875:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310234880 00000100:00100000:2.0:1746147207.247879:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310234880 00010000:00010000:2.0:1746147207.247895:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d42200/0x3139939425061bf9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e66e expref: 29 pid: 1854 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.247911:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8855 00000100:00100000:2.0:1746147207.247916:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310234880:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.247923:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.247930:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d42200/0x3139939425061bf9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e66e expref: 29 pid: 1854 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.247938:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d42200/0x3139939425061bf9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e66e expref: 29 pid: 1854 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.247948:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d42200/0x3139939425061bf9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e66e expref: 29 pid: 1854 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.247962:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.247979:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2001:x1830967310234880:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 62us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.247984:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8855 00010000:00010000:3.0:1746147207.248009:0:1398:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011db81c00/0x3139939425061d73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.248029:0:1398:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db81c00/0x3139939425061d73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.248054:0:1398:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011db81c00/0x3139939425061d73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.248061:0:1398:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011db81c00/0x3139939425061d73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.248067:0:1398:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011db81c00/0x3139939425061d73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.248073:0:1398:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db81c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147207.248076:0:1398:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011db81c00/0x3139939425061d73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.248083:0:1398:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011db81c00/0x3139939425061d73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.248132:0:1398:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011db81c00/0x3139939425061d73 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.248138:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db81c00/0x3139939425061d73 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.248223:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2001:x1830967310232448:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 24089us (24873us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.248233:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19489 00010000:00010000:3.0:1746147207.248280:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147207.248296:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310235008:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 858us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.248303:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8852 00010000:00010000:2.0:1746147207.248318:0:1853:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425061d7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.248327:0:1853:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425061d7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.248342:0:1853:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425061d7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.248349:0:1853:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425061d7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.248356:0:1853:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425061d7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.248362:0:1853:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38d800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147207.248365:0:1853:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425061d7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.248372:0:1853:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425061d7a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.248381:0:1853:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425061d7a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.248386:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425061d7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.248428:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310231808:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 23972us (24011us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.248445:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19490 00000100:00100000:0.0:1746147207.248980:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.248994:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310234752 00000100:00100000:0.0:1746147207.248996:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310234752 00010000:00010000:0.0:1746147207.249012:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061d03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e708 expref: 22 pid: 9584 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746147207.249039:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8856 00000100:00100000:0.0:1746147207.249044:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2003:x1830967310234752:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147207.249050:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147207.249057:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061d03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e708 expref: 22 pid: 9584 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.249066:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061d03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e708 expref: 22 pid: 9584 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.249083:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061d03 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e708 expref: 22 pid: 9584 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.249125:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.249127:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.249130:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c11200/0x3139939425061d65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.249137:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c11200/0x3139939425061d65 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.249154:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147207.249169:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2003:x1830967310234752:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 125us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.249175:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8856 00010000:00010000:3.0:1746147207.255020:0:9584:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098c11200/0x3139939425061d65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.255034:0:9584:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c11200/0x3139939425061d65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.255058:0:9584:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098c11200/0x3139939425061d65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.255062:0:9584:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098c11200/0x3139939425061d65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.255067:0:9584:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098c11200/0x3139939425061d65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.255073:0:9584:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c11200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147207.255077:0:9584:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098c11200/0x3139939425061d65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.255084:0:9584:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098c11200/0x3139939425061d65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.255137:0:9584:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098c11200/0x3139939425061d65 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.255143:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c11200/0x3139939425061d65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.255224:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967310231936:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 31771us (33438us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.255232:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19487 00000100:00100000:3.0:1746147207.255297:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.255317:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310235264 00000100:00100000:3.0:1746147207.255323:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310235264 00010000:00010000:3.0:1746147207.255346:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x3139939425061c9a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6d0 expref: 24 pid: 17600 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746147207.255370:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8857 00000100:00100000:3.0:1746147207.255375:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967310235264:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.255387:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.255403:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x3139939425061c9a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6d0 expref: 24 pid: 17600 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.255412:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x3139939425061c9a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6d0 expref: 24 pid: 17600 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.255427:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c11400/0x3139939425061c9a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6d0 expref: 24 pid: 17600 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.255436:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147207.255452:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2003:x1830967310235264:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 76us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.255457:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8857 00000100:00100000:3.0:1746147207.255484:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.255494:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310234624 00000100:00100000:3.0:1746147207.255497:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310234624 00010000:00010000:3.0:1746147207.255505:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c11e00/0x3139939425061d18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e71d expref: 10 pid: 1136 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746147207.255526:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8858 00000100:00100000:3.0:1746147207.255531:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2003:x1830967310234624:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.255537:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.255544:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c11e00/0x3139939425061d18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e71d expref: 10 pid: 1136 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.255553:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c11e00/0x3139939425061d18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e71d expref: 10 pid: 1136 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.255564:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c11e00/0x3139939425061d18 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e71d expref: 10 pid: 1136 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.255570:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147207.255584:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2003:x1830967310234624:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 53us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.255591:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8858 00000100:00100000:3.0:1746147207.255623:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.255652:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310235136 00000100:00100000:2.0:1746147207.255662:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310235136 00010000:00010000:2.0:1746147207.255693:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425061c77 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6ad expref: 12 pid: 10340 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.255738:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8859 00000100:00100000:2.0:1746147207.255746:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2003:x1830967310235136:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.255758:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.255774:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425061c77 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6ad expref: 12 pid: 10340 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.255785:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425061c77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6ad expref: 12 pid: 10340 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.255804:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425061c77 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6ad expref: 12 pid: 10340 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.255818:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.255820:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.255825:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425061d88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.255834:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425061d88 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.255862:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.255959:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2003:x1830967310235136:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 213us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.255965:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8859 00010000:00010000:2.0:1746147207.255985:0:10340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425061d88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.255993:0:10340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425061d88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.256006:0:10340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425061d88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.256018:0:10340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425061d88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.256024:0:10340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425061d88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.256030:0:10340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ffa000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147207.256033:0:10340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425061d88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.256040:0:10340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425061d88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.256049:0:10340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425061d88 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.256054:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ffa000/0x3139939425061d88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.256166:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2001:x1830967310232320:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 25779us (31337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.256174:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19492 00000100:00100000:3.0:1746147207.260739:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2003:x1830967310234496:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 19127us (19669us total) trans 17179875146 rc 0/0 00000100:00100000:3.0:1746147207.260754:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1675 00002000:00100000:3.0:1746147207.260768:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1220608->1617919) req@ffff8800769ad180 x1830967310234496/t17179875146(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/448 e 0 to 0 dl 1746147218 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.260778:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ad180 with x1830967310234496 ext(1220608->1617919) 00010000:00010000:3.0:1746147207.260790:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097ffb000/0x3139939425061cd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6f3 expref: 28 pid: 10340 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.260808:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097ffb000/0x3139939425061cd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6f3 expref: 28 pid: 10340 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746147207.260816:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800769ad180 00000100:00100000:0.0:1746147207.265396:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.268670:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310235392 00000100:00100000:2.0:1746147207.268687:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310235392 00010000:00010000:2.0:1746147207.268747:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ffb000/0x3139939425061cd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1220608->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6f3 expref: 28 pid: 10340 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.268802:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8860 00000100:00100000:2.0:1746147207.268811:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2002:x1830967310235392:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.268830:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.268854:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ffb000/0x3139939425061cd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6f3 expref: 28 pid: 10340 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.268867:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ffb000/0x3139939425061cd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1617919) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6f3 expref: 28 pid: 10340 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.268892:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ffb000/0x3139939425061cd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1220608->1617919) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e6f3 expref: 28 pid: 10340 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.268923:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.268925:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.268930:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425061d81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.268938:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425061d81 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.268970:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.269020:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2002:x1830967310235392:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 209us (3634us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.269027:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8860 00010000:00010000:3.0:1746147207.269566:0:12225:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425061d81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.269578:0:12225:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425061d81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.269600:0:12225:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425061d81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.269607:0:12225:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425061d81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.269617:0:12225:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425061d81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.269626:0:12225:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a57400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147207.269632:0:12225:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425061d81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.269643:0:12225:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425061d81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.269655:0:12225:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425061d81 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.269661:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a57400/0x3139939425061d81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.269743:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310232064:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 45052us (45087us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.269751:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19491 00000100:00100000:1.0:1746147207.272471:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.272540:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310235648 00000100:00100000:3.0:1746147207.272548:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310235648 00000100:00100000:3.0:1746147207.272592:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16374 00000100:00100000:3.0:1746147207.272599:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2724:x1830967310235648:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:3.0:1746147207.272653:0:9138:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.272681:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093730a00/0x3139939425061d42 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e732 expref: 12 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.272705:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147207.272709:0:9138:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147207.272746:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.272760:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250619f3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4fb expref: 22 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.272767:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425061a39 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e525 expref: 39 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.272773:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e429 expref: 22 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.272780:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093708600/0x3139939425061913 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e476 expref: 39 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.272787:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 7/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.272820:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093708600/0x3139939425061913 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e476 expref: 39 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.272833:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093708600/0x3139939425061913 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e476 expref: 39 pid: 7238 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.272847:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311411712:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147207.275054:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.275186:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310235776 00000100:00100000:1.0:1746147207.275193:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310235776 00010000:00010000:1.0:1746147207.275231:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093708600/0x3139939425061913 lrc: 6/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e476 expref: 40 pid: 7238 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.275577:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e429 expref: 22 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.275590:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e429 expref: 22 pid: 7239 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.276036:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311411840:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.276139:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425061a39 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e525 expref: 40 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.276149:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425061a39 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e525 expref: 40 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.276157:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311411968:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.276180:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250619f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4fb expref: 22 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.276186:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250619f3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4fb expref: 22 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.276193:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093147480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311412096:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.276211:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147207.276235:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311411712:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147207.276298:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8861 00000100:00100000:1.0:1746147207.276308:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967310235776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.276319:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147207.276325:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093708600/0x3139939425061913 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e476 expref: 40 pid: 7238 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.276334:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093708600/0x3139939425061913 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e476 expref: 40 pid: 7238 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.276354:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093708600/0x3139939425061913 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e476 expref: 40 pid: 7238 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.276373:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147207.276378:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147207.276387:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147207.276407:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967310235776:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 101us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.276414:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8861 00000100:00100000:0.0:1746147207.280071:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.280443:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311411840:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.280457:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311411968:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.280466:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093147480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311412096:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.280503:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:2.0:1746147207.280657:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310235904 00000100:00100000:2.0:1746147207.280666:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310235904 00000100:00100000:0.0:1746147207.280677:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147207.280702:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e429 expref: 23 pid: 7239 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.280714:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310236032 00000100:00100000:1.0:1746147207.280730:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310236032 00000100:00100000:0.0:1746147207.280761:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147207.280769:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425061a39 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e525 expref: 39 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.281031:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310236160 00000100:00100000:2.0:1746147207.281035:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310236160 00000100:00100000:0.0:1746147207.281040:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8862 00010000:00010000:2.0:1746147207.281049:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250619f3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4fb expref: 24 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746147207.281157:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2001:x1830967310235904:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147207.281167:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147207.281173:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e429 expref: 24 pid: 7239 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.281187:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8863 00010000:00010000:0.0:1746147207.281187:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e429 expref: 24 pid: 7239 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.281193:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967310236032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.281199:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.281203:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425061a39 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e525 expref: 39 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.281205:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098226800/0x31399394250618c6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e429 expref: 24 pid: 7239 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.281210:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425061a39 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e525 expref: 39 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.281219:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425061a39 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e525 expref: 39 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.281227:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147207.281231:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.281238:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147207.281276:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2001:x1830967310235904:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 126us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.281282:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8862 00000100:00100000:0.0:1746147207.281296:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8864 00000100:00100000:0.0:1746147207.281301:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310236160:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147207.281309:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147207.281313:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250619f3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4fb expref: 22 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.281342:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.281346:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.281351:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147207.281355:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250619f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4fb expref: 22 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.281365:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43000/0x31399394250619f3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e4fb expref: 22 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.281368:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310236032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 176us (692us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147207.281372:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00000100:00100000:2.0:1746147207.281373:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8863 00010000:00010000:0.0:1746147207.281375:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.281381:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.281387:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.281404:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147207.281418:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967310236160:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 116us (656us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147207.281422:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147207.281423:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8864 00010000:00010000:3.0:1746147207.281428:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000040:00080000:3.0:1746147207.281701:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1190, 88 off112568 00000004:00080000:3.0:1746147207.281775:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745271618270ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.281808:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1197, 88 off113184 00000004:00080000:3.0:1746147207.281813:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745271723325ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.281835:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1198, 88 off113272 00000004:00080000:3.0:1746147207.281838:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745271748735ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.281845:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1191, 88 off112656 00000004:00080000:3.0:1746147207.281848:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745271758535ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.281856:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1192, 88 off112744 00000004:00080000:3.0:1746147207.281858:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745271768780ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.281866:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1199, 88 off113360 00000004:00080000:3.0:1746147207.281869:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745271779423ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.281876:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1200, 88 off113448 00000004:00080000:3.0:1746147207.281878:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745271788333ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.281884:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1201, 88 off113536 00000004:00080000:3.0:1746147207.281886:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745271796163ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.281891:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1193, 88 off112832 00000004:00080000:3.0:1746147207.281893:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745271803410ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.281900:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1202, 88 off113624 00000004:00080000:3.0:1746147207.281903:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745271813227ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.281909:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1194, 88 off112920 00000004:00080000:3.0:1746147207.281912:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745271822743ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.281921:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1203, 88 off113712 00000004:00080000:3.0:1746147207.281923:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745271833673ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.281930:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1195, 88 off113008 00000004:00080000:3.0:1746147207.281932:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745271842717ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.281940:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1196, 88 off113096 00000004:00080000:3.0:1746147207.281942:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745271852637ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.281955:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1197, 88 off113184 00000004:00080000:3.0:1746147207.281957:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745271867842ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.281965:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1198, 88 off113272 00000004:00080000:3.0:1746147207.281967:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745271877775ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.281979:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1204, 88 off113800 00000004:00080000:3.0:1746147207.281981:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745271891935ns, next at 694367916532ns, rc = 0 00000001:00080000:0.0:1746147207.286153:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937263 is committed 00000004:00080000:0.0:1746147207.286163:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1182 committed 00000004:00080000:0.0:1746147207.286181:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1179 committed 00000004:00080000:0.0:1746147207.286198:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1178 committed 00000004:00080000:0.0:1746147207.286199:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1177 committed 00000004:00080000:0.0:1746147207.286201:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1176 committed 00000004:00080000:0.0:1746147207.286202:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1181 committed 00000004:00080000:0.0:1746147207.286204:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1175 committed 00000004:00080000:0.0:1746147207.286206:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1180 committed 00000004:00080000:0.0:1746147207.286208:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1174 committed 00000004:00080000:0.0:1746147207.286209:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1179 committed 00000004:00080000:0.0:1746147207.286210:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1178 committed 00000004:00080000:0.0:1746147207.286211:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1177 committed 00000004:00080000:0.0:1746147207.286213:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1173 committed 00000004:00080000:0.0:1746147207.286214:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1172 committed 00000004:00080000:0.0:1746147207.286215:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1176 committed 00000004:00080000:0.0:1746147207.286216:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1175 committed 00000004:00080000:0.0:1746147207.286218:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1171 committed 00000001:00080000:0.0:1746147207.286226:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937260 is committed 00000001:00080000:0.0:1746147207.286230:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937259 is committed 00000100:00100000:3.0:1746147207.286506:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311412480:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.286511:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311412224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.286559:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311412352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.286573:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311412608:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.286628:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.286656:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311412736:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.286670:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.286684:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311413248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147207.286696:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147207.286717:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.286728:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311412224 00000100:00100000:2.0:1746147207.286737:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311412224 00000100:00100000:2.0:1746147207.286747:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311412736 00000100:00100000:0.0:1746147207.286748:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311412864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.286749:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311412736 00000100:00100000:0.0:1746147207.286765:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.286776:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311413248 00000100:00100000:2.0:1746147207.286778:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311413248 00000100:00100000:0.0:1746147207.286779:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147207.286783:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311412992:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.286788:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311412352 00000100:00100000:2.0:1746147207.286790:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311412352 00000100:00100000:0.0:1746147207.286794:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.286800:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311412864 00000100:00100000:2.0:1746147207.286802:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311412864 00000100:00100000:2.0:1746147207.286808:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311412992 00000100:00100000:2.0:1746147207.286810:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311412992 00000100:00100000:0.0:1746147207.286816:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19493 00000100:00100000:2.0:1746147207.286821:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19494 00000100:00100000:0.0:1746147207.286823:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+57:3767:x1830967311412736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.286829:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3767:x1830967311413248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147207.286927:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3767:x1830967311413248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (228us total) trans 21474842529 rc 0/0 00000100:00100000:0.0:1746147207.286927:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+58:3767:x1830967311412736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (256us total) trans 17179875147 rc 0/0 00000100:00100000:2.0:1746147207.286932:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19494 00000100:00100000:3.0:1746147207.287018:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147207.287035:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311413504:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147207.287052:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.287061:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311412480 00000100:00100000:3.0:1746147207.287064:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311414016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147207.287065:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311412480 00000100:00100000:3.0:1746147207.287076:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147207.287082:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746147207.287111:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311413376:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147207.287124:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147207.287154:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19493 00000100:00100000:2.0:1746147207.287158:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19495 00000100:00100000:2.0:1746147207.287164:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+58:3764:x1830967311412352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.287164:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311413504 00000100:00100000:1.0:1746147207.287165:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311414016 00000100:00100000:1.0:1746147207.287167:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311414016 00000100:00100000:0.0:1746147207.287167:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311413504 00000100:00100000:0.0:1746147207.287177:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19496 00000100:00100000:1.0:1746147207.287180:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19497 00000100:00100000:0.0:1746147207.287181:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+58:3764:x1830967311412864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.287185:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+58:3764:x1830967311412992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.287221:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3764:x1830967311412352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (499us total) trans 17179875148 rc 0/0 00000100:00100000:1.0:1746147207.287222:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19498 00000100:00100000:2.0:1746147207.287226:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19495 00000100:00100000:1.0:1746147207.287226:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e21b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3765:x1830967311412480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147207.287228:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:0.0:1746147207.287231:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:0.0:1746147207.287233:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1746147207.287235:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19499 00002000:00010000:0.0:1746147207.287235:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:0.0:1746147207.287236:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:2.0:1746147207.287239:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967311413504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.287253:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+60:3764:x1830967311412864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (488us total) trans 17179875149 rc 0/0 00000100:00100000:0.0:1746147207.287258:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19496 00000100:00100000:0.0:1746147207.287267:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19500 00000100:00100000:0.0:1746147207.287271:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3765:x1830967311414016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147207.287276:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3765:x1830967311413504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 37us (223us total) trans 21474842530 rc 0/0 00000100:00100000:1.0:1746147207.287276:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e21b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3765:x1830967311412480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (258us total) trans 17179875151 rc 0/0 00000100:00100000:2.0:1746147207.287281:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19499 00000100:00100000:1.0:1746147207.287283:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19498 00000100:00080000:2.0:1746147207.287294:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746147207.287297:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147207.287304:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311413760:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147207.287306:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147207.287308:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147207.287310:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1746147207.287312:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+59:3764:x1830967311412992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 127us (516us total) trans 17179875150 rc 0/0 00002000:00010000:0.0:1746147207.287312:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147207.287313:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:1.0:1746147207.287316:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19497 00000100:00100000:0.0:1746147207.287329:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3765:x1830967311414016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (252us total) trans 21474842531 rc 0/0 00000100:00100000:0.0:1746147207.287334:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19500 00000100:00100000:1.0:1746147207.287341:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19501 00000100:00100000:1.0:1746147207.287345:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+58:3767:x1830967311412224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.287600:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+59:3767:x1830967311412224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 253us (972us total) trans 17179875152 rc 0/0 00000100:00100000:1.0:1746147207.287605:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19501 00000004:00080000:0.0:1746147207.287613:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258c700/2, rc 0, transno 17179875150 00000100:00100000:0.0:1746147207.287618:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311412992:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147207.287626:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258dc00/2, rc 0, transno 17179875148 00000100:00100000:0.0:1746147207.287629:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311412352:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147207.287633:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258df80/2, rc 0, transno 17179875149 00000100:00100000:0.0:1746147207.287635:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311412864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.287648:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311413376 00000100:00100000:0.0:1746147207.287651:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311413376 00000100:00100000:0.0:1746147207.287665:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19502 00000100:00100000:0.0:1746147207.287668:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3765:x1830967311413376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.287733:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3765:x1830967311413376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (608us total) trans 21474842532 rc 0/0 00000100:00100000:0.0:1746147207.287738:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19502 00000100:00100000:2.0:1746147207.287780:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147207.287798:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311413760 00000100:00100000:0.0:1746147207.287801:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311413760 00000004:00080000:2.0:1746147207.287802:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093147480/2, rc 0, transno 21474842529 00000100:00100000:2.0:1746147207.287808:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311413248:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147207.287815:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258e680/2, rc 0, transno 17179875152 00000100:00100000:0.0:1746147207.287816:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19503 00000100:00100000:2.0:1746147207.287817:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311412224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.287820:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3767:x1830967311413760:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147207.287823:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258f800/2, rc 0, transno 17179875147 00000100:00100000:2.0:1746147207.287825:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311412736:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.287830:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746147207.287834:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311413632:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147207.287850:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.287860:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311414144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147207.287872:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147207.287877:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3767:x1830967311413760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (96us total) trans 21474842533 rc 0/0 00000100:00100000:0.0:1746147207.287882:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19503 00000004:00080000:2.0:1746147207.287885:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093144e00/2, rc 0, transno 21474842533 00000100:00100000:2.0:1746147207.287887:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311413760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.287889:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311413632 00000100:00100000:0.0:1746147207.287891:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311413632 00000100:00100000:0.0:1746147207.287901:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311414144 00000100:00100000:0.0:1746147207.287903:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311414144 00000100:00100000:2.0:1746147207.287912:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311414272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.287913:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19504 00000100:00100000:0.0:1746147207.287917:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3767:x1830967311413632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147207.287926:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.287942:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311414272 00000100:00100000:2.0:1746147207.287945:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311414272 00002000:00010000:0.0:1746147207.287951:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147207.287954:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147207.287955:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147207.287957:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00000100:00100000:2.0:1746147207.287958:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19505 00002000:00010000:0.0:1746147207.287958:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:2.0:1746147207.287962:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3767:x1830967311414144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.287978:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3767:x1830967311413632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (127us total) trans 21474842534 rc 0/0 00000100:00100000:0.0:1746147207.287983:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19504 00000100:00100000:0.0:1746147207.287991:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19506 00000100:00100000:0.0:1746147207.287995:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3767:x1830967311414272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147207.288005:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:2.0:1746147207.288007:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147207.288009:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147207.288010:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147207.288012:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:2.0:1746147207.288029:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3767:x1830967311414144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (156us total) trans 21474842535 rc 0/0 00000100:00100000:2.0:1746147207.288034:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19505 00000100:00100000:0.0:1746147207.288043:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3767:x1830967311414272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (116us total) trans 21474842536 rc 0/0 00000100:00100000:0.0:1746147207.288047:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19506 00000004:00080000:2.0:1746147207.288051:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258c000/2, rc 0, transno 21474842536 00000100:00100000:2.0:1746147207.288055:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311414272:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147207.288061:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093145c00/2, rc 0, transno 21474842534 00000100:00100000:2.0:1746147207.288063:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311413632:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147207.288068:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3ce300/2, rc 0, transno 21474842535 00000100:00100000:2.0:1746147207.288070:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311414144:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147207.288114:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093144700/2, rc 0, transno 21474842532 00000100:00100000:3.0:1746147207.288118:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311413376:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147207.288122:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311413888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147207.288140:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147207.288153:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093145f80/2, rc 0, transno 21474842530 00000100:00100000:3.0:1746147207.288155:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311413504:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147207.288161:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3ced80/2, rc 0, transno 21474842531 00000100:00100000:3.0:1746147207.288164:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311414016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147207.288167:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311413888 00000004:00080000:3.0:1746147207.288170:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258fb80/2, rc 0, transno 17179875151 00000100:00100000:1.0:1746147207.288171:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311413888 00000100:00100000:3.0:1746147207.288172:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311412480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.288184:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19507 00000100:00100000:1.0:1746147207.288188:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+20:3765:x1830967311413888:12345-0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746147207.288219:0:9138:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880095149180 reply state ffff880094219800 transno 8589937263 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.288235:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.288246:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147207.288248:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746147207.288250:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+21:3765:x1830967311413888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (108us total) trans 21474842537 rc 0/0 00000100:00100000:3.0:1746147207.288251:0:9138:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746147207.288255:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19507 00000100:00100000:1.0:1746147207.288270:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147207.288271:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c71f80/2, rc 0, transno 21474842537 00000100:00100000:3.0:1746147207.288273:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311413888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147207.288283:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311413120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.288297:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.288310:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311412608 00000100:00100000:1.0:1746147207.288313:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311412608 00000100:00100000:1.0:1746147207.288323:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311413120 00000100:00100000:1.0:1746147207.288325:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311413120 00010000:00080000:3.0:1746147207.288328:0:9138:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746147207.288340:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2724:x1830967310235648:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 15740us (15876us total) trans 8589937263 rc 0/0 00000100:00100000:1.0:1746147207.288341:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19508 00000100:00100000:1.0:1746147207.288345:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3766:x1830967311412608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147207.288347:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16374 00000100:00100000:3.0:1746147207.288363:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19509 00000100:00100000:3.0:1746147207.288367:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3766:x1830967311413120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147207.288383:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147207.288386:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147207.288387:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147207.288389:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147207.288391:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746147207.288410:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+62:3766:x1830967311412608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (140us total) trans 17179875153 rc 0/0 00000100:00100000:1.0:1746147207.288414:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19508 00000100:00100000:3.0:1746147207.288426:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3766:x1830967311413120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (128us total) trans 17179875154 rc 0/0 00010000:00010000:1.0:1746147207.288429:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00000100:00100000:3.0:1746147207.288431:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19509 00010000:00010000:1.0:1746147207.288435:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147207.288439:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147207.288444:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ffb200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147207.288447:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147207.288452:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147207.288461:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147207.288463:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147207.288729:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147207.288734:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061d8f lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00000004:00080000:1.0:1746147207.289175:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258ed80/2, rc 0, transno 17179875153 00000100:00100000:1.0:1746147207.289180:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311412608:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147207.289187:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258ca80/2, rc 0, transno 17179875154 00000100:00100000:1.0:1746147207.289189:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311413120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.290782:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.290956:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310236288 00000100:00100000:3.0:1746147207.290963:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310236288 00000100:00100000:3.0:1746147207.291002:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16375 00000100:00100000:3.0:1746147207.291008:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2724:x1830967310236288:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147207.291027:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.291043:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x3139939425061d96 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e747 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.291115:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x3139939425061d96 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e747 expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.291126:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x3139939425061d96 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e747 expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.291144:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147207.291146:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147207.291149:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094182400, rc 0) 00000100:00100000:3.0:1746147207.291861:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2724:x1830967310236288:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 849us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.291868:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16375 00000100:00100000:0.0:1746147207.298055:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.298174:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310236416 00000100:00100000:3.0:1746147207.298186:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310236416 00000100:00100000:3.0:1746147207.298236:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16376 00000100:00100000:3.0:1746147207.298244:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2724:x1830967310236416:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147207.298261:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.298279:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094182c00/0x3139939425061d9d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e74e expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.298364:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061da4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.298377:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061da4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.298387:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061da4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147207.298410:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147207.298413:0:9138:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147207.298426:0:9138:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061da4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.298450:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094182c00/0x3139939425061d9d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e74e expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.298489:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061da4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e74e expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.298497:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147207.298500:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147207.298503:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffb200, rc 0) 00000100:00100000:3.0:1746147207.298569:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2724:x1830967310236416:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 326us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.298575:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16376 00000100:00100000:0.0:1746147207.306956:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.307005:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.307317:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310236544 00000100:00100000:2.0:1746147207.307330:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310236544 00000100:00100000:2.0:1746147207.307383:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310236800 00000100:00100000:2.0:1746147207.307386:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310236800 00000100:00100000:2.0:1746147207.307422:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19510 00000100:00100000:2.0:1746147207.307429:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2001:x1830967310236544:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147207.307494:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147207.307498:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19511 00000100:00100000:3.0:1746147207.307506:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310236800:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147207.307513:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.307516:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x3139939425061dab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e755 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.307525:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x3139939425061db2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e763 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147207.307538:0:10340:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x97:0x0] initial LVB size: 2097152, mtime: 0x68141787, atime: 0x68141786, ctime: 0x68141787, blocks: 0x800 00002000:00010000:2.0:1746147207.307538:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x93:0x0] initial LVB size: 1048576, mtime: 0x68141786, atime: 0x68141786, ctime: 0x68141786, blocks: 0x7e8 00010000:00010000:3.0:1746147207.307555:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.307555:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.307557:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.307557:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.307564:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x3139939425061db2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e763 expref: 20 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.307564:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x3139939425061dab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e755 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.307578:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x3139939425061db2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e763 expref: 20 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.307579:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x3139939425061dab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e755 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.307588:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094182c00, rc 0) 00010000:00010000:2.0:1746147207.307588:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db81c00, rc 0) 00000100:00100000:2.0:1746147207.307647:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310236544:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 218us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.307653:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19510 00000100:00100000:0.0:1746147207.307682:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.307710:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310236672 00000100:00100000:2.0:1746147207.307713:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310236672 00000100:00100000:2.0:1746147207.307744:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19512 00000100:00100000:2.0:1746147207.307748:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2000:x1830967310236672:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147207.307754:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.307763:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425061db9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e75c expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147207.307776:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x96:0x0] initial LVB size: 2097152, mtime: 0x68141786, atime: 0x68141786, ctime: 0x68141786, blocks: 0x808 00010000:00010000:2.0:1746147207.307784:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.307785:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.307789:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425061db9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e75c expref: 22 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.307802:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425061db9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e75c expref: 22 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.307807:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80c00, rc 0) 00000100:00100000:3.0:1746147207.307861:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2000:x1830967310236800:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 356us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.307866:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19511 00000100:00100000:2.0:1746147207.307878:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2000:x1830967310236672:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 130us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.307883:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19512 00000100:00100000:0.0:1746147207.309483:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.309523:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.309560:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.309672:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310237056 00000100:00100000:1.0:1746147207.309672:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310236928 00000100:00100000:3.0:1746147207.309677:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310237184 00000100:00100000:2.0:1746147207.309682:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310237056 00000100:00100000:1.0:1746147207.309682:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310236928 00000100:00100000:3.0:1746147207.309685:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310237184 00000100:00100000:1.0:1746147207.309752:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19513 00000100:00100000:2.0:1746147207.309757:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19514 00000100:00100000:1.0:1746147207.309758:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310236928:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:2.0:1746147207.309765:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310237056:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:3.0:1746147207.309769:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19515 00010000:00010000:2.0:1746147207.309772:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147207.309772:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147207.309776:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2000:x1830967310237184:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147207.309790:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.309793:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db80600/0x3139939425061dc0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e771 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.309793:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093730600/0x3139939425061dc7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e76a expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.309810:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061dce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e778 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147207.309814:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4886560, mtime: 0x68141786, atime: 0x68141786, ctime: 0x68141786, blocks: 0x1558 00002000:00010000:1.0:1746147207.309814:0:13695:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x68141786, atime: 0x68141786, ctime: 0x68141786, blocks: 0x808 00010000:00010000:1.0:1746147207.309830:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.309831:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.309832:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.309832:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1746147207.309833:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x98:0x0] initial LVB size: 4194304, mtime: 0x68141786, atime: 0x68141786, ctime: 0x68141786, blocks: 0x1008 00010000:00010000:1.0:1746147207.309839:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093730600/0x3139939425061dc7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e76a expref: 12 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.309840:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db80600/0x3139939425061dc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e771 expref: 12 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.309849:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.309851:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.309852:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093730600/0x3139939425061dc7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e76a expref: 12 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.309853:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db80600/0x3139939425061dc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e771 expref: 12 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.309858:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061dce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e778 expref: 22 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.309861:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80600, rc 0) 00010000:00010000:1.0:1746147207.309861:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093730600, rc 0) 00010000:00010000:3.0:1746147207.309873:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061dce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e778 expref: 22 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.309883:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e572a00, rc 0) 00000100:00100000:2.0:1746147207.309913:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310237056:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 150us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.309914:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310236928:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 156us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.309919:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19514 00000100:00100000:1.0:1746147207.309922:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19513 00000100:00100000:3.0:1746147207.310264:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2000:x1830967310237184:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 488us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.310270:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19515 00000100:00100000:0.0:1746147207.317344:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.317390:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.317415:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.317442:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.317455:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.317478:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.317518:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310237312 00000100:00100000:2.0:1746147207.317527:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310237312 00000100:00100000:1.0:1746147207.317550:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310237440 00000100:00100000:1.0:1746147207.317554:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310237440 00000100:00100000:2.0:1746147207.317561:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310237696 00000100:00100000:2.0:1746147207.317563:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310237696 00000100:00100000:1.0:1746147207.317572:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310237952 00000100:00100000:1.0:1746147207.317574:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310237952 00000100:00100000:2.0:1746147207.317575:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310237568 00000100:00100000:2.0:1746147207.317577:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310237568 00000100:00100000:1.0:1746147207.317583:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310237824 00000100:00100000:1.0:1746147207.317585:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310237824 00000100:00100000:2.0:1746147207.317590:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19516 00000100:00100000:2.0:1746147207.317597:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310237312:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147207.317604:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19517 00000100:00100000:1.0:1746147207.317609:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2001:x1830967310237440:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147207.317610:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19518 00000100:00100000:3.0:1746147207.317618:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310237696:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147207.317683:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310237696:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 66us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.317691:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19519 00000100:00100000:3.0:1746147207.317697:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19518 00000100:00100000:0.0:1746147207.317701:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2001:x1830967310237952:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147207.317711:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19520 00000100:00100000:3.0:1746147207.317714:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2001:x1830967310237568:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147207.317765:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2001:x1830967310237440:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 155us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.317771:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19517 00000100:00100000:2.0:1746147207.317773:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310237312:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 176us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.317779:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19516 00000100:00100000:2.0:1746147207.317789:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19521 00000100:00100000:2.0:1746147207.317794:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310237824:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147207.317802:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2001:x1830967310237568:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 86us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.317804:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2001:x1830967310237952:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 104us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.317807:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19520 00000100:00100000:0.0:1746147207.317811:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19519 00000100:00100000:2.0:1746147207.317830:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310237824:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 35us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.317835:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19521 00000100:00100000:0.0:1746147207.321317:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.321346:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.321365:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.321447:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.321526:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.321542:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310238208 00000100:00100000:1.0:1746147207.321551:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310238208 00000100:00100000:3.0:1746147207.321569:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310238080 00000100:00100000:3.0:1746147207.321573:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310238080 00000100:00100000:3.0:1746147207.321605:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310238464 00000100:00100000:3.0:1746147207.321607:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310238464 00000100:00100000:3.0:1746147207.321624:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310238720 00000100:00100000:3.0:1746147207.321626:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310238720 00000100:00100000:1.0:1746147207.321630:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19522 00000100:00100000:1.0:1746147207.321637:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2002:x1830967310238208:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147207.321640:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19523 00000100:00100000:3.0:1746147207.321644:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310238080:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147207.321647:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19524 00000100:00100000:2.0:1746147207.321659:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2002:x1830967310238464:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147207.321712:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310238336 00000100:00100000:0.0:1746147207.321715:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310238336 00000100:00100000:3.0:1746147207.321742:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310238080:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 96us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.321747:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19525 00000100:00100000:3.0:1746147207.321750:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19523 00000100:00100000:0.0:1746147207.321751:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2002:x1830967310238720:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147207.321820:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19526 00000100:00100000:3.0:1746147207.321828:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2002:x1830967310238336:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147207.321873:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2002:x1830967310238464:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 217us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.321879:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19524 00000100:00100000:0.0:1746147207.321879:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2002:x1830967310238720:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 126us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.321887:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19525 00000100:00100000:3.0:1746147207.321898:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2002:x1830967310238336:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 72us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.321898:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2002:x1830967310238208:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 262us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.321911:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19526 00000100:00100000:1.0:1746147207.321966:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19522 00000100:00100000:0.0:1746147207.322000:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.322013:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310238592 00000100:00100000:1.0:1746147207.322016:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310238592 00000100:00100000:1.0:1746147207.322030:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19527 00000100:00100000:1.0:1746147207.322035:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2002:x1830967310238592:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147207.322067:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2002:x1830967310238592:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 31us (68us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.322072:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19527 00000100:00100000:0.0:1746147207.324311:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.324362:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310238848 00000100:00100000:1.0:1746147207.324372:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310238848 00000100:00100000:1.0:1746147207.324418:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19528 00000100:00100000:1.0:1746147207.324424:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2002:x1830967310238848:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:1.0:1746147207.324566:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147207.324570:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147207.324572:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147207.324573:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147207.324646:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746147207.324692:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2002:x1830967310238848:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 267us (387us total) trans 17179875155 rc 0/0 00000100:00100000:1.0:1746147207.324698:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19528 00000100:00100000:0.0:1746147207.326594:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.326647:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310238976 00000100:00100000:1.0:1746147207.326654:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310238976 00000100:00100000:1.0:1746147207.326705:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19529 00000100:00100000:1.0:1746147207.326712:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2003:x1830967310238976:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:1.0:1746147207.327166:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147207.327170:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147207.327172:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147207.327173:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147207.327176:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:1.0:1746147207.327233:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310238976:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 520us (643us total) trans 21474842538 rc 0/0 00000100:00100000:1.0:1746147207.327240:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19529 00000100:00100000:0.0:1746147207.332751:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.332795:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310239232 00000100:00100000:3.0:1746147207.332806:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310239232 00000100:00100000:3.0:1746147207.332892:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7175 00000100:00100000:3.0:1746147207.332900:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2002:x1830967310239232:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147207.332929:0:29476:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a57a1200/0x3139939425061dd5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.332941:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.332942:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.332945:0:29476:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57a1200/0x3139939425061dd5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.332956:0:29476:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57a1200/0x3139939425061dd5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.334547:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.334650:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310239616 00000100:00100000:3.0:1746147207.334656:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310239616 00000100:00100000:3.0:1746147207.334700:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7176 00000100:00100000:3.0:1746147207.334706:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2003:x1830967310239616:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147207.334740:0:9589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e573e00/0x3139939425061ddc lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.334750:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.334751:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.334754:0:9589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e573e00/0x3139939425061ddc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.334766:0:9589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e573e00/0x3139939425061ddc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.336322:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.337042:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.337210:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310239744 00000100:00100000:0.0:1746147207.337218:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310239744 00000100:00100000:0.0:1746147207.337271:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310240000 00000100:00100000:0.0:1746147207.337273:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310240000 00000100:00100000:0.0:1746147207.337299:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7177 00000100:00100000:0.0:1746147207.337305:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+25:2003:x1830967310239744:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147207.337334:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425061de3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.337347:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.337349:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.337353:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425061de3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.337365:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425061de3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.338043:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7178 00000100:00100000:2.0:1746147207.338051:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967310240000:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147207.338069:0:13302:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061dea lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.338076:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.338077:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.338080:0:13302:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061dea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.338116:0:13302:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061dea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.341350:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.341386:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.344048:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310240384 00000100:00100000:3.0:1746147207.344060:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310240384 00000100:00100000:3.0:1746147207.344126:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310240640 00000100:00100000:3.0:1746147207.344129:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310240640 00000100:00100000:3.0:1746147207.344154:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7179 00000100:00100000:3.0:1746147207.344161:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+27:2002:x1830967310240384:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147207.344190:0:29478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0400/0x3139939425061df1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.344202:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.344203:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.344207:0:29478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0400/0x3139939425061df1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.344218:0:29478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0400/0x3139939425061df1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.344864:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7180 00000100:00100000:1.0:1746147207.344874:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2002:x1830967310240640:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147207.344901:0:29474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f0aea00/0x3139939425061df8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.344910:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.344911:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.344914:0:29474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0aea00/0x3139939425061df8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.344924:0:29474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0aea00/0x3139939425061df8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.346877:0:29476:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a57a1200/0x3139939425061dd5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.346891:0:29476:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57a1200/0x3139939425061dd5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.346898:0:29476:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a57a1200/0x3139939425061dd5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.346904:0:29476:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a57a1200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147207.346907:0:29476:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a57a1200/0x3139939425061dd5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.346913:0:29476:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a57a1200/0x3139939425061dd5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.346928:0:29476:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a57a1200/0x3139939425061dd5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.346934:0:29476:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57a1200/0x3139939425061dd5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.347288:0:9589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e573e00/0x3139939425061ddc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.347296:0:9589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e573e00/0x3139939425061ddc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.347302:0:9589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e573e00/0x3139939425061ddc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.347306:0:9589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e573e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147207.347308:0:9589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e573e00/0x3139939425061ddc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.347314:0:9589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e573e00/0x3139939425061ddc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.347323:0:9589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e573e00/0x3139939425061ddc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.347327:0:9589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e573e00/0x3139939425061ddc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.348208:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+27:2003:x1830967310239616:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 13496us (13659us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147207.348218:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7176 00000100:00100000:0.0:1746147207.349374:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2002:x1830967310239232:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 16469us (16623us total) trans 0 rc 1032192/1032192 00000100:00100000:0.0:1746147207.349382:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7175 00010000:00010000:0.0:1746147207.355883:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425061de3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.355899:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425061de3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.355905:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425061de3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.355911:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38d000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147207.355915:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425061de3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.355921:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425061de3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.355936:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425061de3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.355941:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38d000/0x3139939425061de3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.356040:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+25:2003:x1830967310239744:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 18730us (19721us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147207.356050:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7177 00010000:00010000:2.0:1746147207.359980:0:13302:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061dea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.359993:0:13302:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061dea lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.360000:0:13302:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061dea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.360007:0:13302:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db81400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147207.360010:0:13302:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061dea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.360017:0:13302:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061dea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.360034:0:13302:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061dea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.360039:0:13302:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db81400/0x3139939425061dea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.361462:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967310240000:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 23404us (24411us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147207.361477:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7178 00010000:00010000:3.0:1746147207.370208:0:29478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0400/0x3139939425061df1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.370225:0:29478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0400/0x3139939425061df1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.370632:0:29478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0400/0x3139939425061df1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.370641:0:29478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a9a0400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147207.370646:0:29478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0400/0x3139939425061df1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.370653:0:29478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0400/0x3139939425061df1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.370670:0:29478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0400/0x3139939425061df1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.370676:0:29478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0400/0x3139939425061df1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.370782:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2002:x1830967310240384:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 26616us (29434us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147207.370791:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7179 00010000:00010000:1.0:1746147207.377619:0:29474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f0aea00/0x3139939425061df8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.377634:0:29474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0aea00/0x3139939425061df8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.377643:0:29474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f0aea00/0x3139939425061df8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.377649:0:29474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0aea00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147207.377653:0:29474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f0aea00/0x3139939425061df8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.377660:0:29474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f0aea00/0x3139939425061df8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.377676:0:29474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f0aea00/0x3139939425061df8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.377681:0:29474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0aea00/0x3139939425061df8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.377778:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2002:x1830967310240640:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 32901us (36385us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147207.377788:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7180 00000100:00100000:0.0:1746147207.385671:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.385773:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310241024 00000100:00100000:2.0:1746147207.385781:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310241024 00000100:00100000:2.0:1746147207.386370:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16377 00000100:00100000:2.0:1746147207.386377:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2724:x1830967310241024:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:2.0:1746147207.386417:0:6215:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.386437:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ffb200/0x3139939425061da4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e74e expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.386457:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.386461:0:6215:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147207.386493:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061dff lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.386503:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061dff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.386509:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061dff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00010000:2.0:1746147207.386579:0:6215:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094584700 reply state ffff880098333000 transno 8589937264 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061dff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.386586:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061dff lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.386590:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.386592:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746147207.386593:0:6215:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746147207.386661:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2724:x1830967310241024:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 284us (998us total) trans 8589937264 rc 0/0 00000100:00100000:2.0:1746147207.386667:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16377 00000100:00100000:0.0:1746147207.389514:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.389578:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310241152 00000100:00100000:1.0:1746147207.389586:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310241152 00000100:00100000:1.0:1746147207.389641:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19530 00000100:00100000:1.0:1746147207.389648:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2724:x1830967310241152:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147207.389660:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147207.389677:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061e06 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e77f expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.389701:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x3139939425061dab lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e755 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.389707:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.389709:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.389713:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061e06 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e77f expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.389749:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x3139939425061dab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e755 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.389758:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x3139939425061dab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e755 expref: 13 pid: 1854 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.389769:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311414400:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147207.390230:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147207.392173:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311414400:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147207.392199:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061e06 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e77f expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.392217:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0af600, rc 0) 00000100:00100000:1.0:1746147207.392265:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2724:x1830967310241152:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2617us (2757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.392273:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19530 00000100:00100000:0.0:1746147207.392885:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.392924:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310241280 00000100:00100000:1.0:1746147207.392930:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310241280 00010000:00010000:1.0:1746147207.392957:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x3139939425061dab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e755 expref: 13 pid: 1854 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.392978:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8865 00000100:00100000:1.0:1746147207.392985:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094584e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310241280:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.392996:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147207.393012:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x3139939425061dab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e755 expref: 13 pid: 1854 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.393022:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x3139939425061dab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e755 expref: 13 pid: 1854 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.393039:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db81c00/0x3139939425061dab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e755 expref: 13 pid: 1854 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.393063:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.393064:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.393070:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061e06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e77f expref: 12 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.393077:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061e06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e77f expref: 12 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.393341:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061e06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e77f expref: 12 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.393352:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311414528:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147207.393395:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.395625:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.395733:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311414528:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147207.395750:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147207.395800:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094584e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310241280:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2815us (2915us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.395809:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8865 00000100:00100000:2.0:1746147207.396074:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310241408 00000100:00100000:2.0:1746147207.396080:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310241408 00000100:00100000:2.0:1746147207.396140:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19531 00000100:00100000:2.0:1746147207.396159:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2724:x1830967310241408:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147207.396172:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.396185:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425061e0d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e786 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.396207:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425061db9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e75c expref: 24 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.396214:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.396216:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.396219:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425061e0d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e786 expref: 24 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.396242:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425061db9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e75c expref: 24 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.396252:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425061db9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e75c expref: 24 pid: 1854 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746147207.396262:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311414656:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.396316:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.399526:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311414656:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.399552:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425061e0d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e786 expref: 24 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.399567:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33800, rc 0) 00000100:00100000:2.0:1746147207.399609:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2724:x1830967310241408:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3462us (3989us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.399617:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19531 00000100:00100000:0.0:1746147207.401462:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.402674:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310241536 00000100:00100000:1.0:1746147207.402688:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310241536 00010000:00010000:1.0:1746147207.402740:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425061db9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e75c expref: 24 pid: 1854 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.402798:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8866 00000100:00100000:1.0:1746147207.402805:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2001:x1830967310241536:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.402827:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147207.402843:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425061db9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e75c expref: 24 pid: 1854 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.402854:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425061db9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e75c expref: 24 pid: 1854 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.402872:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db80c00/0x3139939425061db9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e75c expref: 24 pid: 1854 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.402899:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.402900:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.402906:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425061e0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e786 expref: 23 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.402912:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425061e0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e786 expref: 23 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.402937:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425061e0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e786 expref: 23 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.402952:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311414784:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147207.403024:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.408006:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.408128:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310241664 00000100:00100000:2.0:1746147207.408136:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310241664 00000100:00100000:1.0:1746147207.408180:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311414784:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147207.408197:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147207.408247:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2001:x1830967310241536:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5442us (6787us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.408254:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19532 00000100:00100000:1.0:1746147207.408254:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8866 00000100:00100000:2.0:1746147207.408261:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e21b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2724:x1830967310241664:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147207.408276:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.408296:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x3139939425061e14 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e78d expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.408324:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x3139939425061db2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e763 expref: 24 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.408331:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.408332:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.408335:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x3139939425061e14 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e78d expref: 24 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.408357:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x3139939425061db2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e763 expref: 24 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.408367:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x3139939425061db2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e763 expref: 24 pid: 10340 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746147207.408378:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311414912:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.408759:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.413041:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311414912:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.413066:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x3139939425061e14 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e78d expref: 24 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.413081:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33c00, rc 0) 00000100:00100000:0.0:1746147207.413576:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.413733:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e21b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2724:x1830967310241664:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5470us (5737us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.413741:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19532 00000100:00100000:1.0:1746147207.415368:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310241792 00000100:00100000:1.0:1746147207.415378:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310241792 00010000:00010000:1.0:1746147207.415411:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x3139939425061db2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e763 expref: 24 pid: 10340 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.415437:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8867 00000100:00100000:1.0:1746147207.415444:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2003:x1830967310241792:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.415459:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147207.415477:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x3139939425061db2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e763 expref: 24 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.415487:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x3139939425061db2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e763 expref: 24 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.415507:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094182c00/0x3139939425061db2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e763 expref: 24 pid: 10340 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.415539:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.415541:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.415547:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x3139939425061e14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e78d expref: 23 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.415554:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x3139939425061e14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e78d expref: 23 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.415581:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x3139939425061e14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e78d expref: 23 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.416218:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311415040:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147207.416300:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147207.420414:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311415040:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147207.420434:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147207.420472:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2003:x1830967310241792:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5027us (6897us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.420482:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8867 00000100:00100000:0.0:1746147207.421415:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.421509:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310241920 00000100:00100000:2.0:1746147207.421514:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310241920 00000100:00100000:2.0:1746147207.421559:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19533 00000100:00100000:2.0:1746147207.421564:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2724:x1830967310241920:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147207.421579:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.421593:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db33a00/0x3139939425061e1b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e794 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.421615:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093730600/0x3139939425061dc7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e76a expref: 13 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.421622:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.421623:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.421626:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db33a00/0x3139939425061e1b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e794 expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.421708:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093730600/0x3139939425061dc7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e76a expref: 13 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.421730:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093730600/0x3139939425061dc7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e76a expref: 13 pid: 13695 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746147207.421740:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311415168:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.423004:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.425016:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311415168:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.425039:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db33a00/0x3139939425061e1b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e794 expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.425052:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33a00, rc 0) 00000100:00100000:2.0:1746147207.425085:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2724:x1830967310241920:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3520us (3672us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.425111:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19533 00000100:00100000:0.0:1746147207.425997:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.426417:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310242048 00000100:00100000:1.0:1746147207.426422:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310242048 00010000:00010000:1.0:1746147207.426447:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093730600/0x3139939425061dc7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e76a expref: 13 pid: 13695 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.426468:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8868 00000100:00100000:1.0:1746147207.426473:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094585c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2002:x1830967310242048:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.426484:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147207.426502:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093730600/0x3139939425061dc7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e76a expref: 13 pid: 13695 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.426511:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093730600/0x3139939425061dc7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e76a expref: 13 pid: 13695 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.426529:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093730600/0x3139939425061dc7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e76a expref: 13 pid: 13695 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.426558:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.426560:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.426566:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db33a00/0x3139939425061e1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e794 expref: 12 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.426572:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db33a00/0x3139939425061e1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e794 expref: 12 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.426605:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011db33a00/0x3139939425061e1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e794 expref: 12 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.426616:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311415296:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147207.426684:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.430294:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.430477:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311415296:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147207.430494:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147207.430528:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094585c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2002:x1830967310242048:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4054us (4532us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.430537:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8868 00000100:00100000:2.0:1746147207.430678:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310242176 00000100:00100000:2.0:1746147207.430684:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310242176 00000100:00100000:2.0:1746147207.430874:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19534 00000100:00100000:2.0:1746147207.430881:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2724:x1830967310242176:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147207.430895:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.430908:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x3139939425061e22 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e79b expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.430935:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db80600/0x3139939425061dc0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e771 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.430942:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.430944:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.430947:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x3139939425061e22 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e79b expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.430970:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db80600/0x3139939425061dc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e771 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.430980:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db80600/0x3139939425061dc0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e771 expref: 13 pid: 1854 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746147207.430991:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311415424:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.431037:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.436120:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.436577:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310242304 00000100:00100000:1.0:1746147207.436585:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310242304 00010000:00010000:1.0:1746147207.436614:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db80600/0x3139939425061dc0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e771 expref: 14 pid: 1854 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.436638:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8869 00000100:00100000:1.0:1746147207.436645:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094586300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310242304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.436657:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147207.436673:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db80600/0x3139939425061dc0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e771 expref: 14 pid: 1854 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.436684:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db80600/0x3139939425061dc0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e771 expref: 14 pid: 1854 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.436704:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.436706:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.436712:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x3139939425061e22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e79b expref: 14 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.436730:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x3139939425061e22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e79b expref: 14 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.436756:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x3139939425061e22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e79b expref: 14 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.436768:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311415552:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147207.436843:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746147207.436921:0:13712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db80600/0x3139939425061dc0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e771 expref: 14 pid: 1854 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746147207.436939:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311415424:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.436956:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x3139939425061e22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e79b expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.436963:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db32800, rc 0) 00000100:00100000:2.0:1746147207.436985:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2724:x1830967310242176:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 6105us (6698us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.436992:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19534 00000100:00100000:0.0:1746147207.439624:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.439813:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310242432 00000100:00100000:2.0:1746147207.439821:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310242432 00000100:00100000:1.0:1746147207.439933:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311415552:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147207.439949:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147207.439984:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094586300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310242304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3339us (3903us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.439992:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8869 00000100:00100000:2.0:1746147207.440043:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19535 00000100:00100000:2.0:1746147207.440049:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2724:x1830967310242432:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147207.440065:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.440084:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x3139939425061e29 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e7a2 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.440136:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061dce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e778 expref: 24 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.440142:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.440144:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.440147:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x3139939425061e29 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a2 expref: 24 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.440169:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061dce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e778 expref: 24 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.440179:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061dce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e778 expref: 24 pid: 1853 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746147207.440189:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311415680:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.440226:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.444422:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.444520:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311415680:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.444543:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x3139939425061e29 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a2 expref: 24 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.444558:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33400, rc 0) 00000100:00100000:2.0:1746147207.444594:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2724:x1830967310242432:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4544us (4975us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.444602:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19535 00000100:00100000:1.0:1746147207.444678:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310242560 00000100:00100000:1.0:1746147207.444683:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310242560 00010000:00010000:1.0:1746147207.444705:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061dce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e778 expref: 24 pid: 1853 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.444733:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8870 00000100:00100000:1.0:1746147207.444739:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094586a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2000:x1830967310242560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.444750:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147207.444765:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061dce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e778 expref: 24 pid: 1853 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.444774:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061dce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e778 expref: 24 pid: 1853 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.444792:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425061dce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e778 expref: 24 pid: 1853 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.444807:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.444809:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.444814:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x3139939425061e29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a2 expref: 23 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.444825:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x3139939425061e29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a2 expref: 23 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.444872:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x3139939425061e29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a2 expref: 23 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.444882:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311415808:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147207.444923:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147207.447898:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7225:1830967311415808:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147207.447917:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147207.447951:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094586a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2000:x1830967310242560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3210us (3534us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.447959:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8870 00000100:00100000:0.0:1746147207.449586:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.449626:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.449690:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310242688 00000100:00100000:3.0:1746147207.449696:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310242688 00000100:00100000:3.0:1746147207.449735:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310242816 00000100:00100000:3.0:1746147207.449737:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310242816 00000100:00100000:3.0:1746147207.449752:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19536 00000100:00100000:3.0:1746147207.449758:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310242688:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:3.0:1746147207.449859:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147207.449863:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147206 -> 1746147207 00002000:00010000:3.0:1746147207.449865:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:3.0:1746147207.449867:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147206 -> 1746147207 00002000:00010000:3.0:1746147207.449868:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:3.0:1746147207.449902:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310242688:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 143us (319us total) trans 21474842539 rc 0/0 00000100:00100000:3.0:1746147207.449908:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19536 00000100:00100000:3.0:1746147207.449920:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19537 00000100:00100000:3.0:1746147207.449925:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2001:x1830967310242816:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:3.0:1746147207.449972:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147207.449974:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147206 -> 1746147207 00002000:00010000:3.0:1746147207.449976:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:3.0:1746147207.449978:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147206 -> 1746147207 00002000:00010000:3.0:1746147207.449980:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147207.449994:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2001:x1830967310242816:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 68us (367us total) trans 17179875156 rc 0/0 00000100:00100000:3.0:1746147207.449998:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19537 00000100:00100000:0.0:1746147207.451758:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.451793:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.451821:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.451846:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.451906:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310242944 00000100:00100000:2.0:1746147207.451913:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310242944 00000100:00100000:2.0:1746147207.451943:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310243072 00000100:00100000:2.0:1746147207.451945:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310243072 00000100:00100000:2.0:1746147207.452022:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310243328 00000100:00100000:2.0:1746147207.452025:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310243328 00000100:00100000:3.0:1746147207.452107:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310243200 00000100:00100000:3.0:1746147207.452111:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310243200 00000100:00100000:3.0:1746147207.452131:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19538 00000100:00100000:3.0:1746147207.452137:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+25:2001:x1830967310242944:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:3.0:1746147207.452236:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147207.452238:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00002000:00010000:3.0:1746147207.452240:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:3.0:1746147207.452241:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00002000:00010000:3.0:1746147207.452244:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746147207.452280:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+26:2001:x1830967310242944:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 142us (526us total) trans 17179875157 rc 0/0 00000100:00100000:3.0:1746147207.452286:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19538 00000100:00100000:3.0:1746147207.452299:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19539 00000100:00100000:3.0:1746147207.452304:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310243072:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:3.0:1746147207.452358:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147207.452360:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147206 -> 1746147207 00002000:00010000:3.0:1746147207.452362:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:3.0:1746147207.452364:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147206 -> 1746147207 00002000:00010000:3.0:1746147207.452366:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147207.452383:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310243072:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 78us (589us total) trans 21474842540 rc 0/0 00000100:00100000:3.0:1746147207.452387:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19539 00000100:00100000:3.0:1746147207.452396:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19540 00000100:00100000:3.0:1746147207.452401:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+25:2001:x1830967310243328:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:3.0:1746147207.452437:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147207.452439:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147206 -> 1746147207 00002000:00010000:3.0:1746147207.452440:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:3.0:1746147207.452442:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147206 -> 1746147207 00002000:00010000:3.0:1746147207.452443:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746147207.452456:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+26:2001:x1830967310243328:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 55us (635us total) trans 17179875158 rc 0/0 00000100:00100000:3.0:1746147207.452460:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19540 00000100:00100000:3.0:1746147207.452469:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19541 00000100:00100000:3.0:1746147207.452474:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310243200:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:3.0:1746147207.452509:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:3.0:1746147207.452512:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147206 -> 1746147207 00002000:00010000:3.0:1746147207.452513:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:3.0:1746147207.452515:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147206 -> 1746147207 00002000:00010000:3.0:1746147207.452517:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:3.0:1746147207.452533:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310243200:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 59us (686us total) trans 21474842541 rc 0/0 00000100:00100000:3.0:1746147207.452537:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19541 00000100:00100000:0.0:1746147207.454985:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.455081:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310243584 00000100:00100000:3.0:1746147207.455115:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310243584 00000100:00100000:3.0:1746147207.455164:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6106 00000100:00100000:3.0:1746147207.455170:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2724:x1830967310243584:12345-192.168.204.25@tcp:35:lfs.0 00000004:00010000:3.0:1746147207.455221:0:7240:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x30:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425061d57 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e740 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.455257:0:7240:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e30 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7240 initiator: MDT0 00010000:00010000:3.0:1746147207.455268:0:7240:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x3139939425061d96 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e747 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.455274:0:7240:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e30 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7240 initiator: MDT0 00010000:00010000:3.0:1746147207.455297:0:7240:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x3139939425061d96 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e747 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.455312:0:7240:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x3139939425061d96 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e747 expref: 10 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.455323:0:7240:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7240:1830967311415936:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.456563:0:7240:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009900eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147207.460798:0:7240:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7240:1830967311415936:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.460819:0:7240:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e30 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7240 initiator: MDT0 00000100:00100000:0.0:1746147207.461056:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.461251:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310243712 00000100:00100000:1.0:1746147207.461256:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310243712 00010000:00010000:1.0:1746147207.461283:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x3139939425061d96 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e747 expref: 11 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.461301:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8871 00000100:00100000:1.0:1746147207.461307:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310243712:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.461319:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147207.461324:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x3139939425061d96 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e747 expref: 11 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.461333:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x3139939425061d96 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e747 expref: 11 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.461351:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094182400/0x3139939425061d96 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e747 expref: 11 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.461379:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147207.461383:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e30 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7240 initiator: MDT0 00010000:00010000:1.0:1746147207.461390:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e30 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7240 initiator: MDT0 00010000:00010000:1.0:1746147207.461395:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e30 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7240 initiator: MDT0 00010000:00010000:1.0:1746147207.461487:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147207.461570:0:7240:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e30 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7240 initiator: MDT0 00010000:00010000:3.0:1746147207.461576:0:7240:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e30 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7240 initiator: MDT0 00000040:00080000:3.0:1746147207.461789:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1199, 88 off113360 00000004:00080000:3.0:1746147207.461794:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745451704660ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.461813:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1205, 88 off113888 00000004:00080000:3.0:1746147207.461816:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745451726694ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.461824:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1206, 88 off113976 00000004:00080000:3.0:1746147207.461827:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745451737345ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.461833:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1200, 88 off113448 00000004:00080000:3.0:1746147207.461835:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745451745534ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.461841:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1201, 88 off113536 00000004:00080000:3.0:1746147207.461842:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745451753097ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.461848:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1207, 88 off114064 00000004:00080000:3.0:1746147207.461850:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745451760407ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.461856:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1208, 88 off114152 00000004:00080000:3.0:1746147207.461858:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745451768352ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.461863:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1209, 88 off114240 00000004:00080000:3.0:1746147207.461865:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745451775583ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.461870:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1202, 88 off113624 00000004:00080000:3.0:1746147207.461872:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745451782677ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.461877:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1210, 88 off114328 00000004:00080000:3.0:1746147207.461879:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745451789663ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.461884:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1203, 88 off113712 00000004:00080000:3.0:1746147207.461886:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745451796772ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.461891:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1211, 88 off114416 00000004:00080000:3.0:1746147207.461893:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745451803863ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.461899:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1204, 88 off113800 00000004:00080000:3.0:1746147207.461901:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745451811407ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.461906:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1205, 88 off113888 00000004:00080000:3.0:1746147207.461908:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745451818765ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.461913:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1206, 88 off113976 00000004:00080000:3.0:1746147207.461915:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745451825925ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.461921:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1207, 88 off114064 00000004:00080000:3.0:1746147207.461923:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745451833154ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.461928:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1212, 88 off114504 00000004:00080000:3.0:1746147207.461930:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745451840273ns, next at 694367916532ns, rc = 0 00000100:00100000:1.0:1746147207.461974:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310243712:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 666us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.461981:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8871 00000001:00080000:2.0:1746147207.465170:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937265 is committed 00000004:00080000:2.0:1746147207.465180:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1190 committed 00010000:00010000:1.0:1746147207.465241:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061dff lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147207.465256:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061dff lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147207.465262:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061dff lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147207.465268:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db32200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147207.465272:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061dff lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147207.465277:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061dff lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147207.465295:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147207.465298:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147207.465302:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061dff lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147207.465307:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061dff lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00000004:00080000:2.0:1746147207.465592:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1188 committed 00000004:00080000:2.0:1746147207.465600:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1187 committed 00000004:00080000:2.0:1746147207.465602:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1186 committed 00000004:00080000:2.0:1746147207.465603:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1185 committed 00000004:00080000:2.0:1746147207.465605:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1189 committed 00000004:00080000:2.0:1746147207.465608:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1184 committed 00000004:00080000:2.0:1746147207.465610:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1188 committed 00000004:00080000:2.0:1746147207.465612:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1183 committed 00000004:00080000:2.0:1746147207.465613:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1187 committed 00000004:00080000:2.0:1746147207.465615:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1186 committed 00000004:00080000:2.0:1746147207.465616:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1185 committed 00000004:00080000:2.0:1746147207.465618:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1182 committed 00000004:00080000:2.0:1746147207.465619:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1181 committed 00000004:00080000:2.0:1746147207.465620:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1184 committed 00000004:00080000:2.0:1746147207.465622:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1183 committed 00000004:00080000:2.0:1746147207.465624:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1180 committed 00000100:00100000:0.0:1746147207.465768:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311416064:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147207.465801:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311416192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.465842:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147207.465893:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311416576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.465908:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.466001:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311416320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.466025:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.466763:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311416832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.466764:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311416064 00000100:00100000:0.0:1746147207.466772:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311416064 00000100:00100000:1.0:1746147207.466781:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.466799:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746147207.466804:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311416448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.466814:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311416576 00000100:00100000:0.0:1746147207.466816:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311416576 00000100:00100000:1.0:1746147207.466817:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.466943:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311417472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.467284:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311416320 00000100:00100000:1.0:1746147207.467285:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311416960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.467287:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311416320 00000100:00100000:1.0:1746147207.467303:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147207.467303:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311416832 00000100:00100000:0.0:1746147207.467305:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311416832 00000100:00100000:0.0:1746147207.467315:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311416448 00000100:00100000:0.0:1746147207.467317:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311416448 00000100:00100000:1.0:1746147207.467318:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311417344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.467326:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311416960 00000100:00100000:0.0:1746147207.467328:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311416960 00000100:00100000:1.0:1746147207.467332:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147207.467341:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311417344 00000100:00100000:0.0:1746147207.467342:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311417344 00000100:00100000:1.0:1746147207.467346:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311417856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.467355:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19542 00000100:00100000:1.0:1746147207.467358:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147207.467362:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+66:3764:x1830967311416064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.467385:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311417856 00000100:00100000:1.0:1746147207.467391:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311417856 00000100:00100000:1.0:1746147207.467415:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19543 00000100:00100000:1.0:1746147207.467422:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+66:3764:x1830967311416576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147207.467501:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147207.467504:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00002000:00010000:0.0:1746147207.467506:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:0.0:1746147207.467508:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00002000:00010000:0.0:1746147207.467510:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147207.467549:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+68:3764:x1830967311416064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 186us (1707us total) trans 17179875159 rc 0/0 00000100:00100000:1.0:1746147207.467552:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3764:x1830967311416576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 130us (1642us total) trans 17179875160 rc 0/0 00000100:00100000:0.0:1746147207.467555:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19542 00000100:00100000:1.0:1746147207.467559:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19543 00000100:00100000:0.0:1746147207.467570:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19544 00000100:00100000:1.0:1746147207.467575:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19545 00000100:00100000:0.0:1746147207.467576:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+66:3766:x1830967311416320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.467580:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+66:3766:x1830967311416832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147207.467617:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147207.467620:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00002000:00010000:0.0:1746147207.467621:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:0.0:1746147207.467623:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00002000:00010000:0.0:1746147207.467625:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746147207.467642:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3766:x1830967311416832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (860us total) trans 17179875162 rc 0/0 00000100:00100000:1.0:1746147207.467647:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19545 00000100:00100000:0.0:1746147207.467647:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+68:3766:x1830967311416320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (1622us total) trans 17179875161 rc 0/0 00000100:00100000:0.0:1746147207.467652:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19544 00000100:00100000:1.0:1746147207.467658:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19546 00000100:00100000:1.0:1746147207.467663:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+66:3766:x1830967311416448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.467665:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19547 00000100:00100000:0.0:1746147207.467669:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+66:3766:x1830967311416960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147207.467701:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147207.467703:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147207.467705:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147207.467707:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147207.467708:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746147207.467736:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+68:3766:x1830967311416960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (432us total) trans 17179875164 rc 0/0 00000100:00100000:1.0:1746147207.467740:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3766:x1830967311416448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (921us total) trans 17179875163 rc 0/0 00000100:00100000:0.0:1746147207.467742:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19547 00000100:00100000:1.0:1746147207.467745:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19546 00000100:00100000:0.0:1746147207.467754:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19548 00000100:00100000:0.0:1746147207.467759:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3766:x1830967311417344:12345-0@lo:2:osp-syn-0-0.0 00000004:00010000:2.0:1746147207.467786:0:7240:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800b1b9ac50 reply state ffff880094235800 transno 8589937265 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e30 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7240 initiator: MDT0 00010000:00010000:2.0:1746147207.467801:0:7240:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7240 initiator: MDT0 00010000:00010000:2.0:1746147207.467813:0:7240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00002000:00010000:0.0:1746147207.467814:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00010000:00010000:2.0:1746147207.467815:0:7240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00002000:00010000:0.0:1746147207.467817:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00000100:00100000:2.0:1746147207.467818:0:7240:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00002000:00010000:0.0:1746147207.467819:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:0.0:1746147207.467821:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00010000:00010000:2.0:1746147207.467822:0:7240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00002000:00010000:0.0:1746147207.467823:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00010000:00010000:2.0:1746147207.467824:0:7240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147207.467829:0:7240:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81a00/0x3139939425061d57 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e740 expref: 7 pid: 9138 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.467841:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3766:x1830967311417344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (507us total) trans 21474842542 rc 0/0 00010000:00080000:2.0:1746147207.467896:0:7240:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746147207.467904:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2724:x1830967310243584:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 12734us (12925us total) trans 8589937265 rc 0/0 00000100:00100000:2.0:1746147207.467911:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6106 00000100:00100000:1.0:1746147207.468920:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19549 00000100:00100000:0.0:1746147207.468956:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19548 00000100:00100000:1.0:1746147207.468982:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3766:x1830967311417856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147207.469049:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147207.469052:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147207.469054:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147207.469055:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147207.469057:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:1.0:1746147207.469084:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:3766:x1830967311417856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (1725us total) trans 21474842543 rc 0/0 00000100:00100000:3.0:1746147207.469216:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147207.469241:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311417984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147207.469262:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147207.469291:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311417472 00000100:00100000:3.0:1746147207.469295:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311417472 00000100:00100000:3.0:1746147207.469314:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311417984 00000100:00100000:3.0:1746147207.469316:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311417984 00000100:00100000:3.0:1746147207.469326:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19550 00000100:00100000:3.0:1746147207.469330:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+26:3767:x1830967311417472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147207.469375:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746147207.469378:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147207.469379:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147207.469381:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147207.469382:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:3.0:1746147207.469405:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3767:x1830967311417472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (190us total) trans 21474842544 rc 0/0 00000100:00100000:3.0:1746147207.469410:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19550 00000100:00100000:3.0:1746147207.469420:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19551 00000100:00100000:3.0:1746147207.469424:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+26:3767:x1830967311417984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147207.469463:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:3.0:1746147207.469465:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147207.469467:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147207.469468:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147207.469470:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:3.0:1746147207.469487:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3767:x1830967311417984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (224us total) trans 21474842545 rc 0/0 00000100:00100000:3.0:1746147207.469491:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19551 00000004:00080000:3.0:1746147207.469519:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909fa300/2, rc 0, transno 21474842544 00000100:00100000:3.0:1746147207.469526:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311417472:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147207.469532:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095060000/2, rc 0, transno 21474842545 00000100:00100000:3.0:1746147207.469535:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311417984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.469653:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311417088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.469685:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147207.469700:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311417600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.469724:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147207.469735:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311418112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.469748:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147207.469773:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800769d8700/2, rc 0, transno 17179875160 00000100:00100000:0.0:1746147207.469777:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311416576:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147207.469785:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cc700/2, rc 0, transno 17179875159 00000100:00100000:0.0:1746147207.469787:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311416064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.469795:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746147207.469799:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311417216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.469811:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147207.469822:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311417728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.469834:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147207.469849:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311417088 00000100:00100000:0.0:1746147207.469852:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311417088 00000100:00100000:0.0:1746147207.469864:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311417600 00000100:00100000:0.0:1746147207.469866:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311417600 00000100:00100000:0.0:1746147207.469872:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311418112 00000100:00100000:0.0:1746147207.469874:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311418112 00000100:00100000:0.0:1746147207.469880:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311417216 00000100:00100000:0.0:1746147207.469881:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311417216 00000100:00100000:0.0:1746147207.469887:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311417728 00000100:00100000:0.0:1746147207.469889:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311417728 00000100:00100000:0.0:1746147207.469896:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19552 00000100:00100000:0.0:1746147207.469900:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3764:x1830967311417088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147207.469943:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147207.469945:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00002000:00010000:0.0:1746147207.469947:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:0.0:1746147207.469948:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00002000:00010000:0.0:1746147207.469950:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:0.0:1746147207.469971:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3764:x1830967311417088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (285us total) trans 21474842546 rc 0/0 00000100:00100000:0.0:1746147207.469975:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19552 00000100:00100000:0.0:1746147207.469983:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19553 00000100:00100000:0.0:1746147207.469988:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3764:x1830967311417600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.470033:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3764:x1830967311417600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (318us total) trans 21474842547 rc 0/0 00000100:00100000:0.0:1746147207.470038:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19553 00000100:00100000:0.0:1746147207.470045:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19554 00000100:00100000:0.0:1746147207.470049:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3764:x1830967311418112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.470108:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3764:x1830967311418112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (358us total) trans 21474842548 rc 0/0 00000100:00100000:0.0:1746147207.470112:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19554 00000100:00100000:0.0:1746147207.470120:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19555 00000100:00100000:0.0:1746147207.470123:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3764:x1830967311417216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147207.470158:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147207.470160:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00002000:00010000:0.0:1746147207.470161:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:0.0:1746147207.470163:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00002000:00010000:0.0:1746147207.470165:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147207.470181:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3764:x1830967311417216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (369us total) trans 21474842549 rc 0/0 00000100:00100000:0.0:1746147207.470186:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19555 00000100:00100000:0.0:1746147207.470194:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19556 00000100:00100000:0.0:1746147207.470198:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3764:x1830967311417728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.470240:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3764:x1830967311417728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (404us total) trans 21474842550 rc 0/0 00000100:00100000:0.0:1746147207.470244:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19556 00000004:00080000:0.0:1746147207.470261:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909fb100/2, rc 0, transno 21474842549 00000100:00100000:0.0:1746147207.470264:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311417216:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147207.470270:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909fb480/2, rc 0, transno 21474842550 00000100:00100000:0.0:1746147207.470272:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311417728:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147207.470277:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909fbb80/2, rc 0, transno 21474842546 00000100:00100000:0.0:1746147207.470279:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311417088:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147207.470284:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909f8380/2, rc 0, transno 21474842547 00000100:00100000:0.0:1746147207.470287:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311417600:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147207.470291:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800769d9f80/2, rc 0, transno 21474842548 00000100:00100000:0.0:1746147207.470293:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311418112:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147207.470443:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.470462:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311416704:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.470480:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.470497:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311416192 00000100:00100000:2.0:1746147207.470500:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311416192 00000100:00100000:2.0:1746147207.470514:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311416704 00000100:00100000:2.0:1746147207.470516:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311416704 00000100:00100000:2.0:1746147207.470527:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19557 00000100:00100000:2.0:1746147207.470531:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+68:3765:x1830967311416192:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147207.470584:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147207.470586:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00002000:00010000:2.0:1746147207.470588:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:2.0:1746147207.470589:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00002000:00010000:2.0:1746147207.470591:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746147207.470612:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+69:3765:x1830967311416192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (169us total) trans 17179875165 rc 0/0 00000100:00100000:2.0:1746147207.470617:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19557 00000100:00100000:2.0:1746147207.470626:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19558 00000100:00100000:2.0:1746147207.470629:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+68:3765:x1830967311416704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147207.470667:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:2.0:1746147207.470669:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:2.0:1746147207.470670:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147207.470672:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:2.0:1746147207.470673:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:2.0:1746147207.470688:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+69:3765:x1830967311416704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (207us total) trans 17179875166 rc 0/0 00000100:00100000:2.0:1746147207.470692:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19558 00000004:00080000:2.0:1746147207.470710:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3ce680/2, rc 0, transno 17179875165 00000100:00100000:2.0:1746147207.470713:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311416192:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147207.470733:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800769d8380/2, rc 0, transno 17179875166 00000100:00100000:2.0:1746147207.470735:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311416704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.470842:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19549 00010000:00010000:1.0:1746147207.470864:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7240 initiator: MDT0 00010000:00010000:1.0:1746147207.470872:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7240 initiator: MDT0 00010000:00010000:1.0:1746147207.470878:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7240 initiator: MDT0 00010000:00010000:1.0:1746147207.470883:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fc800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147207.470887:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7240 initiator: MDT0 00010000:00010000:1.0:1746147207.470893:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7240 initiator: MDT0 00010000:00010000:1.0:1746147207.470906:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147207.470908:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147207.470911:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e30 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7240 initiator: MDT0 00010000:00010000:1.0:1746147207.470916:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e30 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7240 initiator: MDT0 00000004:00080000:1.0:1746147207.470953:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909f8a80/2, rc 0, transno 21474842542 00000100:00100000:1.0:1746147207.470957:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311417344:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147207.470963:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095062d80/2, rc 0, transno 21474842543 00000100:00100000:1.0:1746147207.470965:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311417856:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147207.470973:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cf800/2, rc 0, transno 17179875163 00000100:00100000:1.0:1746147207.470975:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311416448:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147207.470983:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800769d9500/2, rc 0, transno 17179875164 00000100:00100000:1.0:1746147207.470985:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311416960:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147207.470991:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cd180/2, rc 0, transno 17179875161 00000100:00100000:1.0:1746147207.470993:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311416320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147207.470999:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800769d9180/2, rc 0, transno 17179875162 00000100:00100000:1.0:1746147207.471001:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311416832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.471929:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.472121:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310243840 00000100:00100000:3.0:1746147207.472125:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310243840 00000100:00100000:3.0:1746147207.472532:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16378 00000100:00100000:3.0:1746147207.472539:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+6:2724:x1830967310243840:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147207.472555:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.472569:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425061e37 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e7a9 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.472611:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425061e37 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a9 expref: 7 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.472620:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425061e37 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a9 expref: 7 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.472634:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147207.472636:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147207.472638:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fe400, rc 0) 00000100:00100000:3.0:1746147207.473916:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2724:x1830967310243840:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1370us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.473923:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16378 00000100:00100000:0.0:1746147207.479612:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.479756:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310244096 00000100:00100000:2.0:1746147207.479767:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310244096 00000100:00100000:2.0:1746147207.479914:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6107 00000100:00100000:2.0:1746147207.479922:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2724:x1830967310244096:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:2.0:1746147207.480623:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2724:x1830967310244096:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 699us (1019us total) trans 8589937266 rc 0/0 00000100:00100000:2.0:1746147207.480629:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6107 00000100:00100000:0.0:1746147207.504318:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.504373:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.504750:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310244352 00000100:00100000:3.0:1746147207.504761:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310244352 00000100:00100000:3.0:1746147207.505230:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310244608 00000100:00100000:3.0:1746147207.505234:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310244608 00000100:00100000:3.0:1746147207.505273:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16379 00000100:00100000:3.0:1746147207.505282:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2730:x1830967310244352:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147207.505308:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.505337:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0e00/0x3139939425061e3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e7b0 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.505392:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16380 00000100:00100000:2.0:1746147207.505400:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2736:x1830967310244608:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.505412:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.505422:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c200/0x3139939425061e45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e7b7 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.505436:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.505448:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.505450:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425061e53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.505459:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.506345:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425061e53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.506356:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425061e53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.506372:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d000/0x3139939425061e5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.506377:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x3139939425061e61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.506377:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d000/0x3139939425061e5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.506382:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d000/0x3139939425061e5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.506383:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x3139939425061e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.506389:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x3139939425061e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.506490:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425061e68 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.506492:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425061e6f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.506498:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425061e68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.506503:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425061e68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.506504:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425061e6f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.506510:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425061e6f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147207.506512:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:2.0:1746147207.506515:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147207.506579:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425061e53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.506580:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e4c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.506585:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425061e53 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.506590:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425061e53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.506591:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e4c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.506596:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.506601:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.506603:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38d800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147207.506604:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fc800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147207.506607:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.506607:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425061e53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.506614:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e4c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.506614:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425061e53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.506624:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147207.506626:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147207.506629:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147207.506630:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425061e53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.506631:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147207.506633:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e4c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.506634:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425061e53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.506637:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061e4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.506855:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x3139939425061e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.506860:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x3139939425061e61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.506865:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x3139939425061e61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.506865:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d000/0x3139939425061e5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.506871:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d000/0x3139939425061e5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.506879:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fce00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147207.506879:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d000/0x3139939425061e5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.506881:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x3139939425061e61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.506883:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38d000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147207.506885:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d000/0x3139939425061e5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.506889:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d000/0x3139939425061e5a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.506890:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x3139939425061e61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.506896:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a570db00) 00010000:00010000:2.0:1746147207.506898:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147207.506899:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a570db00) 00010000:00010000:2.0:1746147207.506900:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d000/0x3139939425061e5a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.506901:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147207.506903:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x3139939425061e61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.506904:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d000/0x3139939425061e5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.506907:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x3139939425061e61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.506939:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57a0e00/0x3139939425061e3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7b0 expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.506939:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c200/0x3139939425061e45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7b7 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.506950:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425061e6f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7b7 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.506951:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425061e68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7b0 expref: 28 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.506956:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.506957:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147207.506959:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.506960:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c42c00, rc 0) 00010000:00010000:3.0:1746147207.506961:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147207.506962:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ffc600, rc 0) 00000100:00100000:2.0:1746147207.507019:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2736:x1830967310244608:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1620us (2644us total) trans 8589937267 rc 0/0 00000100:00100000:2.0:1746147207.507025:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16380 00000100:00100000:3.0:1746147207.507613:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2730:x1830967310244352:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2331us (3304us total) trans 8589937268 rc 0/0 00000100:00100000:3.0:1746147207.507619:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16379 00000100:00100000:0.0:1746147207.513645:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.514135:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310244736 00000100:00100000:2.0:1746147207.514144:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310244736 00000100:00100000:2.0:1746147207.514196:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19559 00000100:00100000:2.0:1746147207.514205:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2736:x1830967310244736:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.514225:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.514246:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425061e84 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e7be expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.514275:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061e06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e77f expref: 14 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.514283:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147207.514284:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147207.514288:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425061e84 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7be expref: 12 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.514317:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061e06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e77f expref: 14 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.514328:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061e06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e77f expref: 14 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.514340:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095063480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311418240:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.514444:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1500c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.515024:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.515112:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310244992 00000100:00100000:3.0:1746147207.515117:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310244992 00000100:00100000:3.0:1746147207.515162:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16381 00000100:00100000:3.0:1746147207.515168:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2735:x1830967310244992:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147207.515192:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.515210:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x3139939425061e8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e7c5 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.515304:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31600/0x3139939425061e92 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.515316:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31600/0x3139939425061e92 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.515326:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31600/0x3139939425061e92 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147207.515337:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147207.515442:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x3139939425061e8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7c5 expref: 31 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.515483:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31600/0x3139939425061e92 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7c5 expref: 30 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.515492:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147207.515494:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746147207.515497:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091e31600, rc 0) 00000100:00100000:3.0:1746147207.515547:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2735:x1830967310244992:12345-192.168.204.25@tcp:101:cat.0 Request processed in 378us (529us total) trans 8589937269 rc 0/0 00000100:00100000:3.0:1746147207.515554:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16381 00000100:00100000:1.0:1746147207.518815:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.518928:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095063480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311418240:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.518956:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425061e84 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7be expref: 12 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.518974:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57a0e00, rc 0) 00000100:00100000:1.0:1746147207.519171:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.519652:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310245248 00000100:00100000:2.0:1746147207.519660:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310245248 00000100:00100000:2.0:1746147207.519876:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16382 00000100:00100000:2.0:1746147207.519883:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2730:x1830967310245248:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147207.519904:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.519907:0:6215:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147207.519934:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425061e68 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7b0 expref: 30 pid: 9138 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.520374:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2736:x1830967310244736:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6167us (6738us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.520383:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19559 00000100:00100000:1.0:1746147207.520419:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310245376 00000100:00100000:1.0:1746147207.520423:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310245376 00010000:00010000:1.0:1746147207.520444:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061e06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e77f expref: 15 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.520471:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8872 00000100:00100000:1.0:1746147207.520476:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310245376:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.520489:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147207.520509:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061e06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e77f expref: 15 pid: 13712 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.520520:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061e06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e77f expref: 15 pid: 13712 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.520536:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061e06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e77f expref: 15 pid: 13712 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.520550:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.520553:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.520561:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425061e84 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7be expref: 11 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.520570:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425061e84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7be expref: 11 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.520603:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425061e84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7be expref: 11 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.520615:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968a0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311418368:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147207.520680:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147207.520800:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.520826:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147207.521044:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.521050:0:6215:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147207.521064:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061ea0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e7cc expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.521075:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310245760 00000100:00100000:3.0:1746147207.521079:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310245760 00000100:00100000:3.0:1746147207.521121:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310245504 00000100:00100000:3.0:1746147207.521123:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310245504 00010000:00010000:2.0:1746147207.521126:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.521139:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425061e6f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7b7 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.521144:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16383 00010000:00010000:2.0:1746147207.521146:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425061e37 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a9 expref: 7 pid: 9138 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.521150:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2732:x1830967310245760:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147207.521152:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31600/0x3139939425061e92 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7c5 expref: 31 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.521157:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.521176:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31600/0x3139939425061e92 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7c5 expref: 31 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.521186:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31600/0x3139939425061e92 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7c5 expref: 31 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.521199:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095063480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311418496:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.521209:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.521219:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x3139939425061eae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e7da expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.521246:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425061e37 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a9 expref: 7 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.521254:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425061e37 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a9 expref: 7 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.521262:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311418624:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.521297:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425061e6f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7b7 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.521302:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425061eb5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147207.521304:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425061e6f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7b7 expref: 10 pid: 6215 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.521311:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425061eb5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00000100:00100000:2.0:1746147207.521312:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e484380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311418752:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.521318:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425061eb5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:2.0:1746147207.521329:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1500c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147207.521336:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16384 00000100:00100000:3.0:1746147207.521342:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2735:x1830967310245504:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147207.521351:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.521358:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3400/0x3139939425061ebc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e7d3 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.521399:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.521409:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.521414:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425061eb5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147207.521419:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.521429:0:9138:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425061eb5 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147207.521435:0:9138:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.521441:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:1.0:1746147207.523931:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968a0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311418368:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147207.523961:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147207.525158:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.525188:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310245888 00000100:00100000:0.0:1746147207.525196:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310245888 00010000:00010000:0.0:1746147207.525230:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425061e37 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a9 expref: 8 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746147207.525335:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8873 00000100:00100000:0.0:1746147207.525342:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967310245888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147207.525362:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147207.525363:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310245376:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4885us (6191us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147207.525368:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425061e37 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a9 expref: 8 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.525370:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8872 00010000:00010000:0.0:1746147207.525386:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425061e37 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a9 expref: 8 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.525409:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147207.525414:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425061eb5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147207.525422:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147207.525427:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425061eb5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147207.525430:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147207.525435:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.525440:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147207.525458:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967310245888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 117us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.525464:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8873 00000100:00100000:1.0:1746147207.525476:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147207.525582:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe400/0x3139939425061e37 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a9 expref: 7 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.525597:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311418624:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.525608:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e484380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311418752:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147207.525758:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310246016 00000100:00100000:0.0:1746147207.525761:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310246016 00010000:00010000:0.0:1746147207.525773:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425061e6f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7b7 expref: 11 pid: 6215 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746147207.525799:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8874 00000100:00100000:0.0:1746147207.525804:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aa328450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2000:x1830967310246016:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147207.525812:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147207.525815:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425061e6f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7b7 expref: 11 pid: 6215 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.525823:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425061e6f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7b7 expref: 11 pid: 6215 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.525835:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42c00/0x3139939425061e6f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7b7 expref: 11 pid: 6215 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.526342:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147207.526354:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425061eb5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147207.526368:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425061eb5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147207.526374:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425061eb5 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147207.526383:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.526388:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147207.526393:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147207.526398:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.526448:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147207.526501:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aa328450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310246016:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 692us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.526511:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8874 00010000:00010000:3.0:1746147207.526630:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425061eb5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147207.526638:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425061eb5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00000004:00200000:3.0:1746147207.526662:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147207.526788:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x3139939425061eae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7da expref: 11 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.526808:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425061eb5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7da expref: 10 pid: 7237 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.526815:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425061eb5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7da expref: 10 pid: 7237 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.526822:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9ff600, rc 0) 00000100:00100000:3.0:1746147207.526847:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2732:x1830967310245760:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5697us (6048us total) trans 8589937270 rc 0/0 00000100:00100000:3.0:1746147207.526854:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16383 00000100:00100000:1.0:1746147207.527755:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.527812:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095063480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311418496:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.527882:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147207.529161:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310246144 00000100:00100000:0.0:1746147207.529170:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310246144 00010000:00010000:0.0:1746147207.529204:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31600/0x3139939425061e92 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7c5 expref: 33 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746147207.529368:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8875 00000100:00100000:0.0:1746147207.529377:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967310246144:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147207.529390:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147207.529395:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31600/0x3139939425061e92 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7c5 expref: 33 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.529406:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31600/0x3139939425061e92 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7c5 expref: 33 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.529424:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31600/0x3139939425061e92 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7c5 expref: 33 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.529436:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147207.529440:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.529447:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147207.529457:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147207.529462:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147207.529468:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.529472:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.529503:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147207.529575:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.529583:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00000040:00080000:3.0:1746147207.529821:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1208, 88 off114152 00000004:00080000:3.0:1746147207.529827:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745519736854ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.529880:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1213, 88 off114592 00000004:00080000:3.0:1746147207.529884:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745519794233ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.530004:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1215, 88 off114776 00000004:00080000:3.0:1746147207.530009:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745519919359ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.530027:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1209, 88 off114240 00000004:00080000:3.0:1746147207.530030:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745519940389ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.530043:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1210, 88 off114328 00000004:00080000:3.0:1746147207.530046:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745519956434ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.530059:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1216, 88 off114864 00000004:00080000:3.0:1746147207.530062:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745519972372ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.530074:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1217, 88 off114952 00000004:00080000:3.0:1746147207.530076:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745519987117ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.530111:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1218, 88 off115040 00000004:00080000:3.0:1746147207.530115:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745520025115ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.530132:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1211, 88 off114416 00000004:00080000:3.0:1746147207.530135:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745520045314ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.530148:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1219, 88 off115128 00000004:00080000:3.0:1746147207.530150:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745520060982ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.530162:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1212, 88 off114504 00000004:00080000:3.0:1746147207.530166:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745520076445ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.530178:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1220, 88 off115216 00000004:00080000:3.0:1746147207.530181:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745520091362ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147207.530193:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1213, 88 off114592 00000004:00080000:3.0:1746147207.530196:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745520106433ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.530244:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1215, 88 off114776 00000004:00080000:3.0:1746147207.530248:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745520158739ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.530265:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1216, 88 off114864 00000004:00080000:3.0:1746147207.530267:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745520177754ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.530279:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1217, 88 off114952 00000004:00080000:3.0:1746147207.530282:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745520192447ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147207.530294:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1221, 88 off115304 00000004:00080000:3.0:1746147207.530297:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745520207695ns, next at 694367916532ns, rc = 0 00000100:00100000:0.0:1746147207.530666:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967310246144:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1288us (2911us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.530674:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8875 00000100:00100000:2.0:1746147207.530791:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.530908:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310246400 00000100:00100000:0.0:1746147207.530913:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310246400 00002000:00100000:0.0:1746147207.530938:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88011e484380 x1830967310246400/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147207.530946:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e484380 with x1830967310246400 ext(0->1048575) 00002000:00010000:0.0:1746147207.530950:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e484380 00000100:00100000:0.0:1746147207.530965:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7181 00000100:00100000:0.0:1746147207.530970:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2003:x1830967310246400:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147207.541673:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.541854:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310246528 00000100:00100000:0.0:1746147207.541913:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310246528 00010000:00010000:0.0:1746147207.541945:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425061eb5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7da expref: 10 pid: 7237 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.543074:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8876 00000100:00100000:1.0:1746147207.543084:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2002:x1830967310246528:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.543121:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147207.543127:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425061eb5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7da expref: 10 pid: 7237 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.543144:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425061eb5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7da expref: 10 pid: 7237 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.543163:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x3139939425061eb5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7da expref: 10 pid: 7237 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.543193:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147207.543199:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147207.543205:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147207.543214:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147207.543219:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147207.543261:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2002:x1830967310246528:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 178us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.543267:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8876 00000100:00100000:0.0:1746147207.543996:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2003:x1830967310246400:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13023us (13203us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147207.544003:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7181 00002000:00100000:0.0:1746147207.544011:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88011e484380 x1830967310246400/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147207.544019:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e484380 with x1830967310246400 ext(0->1048575) 00002000:00010000:0.0:1746147207.544023:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e484380 00000001:00080000:3.0:1746147207.546625:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937271 is committed 00000004:00080000:3.0:1746147207.546635:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1198 committed 00000004:00080000:3.0:1746147207.546654:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1197 committed 00000004:00080000:3.0:1746147207.546696:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1196 committed 00000004:00080000:3.0:1746147207.546699:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1195 committed 00000004:00080000:3.0:1746147207.546700:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1194 committed 00000004:00080000:3.0:1746147207.546703:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1197 committed 00000004:00080000:3.0:1746147207.546705:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1193 committed 00000004:00080000:3.0:1746147207.546706:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1196 committed 00000004:00080000:3.0:1746147207.546708:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1192 committed 00000004:00080000:3.0:1746147207.546710:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1195 committed 00000004:00080000:3.0:1746147207.546711:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1194 committed 00000004:00080000:3.0:1746147207.546725:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1193 committed 00000004:00080000:3.0:1746147207.546727:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1191 committed 00000004:00080000:3.0:1746147207.546728:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1190 committed 00000004:00080000:3.0:1746147207.546730:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1192 committed 00000004:00080000:3.0:1746147207.546731:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1191 committed 00000004:00080000:3.0:1746147207.546732:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1189 committed 00000001:00080000:3.0:1746147207.546737:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937270 is committed 00000001:00080000:3.0:1746147207.546748:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937266 is committed 00010000:00010000:3.0:1746147207.546799:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7cc expref: 30 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.546811:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147207.546814:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746147207.546817:0:6215:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.546825:0:6215:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.546831:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.546863:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x3139939425061ea0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7cc expref: 30 pid: 6215 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1746147207.547015:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147207.547031:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311418880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.547081:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746147207.547757:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7cc expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.547781:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db32200, rc 0) 00000100:00100000:2.0:1746147207.548440:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311419392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147207.548467:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.548486:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311419904:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147207.548501:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.548515:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746147207.548519:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311419264:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147207.548533:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.548544:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311419776:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147207.548557:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.548579:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311418880 00000100:00100000:2.0:1746147207.548585:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311418880 00000100:00100000:2.0:1746147207.548614:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311419392 00000100:00100000:2.0:1746147207.548616:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311419392 00000100:00100000:2.0:1746147207.548634:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311419904 00000100:00100000:2.0:1746147207.548637:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311419904 00000100:00100000:2.0:1746147207.548648:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311419264 00000100:00100000:2.0:1746147207.548650:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311419264 00000100:00100000:2.0:1746147207.548658:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311419776 00000100:00100000:2.0:1746147207.548660:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311419776 00000100:00100000:2.0:1746147207.548672:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19560 00000100:00100000:2.0:1746147207.548678:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3764:x1830967311418880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147207.548793:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746147207.548796:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00002000:00010000:2.0:1746147207.548798:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:2.0:1746147207.548800:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00002000:00010000:2.0:1746147207.548803:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:2.0:1746147207.548824:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3764:x1830967311418880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 146us (1744us total) trans 21474842551 rc 0/0 00000100:00100000:2.0:1746147207.548830:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19560 00000100:00100000:2.0:1746147207.548843:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19561 00000100:00100000:2.0:1746147207.548847:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3765:x1830967311419392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147207.548886:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746147207.548888:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147207.548890:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147207.548891:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147207.548893:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:2.0:1746147207.548915:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3765:x1830967311419392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (447us total) trans 21474842552 rc 0/0 00000100:00100000:2.0:1746147207.548919:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19561 00000100:00100000:2.0:1746147207.548929:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19562 00000100:00100000:2.0:1746147207.548933:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3765:x1830967311419904:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147207.548971:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:2.0:1746147207.548973:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147207.548975:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147207.548977:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147207.548978:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:2.0:1746147207.548996:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3765:x1830967311419904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (494us total) trans 21474842553 rc 0/0 00000100:00100000:2.0:1746147207.549002:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19562 00000100:00100000:2.0:1746147207.549012:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19563 00000100:00100000:2.0:1746147207.549016:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3765:x1830967311419264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147207.549054:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:2.0:1746147207.549056:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00002000:00010000:2.0:1746147207.549057:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:2.0:1746147207.549059:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00002000:00010000:2.0:1746147207.549060:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:2.0:1746147207.549077:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3765:x1830967311419264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (543us total) trans 21474842554 rc 0/0 00000100:00100000:2.0:1746147207.549082:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19563 00000100:00100000:2.0:1746147207.549115:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19564 00000100:00100000:2.0:1746147207.549120:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3765:x1830967311419776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147207.549155:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147207.549157:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147207.549159:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147207.549160:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147207.549162:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:2.0:1746147207.549179:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3765:x1830967311419776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (621us total) trans 21474842555 rc 0/0 00000100:00100000:2.0:1746147207.549184:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19564 00000004:00080000:2.0:1746147207.549230:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258f100/2, rc 0, transno 21474842554 00000100:00100000:2.0:1746147207.549238:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311419264:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147207.549245:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009514a300/2, rc 0, transno 21474842555 00000100:00100000:2.0:1746147207.549248:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311419776:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147207.549254:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258ea00/2, rc 0, transno 21474842552 00000100:00100000:2.0:1746147207.549256:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311419392:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147207.549264:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095149f80/2, rc 0, transno 21474842553 00000100:00100000:2.0:1746147207.549267:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311419904:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147207.550459:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311419008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147207.550492:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.550573:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311419520:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147207.550591:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.550602:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311420032:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147207.550623:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.550638:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746147207.550644:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311419136:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.550664:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.550684:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311419648:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147207.550700:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.550732:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311419008 00000100:00100000:1.0:1746147207.550736:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311419008 00000100:00100000:1.0:1746147207.550758:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311419520 00000100:00100000:1.0:1746147207.550760:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311419520 00000100:00100000:1.0:1746147207.550770:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311420032 00000100:00100000:1.0:1746147207.550772:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311420032 00000100:00100000:1.0:1746147207.550782:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311419136 00000100:00100000:1.0:1746147207.550784:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311419136 00000100:00100000:1.0:1746147207.550793:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311419648 00000100:00100000:1.0:1746147207.550795:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311419648 00000100:00100000:1.0:1746147207.550806:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19565 00000100:00100000:1.0:1746147207.550810:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3766:x1830967311419008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147207.550872:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147207.550875:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00002000:00010000:1.0:1746147207.550876:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:1.0:1746147207.550878:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00002000:00010000:1.0:1746147207.550880:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147207.550909:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3766:x1830967311419008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (410us total) trans 21474842556 rc 0/0 00000100:00100000:1.0:1746147207.550915:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19565 00000100:00100000:1.0:1746147207.550930:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19566 00000100:00100000:1.0:1746147207.550934:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3766:x1830967311419520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147207.551000:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3766:x1830967311419520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (408us total) trans 21474842557 rc 0/0 00000100:00100000:1.0:1746147207.551013:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19566 00000100:00100000:1.0:1746147207.551027:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19567 00000100:00100000:1.0:1746147207.551032:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3766:x1830967311420032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147207.551124:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3766:x1830967311420032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (499us total) trans 21474842558 rc 0/0 00000100:00100000:1.0:1746147207.551129:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19567 00000100:00100000:1.0:1746147207.551138:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19568 00000100:00100000:1.0:1746147207.551142:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e21b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+69:3766:x1830967311419136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147207.551214:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147207.551221:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00002000:00010000:1.0:1746147207.551223:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:1.0:1746147207.551224:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00002000:00010000:1.0:1746147207.551226:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147207.551248:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e21b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+70:3766:x1830967311419136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (583us total) trans 17179875167 rc 0/0 00000100:00100000:1.0:1746147207.551253:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19568 00000100:00100000:1.0:1746147207.551337:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19569 00000100:00100000:1.0:1746147207.551349:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3766:x1830967311419648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147207.551413:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3766:x1830967311419648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (706us total) trans 21474842559 rc 0/0 00000100:00100000:1.0:1746147207.551418:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19569 00000004:00080000:1.0:1746147207.551447:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095122a00/2, rc 0, transno 17179875167 00000100:00100000:1.0:1746147207.551452:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311419136:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147207.551459:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258f480/2, rc 0, transno 21474842559 00000100:00100000:1.0:1746147207.551463:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311419648:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147207.551469:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258d880/2, rc 0, transno 21474842556 00000100:00100000:1.0:1746147207.551471:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311419008:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147207.551476:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258ce00/2, rc 0, transno 21474842557 00000100:00100000:1.0:1746147207.551479:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311419520:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147207.551484:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbc3b80/2, rc 0, transno 21474842558 00000100:00100000:1.0:1746147207.551486:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311420032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147207.551565:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2730:x1830967310245248:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 31679us (32756us total) trans 8589937271 rc 0/0 00000100:00100000:3.0:1746147207.551573:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16382 00010000:00010000:3.0:1746147207.551607:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.551615:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147207.551654:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147207.551658:0:9138:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147207.551672:0:9138:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.551700:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3400/0x3139939425061ebc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7d3 expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.551722:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7d3 expref: 28 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.551732:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147207.551735:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746147207.551737:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cd3600, rc 0) 00000100:00100000:3.0:1746147207.551765:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2735:x1830967310245504:12345-192.168.204.25@tcp:101:cat.0 Request processed in 30424us (30939us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.551770:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16384 00000100:00100000:0.0:1746147207.551782:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311420160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.551804:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147207.551828:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311420672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.551840:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.551865:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311420544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.552203:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311420288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.552465:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311420416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.552483:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147207.552589:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311420160 00000100:00100000:3.0:1746147207.552594:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311420160 00000100:00100000:3.0:1746147207.552614:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311420672 00000100:00100000:3.0:1746147207.552616:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311420672 00000100:00100000:3.0:1746147207.552625:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19570 00000100:00100000:3.0:1746147207.552629:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+71:3767:x1830967311420160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147207.552694:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147207.552700:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00002000:00010000:3.0:1746147207.552702:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:3.0:1746147207.552703:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00002000:00010000:3.0:1746147207.552705:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746147207.552735:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+72:3767:x1830967311420160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (931us total) trans 17179875168 rc 0/0 00000100:00100000:3.0:1746147207.552743:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19570 00000100:00100000:3.0:1746147207.552751:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19571 00000100:00100000:3.0:1746147207.552755:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+71:3767:x1830967311420672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.552782:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311420928:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147207.552787:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:3.0:1746147207.552789:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147207.552791:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147207.552792:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147207.552794:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:0.0:1746147207.552799:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147207.552810:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+72:3767:x1830967311420672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (969us total) trans 17179875169 rc 0/0 00000100:00100000:3.0:1746147207.552813:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19571 00000100:00100000:3.0:1746147207.552819:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311420416 00000100:00100000:0.0:1746147207.552820:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311420928 00000100:00100000:3.0:1746147207.552821:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311420416 00000100:00100000:0.0:1746147207.552823:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311420928 00000100:00100000:3.0:1746147207.552831:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19572 00000100:00100000:3.0:1746147207.552834:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+73:3765:x1830967311420416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.552841:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19573 00000100:00100000:0.0:1746147207.552845:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+73:3765:x1830967311420928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147207.552864:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147207.552866:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147207.552867:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147207.552869:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147207.552871:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746147207.552886:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+75:3765:x1830967311420416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (402us total) trans 17179875170 rc 0/0 00000100:00100000:3.0:1746147207.552890:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19572 00000100:00100000:0.0:1746147207.552904:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+74:3765:x1830967311420928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (103us total) trans 17179875171 rc 0/0 00000100:00100000:0.0:1746147207.552910:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19573 00000004:00080000:0.0:1746147207.552935:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095123480/2, rc 0, transno 17179875170 00000100:00100000:0.0:1746147207.552939:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311420416:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147207.552945:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095120380/2, rc 0, transno 17179875171 00000100:00100000:0.0:1746147207.552947:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311420928:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.552995:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.553028:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.553039:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311420800:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.553054:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147207.553072:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f56a00/2, rc 0, transno 21474842551 00000100:00100000:1.0:1746147207.553075:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311418880:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147207.553106:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095122d80/2, rc 0, transno 17179875168 00000100:00100000:1.0:1746147207.553110:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311420160:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147207.553117:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095123b80/2, rc 0, transno 17179875169 00000100:00100000:1.0:1746147207.553119:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311420672:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.553129:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311420544 00000100:00100000:1.0:1746147207.553132:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311420544 00000100:00100000:1.0:1746147207.553145:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311420288 00000100:00100000:1.0:1746147207.553147:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311420288 00000100:00100000:0.0:1746147207.553150:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311420800 00000100:00100000:0.0:1746147207.553154:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311420800 00000100:00100000:1.0:1746147207.553156:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19574 00000100:00100000:1.0:1746147207.553161:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+76:3766:x1830967311420544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.553360:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19575 00000100:00100000:0.0:1746147207.553365:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+76:3764:x1830967311420288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147207.553406:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147207.553409:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00002000:00010000:0.0:1746147207.553411:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:0.0:1746147207.553412:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00002000:00010000:0.0:1746147207.553414:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746147207.553435:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+77:3764:x1830967311420288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (406us total) trans 17179875172 rc 0/0 00000100:00100000:0.0:1746147207.553441:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19575 00000100:00100000:0.0:1746147207.553819:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19576 00000100:00100000:0.0:1746147207.553825:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+76:3764:x1830967311420800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.553881:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+77:3764:x1830967311420800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (825us total) trans 17179875173 rc 0/0 00000100:00100000:0.0:1746147207.553886:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19576 00000004:00080000:0.0:1746147207.554308:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095123100/2, rc 0, transno 17179875172 00000100:00100000:0.0:1746147207.554313:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311420288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.554316:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+77:3766:x1830967311420544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1154us (1320us total) trans 17179875174 rc 0/0 00000100:00100000:1.0:1746147207.554322:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19574 00000004:00080000:0.0:1746147207.554322:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095120000/2, rc 0, transno 17179875173 00000100:00100000:0.0:1746147207.554324:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311420800:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147207.554408:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095123800/2, rc 0, transno 17179875174 00000100:00100000:1.0:1746147207.554412:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311420544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.554428:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.554476:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310246656 00000100:00100000:3.0:1746147207.554480:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310246656 00000100:00100000:3.0:1746147207.554502:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19577 00000100:00100000:3.0:1746147207.554507:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2736:x1830967310246656:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147207.554516:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.554529:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x3139939425061ed1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e7e1 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.554549:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425061e0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e786 expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.554556:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147207.554558:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147207.554562:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x3139939425061ed1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7e1 expref: 28 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.554586:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425061e0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e786 expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.554598:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425061e0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e786 expref: 25 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.554609:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311421056:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.554668:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147207.557135:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311421056:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.557160:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x3139939425061ed1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7e1 expref: 28 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.557174:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cd3800, rc 0) 00000100:00100000:3.0:1746147207.557223:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2736:x1830967310246656:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2715us (2795us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.557234:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19577 00000100:00100000:0.0:1746147207.557311:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.557409:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.557427:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310246912 00000100:00100000:0.0:1746147207.557431:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310246912 00000100:00100000:3.0:1746147207.557576:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310246784 00000100:00100000:3.0:1746147207.557580:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310246784 00000100:00100000:3.0:1746147207.557618:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16385 00000100:00100000:3.0:1746147207.557624:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2735:x1830967310246784:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147207.557636:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.557649:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31800/0x3139939425061ed8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e7e8 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.557690:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31800/0x3139939425061ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7e8 expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.557700:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31800/0x3139939425061ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7e8 expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.557721:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147207.557724:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147207.557726:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091e31800, rc 0) 00000100:00100000:3.0:1746147207.557757:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2735:x1830967310246784:12345-192.168.204.25@tcp:101:cat.0 Request processed in 133us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.557762:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16385 00010000:00010000:0.0:1746147207.557808:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425061e0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e786 expref: 26 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746147207.557836:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8877 00000100:00100000:0.0:1746147207.557841:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094585880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+26:2001:x1830967310246912:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147207.557849:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147207.557860:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425061e0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e786 expref: 26 pid: 13712 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.557869:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425061e0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e786 expref: 26 pid: 13712 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.557885:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db33800/0x3139939425061e0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e786 expref: 26 pid: 13712 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.557898:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.557900:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.557905:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x3139939425061ed1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7e1 expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.557912:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x3139939425061ed1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7e1 expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.558011:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x3139939425061ed1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7e1 expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.558024:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094585f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311421184:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147207.558078:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.558120:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.558416:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310247040 00000100:00100000:3.0:1746147207.558419:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310247040 00000100:00100000:3.0:1746147207.558433:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19578 00000100:00100000:3.0:1746147207.558438:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2730:x1830967310247040:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147207.558445:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.558451:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e7ef expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.558463:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x3139939425061ed1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7e1 expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.558468:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.558470:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.558472:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [2031616->2097151] (req 2031616->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 39 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.558484:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x3139939425061ed1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7e1 expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.558492:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x3139939425061ed1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7e1 expref: 27 pid: 1398 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.558499:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311421312:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.558532:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.561502:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.561613:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094585f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311421184:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147207.561635:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147207.561738:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310247168 00000100:00100000:1.0:1746147207.561745:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310247168 00000100:00100000:1.0:1746147207.561795:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19579 00000100:00100000:1.0:1746147207.561802:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2003:x1830967310247168:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147207.561819:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147207.561836:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425061ee6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e7f6 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.561856:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.561859:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.561866:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425061ee6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7f6 expref: 24 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.561880:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425061ee6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7f6 expref: 24 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.561890:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d98200, rc 0) 00000100:00100000:2.0:1746147207.562174:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094585880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+25:2001:x1830967310246912:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4331us (4762us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.562182:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8877 00000100:00100000:0.0:1746147207.562495:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.562559:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967310247168:12345-192.168.204.25@tcp:101:cat.0 Request processed in 756us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.562564:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19579 00000100:00100000:3.0:1746147207.562643:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310247296 00000100:00100000:3.0:1746147207.562648:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310247296 00000100:00100000:3.0:1746147207.562677:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16386 00000100:00100000:3.0:1746147207.562681:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2736:x1830967310247296:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147207.562695:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.562709:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a466dc00/0x3139939425061eed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e7fd expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.562769:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a466dc00/0x3139939425061eed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7fd expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.562779:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a466dc00/0x3139939425061eed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7fd expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.562792:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147207.562795:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147207.562798:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a466dc00, rc 0) 00000100:00100000:3.0:1746147207.562819:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2736:x1830967310247296:12345-192.168.204.25@tcp:101:cat.0 Request processed in 138us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.562824:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16386 00000100:00100000:0.0:1746147207.563909:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.563934:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.563953:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.563971:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.563982:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.563994:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.564024:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.564190:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310247424 00000100:00100000:2.0:1746147207.564194:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310247424 00000100:00100000:2.0:1746147207.564219:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310247552 00000100:00100000:2.0:1746147207.564220:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310247552 00000100:00100000:2.0:1746147207.564229:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310247680 00000100:00100000:2.0:1746147207.564230:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310247680 00000100:00100000:2.0:1746147207.564238:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310247808 00000100:00100000:2.0:1746147207.564239:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310247808 00000100:00100000:2.0:1746147207.564249:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310247936 00000100:00100000:2.0:1746147207.564250:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310247936 00000100:00100000:2.0:1746147207.564261:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19580 00000100:00100000:2.0:1746147207.564266:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967310247424:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.564276:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.564288:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093709600/0x3139939425061ef4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e804 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.564303:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.564311:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093709600/0x3139939425061ef4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e804 expref: 43 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.564319:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093709600/0x3139939425061ef4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e804 expref: 43 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.564332:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093709600, rc 0) 00000100:00100000:2.0:1746147207.564363:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967310247424:12345-192.168.204.25@tcp:101:cat.0 Request processed in 97us (458us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147207.564367:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19580 00000100:00100000:2.0:1746147207.564378:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19581 00000100:00100000:2.0:1746147207.564382:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2003:x1830967310247552:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.564387:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.564394:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x3139939425061efb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e80b expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.564428:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311421440:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147207.564479:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1500c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.564497:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19582 00000100:00100000:2.0:1746147207.564502:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967310247680:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.564508:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.564517:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093709400/0x3139939425061f02 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e812 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.564539:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311421568:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147207.564555:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa150540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.564576:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310248064 00000100:00100000:2.0:1746147207.564578:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310248064 00000100:00100000:2.0:1746147207.564601:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310248192 00000100:00100000:2.0:1746147207.564602:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310248192 00010000:00010000:2.0:1746147207.564611:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x3139939425061ed1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7e1 expref: 28 pid: 1398 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.564625:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8878 00000100:00100000:2.0:1746147207.564629:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094585c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2001:x1830967310248192:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.564635:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.564652:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x3139939425061ed1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7e1 expref: 28 pid: 1398 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.564662:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x3139939425061ed1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7e1 expref: 28 pid: 1398 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.564676:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.564678:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.564682:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 42 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.564690:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 42 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.564709:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 42 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.564725:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311421696:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147207.564743:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42e03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.564760:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 985 00000100:00100000:2.0:1746147207.564764:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094585180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310248064:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.564771:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.564782:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31800/0x3139939425061ed8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7e8 expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.564791:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.564795:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.564805:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094585180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310248064:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 41us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.564810:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 985 00000100:00100000:1.0:1746147207.564958:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19583 00000100:00100000:1.0:1746147207.564965:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310247808:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147207.564972:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147207.564980:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d99c00/0x3139939425061f09 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e819 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.565003:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311421824:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147207.565024:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147207.565038:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19584 00000100:00100000:1.0:1746147207.565042:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2003:x1830967310247936:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147207.565047:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147207.565054:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x3139939425061f10 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e820 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.565072:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311421952:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147207.565117:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984899c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147207.565387:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x3139939425061ed1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7e1 expref: 28 pid: 1398 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.565413:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311421312:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.565441:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 43 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.565448:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091e31c00, rc 0) 00000100:00100000:3.0:1746147207.565467:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2730:x1830967310247040:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7029us (7347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.565472:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19578 00000100:00100000:0.0:1746147207.567578:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.567627:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310248320 00000100:00100000:2.0:1746147207.567634:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310248320 00000100:00100000:2.0:1746147207.567689:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16387 00000100:00100000:2.0:1746147207.567696:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2732:x1830967310248320:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147207.567711:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.567736:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009371da00/0x3139939425061f17 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e827 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.567791:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009371da00/0x3139939425061f17 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e827 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.567802:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009371da00/0x3139939425061f17 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e827 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.567818:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.567820:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147207.567823:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371da00, rc 0) 00000100:00100000:2.0:1746147207.567870:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2732:x1830967310248320:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 173us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.567876:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16387 00000100:00100000:0.0:1746147207.568684:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.569458:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310248448 00000100:00100000:3.0:1746147207.569464:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310248448 00000100:00100000:3.0:1746147207.569515:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19585 00000100:00100000:3.0:1746147207.569522:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2736:x1830967310248448:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147207.569534:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.569550:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425061f1e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e82e expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.569573:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 42 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.569580:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147207.569582:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147207.569585:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425061f1e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e82e expref: 29 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.569615:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 42 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.569628:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 42 pid: 1398 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.569641:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311422080:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.569734:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985000 going to sleep for 11 seconds 00010000:00010000:2.0:1746147207.570429:0:12201:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff88011db33a00/0x3139939425061e1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e794 expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.570456:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311421568:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147207.570481:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093709400/0x3139939425061f02 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e812 expref: 27 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.570491:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093709400/0x3139939425061f02 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e812 expref: 27 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.570502:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093709400, rc 0) 00000100:00100000:2.0:1746147207.570529:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310247680:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6027us (6574us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147207.570537:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19582 00010000:00010000:3.0:1746147207.570980:0:1854:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x3139939425061e14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e78d expref: 24 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.571000:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311421440:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147207.571018:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x3139939425061efb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e80b expref: 42 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.571027:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x3139939425061efb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e80b expref: 42 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.571034:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093709c00, rc 0) 00000100:00100000:3.0:1746147207.571056:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2003:x1830967310247552:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6673us (7121us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147207.571062:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19581 00010000:00010000:1.0:1746147207.571667:0:12225:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x3139939425061e22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e79b expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.571683:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311421824:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147207.571702:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d99c00/0x3139939425061f09 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e819 expref: 25 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.571710:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d99c00/0x3139939425061f09 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e819 expref: 25 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.571746:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99c00, rc 0) 00000100:00100000:1.0:1746147207.571767:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967310247808:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6803us (7794us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147207.571772:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19583 00000100:00100000:2.0:1746147207.572043:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.572107:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.572165:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310248704 00000100:00100000:1.0:1746147207.572170:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310248704 00000100:00100000:1.0:1746147207.572210:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19586 00000100:00100000:1.0:1746147207.572216:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2732:x1830967310248704:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147207.572228:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147207.572239:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e835 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.572260:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x3139939425061e14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e78d expref: 24 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.572267:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147207.572269:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147207.572272:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1994752->2097151] (req 1994752->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.572296:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x3139939425061e14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e78d expref: 24 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.572306:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x3139939425061e14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e78d expref: 24 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.572321:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cf9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311422208:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147207.572373:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489900 going to sleep for 11 seconds 00010000:00010000:1.0:1746147207.572395:0:1853:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x3139939425061e29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a2 expref: 24 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.572411:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311421952:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147207.572428:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x3139939425061f10 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e820 expref: 40 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.572436:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a73c00/0x3139939425061f10 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e820 expref: 40 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.572442:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a73c00, rc 0) 00000100:00100000:1.0:1746147207.572461:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967310247936:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7418us (8478us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147207.572592:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310248576 00000100:00100000:0.0:1746147207.572596:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310248576 00000100:00100000:0.0:1746147207.572625:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 986 00000100:00100000:0.0:1746147207.572747:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310248576:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147207.572757:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147207.572776:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009371da00/0x3139939425061f17 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e827 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.572797:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147207.572801:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147207.572817:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2001:x1830967310248576:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 187us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.572822:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 986 00000100:00100000:0.0:1746147207.572880:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.572896:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310248960 00000100:00100000:0.0:1746147207.572899:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310248960 00002000:00100000:0.0:1746147207.572922:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (2031616->2035711) req@ffff880094585500 x1830967310248960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147207.572931:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094585500 with x1830967310248960 ext(2031616->2035711) 00010000:00010000:0.0:1746147207.572938:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 40 pid: 1398 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.572947:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 40 pid: 1398 timeout: 845 lvb_type: 0 00002000:00010000:0.0:1746147207.572953:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094585500 00000100:00100000:0.0:1746147207.572966:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1676 00000100:00100000:0.0:1746147207.572971:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2002:x1830967310248960:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147207.573013:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311421696:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147207.573025:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.573042:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094585c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2001:x1830967310248192:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8412us (9016us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.573049:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8878 00000100:00100000:0.0:1746147207.573074:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2002:x1830967310248960:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 103us (194us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147207.573080:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1676 00002000:00100000:0.0:1746147207.573084:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (2031616->2035711) req@ffff880094585500 x1830967310248960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/4536 e 0 to 0 dl 1746147218 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147207.573114:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094585500 with x1830967310248960 ext(2031616->2035711) 00010000:00010000:0.0:1746147207.573118:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 40 pid: 1398 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.573126:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 40 pid: 1398 timeout: 845 lvb_type: 0 00002000:00010000:0.0:1746147207.573131:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094585500 00000100:00100000:2.0:1746147207.573173:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311422080:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.573192:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425061f1e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e82e expref: 30 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.573202:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091e30600, rc 0) 00000100:00100000:2.0:1746147207.573482:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2736:x1830967310248448:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3959us (4801us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.573488:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19585 00000100:00100000:1.0:1746147207.573685:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19584 00000100:00100000:1.0:1746147207.576474:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.576847:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cf9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311422208:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.576881:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1994752->2097151] (req 1994752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.576900:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cd3400, rc 0) 00000100:00100000:2.0:1746147207.576963:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2732:x1830967310248704:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4746us (4854us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.576972:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19586 00000100:00100000:1.0:1746147207.577136:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.577168:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.577268:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310249088 00000100:00100000:3.0:1746147207.577275:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310249088 00010000:00010000:3.0:1746147207.577306:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x3139939425061e14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e78d expref: 25 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.577329:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8879 00000100:00100000:3.0:1746147207.577334:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aa328050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+25:2000:x1830967310249088:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.577346:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.577365:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x3139939425061e14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e78d expref: 25 pid: 13712 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.577373:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x3139939425061e14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e78d expref: 25 pid: 13712 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.577397:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db33c00/0x3139939425061e14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e78d expref: 25 pid: 13712 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.577408:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.577410:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.577417:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.577424:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.577454:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.577465:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311422336:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147207.577528:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800989856c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.577626:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310249344 00000100:00100000:2.0:1746147207.577630:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310249344 00000100:00100000:2.0:1746147207.577655:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19587 00000100:00100000:2.0:1746147207.577660:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2730:x1830967310249344:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147207.577673:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.577685:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e83c expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.577703:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.577709:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147207.577723:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147207.577727:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->1118207] (req 1048576->1118207) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 40 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.577728:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310249472 00000100:00100000:3.0:1746147207.577732:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310249472 00010000:00010000:2.0:1746147207.577745:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.577756:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 28 pid: 12225 timeout: 845 lvb_type: 0 00002000:00100000:3.0:1746147207.577758:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x96:0x0] (2031616->2097151) req@ffff880096cf9500 x1830967310249472/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746147207.577764:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311422464:192.168.204.25@tcp:104: 00002000:00100000:3.0:1746147207.577767:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9500 with x1830967310249472 ext(2031616->2097151) 00010000:00010000:3.0:1746147207.577773:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 41 pid: 1398 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.577782:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 41 pid: 1398 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746147207.577789:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096cf9500 00000100:00100000:2.0:1746147207.577805:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42e03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147207.577850:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1677 00000100:00100000:3.0:1746147207.577856:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967310249472:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147207.579909:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.579959:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.579980:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.579995:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.580013:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.580034:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310249600 00000100:00100000:0.0:1746147207.580040:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310249600 00000100:00100000:0.0:1746147207.580071:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310249728 00000100:00100000:0.0:1746147207.580073:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310249728 00000100:00100000:0.0:1746147207.580082:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310249856 00000100:00100000:0.0:1746147207.580084:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310249856 00000100:00100000:0.0:1746147207.580116:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310249984 00000100:00100000:0.0:1746147207.580118:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310249984 00000100:00100000:3.0:1746147207.580121:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310250112 00000100:00100000:3.0:1746147207.580125:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310250112 00000100:00100000:0.0:1746147207.580130:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19588 00000100:00100000:0.0:1746147207.580136:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967310249600:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:3.0:1746147207.580147:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19589 00010000:00010000:0.0:1746147207.580148:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147207.580152:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967310249728:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147207.580159:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147207.580163:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d99a00/0x3139939425061f33 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e843 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.580166:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f38f600/0x3139939425061f3a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e84a expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.580205:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311422592:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147207.580205:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311422720:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147207.580347:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19590 00000100:00100000:1.0:1746147207.580354:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310249856:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147207.580362:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147207.580374:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c86e00/0x3139939425061f41 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e851 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.580404:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311422848:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147207.580466:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19591 00000100:00100000:2.0:1746147207.580472:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310249984:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.580478:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.580485:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009371da00/0x3139939425061f48 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e858 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.580508:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311422976:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147207.581061:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42e0180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.581112:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311422464:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.581137:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [1048576->1118207] (req 1048576->1118207) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 47 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.581148:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371c600, rc 0) 00000100:00100000:2.0:1746147207.581169:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2730:x1830967310249344:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3509us (4033us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.581176:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19587 00000100:00100000:2.0:1746147207.581193:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19592 00000100:00100000:2.0:1746147207.581198:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2000:x1830967310250112:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.581204:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.581211:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x3139939425061f4f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e85f expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.581231:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311423104:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147207.581249:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42e03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.581427:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.581626:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984899c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147207.581642:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310250368 00000100:00100000:1.0:1746147207.581646:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310250368 00002000:00100000:1.0:1746147207.581674:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1994752->1998847) req@ffff8800933f4000 x1830967310250368/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.581683:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f4000 with x1830967310250368 ext(1994752->1998847) 00010000:00010000:1.0:1746147207.581689:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 7/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 29 pid: 12225 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.581698:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 7/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 29 pid: 12225 timeout: 845 lvb_type: 0 00002000:00010000:1.0:1746147207.581705:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800933f4000 00000100:00100000:1.0:1746147207.581734:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1678 00000100:00100000:1.0:1746147207.581739:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310250368:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147207.581844:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310250368:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 104us (416us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147207.581849:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1678 00002000:00100000:1.0:1746147207.581854:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1994752->1998847) req@ffff8800933f4000 x1830967310250368/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/4536 e 0 to 0 dl 1746147218 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.581860:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f4000 with x1830967310250368 ext(1994752->1998847) 00010000:00010000:1.0:1746147207.581864:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 7/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 29 pid: 12225 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.581872:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 7/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 29 pid: 12225 timeout: 845 lvb_type: 0 00002000:00010000:1.0:1746147207.581877:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800933f4000 00000100:00100000:3.0:1746147207.582068:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147207.582360:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311422336:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147207.582371:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147207.582391:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aa328050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2000:x1830967310249088:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5057us (5926us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.582399:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8879 00000100:00100000:0.0:1746147207.582840:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095affd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.582960:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2000:x1830967310249472:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 5103us (5790us total) trans 17179875175 rc 0/0 00000100:00100000:2.0:1746147207.582967:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1677 00002000:00100000:2.0:1746147207.582974:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x96:0x0] (2031616->2097151) req@ffff880096cf9500 x1830967310249472/t17179875175(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/448 e 0 to 0 dl 1746147218 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.582981:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9500 with x1830967310249472 ext(2031616->2097151) 00010000:00010000:2.0:1746147207.582987:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 48 pid: 1398 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.582996:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 48 pid: 1398 timeout: 845 lvb_type: 0 00002000:00010000:2.0:1746147207.583002:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096cf9500 00010000:00010000:2.0:1746147207.584305:0:12201:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x3139939425061e22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e79b expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.584309:0:1853:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff88011db33a00/0x3139939425061e1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e794 expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.584331:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311422976:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147207.584331:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311422848:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147207.584357:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009371da00/0x3139939425061f48 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e858 expref: 27 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.584357:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c86e00/0x3139939425061f41 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e851 expref: 27 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.584368:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009371da00/0x3139939425061f48 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e858 expref: 27 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.584368:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c86e00/0x3139939425061f41 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e851 expref: 27 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.584377:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c86e00, rc 0) 00010000:00010000:2.0:1746147207.584382:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371da00, rc 0) 00010000:00010000:3.0:1746147207.584439:0:12225:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x3139939425061e29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a2 expref: 23 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.584456:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311423104:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147207.584474:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x3139939425061f4f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e85f expref: 47 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.584483:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009371d200/0x3139939425061f4f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e85f expref: 47 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.584490:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371d200, rc 0) 00000100:00100000:1.0:1746147207.584550:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310249856:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4195us (4566us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147207.584557:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19590 00000100:00100000:3.0:1746147207.584609:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2000:x1830967310250112:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3411us (4595us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147207.584609:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310249984:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4136us (4612us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147207.584614:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19592 00002000:00010000:3.0:1746147207.584693:0:1398:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime: 1746147206 -> 1746147207 00000100:00100000:3.0:1746147207.584702:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311422592:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147207.584728:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f38f600/0x3139939425061f3a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e84a expref: 45 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.584736:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38f600/0x3139939425061f3a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e84a expref: 45 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.584743:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38f600, rc 0) 00000100:00100000:2.0:1746147207.584756:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19591 00000100:00100000:3.0:1746147207.584774:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2001:x1830967310249728:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4621us (4814us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147207.584779:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19589 00000100:00100000:1.0:1746147207.585030:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311422720:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147207.585052:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d99a00/0x3139939425061f33 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e843 expref: 43 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.585061:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d99a00/0x3139939425061f33 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e843 expref: 43 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.585073:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d99a00, rc 0) 00000100:00100000:1.0:1746147207.585120:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967310249600:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4983us (5219us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147207.585125:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19588 00000100:00100000:0.0:1746147207.585913:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.585945:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.586007:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.586125:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310250880 00000100:00100000:2.0:1746147207.586131:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310250880 00002000:00100000:2.0:1746147207.586166:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1994752->2097151) req@ffff88009514e680 x1830967310250880/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.586176:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514e680 with x1830967310250880 ext(1994752->2097151) 00010000:00010000:2.0:1746147207.586182:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 29 pid: 12225 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.586192:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 29 pid: 12225 timeout: 845 lvb_type: 0 00002000:00010000:2.0:1746147207.586198:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009514e680 00000100:00100000:2.0:1746147207.586217:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1679 00000100:00100000:2.0:1746147207.586224:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310250880:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:1.0:1746147207.586285:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310251008 00000100:00100000:1.0:1746147207.586289:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310251008 00000100:00100000:1.0:1746147207.586313:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19593 00000100:00100000:1.0:1746147207.586318:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2732:x1830967310251008:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147207.586332:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147207.586346:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061f56 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e866 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.586368:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db33a00/0x3139939425061e1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e794 expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.586372:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310250624 00010000:00010000:1.0:1746147207.586374:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746147207.586376:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310250624 00010000:00010000:1.0:1746147207.586376:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147207.586379:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061f56 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->1437695] (req 1048576->1437695) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e866 expref: 13 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.586393:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 42 pid: 1398 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.586407:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db33a00/0x3139939425061e1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e794 expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.586416:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db33a00/0x3139939425061e1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e794 expref: 13 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.586432:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311423232:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.586457:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8880 00000100:00100000:3.0:1746147207.586464:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967310250624:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.586475:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.586484:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 42 pid: 1398 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.586490:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984899c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147207.586494:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 42 pid: 1398 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.586510:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091e31c00/0x3139939425061edf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7ef expref: 42 pid: 1398 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.586520:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.586522:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.586527:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425061f1e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e82e expref: 30 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.586534:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425061f1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e82e expref: 30 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.586561:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425061f1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e82e expref: 30 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.586570:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311423360:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147207.586594:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147207.589584:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311423232:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147207.589622:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061f56 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->1437695] (req 1048576->1437695) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e866 expref: 13 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.589639:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311423360:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147207.589642:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0af600, rc 0) 00010000:00010000:3.0:1746147207.589654:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147207.589696:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967310250624:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3231us (3748us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.589706:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8880 00000100:00100000:1.0:1746147207.589883:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2732:x1830967310251008:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3370us (3777us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.589890:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19593 00000100:00100000:0.0:1746147207.590043:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.590159:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.590737:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310251392 00000100:00100000:3.0:1746147207.590745:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310251392 00010000:00010000:3.0:1746147207.590771:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db33a00/0x3139939425061e1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e794 expref: 14 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746147207.590771:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310251264 00000100:00100000:0.0:1746147207.590775:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310251264 00000100:00100000:3.0:1746147207.590796:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8881 00000100:00100000:3.0:1746147207.590802:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310251392:12345-192.168.204.25@tcp:103:ldlm_bl.0 00002000:00100000:0.0:1746147207.590803:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88009514a680 x1830967310251264/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147207.590812:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514a680 with x1830967310251264 ext(0->1048575) 00002000:00010000:0.0:1746147207.590816:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514a680 00010000:00010000:3.0:1746147207.590900:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.590919:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db33a00/0x3139939425061e1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e794 expref: 14 pid: 13712 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.590929:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db33a00/0x3139939425061e1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e794 expref: 14 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746147207.590934:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7182 00000100:00100000:0.0:1746147207.590941:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2002:x1830967310251264:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:3.0:1746147207.590951:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db33a00/0x3139939425061e1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e794 expref: 14 pid: 13712 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.590964:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.590966:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.590973:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061f56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e866 expref: 12 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.590981:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061f56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e866 expref: 12 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.591012:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061f56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e866 expref: 12 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.591024:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311423488:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147207.591073:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147207.591230:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2001:x1830967310250880:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 5005us (5222us total) trans 17179875176 rc 0/0 00000100:00100000:3.0:1746147207.591237:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1679 00002000:00100000:3.0:1746147207.591243:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1994752->2097151) req@ffff88009514e680 x1830967310250880/t17179875176(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/448 e 0 to 0 dl 1746147218 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.591251:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514e680 with x1830967310250880 ext(1994752->2097151) 00010000:00010000:3.0:1746147207.591257:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 31 pid: 12225 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.591268:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 31 pid: 12225 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746147207.591273:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009514e680 00000100:00100000:2.0:1746147207.592606:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.592729:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310251648 00000100:00100000:1.0:1746147207.592735:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310251648 00002000:00100000:1.0:1746147207.592764:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8800933f4380 x1830967310251648/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.592772:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f4380 with x1830967310251648 ext(1048576->2097151) 00002000:00010000:1.0:1746147207.592776:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800933f4380 00000100:00100000:1.0:1746147207.592802:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7183 00000100:00100000:1.0:1746147207.592808:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2001:x1830967310251648:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147207.593052:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311423488:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147207.593072:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147207.593124:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310251392:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2321us (2963us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.593132:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8881 00000100:00100000:0.0:1746147207.596572:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.596653:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310251776 00000100:00100000:3.0:1746147207.596661:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310251776 00010000:00010000:3.0:1746147207.596696:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 33 pid: 12225 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.596741:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8882 00000100:00100000:3.0:1746147207.596748:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2000:x1830967310251776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.596762:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.596916:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 33 pid: 12225 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.596928:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 33 pid: 12225 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.596954:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x3139939425061f25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e835 expref: 33 pid: 12225 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.597181:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.597184:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.597191:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 40 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.597199:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 40 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.597232:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 40 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.597250:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311423616:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147207.597337:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.599665:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.600422:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310252032 00000100:00100000:3.0:1746147207.600431:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310252032 00002000:00100000:3.0:1746147207.600478:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1433600->1437695) req@ffff8800968a0380 x1830967310252032/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.600489:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a0380 with x1830967310252032 ext(1433600->1437695) 00002000:00010000:3.0:1746147207.600494:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968a0380 00000100:00100000:3.0:1746147207.600533:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7184 00000100:00100000:3.0:1746147207.600540:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310252032:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147207.600729:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310252032:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 188us (1069us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147207.600736:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7184 00002000:00100000:3.0:1746147207.600741:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1433600->1437695) req@ffff8800968a0380 x1830967310252032/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/4536 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.600748:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a0380 with x1830967310252032 ext(1433600->1437695) 00002000:00010000:3.0:1746147207.600751:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968a0380 00000100:00100000:0.0:1746147207.601311:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2002:x1830967310251264:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10369us (11267us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147207.601318:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7182 00002000:00100000:0.0:1746147207.601324:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88009514a680 x1830967310251264/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147207.601330:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514a680 with x1830967310251264 ext(0->1048575) 00002000:00010000:0.0:1746147207.601335:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514a680 00000100:00100000:0.0:1746147207.602653:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.602702:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311423616:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147207.602733:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147207.602768:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2000:x1830967310251776:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6019us (6206us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.602777:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8882 00000100:00100000:1.0:1746147207.602795:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310252288 00000100:00100000:1.0:1746147207.602801:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310252288 00002000:00100000:1.0:1746147207.602832:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1114112->1118207) req@ffff8800968a0e00 x1830967310252288/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.602839:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a0e00 with x1830967310252288 ext(1114112->1118207) 00002000:00010000:1.0:1746147207.602844:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968a0e00 00000100:00100000:1.0:1746147207.602858:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7185 00000100:00100000:1.0:1746147207.602864:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967310252288:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147207.603258:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2001:x1830967310251648:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 10450us (10657us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147207.603264:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7183 00002000:00100000:3.0:1746147207.603269:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8800933f4380 x1830967310251648/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.603276:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f4380 with x1830967310251648 ext(1048576->2097151) 00002000:00010000:3.0:1746147207.603280:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800933f4380 00000100:00100000:1.0:1746147207.603322:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2001:x1830967310252288:12345-192.168.204.25@tcp:3:cat.0 Request processed in 457us (671us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147207.603331:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7185 00002000:00100000:1.0:1746147207.603337:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1114112->1118207) req@ffff8800968a0e00 x1830967310252288/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/4536 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.603343:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a0e00 with x1830967310252288 ext(1114112->1118207) 00002000:00010000:1.0:1746147207.603346:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968a0e00 00000100:00100000:0.0:1746147207.604422:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.606471:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310252544 00000100:00100000:2.0:1746147207.606483:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310252544 00000100:00100000:2.0:1746147207.606534:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6108 00000100:00100000:2.0:1746147207.606542:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2732:x1830967310252544:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147207.606809:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2732:x1830967310252544:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 267us (2389us total) trans 8589937272 rc 0/0 00000100:00100000:2.0:1746147207.606816:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6108 00000100:00100000:0.0:1746147207.608380:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.608441:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310252800 00000100:00100000:2.0:1746147207.608446:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310252800 00000100:00100000:2.0:1746147207.608479:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6109 00000100:00100000:2.0:1746147207.608485:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2730:x1830967310252800:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147207.608640:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2730:x1830967310252800:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 154us (263us total) trans 8589937273 rc 0/0 00000100:00100000:2.0:1746147207.608645:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6109 00000100:00100000:0.0:1746147207.609003:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.609058:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310252928 00000100:00100000:1.0:1746147207.609062:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310252928 00000100:00100000:3.0:1746147207.609128:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19594 00000100:00100000:3.0:1746147207.609138:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2735:x1830967310252928:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147207.609150:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.609168:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f38e200/0x3139939425061f5d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e86d expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.609189:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.609191:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.609198:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38e200/0x3139939425061f5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e86d expref: 42 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.609212:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f38e200/0x3139939425061f5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e86d expref: 42 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.609221:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38e200, rc 0) 00000100:00100000:3.0:1746147207.609243:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2735:x1830967310252928:12345-192.168.204.25@tcp:101:cat.0 Request processed in 108us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.609249:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19594 00000100:00100000:0.0:1746147207.612192:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.612412:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310253056 00000100:00100000:3.0:1746147207.612421:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310253056 00000100:00100000:3.0:1746147207.612474:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19595 00000100:00100000:3.0:1746147207.612482:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2736:x1830967310253056:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147207.612499:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.612516:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x3139939425061f64 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e874 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.612547:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 41 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.612554:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147207.612556:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147207.612560:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x3139939425061f64 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e874 expref: 31 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.612590:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 41 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.612603:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 41 pid: 12225 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.612616:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311423744:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.612709:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147207.614399:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311423744:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.614425:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x3139939425061f64 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e874 expref: 31 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.614442:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38e600, rc 0) 00000100:00100000:3.0:1746147207.614482:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2736:x1830967310253056:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2000us (2298us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.614489:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19595 00000100:00100000:0.0:1746147207.615530:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.615639:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310253184 00000100:00100000:1.0:1746147207.615647:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310253184 00002000:00100000:1.0:1746147207.615691:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1118207) req@ffff880099888a80 x1830967310253184/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.615700:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888a80 with x1830967310253184 ext(1048576->1118207) 00010000:00010000:1.0:1746147207.615708:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 42 pid: 12225 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.615732:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 42 pid: 12225 timeout: 845 lvb_type: 0 00002000:00010000:1.0:1746147207.615738:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099888a80 00000100:00100000:1.0:1746147207.615768:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1680 00000100:00100000:1.0:1746147207.615776:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967310253184:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147207.617985:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.618034:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.618193:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310253440 00000100:00100000:1.0:1746147207.618202:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310253440 00000100:00100000:3.0:1746147207.618216:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310253696 00000100:00100000:3.0:1746147207.618221:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310253696 00002000:00100000:3.0:1746147207.618241:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1118208->2097151) req@ffff880099888380 x1830967310253696/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.618241:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880099889c00 x1830967310253440/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.618251:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888380 with x1830967310253696 ext(1118208->2097151) 00002000:00100000:1.0:1746147207.618251:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099889c00 with x1830967310253440 ext(1048576->2097151) 00002000:00010000:1.0:1746147207.618256:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099889c00 00010000:00010000:3.0:1746147207.618260:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 45 pid: 12225 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.618275:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 45 pid: 12225 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746147207.618281:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099888380 00000100:00100000:1.0:1746147207.618289:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7186 00000100:00100000:1.0:1746147207.618297:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2003:x1830967310253440:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147207.618309:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1681 00000100:00100000:3.0:1746147207.618314:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2003:x1830967310253696:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147207.619507:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2001:x1830967310253184:12345-192.168.204.25@tcp:4:cat.0 Request processed in 3727us (3975us total) trans 17179875177 rc 0/0 00000100:00100000:1.0:1746147207.619514:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1680 00002000:00100000:1.0:1746147207.619520:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1118207) req@ffff880099888a80 x1830967310253184/t17179875177(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/448 e 0 to 0 dl 1746147218 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.619528:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888a80 with x1830967310253184 ext(1048576->1118207) 00010000:00010000:1.0:1746147207.619535:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 48 pid: 12225 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.619546:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 48 pid: 12225 timeout: 845 lvb_type: 0 00002000:00010000:1.0:1746147207.619552:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099888a80 00000100:00100000:1.0:1746147207.632305:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2003:x1830967310253440:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13996us (14317us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147207.632317:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7186 00002000:00100000:1.0:1746147207.632327:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880099889c00 x1830967310253440/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.632336:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099889c00 with x1830967310253440 ext(1048576->2097151) 00002000:00010000:1.0:1746147207.632342:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099889c00 00000100:00100000:2.0:1746147207.634623:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2003:x1830967310253696:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16301us (16581us total) trans 0 rc 978944/978944 00000100:00100000:2.0:1746147207.634634:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1681 00002000:00100000:2.0:1746147207.634643:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1118208->2097151) req@ffff880099888380 x1830967310253696/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:H/200/0 rc 978944/978944 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.634652:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888380 with x1830967310253696 ext(1118208->2097151) 00010000:00010000:2.0:1746147207.634660:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 44 pid: 12225 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.634679:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 44 pid: 12225 timeout: 845 lvb_type: 0 00002000:00010000:2.0:1746147207.634686:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099888380 00000100:00100000:0.0:1746147207.640261:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.640310:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.640363:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310253824 00000100:00100000:3.0:1746147207.640375:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310253824 00010000:00010000:3.0:1746147207.640424:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 44 pid: 12225 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.641004:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310253952 00000100:00100000:2.0:1746147207.641011:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310253952 00000100:00100000:3.0:1746147207.641342:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8883 00000100:00100000:3.0:1746147207.641352:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967310253824:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.641369:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.641391:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 45 pid: 12225 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.641405:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 45 pid: 12225 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.641427:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009371c600/0x3139939425061f2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e83c expref: 45 pid: 12225 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.641455:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.641458:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.641466:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x3139939425061f64 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e874 expref: 30 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.641473:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x3139939425061f64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e874 expref: 30 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.641509:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x3139939425061f64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e874 expref: 30 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.641522:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311423872:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147207.641622:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.641799:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19596 00000100:00100000:2.0:1746147207.641807:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2735:x1830967310253952:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.641822:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.641838:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425061f6b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e87b expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.641858:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.641860:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.641866:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425061f6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e87b expref: 45 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.641878:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425061f6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e87b expref: 45 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.641888:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940c5600, rc 0) 00000100:00100000:2.0:1746147207.641923:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2735:x1830967310253952:12345-192.168.204.25@tcp:101:cat.0 Request processed in 117us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.641928:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19596 00000100:00100000:3.0:1746147207.646138:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311423872:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147207.646488:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147207.646528:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967310253824:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5176us (6274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.646537:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8883 00000100:00100000:0.0:1746147207.648449:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.648630:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.648705:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310254336 00000100:00100000:2.0:1746147207.648727:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310254336 00002000:00100000:2.0:1746147207.648773:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88009988b480 x1830967310254336/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.648783:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009988b480 with x1830967310254336 ext(1048576->2097151) 00002000:00010000:2.0:1746147207.648789:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009988b480 00000100:00100000:2.0:1746147207.648809:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310254464 00000100:00100000:2.0:1746147207.648811:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310254464 00002000:00100000:2.0:1746147207.648823:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1437696->2097151) req@ffff880099888e00 x1830967310254464/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.648830:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888e00 with x1830967310254464 ext(1437696->2097151) 00002000:00010000:2.0:1746147207.648833:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099888e00 00000100:00100000:2.0:1746147207.648857:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7187 00000100:00100000:2.0:1746147207.648864:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2001:x1830967310254336:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147207.649593:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7188 00000100:00100000:0.0:1746147207.649601:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310254464:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147207.651181:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.651244:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310254720 00000100:00100000:3.0:1746147207.651251:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310254720 00002000:00100000:3.0:1746147207.651284:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880094526300 x1830967310254720/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.651294:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094526300 with x1830967310254720 ext(1048576->2097151) 00002000:00010000:3.0:1746147207.651299:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094526300 00000100:00100000:3.0:1746147207.651323:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7189 00000100:00100000:3.0:1746147207.651329:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2002:x1830967310254720:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147207.659909:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310254464:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 10295us (11264us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746147207.659923:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7188 00002000:00100000:2.0:1746147207.659935:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1437696->2097151) req@ffff880099888e00 x1830967310254464/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 659456/659456 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.659945:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099888e00 with x1830967310254464 ext(1437696->2097151) 00002000:00010000:2.0:1746147207.659951:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099888e00 00000100:00100000:2.0:1746147207.662583:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2001:x1830967310254336:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 13708us (14134us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147207.662595:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7187 00002000:00100000:2.0:1746147207.662605:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88009988b480 x1830967310254336/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.662620:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009988b480 with x1830967310254336 ext(1048576->2097151) 00002000:00010000:2.0:1746147207.662625:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009988b480 00000100:00100000:3.0:1746147207.667417:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2002:x1830967310254720:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16075us (16234us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147207.667431:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7189 00002000:00100000:3.0:1746147207.667443:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880094526300 x1830967310254720/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.667452:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094526300 with x1830967310254720 ext(1048576->2097151) 00002000:00010000:3.0:1746147207.667459:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094526300 00000100:00100000:0.0:1746147207.673018:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.673074:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.673237:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310254848 00000100:00100000:2.0:1746147207.673246:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310254848 00000100:00100000:1.0:1746147207.673280:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310254976 00000100:00100000:1.0:1746147207.673286:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310254976 00000100:00100000:2.0:1746147207.673313:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19597 00000100:00100000:2.0:1746147207.673321:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310254848:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.673341:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.673362:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800940c4400/0x3139939425061f72 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e882 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.673416:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311424000:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147207.673507:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42e0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147207.673590:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19598 00000100:00100000:1.0:1746147207.673599:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2000:x1830967310254976:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147207.673608:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147207.673619:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2a000/0x3139939425061f79 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e889 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.673651:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311424128:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147207.673677:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.675671:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.675735:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310255104 00000100:00100000:3.0:1746147207.675743:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310255104 00000100:00100000:3.0:1746147207.675795:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19599 00000100:00100000:3.0:1746147207.675802:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2735:x1830967310255104:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147207.675814:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.675830:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38fe00/0x3139939425061f80 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e890 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.675860:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061f56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e866 expref: 14 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.675867:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147207.675869:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147207.675872:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38fe00/0x3139939425061f80 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e890 expref: 25 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.675900:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061f56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e866 expref: 14 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.675913:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061f56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e866 expref: 14 pid: 9584 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.675924:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311424256:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.676437:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985900 going to sleep for 11 seconds 00010000:00010000:2.0:1746147207.676657:0:1398:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x3139939425061e22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e79b expref: 12 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.676683:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311424000:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147207.676709:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800940c4400/0x3139939425061f72 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e882 expref: 14 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.676731:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800940c4400/0x3139939425061f72 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e882 expref: 14 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.676754:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940c4400, rc 0) 00000100:00100000:2.0:1746147207.676783:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310254848:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3462us (3774us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147207.676793:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19597 00010000:00010000:1.0:1746147207.676798:0:9584:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x3139939425061e29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a2 expref: 23 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.676819:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099154000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311424128:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147207.676839:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2a000/0x3139939425061f79 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e889 expref: 32 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.676848:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2a000/0x3139939425061f79 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e889 expref: 32 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.676877:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2a000, rc 0) 00000100:00100000:1.0:1746147207.676900:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2000:x1830967310254976:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3303us (3825us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147207.676906:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19598 00000100:00100000:0.0:1746147207.679358:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.679396:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311424256:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147207.679401:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.679412:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310255232 00000100:00100000:1.0:1746147207.679419:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310255232 00010000:00010000:3.0:1746147207.679430:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38fe00/0x3139939425061f80 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e890 expref: 25 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.679447:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38fe00, rc 0) 00000100:00100000:1.0:1746147207.679457:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19600 00000100:00100000:1.0:1746147207.679464:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2736:x1830967310255232:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147207.679479:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147207.679493:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425061f87 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e897 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.679496:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2735:x1830967310255104:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3693us (3833us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.679502:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19599 00010000:00010000:1.0:1746147207.679517:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x3139939425061e22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e79b expref: 12 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.679532:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147207.679534:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147207.679538:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425061f87 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e897 expref: 14 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.679572:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x3139939425061e22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e79b expref: 12 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.679582:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310255360 00010000:00010000:1.0:1746147207.679584:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x3139939425061e22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e79b expref: 12 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.679586:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310255360 00000100:00100000:1.0:1746147207.679595:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311424384:192.168.204.25@tcp:104: 00002000:00100000:2.0:1746147207.679614:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1437695) req@ffff8801349a1500 x1830967310255360/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.679624:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a1500 with x1830967310255360 ext(1048576->1437695) 00010000:00010000:2.0:1746147207.679630:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061f56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e866 expref: 15 pid: 9584 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.679640:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061f56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e866 expref: 15 pid: 9584 timeout: 845 lvb_type: 0 00002000:00010000:2.0:1746147207.679646:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801349a1500 00000100:00100000:1.0:1746147207.679647:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.679659:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1682 00000100:00100000:2.0:1746147207.679664:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2002:x1830967310255360:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147207.684804:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.684891:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099154000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311424384:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.684924:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425061f87 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e897 expref: 16 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.684947:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2bc00, rc 0) 00000100:00100000:2.0:1746147207.684994:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2736:x1830967310255232:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5530us (5643us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.685004:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19600 00000100:00100000:3.0:1746147207.685297:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310255488 00000100:00100000:3.0:1746147207.685305:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310255488 00010000:00010000:3.0:1746147207.685332:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x3139939425061e22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e79b expref: 13 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.685364:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8884 00000100:00100000:3.0:1746147207.685369:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310255488:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.685380:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.685395:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x3139939425061e22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e79b expref: 13 pid: 13712 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.685405:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x3139939425061e22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e79b expref: 13 pid: 13712 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.685426:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db32800/0x3139939425061e22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e79b expref: 13 pid: 13712 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.685450:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.685452:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.685459:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425061f87 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e897 expref: 15 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.685466:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425061f87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e897 expref: 15 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.685495:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425061f87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e897 expref: 15 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.685507:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311424512:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147207.685560:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.686172:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967310255360:12345-192.168.204.25@tcp:4:cat.0 Request processed in 6506us (6769us total) trans 21474842560 rc 0/0 00000100:00100000:2.0:1746147207.686936:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1682 00002000:00100000:2.0:1746147207.686950:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1437695) req@ffff8801349a1500 x1830967310255360/t21474842560(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/448 e 0 to 0 dl 1746147218 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.686960:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a1500 with x1830967310255360 ext(1048576->1437695) 00010000:00010000:2.0:1746147207.686970:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061f56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e866 expref: 16 pid: 9584 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.686983:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061f56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e866 expref: 16 pid: 9584 timeout: 845 lvb_type: 0 00002000:00010000:2.0:1746147207.686990:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801349a1500 00000100:00100000:3.0:1746147207.687669:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311424512:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147207.687689:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147207.687738:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310255488:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2367us (2946us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.687746:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8884 00000100:00100000:0.0:1746147207.690274:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.690346:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310255616 00000100:00100000:3.0:1746147207.690354:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310255616 00010000:00010000:3.0:1746147207.690392:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061f56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e866 expref: 16 pid: 9584 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.690433:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8885 00000100:00100000:3.0:1746147207.690442:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2003:x1830967310255616:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.690457:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147207.690475:0:16749:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147206 -> 1746147207 00010000:00010000:3.0:1746147207.690482:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061f56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e866 expref: 16 pid: 9584 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.690495:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061f56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e866 expref: 16 pid: 9584 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.690520:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0af600/0x3139939425061f56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e866 expref: 16 pid: 9584 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.690553:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.690555:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.690565:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38fe00/0x3139939425061f80 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e890 expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.690573:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38fe00/0x3139939425061f80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e890 expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.690612:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38fe00/0x3139939425061f80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e890 expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.690624:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311424640:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147207.690724:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.690728:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.691052:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310255872 00000100:00100000:2.0:1746147207.691056:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310255872 00002000:00100000:2.0:1746147207.691121:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff8801349a2680 x1830967310255872/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.691130:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2680 with x1830967310255872 ext(2097152->3145727) 00002000:00010000:2.0:1746147207.691134:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a2680 00000100:00100000:2.0:1746147207.691156:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7190 00000100:00100000:2.0:1746147207.691162:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310255872:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147207.691842:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311424640:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147207.691860:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147207.692474:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2003:x1830967310255616:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2030us (2208us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.692486:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8885 00000100:00100000:0.0:1746147207.702188:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.703173:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310256128 00000100:00100000:3.0:1746147207.703184:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310256128 00002000:00100000:3.0:1746147207.703227:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8801322eaa00 x1830967310256128/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.703237:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801322eaa00 with x1830967310256128 ext(1048576->2097151) 00002000:00010000:3.0:1746147207.703242:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801322eaa00 00000100:00100000:3.0:1746147207.704037:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7191 00000100:00100000:3.0:1746147207.704047:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310256128:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147207.705327:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310255872:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14158us (14593us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147207.705336:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7190 00002000:00100000:2.0:1746147207.705344:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff8801349a2680 x1830967310255872/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.705358:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2680 with x1830967310255872 ext(2097152->3145727) 00002000:00010000:2.0:1746147207.705363:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a2680 00000100:00100000:3.0:1746147207.713081:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310256128:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9023us (10890us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147207.713127:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7191 00002000:00100000:3.0:1746147207.713139:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8801322eaa00 x1830967310256128/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.713149:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801322eaa00 with x1830967310256128 ext(1048576->2097151) 00002000:00010000:3.0:1746147207.713155:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801322eaa00 00000100:00100000:0.0:1746147207.713207:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.713270:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310256256 00000100:00100000:3.0:1746147207.713277:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310256256 00000100:00100000:3.0:1746147207.713325:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16388 00000100:00100000:3.0:1746147207.713332:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+6:2739:x1830967310256256:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147207.713357:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.713377:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f600/0x3139939425061f8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e89e expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.713436:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e400/0x3139939425061f95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713447:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e400/0x3139939425061f95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713457:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e400/0x3139939425061f95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713469:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3f000/0x3139939425061f9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713474:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3f000/0x3139939425061f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713478:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3f000/0x3139939425061f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713555:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797400/0x3139939425061fa3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713564:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797400/0x3139939425061fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713569:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797400/0x3139939425061fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147207.713605:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147207.713609:0:9138:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147207.713626:0:9138:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797400/0x3139939425061fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713634:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797400/0x3139939425061fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713642:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e400/0x3139939425061f95 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713647:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e400/0x3139939425061f95 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713652:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e400/0x3139939425061f95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713657:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e400/0x3139939425061f95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713663:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38e400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147207.713667:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e400/0x3139939425061f95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713673:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e400/0x3139939425061f95 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713683:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147207.713686:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147207.713690:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e400/0x3139939425061f95 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713694:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38e400/0x3139939425061f95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713727:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3f000/0x3139939425061f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713732:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3f000/0x3139939425061f9c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713737:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3f000/0x3139939425061f9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713741:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096e3f000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147207.713744:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3f000/0x3139939425061f9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713748:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3f000/0x3139939425061f9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713754:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098006c00) 00010000:00010000:3.0:1746147207.713756:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147207.713758:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3f000/0x3139939425061f9c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713762:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3f000/0x3139939425061f9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.713787:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38f600/0x3139939425061f8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e89e expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.713798:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797400/0x3139939425061fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e89e expref: 7 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.713804:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147207.713805:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147207.713807:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5797400, rc 0) 00000100:00100000:3.0:1746147207.713830:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2739:x1830967310256256:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 498us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.713835:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16388 00000100:00100000:1.0:1746147207.714008:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.714057:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310256384 00000100:00100000:2.0:1746147207.714062:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310256384 00000100:00100000:2.0:1746147207.714119:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19601 00000100:00100000:2.0:1746147207.714125:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2736:x1830967310256384:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.714134:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.714146:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425061faa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e8a5 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.714167:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x3139939425061e29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a2 expref: 23 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.714174:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147207.714176:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147207.714179:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425061faa lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8a5 expref: 32 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.714206:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x3139939425061e29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a2 expref: 23 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.714217:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x3139939425061e29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a2 expref: 23 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.714228:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311424768:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.714296:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42e0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.716598:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.716846:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311424768:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.716877:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425061faa lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8a5 expref: 32 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.716893:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0f200, rc 0) 00000100:00100000:2.0:1746147207.716938:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2736:x1830967310256384:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2813us (2930us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.716945:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19601 00000100:00100000:2.0:1746147207.716969:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310256512 00000100:00100000:2.0:1746147207.716973:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310256512 00000100:00100000:2.0:1746147207.716997:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19602 00000100:00100000:2.0:1746147207.717002:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310256512:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147207.717013:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.717026:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0f600/0x3139939425061fb1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e8ac expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.717043:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.717044:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.717051:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0f600/0x3139939425061fb1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8ac expref: 13 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.717062:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0f600/0x3139939425061fb1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8ac expref: 13 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.717068:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0f600, rc 0) 00000100:00100000:2.0:1746147207.717081:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310256512:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 80us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.717104:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19602 00000100:00100000:0.0:1746147207.717222:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.717259:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.717308:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.717401:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310256768 00000100:00100000:2.0:1746147207.717404:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310256768 00000100:00100000:2.0:1746147207.717431:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310256896 00000100:00100000:2.0:1746147207.717433:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310256896 00000100:00100000:2.0:1746147207.717837:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19603 00000100:00100000:2.0:1746147207.717843:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+25:2001:x1830967310256768:12345-192.168.204.25@tcp:101:mirror_io.0 00000100:00100000:3.0:1746147207.717844:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19604 00010000:00010000:2.0:1746147207.717851:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147207.717853:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+25:2001:x1830967310256896:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147207.717860:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.717861:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0e800/0x3139939425061fb8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e8b3 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.717868:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5797800/0x3139939425061fbf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e8ba expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.717873:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.717874:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.717878:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.717879:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0e800/0x3139939425061fb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8b3 expref: 27 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.717880:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.717885:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5797800/0x3139939425061fbf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8ba expref: 27 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.717888:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0e800/0x3139939425061fb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8b3 expref: 27 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.717894:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5797800/0x3139939425061fbf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8ba expref: 27 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.717894:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0e800, rc 0) 00010000:00010000:3.0:1746147207.717901:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5797800, rc 0) 00000100:00100000:2.0:1746147207.718080:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+27:2001:x1830967310256768:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 237us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.718082:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+27:2001:x1830967310256896:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 230us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.718085:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19603 00000100:00100000:3.0:1746147207.718110:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19604 00000100:00100000:3.0:1746147207.718131:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310256640 00000100:00100000:3.0:1746147207.718134:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310256640 00010000:00010000:3.0:1746147207.718152:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x3139939425061e29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a2 expref: 26 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.718371:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.718394:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.718417:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310257024 00000100:00100000:0.0:1746147207.718421:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310257024 00000100:00100000:0.0:1746147207.718437:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310257152 00000100:00100000:0.0:1746147207.718439:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310257152 00000100:00100000:2.0:1746147207.718447:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19605 00000100:00100000:0.0:1746147207.718451:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19606 00000100:00100000:2.0:1746147207.718452:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310257024:12345-192.168.204.25@tcp:101:mirror_io.0 00000100:00100000:0.0:1746147207.718455:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310257152:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147207.718459:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147207.718459:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.718467:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0fc00/0x3139939425061fc6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e8c1 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.718467:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a1fa00/0x3139939425061fcd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e8c8 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.718477:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.718478:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.718479:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.718480:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.718483:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0fc00/0x3139939425061fc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8c1 expref: 16 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.718483:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a1fa00/0x3139939425061fcd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8c8 expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.718493:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0fc00/0x3139939425061fc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8c1 expref: 16 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.718493:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a1fa00/0x3139939425061fcd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8c8 expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.718500:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0fc00, rc 0) 00010000:00010000:0.0:1746147207.718500:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a1fa00, rc 0) 00000100:00100000:2.0:1746147207.718514:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310257024:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 63us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.718514:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310257152:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 59us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.718519:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19606 00000100:00100000:3.0:1746147207.718633:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8886 00000100:00100000:3.0:1746147207.718640:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+26:2003:x1830967310256640:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147207.718643:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147207.718649:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147207.718667:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147207.718669:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x3139939425061e29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a2 expref: 26 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.718677:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310257408 00000100:00100000:0.0:1746147207.718677:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310257280 00010000:00010000:3.0:1746147207.718680:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x3139939425061e29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a2 expref: 26 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.718680:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310257408 00000100:00100000:0.0:1746147207.718680:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310257280 00010000:00010000:3.0:1746147207.718696:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db33400/0x3139939425061e29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7a2 expref: 27 pid: 13712 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.718708:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.718720:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.718725:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425061faa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8a5 expref: 31 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.718728:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19605 00010000:00010000:3.0:1746147207.718732:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425061faa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8a5 expref: 31 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.718739:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19607 00000100:00100000:2.0:1746147207.718744:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+26:2001:x1830967310257280:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147207.718750:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.718755:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0fa00/0x3139939425061fd4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e8cf expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.718760:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425061faa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8a5 expref: 31 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.718764:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.718765:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.718769:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0fa00/0x3139939425061fd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8cf expref: 27 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.718838:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0fa00/0x3139939425061fd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8cf expref: 27 pid: 9584 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147207.718839:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311424896:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147207.718843:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19608 00000100:00100000:1.0:1746147207.718848:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310257408:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.718850:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0fa00, rc 0) 00010000:00010000:1.0:1746147207.718854:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147207.718860:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425061fdb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e8d6 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.718869:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+27:2001:x1830967310257280:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 126us (227us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147207.718869:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.718871:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147207.718874:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19607 00010000:00010000:1.0:1746147207.718875:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425061fdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8d6 expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.718883:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425061fdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8d6 expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.718889:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80600, rc 0) 00000100:00100000:3.0:1746147207.718894:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147207.718903:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310257408:12345-192.168.204.25@tcp:101:cat.0 Request processed in 56us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.719029:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19608 00000100:00100000:1.0:1746147207.719084:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.719143:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310257536 00000100:00100000:0.0:1746147207.719147:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310257536 00000100:00100000:0.0:1746147207.719163:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19609 00000100:00100000:0.0:1746147207.719168:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2000:x1830967310257536:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147207.719175:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147207.719180:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a1e600/0x3139939425061fe2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e8dd expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.719189:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.719191:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.719194:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a1e600/0x3139939425061fe2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8dd expref: 45 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.719202:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a1e600/0x3139939425061fe2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8dd expref: 45 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.719208:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a1e600, rc 0) 00000100:00100000:0.0:1746147207.719235:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967310257536:12345-192.168.204.25@tcp:101:cat.0 Request processed in 66us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.719240:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19609 00000100:00100000:1.0:1746147207.721883:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.721987:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311424896:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147207.722009:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147207.722044:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+26:2003:x1830967310256640:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3404us (4821us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.722047:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310257792 00000100:00100000:3.0:1746147207.722052:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8886 00000100:00100000:2.0:1746147207.722052:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310257792 00000100:00100000:2.0:1746147207.722115:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16389 00000100:00100000:2.0:1746147207.722121:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2739:x1830967310257792:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147207.722137:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.722154:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x3139939425061fe9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e8e4 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.722260:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x3139939425061ff0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.722274:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7d3 expref: 28 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.722281:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797400/0x3139939425061fa3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e89e expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.722288:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x3139939425061ff0 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.722315:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797400/0x3139939425061fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e89e expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.722326:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797400/0x3139939425061fa3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e89e expref: 8 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.722337:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311425024:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.722390:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7d3 expref: 28 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.722397:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7d3 expref: 28 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.722404:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311425152:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.722421:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42e0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.724021:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311425024:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.724036:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311425152:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.724059:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x3139939425061ff0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147207.724154:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.724194:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.724222:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310257920 00000100:00100000:3.0:1746147207.724227:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310257920 00010000:00010000:3.0:1746147207.724255:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797400/0x3139939425061fa3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e89e expref: 9 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.724275:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310258048 00000100:00100000:3.0:1746147207.724277:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310258048 00000100:00100000:2.0:1746147207.724282:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8887 00010000:00010000:3.0:1746147207.724287:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7d3 expref: 29 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.724289:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310257920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147207.724306:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8888 00000100:00100000:3.0:1746147207.724310:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310258048:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.724317:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.724317:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.724322:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7d3 expref: 29 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.724322:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797400/0x3139939425061fa3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e89e expref: 9 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.724331:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7d3 expref: 29 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.724496:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797400/0x3139939425061fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e89e expref: 9 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.724517:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797400/0x3139939425061fa3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e89e expref: 9 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.724596:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.724601:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x3139939425061ff0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.724608:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x3139939425061ff0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.724613:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147207.724722:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3600/0x3139939425061ec3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7d3 expref: 29 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.724732:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147207.724734:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x3139939425061ff0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.724741:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x3139939425061ff0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.724747:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x3139939425061ff0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.724770:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.724814:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967310257920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 524us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.724821:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8887 00010000:00010000:2.0:1746147207.724838:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x3139939425061ff0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.724843:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x3139939425061ff0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147207.724859:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147207.724978:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c5c00/0x3139939425061fe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8e4 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.724993:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x3139939425061ff0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8e4 expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.724999:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.725001:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147207.725003:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db32800, rc 0) 00000100:00100000:3.0:1746147207.725043:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310258048:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 731us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.725049:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8888 00000100:00100000:2.0:1746147207.725796:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2739:x1830967310257792:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 3673us (3925us total) trans 8589937274 rc 0/0 00000100:00100000:2.0:1746147207.725806:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16389 00000100:00100000:2.0:1746147207.727622:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.727665:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.727671:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.727694:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310258816 00000100:00100000:2.0:1746147207.727704:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310258816 00000100:00100000:2.0:1746147207.727764:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16390 00000100:00100000:2.0:1746147207.727771:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2739:x1830967310258816:12345-192.168.204.25@tcp:101:mirror_io.0 00000100:00100000:3.0:1746147207.727780:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310258432 00000100:00100000:3.0:1746147207.727784:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310258432 00010000:00010000:2.0:1746147207.727792:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.727794:0:6215:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00002000:00100000:3.0:1746147207.727812:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff8800933f5180 x1830967310258432/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147207.727815:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x3139939425061ff0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8e4 expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746147207.727821:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f5180 with x1830967310258432 ext(2097152->4194303) 00002000:00010000:3.0:1746147207.727826:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800933f5180 00010000:00010000:2.0:1746147207.727829:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.727832:0:6215:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147207.727842:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c5200/0x3139939425061ffe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e8eb expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.727843:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310258560 00000100:00100000:3.0:1746147207.727845:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310258560 00002000:00100000:3.0:1746147207.727857:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800933f4700 x1830967310258560/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.727863:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f4700 with x1830967310258560 ext(3145728->4194303) 00002000:00010000:3.0:1746147207.727866:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800933f4700 00000100:00100000:3.0:1746147207.727888:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7192 00000100:00100000:3.0:1746147207.727893:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2000:x1830967310258432:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:2.0:1746147207.727931:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4e00/0x3139939425062005 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.727942:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4e00/0x3139939425062005 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.727949:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4e00/0x3139939425062005 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147207.727956:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147207.728031:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c5200/0x3139939425061ffe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8eb expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.728045:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4e00/0x3139939425062005 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8eb expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.728051:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.728053:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147207.728055:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49c4e00, rc 0) 00000100:00100000:2.0:1746147207.728109:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2739:x1830967310258816:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 338us (443us total) trans 8589937275 rc 0/0 00000100:00100000:2.0:1746147207.728117:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16390 00000100:00100000:2.0:1746147207.728136:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7193 00000100:00100000:2.0:1746147207.728271:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310258560:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147207.730650:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.730684:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310258944 00000100:00100000:0.0:1746147207.730692:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310258944 00000100:00100000:0.0:1746147207.730763:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16391 00000100:00100000:0.0:1746147207.730771:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2739:x1830967310258944:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147207.730792:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147207.730812:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425062013 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e8f2 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.730868:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425062013 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8f2 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.730882:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425062013 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8f2 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.730898:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147207.730901:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147207.730904:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a1e000, rc 0) 00000100:00100000:0.0:1746147207.730928:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2739:x1830967310258944:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 158us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.730934:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16391 00000100:00100000:1.0:1746147207.736294:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.736338:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.736340:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310259328 00000100:00100000:2.0:1746147207.736349:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310259328 00002000:00100000:2.0:1746147207.736394:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88012ca13800 x1830967310259328/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.736404:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca13800 with x1830967310259328 ext(2097152->4194303) 00002000:00010000:2.0:1746147207.736410:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ca13800 00000100:00100000:2.0:1746147207.736428:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310259456 00000100:00100000:2.0:1746147207.736430:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310259456 00002000:00100000:2.0:1746147207.736441:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88012ca11500 x1830967310259456/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.736448:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca11500 with x1830967310259456 ext(2097152->4194303) 00002000:00010000:2.0:1746147207.736451:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca11500 00000100:00100000:2.0:1746147207.736476:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7194 00000100:00100000:2.0:1746147207.736485:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967310259328:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147207.736658:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7195 00000100:00100000:1.0:1746147207.736664:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2002:x1830967310259456:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147207.744370:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2000:x1830967310258432:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16463us (16742us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147207.744383:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7192 00002000:00100000:3.0:1746147207.744396:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff8800933f5180 x1830967310258432/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.744406:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f5180 with x1830967310258432 ext(2097152->4194303) 00002000:00010000:3.0:1746147207.744412:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800933f5180 00000100:00100000:0.0:1746147207.748912:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.748954:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.748986:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.749013:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.749026:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.749038:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.749062:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310259584 00000100:00100000:0.0:1746147207.749072:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310259584 00000100:00100000:0.0:1746147207.749130:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310259712 00000100:00100000:0.0:1746147207.749132:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310259712 00000100:00100000:0.0:1746147207.749146:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310259840 00000100:00100000:0.0:1746147207.749149:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310259840 00000100:00100000:0.0:1746147207.749158:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310259968 00000100:00100000:0.0:1746147207.749160:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310259968 00000100:00100000:0.0:1746147207.749169:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310260096 00000100:00100000:0.0:1746147207.749170:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310260096 00000100:00100000:0.0:1746147207.749179:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310260224 00000100:00100000:0.0:1746147207.749181:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310260224 00000100:00100000:0.0:1746147207.749195:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19610 00000100:00100000:0.0:1746147207.749202:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310259584:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147207.749250:0:13695:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800958e0400/0x313993942506201a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.749270:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425061e84 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7be expref: 16 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.749278:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0f600/0x3139939425061fb1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8ac expref: 17 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.749286:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425061ee6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7f6 expref: 27 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.749292:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.749294:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.749296:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e0400/0x313993942506201a lrc: 6/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.749329:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425061ee6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7f6 expref: 27 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.749343:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425061ee6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7f6 expref: 27 pid: 12225 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746147207.749358:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099012a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311425280:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147207.749469:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0f600/0x3139939425061fb1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8ac expref: 17 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.749484:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da0f600/0x3139939425061fb1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8ac expref: 17 pid: 9584 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746147207.749492:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311425408:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147207.749520:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425061e84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7be expref: 16 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.749528:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425061e84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7be expref: 16 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746147207.749536:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311425536:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147207.749552:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.749580:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19611 00000100:00100000:0.0:1746147207.749586:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+28:2001:x1830967310259712:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147207.749608:0:17600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425062021 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.749621:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425061f1e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e82e expref: 31 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.749629:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0e800/0x3139939425061fb8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8b3 expref: 28 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.749638:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f38e200/0x3139939425061f5d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e86d expref: 46 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.749646:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.749648:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.749650:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425062021 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.749680:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f38e200/0x3139939425061f5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e86d expref: 46 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.749689:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f38e200/0x3139939425061f5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e86d expref: 46 pid: 1398 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746147207.749701:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311425664:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147207.749743:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0e800/0x3139939425061fb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8b3 expref: 28 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.749752:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0e800/0x3139939425061fb8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8b3 expref: 28 pid: 12201 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746147207.749760:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311425792:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147207.749783:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425061f1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e82e expref: 31 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.749791:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425061f1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e82e expref: 31 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746147207.749805:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311425920:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147207.749822:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095affd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.749841:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19612 00000100:00100000:0.0:1746147207.749847:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e21ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+28:2000:x1830967310259840:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147207.749865:0:1136:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9400/0x3139939425062028 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.749875:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x3139939425061f64 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e874 expref: 31 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.749883:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5797800/0x3139939425061fbf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8ba expref: 28 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.749891:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425061f6b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e87b expref: 46 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.749897:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.749898:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.749900:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9400/0x3139939425062028 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.749914:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425061f6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e87b expref: 46 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.749923:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425061f6b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e87b expref: 46 pid: 1398 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746147207.749932:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311426048:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147207.749954:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5797800/0x3139939425061fbf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8ba expref: 28 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147207.749962:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5797800/0x3139939425061fbf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8ba expref: 28 pid: 1398 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746147207.749970:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311426176:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147207.749986:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x3139939425061f64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e874 expref: 31 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.749993:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x3139939425061f64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e874 expref: 31 pid: 1398 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746147207.750000:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311426304:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147207.750008:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147207.750235:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19613 00000100:00100000:1.0:1746147207.750244:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310259968:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147207.750263:0:1853:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800984ee800/0x313993942506202f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.750273:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38fe00/0x3139939425061f80 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e890 expref: 27 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.750281:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0fc00/0x3139939425061fc6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8c1 expref: 17 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.750286:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.750287:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.750289:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ee800/0x313993942506202f lrc: 5/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.750318:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0fc00/0x3139939425061fc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8c1 expref: 17 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.750326:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da0fc00/0x3139939425061fc6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8c1 expref: 17 pid: 9584 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.750340:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095124000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311426432:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147207.750384:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38fe00/0x3139939425061f80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e890 expref: 27 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.750392:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f38fe00/0x3139939425061f80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e890 expref: 27 pid: 12201 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.750399:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095124380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311426560:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147207.750413:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147207.750431:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19614 00000100:00100000:1.0:1746147207.750436:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310260096:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147207.750452:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800984ef400/0x3139939425062036 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.750462:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425061f87 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e897 expref: 16 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.750469:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425061fdb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8d6 expref: 27 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.750476:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a1fa00/0x3139939425061fcd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8c8 expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.750481:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.750483:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.750485:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ef400/0x3139939425062036 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.750498:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a1fa00/0x3139939425061fcd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8c8 expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.750506:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a1fa00/0x3139939425061fcd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8c8 expref: 17 pid: 12225 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.750514:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095124700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311426688:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147207.750534:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425061fdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8d6 expref: 27 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.750541:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425061fdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8d6 expref: 27 pid: 1853 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.750548:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095124a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311426816:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147207.750567:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425061f87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e897 expref: 16 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.750575:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425061f87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e897 expref: 16 pid: 9584 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.750582:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095124e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311426944:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147207.750594:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147207.750725:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19615 00000100:00100000:3.0:1746147207.750734:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+28:2001:x1830967310260224:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147207.750750:0:10340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x313993942506203d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.750761:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425061faa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8a5 expref: 31 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.750768:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a1e600/0x3139939425061fe2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8dd expref: 46 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.750775:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0fa00/0x3139939425061fd4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8cf expref: 28 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.750779:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.750781:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.750783:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x313993942506203d lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.750798:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0fa00/0x3139939425061fd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8cf expref: 28 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.750806:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0fa00/0x3139939425061fd4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8cf expref: 28 pid: 9584 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746147207.750814:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311427072:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.750846:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a1e600/0x3139939425061fe2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8dd expref: 46 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.750853:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a1e600/0x3139939425061fe2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8dd expref: 46 pid: 1853 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746147207.750860:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311427200:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.750878:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425061faa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8a5 expref: 31 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.750885:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425061faa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8a5 expref: 31 pid: 9584 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.750893:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311427328:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.750905:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147207.751009:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310258560:12345-192.168.204.25@tcp:3:cat.0 Request processed in 22867us (23335us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147207.751018:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7193 00002000:00100000:3.0:1746147207.751027:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800933f4700 x1830967310258560/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.751036:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f4700 with x1830967310258560 ext(3145728->4194303) 00010000:00010000:3.0:1746147207.751042:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425061f87 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e897 expref: 15 pid: 9584 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.751050:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425061f87 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e897 expref: 15 pid: 9584 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746147207.751057:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800933f4700 00000100:00100000:1.0:1746147207.761011:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.761229:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311425536:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.761241:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311425408:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147207.761492:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311425664:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147207.761561:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.761610:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.761666:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095124000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311426432:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147207.761693:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095124380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311426560:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147207.761730:0:1853:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800984ee800/0x313993942506202f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.761773:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095124700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311426688:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147207.761790:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.761809:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.762943:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.762963:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310260480 00000100:00100000:1.0:1746147207.762971:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310260480 00010000:00010000:1.0:1746147207.763005:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0f600/0x3139939425061fb1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8ac expref: 18 pid: 9584 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.763025:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310260352 00000100:00100000:1.0:1746147207.763032:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310260352 00010000:00010000:1.0:1746147207.763043:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425061e84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7be expref: 15 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.763052:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310260736 00000100:00100000:1.0:1746147207.763054:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310260736 00000100:00100000:2.0:1746147207.763058:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310260864 00000100:00100000:2.0:1746147207.763063:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310260864 00010000:00010000:1.0:1746147207.763065:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38e200/0x3139939425061f5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e86d expref: 47 pid: 1398 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.763074:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310261120 00000100:00100000:1.0:1746147207.763077:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310261120 00010000:00010000:2.0:1746147207.763079:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425061ee6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7f6 expref: 28 pid: 12225 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.763100:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5797800/0x3139939425061fbf lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8ba expref: 29 pid: 1398 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746147207.763103:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310261504 00000100:00100000:2.0:1746147207.763105:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310261504 00000100:00100000:1.0:1746147207.763113:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8889 00010000:00010000:2.0:1746147207.763114:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a1fa00/0x3139939425061fcd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8c8 expref: 19 pid: 12225 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.763120:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310260480:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147207.763124:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8890 00000100:00100000:2.0:1746147207.763129:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2001:x1830967310260352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.763132:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.763138:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.763152:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425061e84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7be expref: 15 pid: 13712 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.763156:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0f600/0x3139939425061fb1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8ac expref: 19 pid: 9584 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746147207.763161:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425061e84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7be expref: 15 pid: 13712 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.763168:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0f600/0x3139939425061fb1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8ac expref: 19 pid: 9584 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746147207.763256:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8891 00000100:00100000:0.0:1746147207.763263:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2001:x1830967310260736:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147207.763272:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147207.763285:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f38e200/0x3139939425061f5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e86d expref: 47 pid: 1398 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.763304:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f38e200/0x3139939425061f5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e86d expref: 47 pid: 1398 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.763324:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38e200/0x3139939425061f5d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e86d expref: 47 pid: 1398 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.763344:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147207.763381:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967310260736:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 118us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.763387:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8891 00000100:00100000:0.0:1746147207.763403:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8892 00000100:00100000:0.0:1746147207.763407:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967310260864:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147207.763413:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147207.763476:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8893 00000100:00100000:3.0:1746147207.763488:0:7227:0:(service.c:3346:ptlrpc_start_thread()) ldlm_canceld[0] started 6 min 3 max 56 00000100:00100000:3.0:1746147207.763496:0:7227:0:(service.c:3405:ptlrpc_start_thread()) starting thread 'ldlm_cn00_006' 00000100:00100000:3.0:1746147207.763528:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+29:2003:x1830967310261120:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.763536:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.763546:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5797800/0x3139939425061fbf lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8ba expref: 29 pid: 1398 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.763554:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5797800/0x3139939425061fbf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8ba expref: 29 pid: 1398 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.763566:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147207.763581:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+29:2003:x1830967310261120:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 99us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.763587:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8893 00000100:00100000:3.0:1746147207.763597:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8894 00000100:00100000:3.0:1746147207.763601:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2003:x1830967310261504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.763607:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.763615:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a1fa00/0x3139939425061fcd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8c8 expref: 19 pid: 12225 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.763623:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a1fa00/0x3139939425061fcd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8c8 expref: 19 pid: 12225 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.763635:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a1fa00/0x3139939425061fcd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8c8 expref: 19 pid: 12225 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.763647:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147207.763664:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2003:x1830967310261504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 62us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.763669:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8894 00000100:00100000:3.0:1746147207.763706:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099012a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311425280:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147207.764248:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0f600/0x3139939425061fb1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8ac expref: 17 pid: 9584 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.764263:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147207.764273:0:13695:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800958e0400/0x313993942506201a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.764284:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310260480:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1165us (3285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.764290:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8889 00000100:00100000:1.0:1746147207.764327:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.764340:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310260608 00000100:00100000:1.0:1746147207.764343:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310260608 00010000:00010000:2.0:1746147207.764348:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x3139939425061e84 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7be expref: 15 pid: 13712 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.764355:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0e800/0x3139939425061fb8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8b3 expref: 29 pid: 12201 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746147207.764365:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147207.764378:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8895 00000100:00100000:1.0:1746147207.764383:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+29:2003:x1830967310260608:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147207.764386:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310260352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1256us (2825us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147207.764391:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147207.764393:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8890 00010000:00010000:1.0:1746147207.764399:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0e800/0x3139939425061fb8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8b3 expref: 29 pid: 12201 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.764407:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0e800/0x3139939425061fb8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8b3 expref: 29 pid: 12201 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.764416:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147207.764429:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+29:2003:x1830967310260608:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 46us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.764435:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8895 00000100:00100000:1.0:1746147207.764520:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.764575:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310261248 00000100:00100000:3.0:1746147207.764580:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310261248 00000100:00100000:1.0:1746147207.764586:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147207.764595:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0fc00/0x3139939425061fc6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8c1 expref: 16 pid: 9584 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.764603:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310260992 00000100:00100000:1.0:1746147207.764606:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310260992 00010000:00010000:1.0:1746147207.764623:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425061f1e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e82e expref: 32 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.764630:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8896 00000100:00100000:3.0:1746147207.764636:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310261248:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.764643:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147207.764646:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8897 00010000:00010000:3.0:1746147207.764652:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0fc00/0x3139939425061fc6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8c1 expref: 16 pid: 9584 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.764653:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2003:x1830967310260992:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.764660:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0fc00/0x3139939425061fc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8c1 expref: 16 pid: 9584 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.764663:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.764671:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0fc00/0x3139939425061fc6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8c1 expref: 16 pid: 9584 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.764674:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425061f1e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e82e expref: 32 pid: 13712 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.764679:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147207.764682:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425061f1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e82e expref: 32 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.764693:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310261248:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 58us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.764699:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8896 00010000:00010000:1.0:1746147207.764704:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.764706:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.764725:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425062021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.764734:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425062021 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.764749:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147207.764765:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2003:x1830967310260992:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 113us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.764770:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8897 00000100:00100000:1.0:1746147207.764805:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.764846:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095124a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311426816:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147207.764870:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.764877:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310261376 00000100:00100000:2.0:1746147207.764881:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310261376 00010000:00010000:2.0:1746147207.764896:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425061f6b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e87b expref: 46 pid: 1398 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.764898:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095124e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311426944:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.764911:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310261632 00000100:00100000:2.0:1746147207.764913:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310261632 00010000:00010000:1.0:1746147207.764916:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800984ef400/0x3139939425062036 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.764921:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x3139939425061f64 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e874 expref: 32 pid: 1398 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.764932:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8898 00000100:00100000:2.0:1746147207.764937:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2003:x1830967310261376:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.764943:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.764951:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425061f6b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e87b expref: 46 pid: 1398 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.764959:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425061f6b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e87b expref: 46 pid: 1398 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.765016:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.765181:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2002:x1830967310259456:12345-192.168.204.25@tcp:3:cat.0 Request processed in 28517us (28842us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147207.765189:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7195 00002000:00100000:1.0:1746147207.765197:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88012ca11500 x1830967310259456/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.765211:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca11500 with x1830967310259456 ext(2097152->4194303) 00010000:00010000:1.0:1746147207.765217:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a1e600/0x3139939425061fe2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8dd expref: 45 pid: 1853 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.765226:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a1e600/0x3139939425061fe2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8dd expref: 45 pid: 1853 timeout: 845 lvb_type: 1 00002000:00010000:1.0:1746147207.765232:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ca11500 00000100:00100000:1.0:1746147207.765265:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147207.765273:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425061ee6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7f6 expref: 28 pid: 12225 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.765278:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310261760 00000100:00100000:1.0:1746147207.765281:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310261760 00010000:00010000:0.0:1746147207.765284:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425061ee6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7f6 expref: 28 pid: 12225 timeout: 845 lvb_type: 1 00010000:00010000:1.0:1746147207.765290:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0fa00/0x3139939425061fd4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8cf expref: 29 pid: 9584 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.765297:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d98200/0x3139939425061ee6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7f6 expref: 28 pid: 12225 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.765300:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310261888 00000100:00100000:1.0:1746147207.765301:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310261888 00010000:00010000:0.0:1746147207.765305:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.765307:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.765309:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38fe00/0x3139939425061f80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e890 expref: 28 pid: 12201 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.765310:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e0400/0x313993942506201a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.765317:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8899 00010000:00010000:0.0:1746147207.765317:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e0400/0x313993942506201a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.765321:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2003:x1830967310261632:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.765327:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147207.765331:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147207.765460:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147207.765463:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x3139939425061f64 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e874 expref: 32 pid: 1398 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.765472:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x3139939425061f64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e874 expref: 32 pid: 1398 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.765483:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.765484:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.765487:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9400/0x3139939425062028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.765493:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9400/0x3139939425062028 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.765501:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147207.765504:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311427072:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.765514:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311427200:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.765522:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311427328:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.765825:0:10340:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x313993942506203d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.765845:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8900 00000100:00100000:3.0:1746147207.765852:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+29:2003:x1830967310261760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.765860:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.765868:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0fa00/0x3139939425061fd4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8cf expref: 29 pid: 9584 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.765876:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0fa00/0x3139939425061fd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8cf expref: 29 pid: 9584 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.765888:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0fa00/0x3139939425061fd4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8cf expref: 29 pid: 9584 timeout: 845 lvb_type: 1 00010000:00010000:3.0:1746147207.765896:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.765982:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2003:x1830967310261376:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1044us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.765982:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967310260864:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2574us (4190us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.765988:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8898 00000100:00100000:0.0:1746147207.765991:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8892 00000100:00100000:2.0:1746147207.766000:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8901 00000100:00100000:2.0:1746147207.766005:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310261888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.766010:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.766018:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f38fe00/0x3139939425061f80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e890 expref: 27 pid: 12201 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.766025:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f38fe00/0x3139939425061f80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e890 expref: 27 pid: 12201 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.766035:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38fe00/0x3139939425061f80 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e890 expref: 27 pid: 12201 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746147207.766042:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800940c5600/0x3139939425061f6b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e87b expref: 43 pid: 1398 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.766043:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.766044:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.766047:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984ee800/0x313993942506202f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.766051:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311426048:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.766053:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ee800/0x313993942506202f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.766060:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5797800/0x3139939425061fbf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8ba expref: 28 pid: 1398 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746147207.766067:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311426176:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.766068:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147207.766076:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38e600/0x3139939425061f64 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e874 expref: 32 pid: 1398 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.766078:0:1853:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800984ee800/0x313993942506202f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.766083:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311426304:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.766085:0:1853:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984ee800/0x313993942506202f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.766112:0:1853:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800984ee800/0x313993942506202f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.766112:0:1136:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9400/0x3139939425062028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.766118:0:1136:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9400/0x3139939425062028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.766124:0:1853:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ee800/0x313993942506202f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.766128:0:1136:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9400/0x3139939425062028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.766131:0:1853:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800984ee800/0x313993942506202f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.766136:0:1853:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984ee800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147207.766138:0:1136:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9400/0x3139939425062028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.766140:0:1853:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984ee800/0x313993942506202f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.766142:0:1136:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9400/0x3139939425062028 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.766147:0:1853:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984ee800/0x313993942506202f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.766148:0:1136:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9400/0x3139939425062028 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.766153:0:1136:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2e9400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147207.766155:0:1136:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9400/0x3139939425062028 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.766156:0:1853:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800984ee800/0x313993942506202f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.766159:0:1136:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9400/0x3139939425062028 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.766162:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984ee800/0x313993942506202f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.766166:0:1136:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9400/0x3139939425062028 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.766172:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9400/0x3139939425062028 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.766197:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310259968:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 15954us (17183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.766197:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e21ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+27:2000:x1830967310259840:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 16350us (17210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.766204:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19613 00000100:00100000:2.0:1746147207.766228:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310261888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 223us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.766233:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8901 00010000:00010000:2.0:1746147207.766253:0:13695:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800958e0400/0x313993942506201a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.766260:0:13695:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e0400/0x313993942506201a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.766271:0:13695:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800958e0400/0x313993942506201a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.766277:0:13695:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e0400/0x313993942506201a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.766284:0:13695:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800958e0400/0x313993942506201a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.766288:0:13695:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958e0400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147207.766291:0:13695:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800958e0400/0x313993942506201a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.766297:0:13695:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800958e0400/0x313993942506201a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.766305:0:13695:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800958e0400/0x313993942506201a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.766311:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e0400/0x313993942506201a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.766331:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2003:x1830967310261632:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1008us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.766338:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310259584:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 17137us (17437us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.766338:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8899 00000100:00100000:1.0:1746147207.766384:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.766394:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310262016 00000100:00100000:1.0:1746147207.766398:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310262016 00010000:00010000:1.0:1746147207.766409:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425061faa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8a5 expref: 31 pid: 9584 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.766423:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8902 00000100:00100000:1.0:1746147207.766428:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2001:x1830967310262016:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.766434:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147207.766441:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425061faa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8a5 expref: 31 pid: 9584 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.766448:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425061faa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8a5 expref: 31 pid: 9584 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.766464:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425061faa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8a5 expref: 31 pid: 9584 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.766472:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147207.766486:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2001:x1830967310262016:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 58us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.766490:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8902 00000100:00100000:1.0:1746147207.766575:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.766737:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+27:2003:x1830967310261760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 885us (1722us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.766743:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8900 00010000:00010000:1.0:1746147207.767389:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0e800/0x3139939425061fb8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8b3 expref: 26 pid: 12201 timeout: 845 lvb_type: 1 00000100:00100000:1.0:1746147207.767399:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311425792:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147207.767410:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091e30600/0x3139939425061f1e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e82e expref: 29 pid: 13712 timeout: 845 lvb_type: 0 00000100:00100000:1.0:1746147207.767418:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311425920:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147207.767433:0:17600:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425062021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.767439:0:17600:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425062021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.767444:0:17600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425062021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.767459:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19612 00010000:00010000:1.0:1746147207.767461:0:17600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425062021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.767467:0:17600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425062021 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.767473:0:17600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425062021 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.767473:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310262144 00000100:00100000:0.0:1746147207.767475:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310262144 00010000:00010000:1.0:1746147207.767478:0:17600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958e1400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147207.767481:0:17600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425062021 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.767487:0:17600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425062021 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.767492:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19616 00000100:00100000:0.0:1746147207.767496:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2736:x1830967310262144:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147207.767497:0:17600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425062021 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.767502:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425062021 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.767511:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147207.767522:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425062044 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e8f9 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.767534:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147207.767535:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2001:x1830967310259712:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 17949us (18580us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147207.767538:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x313993942506203d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.767540:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19611 00010000:00010000:0.0:1746147207.767543:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147207.767546:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425062044 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8f9 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.767556:0:1136:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x313993942506203d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.767566:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425062044 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8f9 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.767568:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147207.767575:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4600, rc 0) 00000100:00100000:0.0:1746147207.767589:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2736:x1830967310262144:12345-192.168.204.25@tcp:101:cat.0 Request processed in 92us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.767594:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19616 00000100:00100000:2.0:1746147207.767723:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19610 00000100:00100000:2.0:1746147207.768586:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2002:x1830967310259328:12345-192.168.204.25@tcp:3:cat.0 Request processed in 32100us (32306us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147207.768595:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7194 00002000:00100000:2.0:1746147207.768604:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88012ca13800 x1830967310259328/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.768614:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca13800 with x1830967310259328 ext(2097152->4194303) 00010000:00010000:2.0:1746147207.768621:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425061fdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8d6 expref: 24 pid: 1853 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746147207.768632:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425061fdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8d6 expref: 24 pid: 1853 timeout: 845 lvb_type: 1 00002000:00010000:2.0:1746147207.768639:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ca13800 00000100:00100000:3.0:1746147207.768788:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310262272 00000100:00100000:3.0:1746147207.768793:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310262272 00010000:00010000:3.0:1746147207.768818:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425061f87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e897 expref: 14 pid: 9584 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.768847:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8903 00000100:00100000:3.0:1746147207.768852:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2002:x1830967310262272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.768861:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.768987:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425061f87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e897 expref: 14 pid: 9584 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.769001:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425061f87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e897 expref: 14 pid: 9584 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.769017:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425061f87 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e897 expref: 14 pid: 9584 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.769028:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147207.769244:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2002:x1830967310262272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 391us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.769250:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8903 00000100:00100000:1.0:1746147207.771909:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.771930:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310262400 00000100:00100000:2.0:1746147207.771938:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310262400 00010000:00010000:2.0:1746147207.771969:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a1e600/0x3139939425061fe2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8dd expref: 43 pid: 1853 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746147207.772006:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8904 00000100:00100000:2.0:1746147207.772013:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967310262400:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.772026:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.772045:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a1e600/0x3139939425061fe2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8dd expref: 43 pid: 1853 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746147207.772060:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a1e600/0x3139939425061fe2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8dd expref: 43 pid: 1853 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746147207.772081:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a1e600/0x3139939425061fe2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8dd expref: 43 pid: 1853 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746147207.772110:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.772112:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.772117:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x313993942506203d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.772126:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x313993942506203d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.772151:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.772199:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967310262400:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 186us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.772206:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8904 00010000:00010000:3.0:1746147207.772213:0:10340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x313993942506203d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.772227:0:10340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x313993942506203d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.772244:0:10340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x313993942506203d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.772252:0:10340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x313993942506203d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.772259:0:10340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x313993942506203d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.772265:0:10340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c79bc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147207.772270:0:10340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x313993942506203d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.772278:0:10340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x313993942506203d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.772286:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.772288:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.772293:0:10340:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425062044 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8f9 expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.772300:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425062044 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8f9 expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.772329:0:10340:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425062044 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8f9 expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.772349:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311427456:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147207.772420:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147207.774592:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.774639:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310262528 00000100:00100000:2.0:1746147207.774647:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310262528 00000100:00100000:2.0:1746147207.774704:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19617 00000100:00100000:2.0:1746147207.774724:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2735:x1830967310262528:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.774742:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.774759:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f01ac00/0x313993942506204b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e900 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.774790:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.774792:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.774797:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f01ac00/0x313993942506204b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e900 expref: 43 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.774810:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f01ac00/0x313993942506204b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e900 expref: 43 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.774819:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f01ac00, rc 0) 00000100:00100000:2.0:1746147207.774875:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2735:x1830967310262528:12345-192.168.204.25@tcp:101:cat.0 Request processed in 163us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.774882:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19617 00000100:00100000:3.0:1746147207.776039:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311427456:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147207.776067:0:10340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x313993942506203d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.776075:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c79bc00/0x313993942506203d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147207.776717:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2001:x1830967310260224:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 25971us (27664us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.776726:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19615 00000100:00100000:1.0:1746147207.777387:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.777487:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.777546:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310262784 00000100:00100000:2.0:1746147207.777553:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310262784 00002000:00100000:2.0:1746147207.777593:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff880095127800 x1830967310262784/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.777603:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095127800 with x1830967310262784 ext(3145728->4194303) 00002000:00010000:2.0:1746147207.777609:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095127800 00000100:00100000:2.0:1746147207.777634:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7196 00000100:00100000:2.0:1746147207.777641:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2001:x1830967310262784:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147207.778959:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310262912 00000100:00100000:0.0:1746147207.778965:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310262912 00010000:00010000:0.0:1746147207.778992:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425061fdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8d6 expref: 24 pid: 1853 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746147207.779018:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8905 00000100:00100000:0.0:1746147207.779023:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967310262912:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147207.779034:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147207.779053:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425061fdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8d6 expref: 24 pid: 1853 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.779064:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425061fdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8d6 expref: 24 pid: 1853 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.779086:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b80600/0x3139939425061fdb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8d6 expref: 24 pid: 1853 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.779127:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.779129:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.779134:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984ef400/0x3139939425062036 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.779143:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ef400/0x3139939425062036 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.779171:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147207.779206:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2003:x1830967310262912:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 182us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.779215:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8905 00010000:00010000:1.0:1746147207.779313:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800984ef400/0x3139939425062036 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.779322:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984ef400/0x3139939425062036 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.779339:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800984ef400/0x3139939425062036 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.779346:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ef400/0x3139939425062036 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.779356:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800984ef400/0x3139939425062036 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.779363:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984ef400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147207.779366:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984ef400/0x3139939425062036 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.779374:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984ef400/0x3139939425062036 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.779385:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800984ef400/0x3139939425062036 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.779396:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984ef400/0x3139939425062036 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.779451:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310260096:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 29013us (30422us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.779460:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19614 00000100:00100000:0.0:1746147207.780948:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.781005:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310263168 00000100:00100000:1.0:1746147207.781012:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310263168 00002000:00100000:1.0:1746147207.781050:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3145727) req@ffff880097eb9180 x1830967310263168/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.781058:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097eb9180 with x1830967310263168 ext(2097152->3145727) 00002000:00010000:1.0:1746147207.781063:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097eb9180 00000100:00100000:1.0:1746147207.781124:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7197 00000100:00100000:1.0:1746147207.781131:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967310263168:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147207.788027:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2001:x1830967310262784:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10372us (10627us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147207.788042:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7196 00002000:00100000:2.0:1746147207.788055:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff880095127800 x1830967310262784/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.788066:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095127800 with x1830967310262784 ext(3145728->4194303) 00002000:00010000:2.0:1746147207.788072:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095127800 00000100:00100000:3.0:1746147207.790985:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.791168:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310263424 00000100:00100000:2.0:1746147207.791179:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310263424 00000100:00100000:2.0:1746147207.791225:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16392 00000100:00100000:2.0:1746147207.791232:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2739:x1830967310263424:12345-192.168.204.25@tcp:36:mirror_io.0 00010000:00010000:2.0:1746147207.791285:0:6215:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.791314:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e000/0x3139939425062013 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8f2 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.791333:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.791337:0:6215:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147207.791366:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062052 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.791380:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7cc expref: 27 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.791386:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a466dc00/0x3139939425061eed lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7fd expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.791391:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062052 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.791422:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a466dc00/0x3139939425061eed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7fd expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.791432:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a466dc00/0x3139939425061eed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7fd expref: 8 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.791447:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311427584:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.791548:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7cc expref: 27 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.791556:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7cc expref: 27 pid: 6215 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.791563:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311427712:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.791583:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42e03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147207.791750:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2000:x1830967310263168:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10617us (10804us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147207.791760:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7197 00002000:00100000:1.0:1746147207.791768:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3145727) req@ffff880097eb9180 x1830967310263168/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.791776:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097eb9180 with x1830967310263168 ext(2097152->3145727) 00002000:00010000:1.0:1746147207.791780:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097eb9180 00000100:00100000:2.0:1746147207.792929:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311427712:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.793430:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311427584:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.793455:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062052 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147207.794771:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.795027:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.795231:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310263552 00000100:00100000:2.0:1746147207.795239:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310263552 00010000:00010000:2.0:1746147207.795277:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7cc expref: 28 pid: 6215 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.795316:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310263680 00000100:00100000:2.0:1746147207.795319:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310263680 00000100:00100000:1.0:1746147207.795363:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8906 00000100:00100000:1.0:1746147207.795373:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310263552:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.795389:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147207.795394:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7cc expref: 28 pid: 6215 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.795404:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7cc expref: 28 pid: 6215 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.795424:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32200/0x3139939425061ea7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7cc expref: 28 pid: 6215 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.795456:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a466dc00/0x3139939425061eed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7fd expref: 9 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.795470:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8907 00000100:00100000:2.0:1746147207.795473:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310263680:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.795479:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.795482:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a466dc00/0x3139939425061eed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7fd expref: 9 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.795489:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a466dc00/0x3139939425061eed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7fd expref: 9 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.795499:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a466dc00/0x3139939425061eed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e7fd expref: 9 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.795511:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.795516:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062052 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.795524:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062052 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.795530:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062052 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.795562:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147207.795577:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062052 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.795583:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062052 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000040:00080000:2.0:1746147207.795840:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1218, 88 off115040 00000004:00080000:2.0:1746147207.795846:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745785756122ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147207.795872:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1222, 88 off115392 00000004:00080000:2.0:1746147207.795875:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745785785823ns, next at 694367916532ns, rc = 0 00010000:00010000:1.0:1746147207.795960:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147207.795964:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:2.0:1746147207.796545:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1223, 88 off115480 00000004:00080000:2.0:1746147207.796550:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745786460414ns, next at 694367916532ns, rc = 0 00000100:00100000:1.0:1746147207.796563:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310263552:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1189us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.796570:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8906 00000100:00100000:0.0:1746147207.796967:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.796993:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310263808 00000100:00100000:0.0:1746147207.796998:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310263808 00000100:00100000:0.0:1746147207.797039:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16393 00000100:00100000:0.0:1746147207.797045:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2736:x1830967310263808:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147207.797066:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147207.797080:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425062059 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e907 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.797248:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000040:00080000:2.0:1746147207.797325:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1219, 88 off115128 00000004:00080000:2.0:1746147207.797331:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745787241309ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147207.797343:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1220, 88 off115216 00000004:00080000:2.0:1746147207.797345:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745787255925ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147207.797355:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1224, 88 off115568 00000004:00080000:2.0:1746147207.797358:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745787268545ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147207.797367:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1225, 88 off115656 00000004:00080000:2.0:1746147207.797370:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745787280624ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147207.797377:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1226, 88 off115744 00000004:00080000:2.0:1746147207.797379:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745787289670ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147207.797386:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1221, 88 off115304 00000004:00080000:2.0:1746147207.797388:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745787298842ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147207.797394:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1227, 88 off115832 00000004:00080000:2.0:1746147207.797396:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745787306923ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147207.797402:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1222, 88 off115392 00000004:00080000:2.0:1746147207.797405:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745787315300ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147207.797410:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1228, 88 off115920 00000004:00080000:2.0:1746147207.797413:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745787323124ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147207.797419:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1223, 88 off115480 00000004:00080000:2.0:1746147207.797421:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745787331745ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147207.797428:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1224, 88 off115568 00000004:00080000:2.0:1746147207.797430:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745787340634ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147207.797437:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1225, 88 off115656 00000004:00080000:2.0:1746147207.797439:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745787349365ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147207.797445:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1226, 88 off115744 00000004:00080000:2.0:1746147207.797448:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745787358422ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147207.797454:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1229, 88 off116008 00000004:00080000:2.0:1746147207.797456:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745787366260ns, next at 694367916532ns, rc = 0 00000100:00100000:2.0:1746147207.797553:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310263680:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2077us (2524us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.797560:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8907 00000100:00100000:1.0:1746147207.797645:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310263936 00000100:00100000:1.0:1746147207.797649:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310263936 00000100:00100000:1.0:1746147207.797679:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19618 00000100:00100000:1.0:1746147207.797685:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2735:x1830967310263936:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147207.797694:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147207.797720:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425062060 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e90e expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147207.797742:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4886560, mtime: 0x68141787, atime: 0x68141786, ctime: 0x68141787, blocks: 0x1558 00010000:00010000:1.0:1746147207.797763:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.797766:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.797779:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062052 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147207.797788:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425062059 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e907 expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.797804:0:9138:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062052 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147207.797817:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425062059 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e907 expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.797818:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425062060 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e90e expref: 24 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.797827:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147207.797829:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147207.797833:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425062060 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e90e expref: 24 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.797833:0:9138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425062059 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e907 expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.797837:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4400, rc 0) 00010000:00010000:1.0:1746147207.797841:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984eea00, rc 0) 00000100:00100000:0.0:1746147207.797862:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2736:x1830967310263808:12345-192.168.204.25@tcp:101:cat.0 Request processed in 817us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.797863:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2735:x1830967310263936:12345-192.168.204.25@tcp:101:cat.0 Request processed in 177us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.797867:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16393 00000100:00100000:1.0:1746147207.797868:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19618 00000100:00100000:2.0:1746147207.799790:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000001:00080000:3.0:1746147207.799796:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937276 is committed 00000004:00080000:3.0:1746147207.799804:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1206 committed 00000100:00100000:0.0:1746147207.799855:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310264064 00000100:00100000:0.0:1746147207.799863:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310264064 00000100:00100000:0.0:1746147207.799910:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16394 00000100:00100000:0.0:1746147207.799918:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2735:x1830967310264064:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147207.799938:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147207.799952:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x3139939425062067 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e915 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746147207.800002:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1206 committed 00000004:00080000:3.0:1746147207.800008:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1205 committed 00000004:00080000:3.0:1746147207.800009:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1204 committed 00000004:00080000:3.0:1746147207.800010:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1203 committed 00000004:00080000:3.0:1746147207.800011:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1205 committed 00000004:00080000:3.0:1746147207.800013:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1202 committed 00000004:00080000:3.0:1746147207.800015:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1204 committed 00000004:00080000:3.0:1746147207.800016:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1201 committed 00000004:00080000:3.0:1746147207.800018:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1203 committed 00000004:00080000:3.0:1746147207.800021:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1202 committed 00000004:00080000:3.0:1746147207.800022:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1201 committed 00000004:00080000:3.0:1746147207.800023:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1200 committed 00000004:00080000:3.0:1746147207.800025:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1199 committed 00000004:00080000:3.0:1746147207.800026:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1200 committed 00000004:00080000:3.0:1746147207.800027:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1199 committed 00000004:00080000:3.0:1746147207.800028:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1198 committed 00000001:00080000:3.0:1746147207.800034:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937273 is committed 00000001:00080000:3.0:1746147207.800037:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937272 is committed 00000100:00100000:0.0:1746147207.800209:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311428096:0@lo:2:osp-syn-1-0.0 00000004:00010000:2.0:1746147207.800217:0:6215:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800769d8a80 reply state ffff88009843fc00 transno 8589937276 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062052 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.800231:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062052 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00000100:00100000:1.0:1746147207.800231:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311427840:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746147207.800239:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.800241:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147207.800245:0:6215:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425062059 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e907 expref: 7 pid: 9138 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.800251:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746147207.800253:0:6215:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425062059 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e907 expref: 7 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.800258:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425062059 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e907 expref: 7 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.800277:0:6215:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425062059 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e907 expref: 7 pid: 9138 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.800277:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311428608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147207.800278:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.800285:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311429888:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147207.800296:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147207.800348:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311428096 00000100:00100000:3.0:1746147207.800352:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311428096 00000100:00100000:3.0:1746147207.800372:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311427840 00000100:00100000:3.0:1746147207.800374:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311427840 00000100:00100000:3.0:1746147207.800385:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311428608 00000100:00100000:3.0:1746147207.800387:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311428608 00000100:00100000:3.0:1746147207.800397:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19619 00000100:00100000:0.0:1746147207.800397:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311428224:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147207.800401:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:3764:x1830967311428096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.800407:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19620 00000100:00100000:2.0:1746147207.800414:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3766:x1830967311427840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.800421:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746147207.800449:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x3139939425062067 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e915 expref: 27 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.800460:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x3139939425062067 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e915 expref: 27 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.800484:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147207.800486:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147207.800488:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff5800, rc 0) 00000100:00100000:2.0:1746147207.800520:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3766:x1830967311427840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (242us total) trans 21474842561 rc 0/0 00000100:00100000:2.0:1746147207.800526:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19620 00000100:00100000:3.0:1746147207.800528:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+78:3764:x1830967311428096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 126us (277us total) trans 17179875178 rc 0/0 00000100:00100000:3.0:1746147207.800534:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19619 00000100:00100000:2.0:1746147207.800539:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311428224 00000100:00100000:2.0:1746147207.800541:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311428224 00000100:00100000:3.0:1746147207.800544:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19621 00000100:00100000:3.0:1746147207.800548:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3764:x1830967311428608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147207.800556:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19622 00000100:00100000:2.0:1746147207.800560:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3765:x1830967311428224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147207.800607:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+43:3764:x1830967311428608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (309us total) trans 21474842562 rc 0/0 00000100:00100000:3.0:1746147207.800612:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19621 00000100:00100000:2.0:1746147207.800622:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3765:x1830967311428224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (205us total) trans 21474842563 rc 0/0 00000100:00100000:2.0:1746147207.800627:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19622 00000004:00080000:1.0:1746147207.800703:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800933f5880/2, rc 0, transno 21474842561 00000100:00100000:1.0:1746147207.800728:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311427840:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147207.800735:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311428352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147207.800757:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.800772:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311428864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147207.800787:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.800798:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311429376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.800814:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.800831:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746147207.800836:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311427968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.800849:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.800857:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311428480:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147207.800870:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.800879:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311428992:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147207.800892:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.800901:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311429504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.800930:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.800967:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311428352 00000100:00100000:0.0:1746147207.800967:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2735:x1830967310264064:12345-192.168.204.25@tcp:101:cat.0 Request processed in 595us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.800971:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311428352 00000100:00100000:0.0:1746147207.800974:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16394 00000100:00100000:1.0:1746147207.800997:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311428864 00000100:00100000:1.0:1746147207.801000:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311428864 00000100:00100000:1.0:1746147207.801011:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311429376 00000004:00080000:0.0:1746147207.801011:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800933f6300/2, rc 0, transno 21474842562 00000100:00100000:1.0:1746147207.801012:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311429376 00000100:00100000:0.0:1746147207.801016:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311428608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.801023:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311429120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.801044:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147207.801064:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311429632:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.801076:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311427968 00000100:00100000:0.0:1746147207.801076:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.801079:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311427968 00000100:00100000:3.0:1746147207.801082:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311428480 00000100:00100000:3.0:1746147207.801086:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311428480 00000004:00080000:0.0:1746147207.801103:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095124a80/2, rc 0, transno 17179875178 00000100:00100000:0.0:1746147207.801106:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311428096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.801108:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311428992 00000100:00100000:2.0:1746147207.801111:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311428992 00000100:00100000:3.0:1746147207.801114:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311429504 00000100:00100000:3.0:1746147207.801116:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311429504 00000100:00100000:2.0:1746147207.801119:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311429120 00000100:00100000:2.0:1746147207.801120:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311429120 00000100:00100000:3.0:1746147207.801123:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311429632 00000004:00080000:0.0:1746147207.801124:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800933f5500/2, rc 0, transno 21474842563 00000100:00100000:3.0:1746147207.801125:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311429632 00000100:00100000:0.0:1746147207.801127:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311428224:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147207.801133:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19623 00000100:00100000:3.0:1746147207.801138:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3766:x1830967311428352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147207.801141:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19624 00000100:00100000:2.0:1746147207.801147:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3766:x1830967311428864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147207.801187:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:3.0:1746147207.801189:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00002000:00010000:3.0:1746147207.801191:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:3.0:1746147207.801193:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00002000:00010000:3.0:1746147207.801194:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00002000:00010000:2.0:1746147207.801195:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147207.801197:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147207.801199:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147207.801201:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147207.801202:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:3.0:1746147207.801217:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3766:x1830967311428352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (459us total) trans 21474842564 rc 0/0 00000100:00100000:3.0:1746147207.801221:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19623 00000100:00100000:2.0:1746147207.801225:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+47:3766:x1830967311428864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (436us total) trans 21474842565 rc 0/0 00000100:00100000:2.0:1746147207.801230:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19624 00000100:00100000:3.0:1746147207.801234:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19625 00000100:00100000:3.0:1746147207.801238:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+82:3766:x1830967311429376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.801241:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19626 00000100:00100000:2.0:1746147207.801245:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+82:3766:x1830967311427968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147207.801296:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+83:3766:x1830967311429376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (480us total) trans 17179875179 rc 0/0 00000100:00100000:3.0:1746147207.801300:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19625 00000100:00100000:3.0:1746147207.801308:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19627 00000100:00100000:3.0:1746147207.801311:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3766:x1830967311428480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147207.801346:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746147207.801348:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147207.801350:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147207.801351:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147207.801353:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:3.0:1746147207.801368:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+46:3766:x1830967311428480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (497us total) trans 21474842566 rc 0/0 00000100:00100000:3.0:1746147207.801373:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19627 00000100:00100000:3.0:1746147207.801380:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19628 00000100:00100000:3.0:1746147207.801384:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3766:x1830967311428992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147207.801419:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:3.0:1746147207.801421:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147207.801423:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1746147207.801423:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311428736:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147207.801424:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147207.801426:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:0.0:1746147207.801441:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147207.801443:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+46:3766:x1830967311428992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (550us total) trans 21474842567 rc 0/0 00000100:00100000:3.0:1746147207.801447:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19628 00000100:00100000:0.0:1746147207.801450:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311429248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147207.801454:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311428736 00000100:00100000:3.0:1746147207.801457:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311428736 00000100:00100000:0.0:1746147207.801462:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147207.801464:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311429248 00000100:00100000:3.0:1746147207.801466:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311429248 00000100:00100000:0.0:1746147207.801468:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311429760:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147207.801472:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19629 00000100:00100000:3.0:1746147207.801476:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+84:3766:x1830967311429504:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147207.801510:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:3.0:1746147207.801513:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147207.801514:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147207.801516:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147207.801517:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:0.0:1746147207.801585:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.801748:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:3766:x1830967311427968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 502us (897us total) trans 17179875180 rc 0/0 00000100:00100000:2.0:1746147207.801754:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19626 00000100:00100000:2.0:1746147207.801763:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311429760 00000100:00100000:2.0:1746147207.801767:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311429760 00000100:00100000:2.0:1746147207.801777:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19630 00000100:00100000:2.0:1746147207.801780:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:3764:x1830967311429120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147207.801822:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147207.801824:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00002000:00010000:2.0:1746147207.801826:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:2.0:1746147207.801828:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00002000:00010000:2.0:1746147207.801829:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746147207.801851:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+86:3764:x1830967311429120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (806us total) trans 17179875182 rc 0/0 00000100:00100000:2.0:1746147207.801856:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19630 00000100:00100000:2.0:1746147207.801864:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19631 00000100:00100000:2.0:1746147207.801868:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:3764:x1830967311429632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147207.801877:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+85:3766:x1830967311429504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 399us (945us total) trans 17179875181 rc 0/0 00000100:00100000:3.0:1746147207.801882:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19629 00000100:00100000:3.0:1746147207.801897:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19632 00000100:00100000:3.0:1746147207.801902:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+46:3765:x1830967311428736:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147207.801909:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095126d80/2, rc 0, transno 17179875182 00000100:00100000:0.0:1746147207.801913:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311429120:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.801916:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:3764:x1830967311429632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (838us total) trans 17179875183 rc 0/0 00000100:00100000:2.0:1746147207.801921:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19631 00000004:00080000:0.0:1746147207.801921:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095125c00/2, rc 0, transno 17179875183 00000100:00100000:0.0:1746147207.801924:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311429632:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.801929:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19633 00000100:00100000:3.0:1746147207.801953:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3765:x1830967311428736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (511us total) trans 21474842568 rc 0/0 00000100:00100000:3.0:1746147207.801958:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19632 00000004:00080000:0.0:1746147207.801961:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800933f6680/2, rc 0, transno 21474842568 00000100:00100000:0.0:1746147207.801964:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311428736:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147207.801966:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19634 00000100:00100000:3.0:1746147207.801970:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+84:3765:x1830967311429760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.802065:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:3765:x1830967311429248:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147207.802120:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147207.802122:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147207.802124:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147207.802125:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147207.802127:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746147207.802321:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+86:3765:x1830967311429760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 349us (735us total) trans 17179875184 rc 0/0 00000100:00100000:3.0:1746147207.802326:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19634 00000100:00100000:3.0:1746147207.802362:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.802372:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:3765:x1830967311429248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 438us (908us total) trans 17179875185 rc 0/0 00000100:00100000:2.0:1746147207.802378:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19633 00000100:00100000:2.0:1746147207.802404:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746147207.802412:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311430016:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147207.802416:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095127100/2, rc 0, transno 17179875185 00000100:00100000:0.0:1746147207.802419:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311429248:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147207.802425:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095125f80/2, rc 0, transno 17179875184 00000100:00100000:0.0:1746147207.802428:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311429760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.802438:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746147207.802468:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095124e00/2, rc 0, transno 17179875180 00000100:00100000:2.0:1746147207.802472:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311427968:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147207.802479:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800933f4e00/2, rc 0, transno 21474842566 00000100:00100000:2.0:1746147207.802481:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311428480:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147207.802487:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800933f6a00/2, rc 0, transno 21474842567 00000100:00100000:2.0:1746147207.802490:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311428992:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147207.802495:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095124000/2, rc 0, transno 17179875181 00000100:00100000:2.0:1746147207.802497:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311429504:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147207.802504:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800933f5c00/2, rc 0, transno 21474842564 00000100:00100000:2.0:1746147207.802505:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311428352:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147207.802511:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800933f6d80/2, rc 0, transno 21474842565 00000100:00100000:2.0:1746147207.802513:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311428864:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147207.802520:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095127b80/2, rc 0, transno 17179875179 00000100:00100000:2.0:1746147207.802522:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311429376:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.802536:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311430016 00000100:00100000:2.0:1746147207.802538:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311430016 00000100:00100000:2.0:1746147207.802553:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19635 00000100:00100000:2.0:1746147207.802557:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+47:3767:x1830967311430016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147207.802627:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3767:x1830967311430016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (187us total) trans 21474842569 rc 0/0 00000100:00100000:2.0:1746147207.802632:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19635 00000004:00080000:3.0:1746147207.802759:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800933f7100/2, rc 0, transno 21474842569 00000100:00100000:3.0:1746147207.802763:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311430016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147207.803177:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311429888:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147207.803195:0:6215:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746147207.803198:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00080000:3.0:1746147207.803247:0:6215:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746147207.803256:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2739:x1830967310263424:12345-192.168.204.25@tcp:36:mirror_io.0 Request processed in 12024us (12283us total) trans 8589937276 rc 0/0 00000100:00100000:3.0:1746147207.803261:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16392 00000100:00100000:1.0:1746147207.803532:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310264192 00000100:00100000:1.0:1746147207.803540:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310264192 00000100:00100000:1.0:1746147207.803597:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6110 00000100:00100000:1.0:1746147207.803604:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2736:x1830967310264192:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:1.0:1746147207.803729:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2736:x1830967310264192:12345-192.168.204.25@tcp:49:cat.0 Request processed in 125us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.803735:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6110 00010000:00010000:1.0:1746147207.803760:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062052 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147207.803769:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062052 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147207.803776:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062052 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147207.803782:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f01a800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147207.803786:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062052 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147207.803792:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062052 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147207.803810:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147207.803813:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147207.803816:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062052 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147207.803821:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062052 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147207.805267:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147207.807520:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.807611:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310264320 00000100:00100000:3.0:1746147207.807624:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310264320 00000100:00100000:3.0:1746147207.807688:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16395 00000100:00100000:3.0:1746147207.807694:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2739:x1830967310264320:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147207.807743:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.807763:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a200/0x313993942506206e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e91c expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.807813:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a200/0x313993942506206e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e91c expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.807824:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a200/0x313993942506206e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e91c expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.807838:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147207.807841:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147207.807843:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f01a200, rc 0) 00000100:00100000:3.0:1746147207.807898:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2739:x1830967310264320:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 204us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.807903:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16395 00000100:00100000:0.0:1746147207.809879:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.810181:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310264448 00000100:00100000:2.0:1746147207.810191:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310264448 00000100:00100000:2.0:1746147207.810251:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19636 00000100:00100000:2.0:1746147207.810260:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2736:x1830967310264448:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.810277:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.810295:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d9bc00/0x3139939425062075 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e923 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.810319:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.810322:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.810329:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d9bc00/0x3139939425062075 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e923 expref: 14 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.810343:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d9bc00/0x3139939425062075 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e923 expref: 14 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.810353:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9bc00, rc 0) 00000100:00100000:2.0:1746147207.810410:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2736:x1830967310264448:12345-192.168.204.25@tcp:101:cat.0 Request processed in 150us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.810416:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19636 00000100:00100000:1.0:1746147207.811239:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.811275:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.811321:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310264832 00000100:00100000:0.0:1746147207.811325:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310264832 00002000:00100000:0.0:1746147207.811364:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88012bab4700 x1830967310264832/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147207.811373:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab4700 with x1830967310264832 ext(3145728->4194303) 00002000:00010000:0.0:1746147207.811377:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bab4700 00000100:00100000:3.0:1746147207.811392:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310264576 00000100:00100000:3.0:1746147207.811396:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310264576 00000100:00100000:1.0:1746147207.811583:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.811600:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16396 00000100:00100000:3.0:1746147207.811609:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2739:x1830967310264576:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147207.811622:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.811640:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400bc00/0x313993942506207c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e92a expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.811749:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062083 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.811764:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062083 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.811775:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062083 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147207.811808:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147207.811813:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147207.811831:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062083 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.811859:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400bc00/0x313993942506207c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e92a expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.811877:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062083 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e92a expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.811885:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147207.811887:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147207.811891:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400a600, rc 0) 00000100:00100000:0.0:1746147207.813874:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310265088 00000100:00100000:0.0:1746147207.813883:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310265088 00000100:00100000:3.0:1746147207.813889:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7198 00000100:00100000:3.0:1746147207.813900:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967310264832:12345-192.168.204.25@tcp:3:cat.0 00002000:00100000:0.0:1746147207.813918:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff88012bab4a80 x1830967310265088/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147207.813922:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:0.0:1746147207.813927:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab4a80 with x1830967310265088 ext(3145728->4194303) 00002000:00010000:0.0:1746147207.813931:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bab4a80 00000100:00100000:1.0:1746147207.813941:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310265216 00000100:00100000:1.0:1746147207.813944:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310265216 00000100:00100000:0.0:1746147207.813947:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7199 00000100:00100000:0.0:1746147207.813951:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2003:x1830967310265088:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147207.813967:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19637 00000100:00100000:1.0:1746147207.813972:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310265216:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147207.813980:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147207.813998:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x313993942506208a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e931 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147207.814013:0:13695:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x93:0x0] initial LVB size: 1048576, mtime: 0x68141787, atime: 0x68141786, ctime: 0x68141787, blocks: 0x7e8 00010000:00010000:1.0:1746147207.814029:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.814031:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.814038:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x313993942506208a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e931 expref: 15 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.814050:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x313993942506208a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e931 expref: 15 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.814060:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0800, rc 0) 00000100:00100000:1.0:1746147207.814111:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310265216:12345-192.168.204.25@tcp:101:cat.0 Request processed in 138us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.814116:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19637 00000100:00100000:1.0:1746147207.814147:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.814160:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310265344 00000100:00100000:1.0:1746147207.814163:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310265344 00000100:00100000:0.0:1746147207.814705:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.814726:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2739:x1830967310264576:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 3115us (3485us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.814732:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16396 00000100:00100000:1.0:1746147207.815481:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310265472 00000100:00100000:1.0:1746147207.815486:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310265472 00000100:00100000:1.0:1746147207.815513:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19638 00000100:00100000:1.0:1746147207.815519:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2000:x1830967310265344:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147207.815529:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147207.815544:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x3139939425062091 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e938 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147207.815560:0:13695:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x96:0x0] initial LVB size: 2097152, mtime: 0x68141787, atime: 0x68141786, ctime: 0x68141787, blocks: 0x808 00010000:00010000:1.0:1746147207.815574:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.815575:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.815580:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x3139939425062091 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e938 expref: 32 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.815592:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x3139939425062091 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e938 expref: 32 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.815600:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0400, rc 0) 00000100:00100000:3.0:1746147207.815974:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19639 00000100:00100000:3.0:1746147207.815982:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2000:x1830967310265472:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147207.815989:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.815999:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f01a800/0x3139939425062098 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e93f expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147207.816012:0:12201:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x97:0x0] initial LVB size: 2097152, mtime: 0x68141787, atime: 0x68141787, ctime: 0x68141787, blocks: 0x800 00010000:00010000:3.0:1746147207.816021:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.816023:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.816028:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f01a800/0x3139939425062098 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e93f expref: 33 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.816037:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f01a800/0x3139939425062098 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e93f expref: 33 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.816043:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f01a800, rc 0) 00000100:00100000:3.0:1746147207.816061:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2000:x1830967310265472:12345-192.168.204.25@tcp:101:cat.0 Request processed in 80us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.816066:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19639 00000100:00100000:2.0:1746147207.816316:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.816373:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310265600 00000100:00100000:3.0:1746147207.816377:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310265600 00000100:00100000:3.0:1746147207.816395:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19640 00000100:00100000:3.0:1746147207.816399:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310265600:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147207.816407:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.816418:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x313993942506209f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e946 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147207.816431:0:12225:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x68141787, atime: 0x68141787, ctime: 0x68141787, blocks: 0x808 00010000:00010000:3.0:1746147207.816439:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.816440:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.816444:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x313993942506209f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e946 expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.816453:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x313993942506209f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e946 expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.816459:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57a0e00, rc 0) 00000100:00100000:3.0:1746147207.816476:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310265600:12345-192.168.204.25@tcp:101:cat.0 Request processed in 77us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.816480:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19640 00000100:00100000:1.0:1746147207.816591:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2000:x1830967310265344:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1070us (2441us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.816598:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19638 00000100:00100000:0.0:1746147207.824645:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.826469:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310265856 00000100:00100000:2.0:1746147207.826482:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310265856 00002000:00100000:2.0:1746147207.826532:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880097eb8700 x1830967310265856/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.826542:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097eb8700 with x1830967310265856 ext(4194304->4890623) 00002000:00010000:2.0:1746147207.826548:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097eb8700 00000100:00100000:2.0:1746147207.826588:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7200 00000100:00100000:2.0:1746147207.826595:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310265856:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147207.828376:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2003:x1830967310265088:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14416us (16785us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147207.828387:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7199 00002000:00100000:2.0:1746147207.828395:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff88012bab4a80 x1830967310265088/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.828404:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab4a80 with x1830967310265088 ext(3145728->4194303) 00002000:00010000:2.0:1746147207.828410:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bab4a80 00000100:00100000:3.0:1746147207.831421:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967310264832:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17511us (20132us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147207.831432:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7198 00002000:00100000:3.0:1746147207.831443:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88012bab4700 x1830967310264832/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.831452:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab4700 with x1830967310264832 ext(3145728->4194303) 00002000:00010000:3.0:1746147207.831458:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bab4700 00000100:00100000:0.0:1746147207.832380:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.832411:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.832656:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310266112 00000100:00100000:0.0:1746147207.832662:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.832664:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310266112 00000100:00100000:2.0:1746147207.832770:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310266368 00000100:00100000:2.0:1746147207.832773:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310266368 00000100:00100000:0.0:1746147207.832779:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.832791:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310266624 00000100:00100000:2.0:1746147207.832793:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310266624 00000100:00100000:2.0:1746147207.832802:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310265984 00000100:00100000:2.0:1746147207.832804:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310265984 00000100:00100000:0.0:1746147207.832806:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.832973:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.833076:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310266240 00000100:00100000:2.0:1746147207.833078:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310266240 00000100:00100000:2.0:1746147207.833112:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310266496 00000100:00100000:2.0:1746147207.833116:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310266496 00000100:00100000:2.0:1746147207.833133:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19641 00000100:00100000:2.0:1746147207.833140:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+25:2000:x1830967310266112:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147207.833159:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.833178:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x31399394250620a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e954 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.833191:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310265856:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6595us (8561us total) trans 0 rc 696320/696320 00000100:00100000:0.0:1746147207.833198:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7200 00010000:00010000:2.0:1746147207.833201:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.833203:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:0.0:1746147207.833206:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880097eb8700 x1830967310265856/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746147207.833211:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x31399394250620a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e954 expref: 26 pid: 13695 timeout: 0 lvb_type: 1 00002000:00100000:0.0:1746147207.833214:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097eb8700 with x1830967310265856 ext(4194304->4890623) 00002000:00010000:0.0:1746147207.833219:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097eb8700 00010000:00010000:2.0:1746147207.833227:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x31399394250620a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e954 expref: 26 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.833238:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95c00, rc 0) 00000100:00100000:2.0:1746147207.833256:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+26:2000:x1830967310266112:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 118us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.833262:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19641 00000100:00100000:2.0:1746147207.833272:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19642 00000100:00100000:2.0:1746147207.833277:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310266368:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147207.833284:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.833294:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d94c00/0x31399394250620ad lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e962 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.833304:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.833306:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.833310:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94c00/0x31399394250620ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e962 expref: 15 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.833319:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d94c00/0x31399394250620ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e962 expref: 15 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.833325:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94c00, rc 0) 00000100:00100000:2.0:1746147207.833343:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310266368:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 66us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.833348:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19642 00000100:00100000:2.0:1746147207.833357:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19643 00000100:00100000:2.0:1746147207.833361:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+25:2000:x1830967310266624:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147207.833366:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.833373:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d95800/0x31399394250620b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e970 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.833384:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.833385:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.833390:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95800/0x31399394250620b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e970 expref: 26 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.833398:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d95800/0x31399394250620b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e970 expref: 26 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.833405:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95800, rc 0) 00000100:00100000:2.0:1746147207.833419:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+26:2000:x1830967310266624:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 57us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.833427:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19643 00000100:00100000:2.0:1746147207.833436:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19644 00000100:00100000:2.0:1746147207.833440:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310265984:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147207.833445:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.833452:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x31399394250620bb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e94d expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.833460:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.833462:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.833466:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x31399394250620bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e94d expref: 15 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.833474:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x31399394250620bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e94d expref: 15 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.833481:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94400, rc 0) 00000100:00100000:1.0:1746147207.833488:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19645 00000100:00100000:2.0:1746147207.833496:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310265984:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 56us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.833497:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+25:2000:x1830967310266240:12345-192.168.204.25@tcp:101:mirror_io.0 00000100:00100000:2.0:1746147207.833501:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19644 00010000:00010000:1.0:1746147207.833504:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147207.833511:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19646 00010000:00010000:1.0:1746147207.833512:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4c03800/0x31399394250620c2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e95b expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.833515:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310266496:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147207.833521:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147207.833524:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.833526:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.833527:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d95600/0x31399394250620c9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e969 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.833530:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4c03800/0x31399394250620c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e95b expref: 26 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.833536:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.833537:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147207.833539:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4c03800/0x31399394250620c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e95b expref: 26 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.833541:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95600/0x31399394250620c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e969 expref: 15 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147207.833545:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c03800, rc 0) 00010000:00010000:2.0:1746147207.833550:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d95600/0x31399394250620c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e969 expref: 15 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.833557:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95600, rc 0) 00000100:00100000:1.0:1746147207.833564:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+26:2000:x1830967310266240:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 69us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.833568:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19645 00000100:00100000:2.0:1746147207.833572:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310266496:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 57us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.833577:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19646 00000100:00100000:0.0:1746147207.835720:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.836187:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310266880 00000100:00100000:3.0:1746147207.836194:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310266880 00000100:00100000:3.0:1746147207.836240:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16397 00000100:00100000:3.0:1746147207.836248:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2742:x1830967310266880:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147207.836265:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.836285:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x31399394250620d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e977 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.836355:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee200/0x31399394250620d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.836368:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee200/0x31399394250620d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.836378:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee200/0x31399394250620d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.836390:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7200/0x31399394250620de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.836395:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7200/0x31399394250620de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.836399:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7200/0x31399394250620de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.836508:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6e00/0x31399394250620e5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.836519:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4e00/0x3139939425062005 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8eb expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.836526:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6e00/0x31399394250620e5 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.836561:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4e00/0x3139939425062005 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8eb expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.836574:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4e00/0x3139939425062005 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8eb expref: 8 pid: 6215 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.836586:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311430144:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.836688:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.837558:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.837587:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.837607:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.837629:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.837684:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310267008 00000100:00100000:2.0:1746147207.837689:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310267008 00000100:00100000:2.0:1746147207.837727:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310267136 00000100:00100000:2.0:1746147207.837729:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310267136 00000100:00100000:2.0:1746147207.837740:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310267392 00000100:00100000:2.0:1746147207.837742:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310267392 00000100:00100000:2.0:1746147207.837751:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310267264 00000100:00100000:2.0:1746147207.837752:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310267264 00000100:00100000:2.0:1746147207.837993:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19647 00000100:00100000:2.0:1746147207.838000:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310267008:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.838012:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.838029:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x31399394250620ec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e97e expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.838049:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.838051:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.838060:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x31399394250620ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e97e expref: 26 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.838080:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x31399394250620ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e97e expref: 26 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.838114:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95e00, rc 0) 00000100:00100000:2.0:1746147207.838149:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967310267008:12345-192.168.204.25@tcp:101:cat.0 Request processed in 149us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.838155:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19647 00000100:00100000:2.0:1746147207.838169:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19648 00000100:00100000:2.0:1746147207.838174:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2002:x1830967310267136:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.838181:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.838193:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x31399394250620f3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e985 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.838207:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.838208:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.838212:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x31399394250620f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e985 expref: 45 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.838222:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x31399394250620f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e985 expref: 45 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.838230:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95400, rc 0) 00000100:00100000:2.0:1746147207.838245:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2002:x1830967310267136:12345-192.168.204.25@tcp:101:cat.0 Request processed in 71us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.838251:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19648 00000100:00100000:2.0:1746147207.838261:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19649 00000100:00100000:2.0:1746147207.838266:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967310267392:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.838271:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.838278:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x31399394250620fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e993 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.838287:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.838289:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.838293:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x31399394250620fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e993 expref: 26 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.838302:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x31399394250620fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e993 expref: 26 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.838309:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94200, rc 0) 00000100:00100000:2.0:1746147207.838323:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310267392:12345-192.168.204.25@tcp:101:cat.0 Request processed in 57us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.838328:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19649 00000100:00100000:2.0:1746147207.838337:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19650 00000100:00100000:2.0:1746147207.838341:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2003:x1830967310267264:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.838347:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.838354:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425062101 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e98c expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.838363:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.838364:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.838368:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425062101 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e98c expref: 45 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.838376:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425062101 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e98c expref: 45 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147207.838383:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94800, rc 0) 00000100:00100000:2.0:1746147207.838397:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2003:x1830967310267264:12345-192.168.204.25@tcp:101:cat.0 Request processed in 56us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.838401:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19650 00000100:00100000:0.0:1746147207.843182:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.843294:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310267904 00000100:00100000:2.0:1746147207.843305:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310267904 00000100:00100000:2.0:1746147207.843361:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16398 00000100:00100000:2.0:1746147207.843369:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2743:x1830967310267904:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147207.843393:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.843414:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425062108 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e99a expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.843499:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x313993942506210f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.843513:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x313993942506210f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.843524:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x313993942506210f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.843536:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062116 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.843543:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.843548:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.843652:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x313993942506211d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.843662:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x313993942506211d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.843668:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x313993942506211d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:1.0:1746147207.844271:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.844508:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310267648 00000100:00100000:2.0:1746147207.844513:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310267648 00000100:00100000:2.0:1746147207.844560:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6111 00000100:00100000:2.0:1746147207.844565:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2736:x1830967310267648:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147207.844667:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311430144:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.844691:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6e00/0x31399394250620e5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:2.0:1746147207.844826:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2736:x1830967310267648:12345-192.168.204.25@tcp:35:cat.0 Request processed in 259us (556us total) trans 8589937277 rc 0/0 00000100:00100000:2.0:1746147207.844833:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6111 00000100:00100000:2.0:1746147207.844887:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.844909:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310268032 00000100:00100000:2.0:1746147207.844911:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310268032 00010000:00010000:2.0:1746147207.844927:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4e00/0x3139939425062005 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8eb expref: 9 pid: 6215 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.844958:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8908 00000100:00100000:2.0:1746147207.844964:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310268032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.844973:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.844979:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4e00/0x3139939425062005 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8eb expref: 9 pid: 6215 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.844990:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4e00/0x3139939425062005 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8eb expref: 9 pid: 6215 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.845173:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4e00/0x3139939425062005 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8eb expref: 9 pid: 6215 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.845187:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.845191:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6e00/0x31399394250620e5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.845199:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6e00/0x31399394250620e5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.845205:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6e00/0x31399394250620e5 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.845211:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x313993942506211d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.845216:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x313993942506211d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.845221:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x313993942506211d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.845250:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.845266:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967310268032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 302us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.845273:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8908 00010000:00010000:0.0:1746147207.845292:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x313993942506211d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845299:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x313993942506211d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:0.0:1746147207.845311:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147207.845362:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x313993942506211d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845369:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x313993942506211d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845374:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x313993942506211d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.845379:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6e00/0x31399394250620e5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147207.845380:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0d600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147207.845384:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x313993942506211d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147207.845385:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6e00/0x31399394250620e5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147207.845390:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x313993942506211d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147207.845395:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147207.845397:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147207.845400:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147207.845403:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x313993942506211d lrc: 2/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845407:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x313993942506211d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845438:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x313993942506210f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845443:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x313993942506210f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845448:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x313993942506210f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845456:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x313993942506210f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845461:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d94a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147207.845463:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x313993942506210f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845468:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x313993942506210f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845475:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147207.845478:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147207.845480:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x313993942506210f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845485:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x313993942506210f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845493:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845498:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062116 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845502:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062116 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845507:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098e6c000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147207.845508:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062116 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845513:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062116 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845522:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012dc2b000) 00010000:00010000:0.0:1746147207.845524:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147207.845526:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062116 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845529:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062116 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147207.845560:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425062108 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e99a expref: 11 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.845567:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x3139939425062108 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e99a expref: 11 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.845575:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95000, rc 0) 00010000:00010000:3.0:1746147207.845665:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6e00/0x31399394250620e5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845671:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6e00/0x31399394250620e5 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845675:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6e00/0x31399394250620e5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845679:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800936b6e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147207.845681:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6e00/0x31399394250620e5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845686:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6e00/0x31399394250620e5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845699:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147207.845701:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147207.845704:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6e00/0x31399394250620e5 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845718:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6e00/0x31399394250620e5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845734:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee200/0x31399394250620d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845739:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee200/0x31399394250620d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845743:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee200/0x31399394250620d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845747:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984ee200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147207.845749:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee200/0x31399394250620d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845753:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee200/0x31399394250620d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845759:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147207.845761:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147207.845763:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee200/0x31399394250620d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845767:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ee200/0x31399394250620d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845774:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7200/0x31399394250620de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845779:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7200/0x31399394250620de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845782:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7200/0x31399394250620de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845786:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800936b7200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147207.845788:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7200/0x31399394250620de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845793:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7200/0x31399394250620de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845798:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012dc2b000) 00010000:00010000:3.0:1746147207.845801:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147207.845803:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7200/0x31399394250620de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845807:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7200/0x31399394250620de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.845840:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x31399394250620d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e977 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.845846:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x31399394250620d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e977 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.845854:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f15f800, rc 0) 00000100:00100000:3.0:1746147207.846042:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2742:x1830967310266880:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 9794us (10340us total) trans 8589937279 rc 301/301 00000100:00100000:0.0:1746147207.846043:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2743:x1830967310267904:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2673us (2873us total) trans 8589937278 rc 301/301 00000100:00100000:3.0:1746147207.846049:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16397 00000100:00100000:0.0:1746147207.846057:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16398 00000100:00100000:0.0:1746147207.846903:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.846993:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310268288 00000100:00100000:2.0:1746147207.847000:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310268288 00002000:00100000:2.0:1746147207.847039:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88012e6e1c00 x1830967310268288/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.847050:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e6e1c00 with x1830967310268288 ext(4194304->4890623) 00002000:00010000:2.0:1746147207.847055:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e6e1c00 00000100:00100000:2.0:1746147207.847084:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7201 00000100:00100000:2.0:1746147207.847112:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310268288:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147207.857028:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310268288:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9927us (10117us total) trans 0 rc 696320/696320 00000100:00100000:3.0:1746147207.857041:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7201 00002000:00100000:3.0:1746147207.857053:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88012e6e1c00 x1830967310268288/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/440 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.857063:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e6e1c00 with x1830967310268288 ext(4194304->4890623) 00002000:00010000:3.0:1746147207.857070:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e6e1c00 00000100:00100000:0.0:1746147207.870412:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.870495:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310268544 00000100:00100000:2.0:1746147207.870507:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310268544 00000100:00100000:2.0:1746147207.870570:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6112 00000100:00100000:2.0:1746147207.870580:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b9b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2735:x1830967310268544:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147207.871560:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b9b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2735:x1830967310268544:12345-192.168.204.25@tcp:35:cat.0 Request processed in 977us (1157us total) trans 8589937280 rc 0/0 00000100:00100000:2.0:1746147207.871569:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6112 00000100:00100000:0.0:1746147207.921412:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.923292:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310268800 00000100:00100000:2.0:1746147207.923305:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310268800 00000100:00100000:2.0:1746147207.923385:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16399 00000100:00100000:2.0:1746147207.923394:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2742:x1830967310268800:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147207.923422:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.923427:0:9138:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147207.923459:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5800/0x3139939425062067 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e915 expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.923482:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.923487:0:9138:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147207.923498:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x3139939425062132 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e9a1 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.923550:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425062139 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.923564:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062083 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e92a expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.923571:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425062059 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e907 expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.923576:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a200/0x313993942506206e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e91c expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.923582:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425062139 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.923615:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a200/0x313993942506206e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e91c expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.923627:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a200/0x313993942506206e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e91c expref: 7 pid: 6215 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.923639:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311430272:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.923777:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425062059 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e907 expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.923784:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425062059 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e907 expref: 9 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.923796:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311430400:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.923818:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062083 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e92a expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.923824:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062083 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e92a expref: 7 pid: 6215 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.923830:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311430528:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.923842:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42e0840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147207.926055:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311430272:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147207.927139:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.927163:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.927164:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311430400:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.927173:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311430528:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147207.927199:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147207.927202:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425062139 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:2.0:1746147207.927233:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310269056 00000100:00100000:0.0:1746147207.927233:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310268928 00000100:00100000:2.0:1746147207.927238:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310269056 00000100:00100000:0.0:1746147207.927238:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310268928 00010000:00010000:2.0:1746147207.927271:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425062059 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e907 expref: 10 pid: 9138 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.927293:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310269184 00000100:00100000:2.0:1746147207.927296:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310269184 00000100:00100000:1.0:1746147207.927353:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8909 00000100:00100000:1.0:1746147207.927363:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310269056:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147207.927376:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147207.927382:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425062059 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e907 expref: 10 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.927396:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425062059 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e907 expref: 10 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.927421:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4400/0x3139939425062059 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e907 expref: 10 pid: 9138 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.927443:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147207.927448:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425062139 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147207.927456:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425062139 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147207.927461:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147207.927499:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310269056:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 137us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147207.927505:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8909 00010000:00010000:0.0:1746147207.927567:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a200/0x313993942506206e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e91c expref: 9 pid: 6215 timeout: 845 lvb_type: 0 00000100:00100000:3.0:1746147207.927602:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8910 00000100:00100000:3.0:1746147207.927614:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2002:x1830967310268928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147207.927622:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.927625:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a200/0x313993942506206e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e91c expref: 9 pid: 6215 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.927633:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a200/0x313993942506206e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e91c expref: 9 pid: 6215 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.927644:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a200/0x313993942506206e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e91c expref: 9 pid: 6215 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.927670:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062083 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e92a expref: 8 pid: 6215 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.927695:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8911 00000100:00100000:2.0:1746147207.927701:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2003:x1830967310269184:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.927716:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.927720:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062083 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e92a expref: 8 pid: 6215 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.927728:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062083 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e92a expref: 8 pid: 6215 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.927738:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062083 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e92a expref: 8 pid: 6215 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.927746:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.927748:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425062139 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.927754:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425062139 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.927761:0:13715:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425062139 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.927777:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.927795:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2003:x1830967310269184:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 94us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.927801:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8911 00010000:00010000:2.0:1746147207.927816:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425062139 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147207.927822:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425062139 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000040:00080000:2.0:1746147207.928116:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1227, 88 off115832 00000004:00080000:2.0:1746147207.928124:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745918033659ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147207.928177:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1230, 88 off116096 00000004:00080000:2.0:1746147207.928182:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745918092527ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147207.928200:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1231, 88 off116184 00000004:00080000:2.0:1746147207.928202:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745918112923ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147207.928210:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1228, 88 off115920 00000004:00080000:2.0:1746147207.928213:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745918123439ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147207.928226:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1229, 88 off116008 00000004:00080000:2.0:1746147207.928235:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745918145803ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147207.928248:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1232, 88 off116272 00000004:00080000:2.0:1746147207.928250:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745918160953ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147207.928257:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1233, 88 off116360 00000004:00080000:2.0:1746147207.928259:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745918169629ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147207.928266:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1234, 88 off116448 00000004:00080000:2.0:1746147207.928269:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745918179295ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147207.928277:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1230, 88 off116096 00000004:00080000:2.0:1746147207.928280:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745918190455ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147207.928296:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1235, 88 off116536 00000004:00080000:2.0:1746147207.928300:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745918210202ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147207.928311:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1231, 88 off116184 00000004:00080000:2.0:1746147207.928315:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745918225549ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147207.928335:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1236, 88 off116624 00000004:00080000:2.0:1746147207.928340:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745918250987ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147207.928350:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1232, 88 off116272 00000004:00080000:2.0:1746147207.928353:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745918263129ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147207.928370:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1233, 88 off116360 00000004:00080000:2.0:1746147207.928375:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745918285379ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147207.928394:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1234, 88 off116448 00000004:00080000:2.0:1746147207.928399:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745918309223ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147207.928421:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1235, 88 off116536 00000004:00080000:2.0:1746147207.928426:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745918336253ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147207.928448:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1237, 88 off116712 00000004:00080000:2.0:1746147207.928452:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745918362915ns, next at 694367916532ns, rc = 0 00010000:00010000:3.0:1746147207.928749:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147207.928754:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147207.928778:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+6:2002:x1830967310268928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1164us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.928784:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8910 00000001:00080000:2.0:1746147207.929783:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937281 is committed 00000004:00080000:2.0:1746147207.929790:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1214 committed 00000004:00080000:2.0:1746147207.929795:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1215 committed 00000004:00080000:2.0:1746147207.929807:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1214 committed 00000004:00080000:2.0:1746147207.929809:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1213 committed 00000004:00080000:2.0:1746147207.929811:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1212 committed 00000004:00080000:2.0:1746147207.929812:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1213 committed 00000004:00080000:2.0:1746147207.929814:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1211 committed 00000004:00080000:2.0:1746147207.929815:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1212 committed 00000004:00080000:2.0:1746147207.929817:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1210 committed 00000004:00080000:2.0:1746147207.929818:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1211 committed 00000004:00080000:2.0:1746147207.929819:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1210 committed 00000004:00080000:2.0:1746147207.929821:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1209 committed 00000004:00080000:2.0:1746147207.929823:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1209 committed 00000004:00080000:2.0:1746147207.929825:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1208 committed 00000004:00080000:2.0:1746147207.929826:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1208 committed 00000004:00080000:2.0:1746147207.929828:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1207 committed 00000004:00080000:2.0:1746147207.929829:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1207 committed 00000001:00080000:2.0:1746147207.929839:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937278 is committed 00010000:00010000:2.0:1746147207.929889:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425062139 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a1 expref: 28 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.929904:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.929907:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746147207.929921:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x3139939425062132 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a1 expref: 28 pid: 9138 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746147207.929937:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425062139 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a1 expref: 27 pid: 9138 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147207.929989:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e6e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311430784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.930009:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e6e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311430912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147207.930061:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e6e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311430656:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.930105:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311431040:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.930149:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147207.930172:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.930180:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311431296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.930186:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311431424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.930197:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147207.930219:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311430784 00000100:00100000:0.0:1746147207.930219:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311430912 00000100:00100000:1.0:1746147207.930224:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311430784 00000100:00100000:0.0:1746147207.930224:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311430912 00000100:00100000:1.0:1746147207.930254:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311431296 00000100:00100000:1.0:1746147207.930256:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311431296 00000100:00100000:1.0:1746147207.930270:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19651 00000100:00100000:1.0:1746147207.930276:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+87:3764:x1830967311430784:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147207.930385:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147207.930389:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00002000:00010000:1.0:1746147207.930390:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147207 -> 1746147207 00002000:00010000:1.0:1746147207.930392:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00002000:00010000:1.0:1746147207.930394:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746147207.930417:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+88:3764:x1830967311430784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 141us (269us total) trans 17179875186 rc 0/0 00000100:00100000:1.0:1746147207.930423:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19651 00000100:00100000:1.0:1746147207.930434:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19652 00000100:00100000:1.0:1746147207.930439:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+87:3764:x1830967311431296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147207.930479:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:1.0:1746147207.930482:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:1.0:1746147207.930484:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147207.930485:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:1.0:1746147207.930487:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:1.0:1746147207.930506:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+88:3764:x1830967311431296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (307us total) trans 17179875187 rc 0/0 00000100:00100000:1.0:1746147207.930511:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19652 00000004:00080000:1.0:1746147207.930540:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132126300/2, rc 0, transno 17179875187 00000100:00100000:1.0:1746147207.930545:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311431296:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147207.930552:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e6e3100/2, rc 0, transno 17179875186 00000100:00100000:1.0:1746147207.930555:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e6e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311430784:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147207.930564:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19653 00000100:00100000:1.0:1746147207.930569:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e21a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+87:3765:x1830967311430912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147207.930574:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147207.930590:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311431424 00000100:00100000:0.0:1746147207.930592:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311431424 00000100:00100000:0.0:1746147207.930606:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19654 00002000:00010000:1.0:1746147207.930610:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:0.0:1746147207.930611:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+89:3765:x1830967311431424:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147207.930612:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00002000:00010000:1.0:1746147207.930614:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:1.0:1746147207.930616:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00002000:00010000:1.0:1746147207.930618:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746147207.930638:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e21a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+89:3765:x1830967311430912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (466us total) trans 17179875188 rc 0/0 00000100:00100000:1.0:1746147207.930643:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19653 00000100:00100000:0.0:1746147207.930663:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+89:3765:x1830967311431424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (89us total) trans 17179875189 rc 0/0 00000100:00100000:0.0:1746147207.930668:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19654 00000004:00080000:0.0:1746147207.930683:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e6e3480/2, rc 0, transno 17179875188 00000100:00100000:0.0:1746147207.930686:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e6e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311430912:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147207.930691:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca11880/2, rc 0, transno 17179875189 00000100:00100000:0.0:1746147207.930694:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311431424:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147207.930793:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147207.930806:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e6e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311431168:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147207.930820:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147207.930839:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311430656 00000100:00100000:3.0:1746147207.930841:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311430656 00000100:00100000:3.0:1746147207.930857:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311431168 00000100:00100000:3.0:1746147207.930859:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311431168 00000100:00100000:3.0:1746147207.930870:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19655 00000100:00100000:3.0:1746147207.930874:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+90:3767:x1830967311430656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147207.930919:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147207.930921:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00002000:00010000:3.0:1746147207.930922:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:3.0:1746147207.930924:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00002000:00010000:3.0:1746147207.930926:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147207.930948:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+91:3767:x1830967311430656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (155us total) trans 17179875190 rc 0/0 00000100:00100000:3.0:1746147207.930953:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19655 00000100:00100000:3.0:1746147207.930963:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19656 00000100:00100000:3.0:1746147207.930967:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+90:3767:x1830967311431168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147207.931022:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+91:3767:x1830967311431168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (198us total) trans 17179875191 rc 0/0 00000100:00100000:3.0:1746147207.931026:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19656 00000100:00100000:3.0:1746147207.931141:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311431680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147207.931163:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147207.931175:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311432192:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147207.931188:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147207.931202:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e6e2d80/2, rc 0, transno 17179875190 00000100:00100000:3.0:1746147207.931205:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e6e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311430656:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147207.931211:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e6e3b80/2, rc 0, transno 17179875191 00000100:00100000:3.0:1746147207.931213:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e6e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311431168:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147207.931219:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746147207.931223:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311432064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147207.931237:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147207.931247:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311432576:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147207.931268:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147207.931291:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311431680 00000100:00100000:3.0:1746147207.931293:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311431680 00000100:00100000:3.0:1746147207.931309:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311432192 00000100:00100000:3.0:1746147207.931310:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311432192 00000100:00100000:3.0:1746147207.931321:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311432064 00000100:00100000:3.0:1746147207.931323:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311432064 00000100:00100000:3.0:1746147207.931332:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311432576 00000100:00100000:3.0:1746147207.931334:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311432576 00000100:00100000:3.0:1746147207.931344:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19657 00000100:00100000:3.0:1746147207.931348:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3767:x1830967311431680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.931368:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311431936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.931386:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147207.931399:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311432448:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147207.931409:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147207.931412:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00000100:00100000:0.0:1746147207.931413:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746147207.931414:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:3.0:1746147207.931416:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00002000:00010000:3.0:1746147207.931417:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:0.0:1746147207.931424:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746147207.931428:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311431808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147207.931435:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:3767:x1830967311431680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (271us total) trans 21474842570 rc 0/0 00000100:00100000:3.0:1746147207.931440:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19657 00000100:00100000:0.0:1746147207.931441:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147207.931448:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311431936 00000100:00100000:0.0:1746147207.931448:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311432320:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147207.931450:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311431936 00000100:00100000:3.0:1746147207.931457:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311432448 00000100:00100000:3.0:1746147207.931459:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311432448 00000100:00100000:0.0:1746147207.931460:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147207.931465:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311431808 00000100:00100000:3.0:1746147207.931467:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311431808 00000100:00100000:3.0:1746147207.931472:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311432320 00000100:00100000:3.0:1746147207.931474:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311432320 00000100:00100000:0.0:1746147207.931475:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19658 00000100:00100000:0.0:1746147207.931480:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+55:3767:x1830967311432192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147207.931481:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19659 00000100:00100000:3.0:1746147207.931485:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+55:3767:x1830967311432064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147207.931518:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19660 00000100:00100000:3.0:1746147207.931523:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3767:x1830967311432576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.931534:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3767:x1830967311432192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (344us total) trans 21474842571 rc 0/0 00000100:00100000:0.0:1746147207.931538:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19658 00000100:00100000:0.0:1746147207.931548:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19661 00000100:00100000:0.0:1746147207.931552:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3765:x1830967311431936:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147207.931562:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:3.0:1746147207.931564:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147207.931566:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147207.931567:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147207.931569:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00002000:00010000:0.0:1746147207.931584:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:0.0:1746147207.931586:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00000100:00100000:3.0:1746147207.931587:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3767:x1830967311432576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (319us total) trans 21474842573 rc 0/0 00002000:00010000:0.0:1746147207.931588:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147206 -> 1746147206 00002000:00010000:0.0:1746147207.931590:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00000100:00100000:3.0:1746147207.931591:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19660 00002000:00010000:0.0:1746147207.931592:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:3.0:1746147207.931600:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19662 00000100:00100000:3.0:1746147207.931604:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3765:x1830967311432448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.931608:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3765:x1830967311431936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (221us total) trans 21474842574 rc 0/0 00000100:00100000:0.0:1746147207.931612:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19661 00000100:00100000:0.0:1746147207.931619:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19663 00000100:00100000:0.0:1746147207.931623:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3765:x1830967311431808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147207.931639:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147207.931641:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147207.931643:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147207.931645:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147207.931647:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00002000:00010000:0.0:1746147207.931652:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147207.931653:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147207 -> 1746147207 00002000:00010000:0.0:1746147207.931655:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147207 -> 1746147207 00002000:00010000:0.0:1746147207.931657:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147207 -> 1746147207 00002000:00010000:0.0:1746147207.931659:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147207.931663:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3765:x1830967311432448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (248us total) trans 21474842575 rc 0/0 00000100:00100000:3.0:1746147207.931668:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19662 00000100:00100000:0.0:1746147207.931670:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3765:x1830967311431808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (229us total) trans 21474842576 rc 0/0 00000100:00100000:0.0:1746147207.931675:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19663 00000100:00100000:3.0:1746147207.931677:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19664 00000100:00100000:3.0:1746147207.931681:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3765:x1830967311432320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147207.931696:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00000004:00080000:3.0:1746147207.931697:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009514dc00/2, rc 0, transno 21474842573 00002000:00010000:0.0:1746147207.931699:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147207.931700:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147207.931702:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00000100:00100000:3.0:1746147207.931703:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311432576:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147207.931704:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000004:00080000:3.0:1746147207.931722:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800769dad80/2, rc 0, transno 21474842570 00000100:00100000:3.0:1746147207.931725:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311431680:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147207.931730:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099010380/2, rc 0, transno 21474842571 00000100:00100000:0.0:1746147207.931730:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:3767:x1830967311432064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 245us (492us total) trans 21474842572 rc 0/0 00000100:00100000:3.0:1746147207.931733:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311432192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.931735:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19659 00000004:00080000:3.0:1746147207.931739:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099012a00/2, rc 0, transno 21474842572 00000100:00100000:3.0:1746147207.931741:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311432064:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147207.931750:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800769d9880/2, rc 0, transno 21474842576 00000100:00100000:0.0:1746147207.931753:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311431808:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147207.931759:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800769daa00/2, rc 0, transno 21474842574 00000100:00100000:0.0:1746147207.931761:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311431936:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147207.931766:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009514fb80/2, rc 0, transno 21474842575 00000100:00100000:0.0:1746147207.931768:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311432448:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147207.931848:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.931865:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311431552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.931880:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.931890:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746147207.931893:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311432704:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147207.931907:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147207.931925:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311431040 00000100:00100000:2.0:1746147207.931928:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311431040 00000100:00100000:2.0:1746147207.931942:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311431552 00000100:00100000:2.0:1746147207.931943:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311431552 00000100:00100000:2.0:1746147207.931949:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311432704 00000100:00100000:2.0:1746147207.931950:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311432704 00000100:00100000:2.0:1746147207.931957:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19665 00000100:00100000:2.0:1746147207.931961:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+92:3766:x1830967311431040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147207.932009:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147207.932011:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147207.932013:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147207.932015:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147207.932017:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:2.0:1746147207.932035:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+93:3766:x1830967311431040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (187us total) trans 17179875192 rc 0/0 00000100:00100000:2.0:1746147207.932040:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19665 00000100:00100000:2.0:1746147207.932049:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19666 00000100:00100000:2.0:1746147207.932053:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+92:3766:x1830967311431552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147207.932117:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+93:3766:x1830967311431552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (235us total) trans 17179875193 rc 0/0 00000100:00100000:2.0:1746147207.932123:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19666 00000100:00100000:2.0:1746147207.932132:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19667 00000100:00100000:2.0:1746147207.932136:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3766:x1830967311432704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147207.932183:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3766:x1830967311432704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (275us total) trans 21474842578 rc 0/0 00000100:00100000:2.0:1746147207.932187:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19667 00000004:00080000:2.0:1746147207.932206:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009988bb80/2, rc 0, transno 21474842578 00000100:00100000:2.0:1746147207.932209:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311432704:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147207.932215:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e6e3800/2, rc 0, transno 17179875192 00000100:00100000:2.0:1746147207.932218:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311431040:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147207.932225:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca10a80/2, rc 0, transno 17179875193 00000100:00100000:2.0:1746147207.932228:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311431552:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746147207.932270:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.932292:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746147207.932297:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0d200, rc 0) 00000100:00100000:2.0:1746147207.932348:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2742:x1830967310268800:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8954us (10949us total) trans 8589937281 rc 0/0 00000100:00100000:2.0:1746147207.932355:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16399 00000100:00100000:3.0:1746147207.933314:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3765:x1830967311432320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1630us (1850us total) trans 21474842577 rc 0/0 00000100:00100000:3.0:1746147207.933321:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19664 00000004:00080000:0.0:1746147207.933331:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099010000/2, rc 0, transno 21474842577 00000100:00100000:0.0:1746147207.933335:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311432320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147207.940950:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.941308:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310269312 00000100:00100000:3.0:1746147207.941318:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310269312 00000100:00100000:3.0:1746147207.941377:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19668 00000100:00100000:3.0:1746147207.941385:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2742:x1830967310269312:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147207.941406:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.941427:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425062140 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e9a8 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.941458:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x3139939425062091 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e938 expref: 31 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.941472:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x31399394250620f3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e985 expref: 46 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.941479:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x31399394250620a6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e954 expref: 25 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.941485:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.941487:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.941491:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425062140 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [1716224->2097151] (req 1716224->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a8 expref: 46 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.941523:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x31399394250620a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e954 expref: 25 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.941535:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x31399394250620a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e954 expref: 25 pid: 13695 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746147207.941548:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311432832:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.941642:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x31399394250620f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e985 expref: 46 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.941649:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x31399394250620f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e985 expref: 46 pid: 1136 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746147207.941656:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311432960:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.941680:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x3139939425062091 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e938 expref: 31 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.941687:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x3139939425062091 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e938 expref: 31 pid: 13695 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746147207.941694:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311433088:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.941719:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.948031:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.948066:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.948135:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.948161:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310269440 00000100:00100000:0.0:1746147207.948170:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310269440 00010000:00010000:0.0:1746147207.948213:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x31399394250620a6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e954 expref: 26 pid: 13695 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746147207.948247:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310269696 00000100:00100000:0.0:1746147207.948249:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310269696 00010000:00010000:0.0:1746147207.948259:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x3139939425062091 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e938 expref: 32 pid: 13695 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746147207.948272:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310269568 00000100:00100000:0.0:1746147207.948274:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310269568 00010000:00010000:0.0:1746147207.948283:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x31399394250620f3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e985 expref: 47 pid: 1136 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746147207.948298:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8912 00000100:00100000:0.0:1746147207.948306:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+26:2002:x1830967310269440:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147207.948325:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147207.948347:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x31399394250620a6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e954 expref: 26 pid: 13695 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.948358:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x31399394250620a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e954 expref: 26 pid: 13695 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.948384:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147207.948423:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+26:2002:x1830967310269440:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 119us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.948429:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8912 00000100:00100000:0.0:1746147207.948446:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8913 00000100:00100000:0.0:1746147207.948450:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2002:x1830967310269696:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147207.948459:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147207.948465:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x3139939425062091 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e938 expref: 32 pid: 13695 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.948472:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x3139939425062091 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e938 expref: 32 pid: 13695 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.948482:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147207.948495:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2002:x1830967310269696:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 44us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.948500:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8913 00000100:00100000:0.0:1746147207.948509:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8914 00000100:00100000:0.0:1746147207.948513:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2002:x1830967310269568:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147207.948519:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147207.948524:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x31399394250620f3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e985 expref: 47 pid: 1136 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.948534:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x31399394250620f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e985 expref: 47 pid: 1136 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.948546:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.948548:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147207.948555:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425062140 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a8 expref: 47 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.948562:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425062140 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a8 expref: 47 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147207.948593:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425062140 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a8 expref: 47 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147207.948606:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099153480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311433216:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147207.948664:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095affd80 going to sleep for 11 seconds 00010000:00010000:3.0:1746147207.949139:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95c00/0x31399394250620a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e954 expref: 25 pid: 13695 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746147207.949159:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311432832:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.949170:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x31399394250620f3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e985 expref: 47 pid: 1136 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746147207.949178:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311432960:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.949185:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e0400/0x3139939425062091 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e938 expref: 31 pid: 13695 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746147207.949193:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311433088:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.949218:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425062140 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a8 expref: 46 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.949227:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400bc00, rc 0) 00000100:00100000:3.0:1746147207.949308:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2742:x1830967310269312:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7924us (8370us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147207.949316:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19668 00000100:00100000:2.0:1746147207.950660:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099153480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311433216:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147207.950679:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.950716:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2002:x1830967310269568:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2191us (2570us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.950726:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8914 00000100:00100000:0.0:1746147207.953218:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.953350:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310269952 00000100:00100000:3.0:1746147207.953364:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310269952 00002000:00100000:3.0:1746147207.953411:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1716224->1720319) req@ffff880099152680 x1830967310269952/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.953421:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152680 with x1830967310269952 ext(1716224->1720319) 00002000:00010000:3.0:1746147207.953427:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099152680 00000100:00100000:3.0:1746147207.953444:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7202 00000100:00100000:3.0:1746147207.953450:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2002:x1830967310269952:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147207.954276:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2002:x1830967310269952:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 823us (1069us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147207.954284:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7202 00002000:00100000:3.0:1746147207.954290:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1716224->1720319) req@ffff880099152680 x1830967310269952/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/4536 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.954298:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152680 with x1830967310269952 ext(1716224->1720319) 00002000:00010000:3.0:1746147207.954302:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099152680 00000100:00100000:0.0:1746147207.961772:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.961893:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310270080 00000100:00100000:3.0:1746147207.961904:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310270080 00000100:00100000:3.0:1746147207.962321:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19669 00000100:00100000:3.0:1746147207.962331:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2742:x1830967310270080:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147207.962354:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147207.962372:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e9af expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.962411:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f01a800/0x3139939425062098 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e93f expref: 30 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.962420:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425062101 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e98c expref: 46 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.962427:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c03800/0x31399394250620c2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e95b expref: 24 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.962433:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.962435:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.962439:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [1048576->1363967] (req 1048576->1363967) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 46 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.962472:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4c03800/0x31399394250620c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e95b expref: 24 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.962485:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4c03800/0x31399394250620c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e95b expref: 24 pid: 9585 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746147207.962497:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311433344:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.963355:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425062101 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e98c expref: 46 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.963365:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425062101 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e98c expref: 46 pid: 1136 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746147207.963374:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311433472:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147207.964659:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f01a800/0x3139939425062098 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e93f expref: 30 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147207.964672:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f01a800/0x3139939425062098 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e93f expref: 30 pid: 12201 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746147207.964685:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311433600:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147207.964995:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.965117:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310270208 00000100:00100000:2.0:1746147207.965124:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310270208 00010000:00010000:2.0:1746147207.965156:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4c03800/0x31399394250620c2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e95b expref: 25 pid: 9585 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746147207.965181:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8915 00000100:00100000:2.0:1746147207.965188:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+25:2001:x1830967310270208:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.965199:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.965218:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4c03800/0x31399394250620c2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e95b expref: 25 pid: 9585 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746147207.965228:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4c03800/0x31399394250620c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e95b expref: 25 pid: 9585 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746147207.965252:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.965276:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+25:2001:x1830967310270208:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 88us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.965282:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8915 00000100:00100000:3.0:1746147207.965432:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00010000:00010000:3.0:1746147207.965464:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c03800/0x31399394250620c2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e95b expref: 24 pid: 9585 timeout: 845 lvb_type: 1 00000100:00100000:3.0:1746147207.965483:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311433344:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147207.965493:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311433472:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147207.965966:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147207.965995:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.966031:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310270336 00000100:00100000:0.0:1746147207.966034:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310270336 00010000:00010000:0.0:1746147207.966051:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425062101 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e98c expref: 47 pid: 1136 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746147207.966066:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8916 00000100:00100000:0.0:1746147207.966070:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2000:x1830967310270336:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147207.966077:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147207.966107:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425062101 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e98c expref: 47 pid: 1136 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.966115:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425062101 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e98c expref: 47 pid: 1136 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.966128:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425062101 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e98c expref: 47 pid: 1136 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746147207.966145:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.966301:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310270464 00000100:00100000:2.0:1746147207.966305:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310270464 00000100:00100000:2.0:1746147207.966332:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16400 00000100:00100000:2.0:1746147207.966336:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2743:x1830967310270464:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147207.966359:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.966375:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x313993942506214e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e9b6 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.966424:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x313993942506214e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9b6 expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.966436:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x313993942506214e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9b6 expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.966448:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.966452:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147207.966455:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0de00, rc 0) 00000100:00100000:2.0:1746147207.966474:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2743:x1830967310270464:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 138us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.966479:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16400 00000100:00100000:0.0:1746147207.967135:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2000:x1830967310270336:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 95us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147207.967146:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8916 00000100:00100000:2.0:1746147207.967369:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311433600:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.967400:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->1363967] (req 1048576->1363967) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 45 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.967410:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbefa00, rc 0) 00000100:00100000:2.0:1746147207.967436:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2742:x1830967310270080:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5108us (5678us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.967443:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19669 00000100:00100000:0.0:1746147207.967838:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.968521:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310270592 00000100:00100000:2.0:1746147207.968527:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310270592 00010000:00010000:2.0:1746147207.968551:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f01a800/0x3139939425062098 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e93f expref: 31 pid: 12201 timeout: 845 lvb_type: 1 00000100:00100000:2.0:1746147207.968575:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8917 00000100:00100000:2.0:1746147207.968581:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2001:x1830967310270592:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.968593:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147207.968616:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f01a800/0x3139939425062098 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e93f expref: 31 pid: 12201 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746147207.968628:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f01a800/0x3139939425062098 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e93f expref: 31 pid: 12201 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746147207.968648:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f01a800/0x3139939425062098 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e93f expref: 31 pid: 12201 timeout: 845 lvb_type: 1 00010000:00010000:2.0:1746147207.969178:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.969181:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147207.969191:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 44 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.969199:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 44 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.969235:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 44 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.969252:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311433728:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147207.969327:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.970394:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.970470:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310270720 00000100:00100000:2.0:1746147207.970476:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310270720 00000100:00100000:2.0:1746147207.970521:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19670 00000100:00100000:2.0:1746147207.970528:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2743:x1830967310270720:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147207.970542:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.970556:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425062155 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e9bd expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.970578:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 44 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.970585:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147207.970586:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147207.970589:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425062155 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1409024->2097151] (req 1409024->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9bd expref: 32 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.970612:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 44 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.970623:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 44 pid: 1854 timeout: 845 lvb_type: 0 00000100:00100000:2.0:1746147207.970633:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311433856:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147207.970693:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caae40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147207.973681:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.973851:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310270976 00000100:00100000:3.0:1746147207.973859:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310270976 00000100:00100000:2.0:1746147207.973863:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311433728:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147207.973882:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746147207.973902:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1359872->1363967) req@ffff8800769aca80 x1830967310270976/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.973912:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769aca80 with x1830967310270976 ext(1359872->1363967) 00010000:00010000:3.0:1746147207.973919:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 45 pid: 1854 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.973932:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 45 pid: 1854 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746147207.973944:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800769aca80 00000100:00100000:3.0:1746147207.973971:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1683 00000100:00100000:3.0:1746147207.973978:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967310270976:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147207.974283:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2001:x1830967310270592:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5700us (6443us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.974293:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8917 00000100:00100000:2.0:1746147207.974440:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311433856:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147207.974457:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425062155 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1409024->2097151] (req 1409024->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9bd expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.974472:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c800, rc 0) 00000100:00100000:3.0:1746147207.974663:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2000:x1830967310270976:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 685us (992us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147207.974670:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1683 00002000:00100000:3.0:1746147207.974675:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1359872->1363967) req@ffff8800769aca80 x1830967310270976/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/4536 e 0 to 0 dl 1746147218 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147207.974683:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769aca80 with x1830967310270976 ext(1359872->1363967) 00010000:00010000:3.0:1746147207.974688:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 45 pid: 1854 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.974697:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 45 pid: 1854 timeout: 845 lvb_type: 0 00002000:00010000:3.0:1746147207.974703:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800769aca80 00000100:00100000:2.0:1746147207.975051:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2743:x1830967310270720:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4523us (4659us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.975059:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19670 00000100:00100000:0.0:1746147207.978502:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.978601:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.979170:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310271488 00000100:00100000:2.0:1746147207.979179:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310271488 00000100:00100000:2.0:1746147207.979454:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6113 00000100:00100000:2.0:1746147207.979462:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2742:x1830967310271488:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147207.979482:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310271232 00000100:00100000:1.0:1746147207.979487:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310271232 00002000:00100000:1.0:1746147207.979523:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1363967) req@ffff8800769ad500 x1830967310271232/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147207.979534:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ad500 with x1830967310271232 ext(1048576->1363967) 00010000:00010000:1.0:1746147207.979543:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 45 pid: 1854 timeout: 845 lvb_type: 0 00010000:00010000:1.0:1746147207.979557:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 45 pid: 1854 timeout: 845 lvb_type: 0 00002000:00010000:1.0:1746147207.979563:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800769ad500 00000100:00100000:1.0:1746147207.979589:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1684 00000100:00100000:1.0:1746147207.979594:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2001:x1830967310271232:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147207.979693:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2742:x1830967310271488:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 231us (1201us total) trans 8589937282 rc 0/0 00000100:00100000:2.0:1746147207.979700:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6113 00000100:00100000:2.0:1746147207.985867:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2001:x1830967310271232:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 6258us (7251us total) trans 17179875194 rc 0/0 00000100:00100000:2.0:1746147207.985881:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1684 00002000:00100000:2.0:1746147207.985894:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1363967) req@ffff8800769ad500 x1830967310271232/t17179875194(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:583/0 lens 488/448 e 0 to 0 dl 1746147218 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.985905:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ad500 with x1830967310271232 ext(1048576->1363967) 00010000:00010000:2.0:1746147207.985916:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 47 pid: 1854 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.985933:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 47 pid: 1854 timeout: 845 lvb_type: 0 00002000:00010000:2.0:1746147207.985941:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800769ad500 00000100:00100000:0.0:1746147207.994581:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.994834:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147207.995159:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310271744 00000100:00100000:2.0:1746147207.995169:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310271744 00000100:00100000:2.0:1746147207.995219:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16401 00000100:00100000:2.0:1746147207.995226:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2751:x1830967310271744:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.995246:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.995266:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x313993942506215c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e9c4 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.995341:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062163 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.995353:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.995363:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.995376:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c03800/0x313993942506216a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.995381:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c03800/0x313993942506216a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.995386:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c03800/0x313993942506216a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.995490:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeea00/0x3139939425062171 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.995498:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeea00/0x3139939425062171 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.995504:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeea00/0x3139939425062171 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147207.995512:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147207.995584:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeea00/0x3139939425062171 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.995591:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeea00/0x3139939425062171 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.995601:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeea00/0x3139939425062171 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.995607:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbeea00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147207.995611:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeea00/0x3139939425062171 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.995617:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeea00/0x3139939425062171 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.995628:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.995630:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147207.995634:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeea00/0x3139939425062171 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.995642:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeea00/0x3139939425062171 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147207.995934:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.996065:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310271872 00000100:00100000:3.0:1746147207.996071:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310271872 00010000:00010000:3.0:1746147207.996109:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 47 pid: 1854 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.996222:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996228:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062163 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996233:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062163 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996237:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009400a600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147207.996239:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062163 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996243:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062163 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996249:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147207.996251:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147207.996253:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062163 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996257:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x3139939425062163 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996264:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c03800/0x313993942506216a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996268:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c03800/0x313993942506216a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996273:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c03800/0x313993942506216a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996278:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4c03800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147207.996280:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c03800/0x313993942506216a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00000100:00100000:3.0:1746147207.996281:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8918 00010000:00010000:2.0:1746147207.996284:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c03800/0x313993942506216a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00000100:00100000:3.0:1746147207.996287:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2003:x1830967310271872:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147207.996290:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093211d00) 00010000:00010000:2.0:1746147207.996292:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147207.996294:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c03800/0x313993942506216a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996298:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c03800/0x313993942506216a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.996301:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147207.996316:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 47 pid: 1854 timeout: 845 lvb_type: 0 00010000:00010000:3.0:1746147207.996327:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 47 pid: 1854 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.996337:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x313993942506215c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9c4 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.996341:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x3139939425062147 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1363967) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9af expref: 47 pid: 1854 timeout: 845 lvb_type: 0 00010000:00010000:2.0:1746147207.996344:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x313993942506215c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9c4 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.996350:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0ca00, rc 0) 00010000:00010000:3.0:1746147207.996356:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.996358:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147207.996365:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425062155 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9bd expref: 30 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147207.996371:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425062155 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9bd expref: 30 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147207.996395:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2751:x1830967310271744:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1169us (1825us total) trans 8589937283 rc 301/301 00000100:00100000:2.0:1746147207.996400:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16401 00000100:00100000:2.0:1746147207.996416:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310272128 00000100:00100000:2.0:1746147207.996418:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310272128 00000100:00100000:2.0:1746147207.996449:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16402 00000100:00100000:2.0:1746147207.996454:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2752:x1830967310272128:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147207.996467:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147207.996475:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x313993942506217f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e9cb expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.996506:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425062186 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996513:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425062186 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996520:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425062186 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996529:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942506218d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996539:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942506218d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996544:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942506218d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996594:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9ba00/0x3139939425062194 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996601:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9ba00/0x3139939425062194 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996607:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9ba00/0x3139939425062194 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147207.996613:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147207.996646:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9ba00/0x3139939425062194 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996655:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9ba00/0x3139939425062194 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996660:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9ba00/0x3139939425062194 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147207.996662:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425062155 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9bd expref: 30 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.996664:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d9ba00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147207.996667:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9ba00/0x3139939425062194 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996672:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9ba00/0x3139939425062194 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00000100:00100000:3.0:1746147207.996675:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311433984:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147207.996678:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147207.996680:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147207.996682:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9ba00/0x3139939425062194 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996686:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9ba00/0x3139939425062194 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996694:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425062186 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996698:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425062186 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996702:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425062186 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996718:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbeee00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147207.996720:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425062186 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996727:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425062186 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996733:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147207.996734:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147207.996736:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425062186 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996740:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbeee00/0x3139939425062186 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996747:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942506218d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00000100:00100000:3.0:1746147207.996751:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00010000:00010000:2.0:1746147207.996751:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942506218d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996756:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942506218d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996759:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0c200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147207.996761:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942506218d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996766:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942506218d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996771:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ccff900) 00010000:00010000:2.0:1746147207.996772:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147207.996774:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942506218d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996778:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c200/0x313993942506218d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147207.996799:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x313993942506217f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9cb expref: 30 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.996804:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbef000/0x313993942506217f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9cb expref: 30 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147207.996810:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbef000, rc 0) 00000100:00100000:2.0:1746147207.996827:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2752:x1830967310272128:12345-192.168.204.25@tcp:101:cat.0 Request processed in 374us (895us total) trans 8589937284 rc 301/301 00000100:00100000:2.0:1746147207.996832:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16402 00000100:00100000:0.0:1746147207.998899:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147207.999003:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147207.999242:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311433984:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147207.999261:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147207.999295:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310272384 00000100:00100000:3.0:1746147207.999299:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2003:x1830967310271872:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3010us (4464us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147207.999304:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310272384 00000100:00100000:3.0:1746147207.999309:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8918 00002000:00100000:2.0:1746147207.999344:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1409024->1413119) req@ffff88009455f800 x1830967310272384/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/0 e 0 to 0 dl 1746147218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.999353:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455f800 with x1830967310272384 ext(1409024->1413119) 00002000:00010000:2.0:1746147207.999358:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009455f800 00000100:00100000:2.0:1746147207.999372:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7203 00000100:00100000:2.0:1746147207.999377:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2000:x1830967310272384:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147207.999492:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310272512 00000100:00100000:1.0:1746147207.999497:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310272512 00000100:00100000:1.0:1746147207.999768:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16403 00000100:00100000:1.0:1746147207.999774:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2752:x1830967310272512:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147207.999791:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147207.999809:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x31399394250621a2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e9d2 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.999886:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95400/0x31399394250621a9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147207.999898:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95400/0x31399394250621a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00000100:00100000:2.0:1746147207.999899:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2000:x1830967310272384:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 521us (1007us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147207.999905:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7203 00010000:00010000:1.0:1746147207.999907:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95400/0x31399394250621a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00002000:00100000:2.0:1746147207.999910:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1409024->1413119) req@ffff88009455f800 x1830967310272384/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:583/0 lens 488/4536 e 0 to 0 dl 1746147218 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147207.999916:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455f800 with x1830967310272384 ext(1409024->1413119) 00002000:00010000:2.0:1746147207.999919:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009455f800 00000004:00200000:1.0:1746147207.999929:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:1.0:1746147207.999933:0:16099:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147207.999946:0:16099:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95400/0x31399394250621a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147207.999968:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x31399394250621a2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9d2 expref: 31 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147207.999991:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95400/0x31399394250621a9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9d2 expref: 30 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.000000:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147208.000002:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147208.000005:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95400, rc 0) 00000100:00100000:1.0:1746147208.000024:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2752:x1830967310272512:12345-192.168.204.25@tcp:101:cat.0 Request processed in 251us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147208.000030:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16403 00000100:00100000:0.0:1746147208.003334:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.003871:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310272640 00000100:00100000:2.0:1746147208.003882:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310272640 00000100:00100000:2.0:1746147208.003962:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19671 00000100:00100000:2.0:1746147208.003971:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967310272640:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147208.003991:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147208.004011:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x31399394250621b0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e9d9 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147208.004072:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311434112:192.168.204.25@tcp:106: 00000100:00080000:0.0:1746147208.004109:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147208.004179:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147208.006054:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.006123:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310272768 00000100:00100000:1.0:1746147208.006129:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310272768 00000100:00100000:1.0:1746147208.006173:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16404 00000100:00100000:1.0:1746147208.006181:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013682c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2751:x1830967310272768:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147208.006200:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147208.006203:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311434112:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147208.006219:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x31399394250621b7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e9e0 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.006231:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x31399394250621b0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9d9 expref: 47 pid: 1854 timeout: 0 lvb_type: 1 00000100:00080000:0.0:1746147208.006235:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746147208.006242:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d9b400/0x31399394250621b0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9d9 expref: 47 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147208.006256:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9b400, rc 0) 00000100:00100000:2.0:1746147208.006288:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967310272640:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2318us (2964us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147208.006294:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19671 00010000:00010000:1.0:1746147208.006301:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9a800/0x31399394250621be lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.006315:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9a800/0x31399394250621be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.006327:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9a800/0x31399394250621be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:1.0:1746147208.006349:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:1.0:1746147208.006353:0:16099:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147208.006369:0:16099:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9a800/0x31399394250621be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.006389:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94800/0x31399394250621b7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e0 expref: 11 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.006410:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9a800/0x31399394250621be lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e0 expref: 10 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.006417:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147208.006421:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147208.006424:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9a800, rc 0) 00000100:00100000:1.0:1746147208.006452:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013682c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2751:x1830967310272768:12345-192.168.204.25@tcp:101:cat.0 Request processed in 272us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147208.006457:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16404 00000100:00100000:0.0:1746147208.009645:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.009804:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.009983:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310272896 00000100:00100000:2.0:1746147208.009990:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310272896 00000100:00100000:2.0:1746147208.010039:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310273024 00000100:00100000:2.0:1746147208.010041:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310273024 00000100:00080000:0.0:1746147208.010160:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147208.010178:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19672 00000100:00100000:0.0:1746147208.010185:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2743:x1830967310272896:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147208.010201:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147208.010219:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e9e7 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.010251:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x313993942506209f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e946 expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147208.010258:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x31399394250620fa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e993 expref: 25 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147208.010265:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d94c00/0x31399394250620ad lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e962 expref: 14 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147208.010271:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147208.010273:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147208.010276:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1048576->1159167] (req 1048576->1159167) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 17 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.010306:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d94c00/0x31399394250620ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e962 expref: 14 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147208.010317:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d94c00/0x31399394250620ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e962 expref: 14 pid: 13695 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746147208.010329:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098821500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311434240:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147208.010410:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x31399394250620fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e993 expref: 25 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147208.010418:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x31399394250620fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e993 expref: 25 pid: 1136 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746147208.010427:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098822d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311434368:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147208.010453:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x313993942506209f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e946 expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147208.010460:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x313993942506209f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e946 expref: 17 pid: 12225 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746147208.010467:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098820e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311434496:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147208.010482:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147208.010592:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19673 00000100:00100000:1.0:1746147208.010601:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2000:x1830967310273024:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147208.010610:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147208.010622:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d9ba00/0x31399394250621cc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e9ee expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147208.010656:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311434624:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147208.010685:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147208.012625:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098821500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311434240:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147208.012638:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098822d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311434368:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147208.013423:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098820e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311434496:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147208.013435:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147208.013462:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1048576->1159167] (req 1048576->1159167) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 17 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147208.013467:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147208.013481:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715200, rc 0) 00000100:00100000:0.0:1746147208.013491:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.013523:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2743:x1830967310272896:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3339us (3887us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.013532:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19672 00000100:00100000:2.0:1746147208.013573:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310273280 00000100:00100000:2.0:1746147208.013579:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310273280 00000100:00080000:0.0:1746147208.013602:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746147208.013607:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94c00/0x31399394250620ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e962 expref: 15 pid: 13695 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746147208.013624:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310273152 00000100:00100000:2.0:1746147208.013626:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310273152 00010000:00010000:2.0:1746147208.013637:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x31399394250620fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e993 expref: 26 pid: 1136 timeout: 846 lvb_type: 1 00000100:00080000:0.0:1746147208.013638:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147208.013647:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310273408 00000100:00100000:2.0:1746147208.013650:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310273408 00010000:00010000:2.0:1746147208.013657:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x313993942506209f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e946 expref: 17 pid: 12225 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746147208.013668:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8919 00000100:00100000:2.0:1746147208.013674:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310273280:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147208.013688:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147208.013693:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8920 00000100:00100000:3.0:1746147208.013702:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310273152:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147208.013720:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d94c00/0x31399394250620ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e962 expref: 15 pid: 13695 timeout: 846 lvb_type: 1 00010000:00010000:3.0:1746147208.013724:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147208.013729:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d94c00/0x31399394250620ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e962 expref: 15 pid: 13695 timeout: 846 lvb_type: 1 00010000:00010000:3.0:1746147208.013746:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x31399394250620fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e993 expref: 26 pid: 1136 timeout: 846 lvb_type: 1 00010000:00010000:3.0:1746147208.013755:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x31399394250620fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e993 expref: 26 pid: 1136 timeout: 846 lvb_type: 1 00010000:00010000:3.0:1746147208.013777:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d94200/0x31399394250620fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e993 expref: 26 pid: 1136 timeout: 846 lvb_type: 1 00010000:00010000:3.0:1746147208.013790:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147208.013809:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310273152:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 109us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147208.013815:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8920 00000100:00100000:3.0:1746147208.013827:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8921 00000100:00100000:3.0:1746147208.013831:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310273408:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147208.013837:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147208.013844:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x313993942506209f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e946 expref: 17 pid: 12225 timeout: 846 lvb_type: 1 00010000:00010000:3.0:1746147208.013853:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x313993942506209f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e946 expref: 17 pid: 12225 timeout: 846 lvb_type: 1 00010000:00010000:3.0:1746147208.013869:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0e00/0x313993942506209f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e946 expref: 17 pid: 12225 timeout: 846 lvb_type: 1 00002000:00010000:1.0:1746147208.013914:0:12201:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime: 1746147206 -> 1746147207 00000100:00100000:1.0:1746147208.013929:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311434624:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147208.013947:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d9ba00/0x31399394250621cc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9ee expref: 32 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147208.013957:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d9ba00/0x31399394250621cc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9ee expref: 32 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147208.013969:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9ba00, rc 0) 00000100:00100000:1.0:1746147208.013991:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2000:x1830967310273024:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3392us (4187us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147208.013997:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19673 00010000:00010000:2.0:1746147208.014005:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d94c00/0x31399394250620ad lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e962 expref: 15 pid: 13695 timeout: 846 lvb_type: 1 00010000:00010000:2.0:1746147208.014024:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.014026:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.014033:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 17 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.014041:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 17 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.014068:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 17 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.014077:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147208.014078:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311434752:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147208.014121:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310273408:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 289us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147208.014127:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8921 00000100:00100000:2.0:1746147208.014142:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147208.014564:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.014604:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.014830:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310273792 00000100:00100000:2.0:1746147208.014835:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310273792 00002000:00100000:2.0:1746147208.014866:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880098821f80 x1830967310273792/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147208.014881:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098821f80 with x1830967310273792 ext(0->1048575) 00002000:00010000:2.0:1746147208.014886:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098821f80 00000100:00100000:2.0:1746147208.014899:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310273920 00000100:00100000:2.0:1746147208.014901:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310273920 00002000:00100000:2.0:1746147208.014914:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->1716223) req@ffff880098822a00 x1830967310273920/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147208.014920:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098822a00 with x1830967310273920 ext(1048576->1716223) 00002000:00010000:2.0:1746147208.014923:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098822a00 00000100:00100000:2.0:1746147208.014933:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7204 00000100:00100000:2.0:1746147208.014937:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310273792:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147208.015058:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7205 00000100:00100000:3.0:1746147208.015065:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2002:x1830967310273920:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147208.017860:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.017947:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311434752:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147208.017966:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147208.018002:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310273280:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4327us (4567us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.018013:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8919 00000100:00100000:1.0:1746147208.018981:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310274176 00000100:00100000:1.0:1746147208.018989:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310274176 00002000:00100000:1.0:1746147208.019025:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1155072->1159167) req@ffff880098821c00 x1830967310274176/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.019034:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098821c00 with x1830967310274176 ext(1155072->1159167) 00002000:00010000:1.0:1746147208.019039:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098821c00 00000100:00100000:1.0:1746147208.019067:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7206 00000100:00100000:1.0:1746147208.019072:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967310274176:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147208.019894:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967310274176:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 818us (2041us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147208.019902:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7206 00002000:00100000:1.0:1746147208.019909:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1155072->1159167) req@ffff880098821c00 x1830967310274176/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/4536 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.019916:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098821c00 with x1830967310274176 ext(1155072->1159167) 00002000:00010000:1.0:1746147208.019919:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098821c00 00000100:00100000:3.0:1746147208.020681:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2002:x1830967310273920:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5614us (6074us total) trans 0 rc 667648/667648 00000100:00100000:3.0:1746147208.020690:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7205 00002000:00100000:3.0:1746147208.020696:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->1716223) req@ffff880098822a00 x1830967310273920/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.020713:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098822a00 with x1830967310273920 ext(1048576->1716223) 00002000:00010000:3.0:1746147208.020717:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098822a00 00000100:00100000:2.0:1746147208.022156:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310273792:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7213us (7587us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147208.022164:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7204 00002000:00100000:2.0:1746147208.022170:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880098821f80 x1830967310273792/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147208.022176:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098821f80 with x1830967310273792 ext(0->1048575) 00002000:00010000:2.0:1746147208.022179:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098821f80 00000100:00100000:1.0:1746147208.025304:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.025353:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.025383:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310274432 00000100:00100000:2.0:1746147208.025393:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310274432 00002000:00100000:2.0:1746147208.025437:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88012bab4380 x1830967310274432/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147208.025446:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab4380 with x1830967310274432 ext(0->1048575) 00002000:00010000:2.0:1746147208.025451:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bab4380 00000100:00100000:3.0:1746147208.025492:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310274688 00000100:00100000:3.0:1746147208.025497:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310274688 00000100:00100000:2.0:1746147208.025499:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7207 00000100:00100000:2.0:1746147208.025506:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967310274432:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147208.025526:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6114 00000100:00100000:3.0:1746147208.025531:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2743:x1830967310274688:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147208.025753:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2743:x1830967310274688:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 220us (399us total) trans 8589937285 rc 0/0 00000100:00100000:3.0:1746147208.025785:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6114 00000100:00100000:0.0:1746147208.032917:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.033802:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310274816 00000100:00100000:1.0:1746147208.033814:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310274816 00000100:00100000:1.0:1746147208.033875:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19674 00000100:00100000:1.0:1746147208.033885:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2752:x1830967310274816:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147208.033903:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147208.033925:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x31399394250621d3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e9f5 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.033958:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425062155 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9bd expref: 30 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.033966:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147208.033968:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147208.033971:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x31399394250621d3 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9f5 expref: 47 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.034002:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425062155 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9bd expref: 30 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.034015:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425062155 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9bd expref: 30 pid: 1854 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746147208.034028:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311434880:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147208.035556:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984899c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147208.036153:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967310274432:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10643us (10851us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147208.036165:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7207 00002000:00100000:3.0:1746147208.036177:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88012bab4380 x1830967310274432/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.036187:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab4380 with x1830967310274432 ext(0->1048575) 00002000:00010000:3.0:1746147208.036193:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bab4380 00000100:00100000:1.0:1746147208.038477:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311434880:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147208.038514:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x31399394250621d3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9f5 expref: 47 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.038534:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092543c00, rc 0) 00000100:00100000:1.0:1746147208.038583:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2752:x1830967310274816:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4699us (6041us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147208.038593:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19674 00000100:00100000:0.0:1746147208.040753:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.041019:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310274944 00000100:00100000:3.0:1746147208.041031:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310274944 00002000:00100000:3.0:1746147208.041082:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1409024->2097151) req@ffff880098820380 x1830967310274944/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.041195:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820380 with x1830967310274944 ext(1409024->2097151) 00010000:00010000:3.0:1746147208.041206:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425062155 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9bd expref: 31 pid: 1854 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.041220:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425062155 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9bd expref: 31 pid: 1854 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746147208.041227:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098820380 00000100:00100000:3.0:1746147208.041260:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1685 00000100:00100000:3.0:1746147208.041268:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2000:x1830967310274944:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147208.044972:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.045172:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310275072 00000100:00100000:1.0:1746147208.045182:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310275072 00000100:00100000:1.0:1746147208.045237:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19675 00000100:00100000:1.0:1746147208.045246:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2751:x1830967310275072:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147208.045264:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147208.045286:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x31399394250621da lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7e9fc expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.045316:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425062140 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a8 expref: 46 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.045323:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147208.045325:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147208.045329:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x31399394250621da lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9fc expref: 34 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.045363:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425062140 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a8 expref: 46 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.045373:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425062140 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a8 expref: 46 pid: 1854 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746147208.045384:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311435008:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147208.045480:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984899c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147208.047686:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311435008:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147208.047728:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x31399394250621da lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9fc expref: 34 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.047747:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092543a00, rc 0) 00000100:00100000:1.0:1746147208.047799:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+36:2751:x1830967310275072:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2552us (2836us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147208.047813:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19675 00000100:00100000:0.0:1746147208.048238:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.048419:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310275200 00000100:00100000:2.0:1746147208.048427:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310275200 00002000:00100000:2.0:1746147208.048464:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1716224->2097151) req@ffff880098822d80 x1830967310275200/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147208.048472:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098822d80 with x1830967310275200 ext(1716224->2097151) 00010000:00010000:2.0:1746147208.048479:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425062140 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a8 expref: 47 pid: 1854 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.048490:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425062140 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a8 expref: 47 pid: 1854 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746147208.048496:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098822d80 00000100:00100000:2.0:1746147208.048531:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1686 00000100:00100000:2.0:1746147208.048538:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2001:x1830967310275200:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147208.048790:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2000:x1830967310274944:12345-192.168.204.25@tcp:4:cat.0 Request processed in 7521us (8043us total) trans 17179875195 rc 0/0 00000100:00100000:3.0:1746147208.048797:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1685 00002000:00100000:3.0:1746147208.048803:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1409024->2097151) req@ffff880098820380 x1830967310274944/t17179875195(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/448 e 0 to 0 dl 1746147219 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.048811:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820380 with x1830967310274944 ext(1409024->2097151) 00010000:00010000:3.0:1746147208.048817:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425062155 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9bd expref: 34 pid: 1854 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.048826:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425062155 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9bd expref: 34 pid: 1854 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746147208.048831:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098820380 00000100:00100000:0.0:1746147208.052532:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.052662:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310275328 00000100:00100000:2.0:1746147208.052675:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310275328 00010000:00010000:2.0:1746147208.052728:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425062155 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9bd expref: 34 pid: 1854 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.052768:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8922 00000100:00100000:2.0:1746147208.052776:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2001:x1830967310275328:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147208.052796:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147208.052816:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425062155 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9bd expref: 34 pid: 1854 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.052826:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425062155 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9bd expref: 34 pid: 1854 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.052853:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c800/0x3139939425062155 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9bd expref: 34 pid: 1854 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.052872:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.052874:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.052882:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x31399394250621d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9f5 expref: 48 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.052891:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x31399394250621d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9f5 expref: 48 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.052930:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x31399394250621d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9f5 expref: 48 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147208.052943:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311435136:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147208.053016:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa180 going to sleep for 11 seconds 00000100:00100000:3.0:1746147208.054295:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2001:x1830967310275200:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5754us (6054us total) trans 17179875196 rc 0/0 00000100:00100000:3.0:1746147208.054306:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1686 00002000:00100000:3.0:1746147208.054316:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1716224->2097151) req@ffff880098822d80 x1830967310275200/t17179875196(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/448 e 0 to 0 dl 1746147219 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.054325:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098822d80 with x1830967310275200 ext(1716224->2097151) 00010000:00010000:3.0:1746147208.054335:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425062140 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a8 expref: 49 pid: 1854 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.054349:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425062140 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a8 expref: 49 pid: 1854 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746147208.054355:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098822d80 00000100:00100000:2.0:1746147208.055265:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311435136:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147208.055287:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147208.055325:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2001:x1830967310275328:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2550us (2809us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.055333:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8922 00000100:00100000:0.0:1746147208.056412:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.056452:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310275456 00000100:00100000:2.0:1746147208.056458:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310275456 00010000:00010000:2.0:1746147208.056483:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425062140 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a8 expref: 49 pid: 1854 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.056518:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8923 00000100:00100000:2.0:1746147208.056526:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2003:x1830967310275456:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147208.056538:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147208.056556:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425062140 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a8 expref: 49 pid: 1854 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.056568:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425062140 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a8 expref: 49 pid: 1854 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.056592:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009400bc00/0x3139939425062140 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a8 expref: 49 pid: 1854 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.056617:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.056619:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.056698:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x31399394250621da lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9fc expref: 32 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.056722:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x31399394250621da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9fc expref: 32 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.056755:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x31399394250621da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9fc expref: 32 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147208.056767:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311435264:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147208.056835:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147208.057731:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.057821:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311435264:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147208.057828:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310275712 00000100:00100000:3.0:1746147208.057834:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310275712 00010000:00010000:2.0:1746147208.057834:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147208.057869:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2003:x1830967310275456:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1343us (1460us total) trans 0 rc 0/0 00002000:00100000:3.0:1746147208.057871:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88009f084700 x1830967310275712/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147208.057877:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8923 00002000:00100000:3.0:1746147208.057887:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f084700 with x1830967310275712 ext(1048576->2097151) 00002000:00010000:3.0:1746147208.057891:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f084700 00000100:00100000:3.0:1746147208.057907:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7208 00000100:00100000:3.0:1746147208.057912:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2000:x1830967310275712:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147208.059518:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.059647:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310275968 00000100:00100000:2.0:1746147208.059652:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310275968 00002000:00100000:2.0:1746147208.059684:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88009f087480 x1830967310275968/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147208.059693:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087480 with x1830967310275968 ext(1048576->2097151) 00002000:00010000:2.0:1746147208.059698:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f087480 00000100:00100000:2.0:1746147208.059812:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7209 00000100:00100000:2.0:1746147208.059819:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2003:x1830967310275968:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147208.069182:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2003:x1830967310275968:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9349us (9657us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147208.069198:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7209 00002000:00100000:2.0:1746147208.069210:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88009f087480 x1830967310275968/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147208.069220:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087480 with x1830967310275968 ext(1048576->2097151) 00002000:00010000:2.0:1746147208.069228:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f087480 00000100:00100000:3.0:1746147208.074505:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2000:x1830967310275712:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16580us (16763us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147208.074519:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7208 00002000:00100000:3.0:1746147208.074533:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88009f084700 x1830967310275712/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.074544:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f084700 with x1830967310275712 ext(1048576->2097151) 00002000:00010000:3.0:1746147208.074550:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f084700 00000100:00100000:0.0:1746147208.074663:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.074968:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310276096 00000100:00100000:2.0:1746147208.074976:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310276096 00000100:00100000:2.0:1746147208.075061:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19676 00000100:00100000:2.0:1746147208.075069:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2751:x1830967310276096:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147208.075085:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147208.075120:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250621e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea03 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.075145:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.075147:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.075255:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250621e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea03 expref: 34 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.075272:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250621e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea03 expref: 34 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.075283:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbefa00, rc 0) 00000100:00100000:2.0:1746147208.075469:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2751:x1830967310276096:12345-192.168.204.25@tcp:101:cat.0 Request processed in 400us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.075475:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19676 00000100:00100000:0.0:1746147208.089000:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.089586:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310276224 00000100:00100000:2.0:1746147208.089596:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310276224 00000100:00100000:2.0:1746147208.089646:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19677 00000100:00100000:2.0:1746147208.089655:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2752:x1830967310276224:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147208.089676:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147208.089694:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x31399394250621e8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea0a expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.089737:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 15 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.089744:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147208.089746:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147208.089749:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x31399394250621e8 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea0a expref: 26 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.089785:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 15 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.089797:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 15 pid: 12225 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.089809:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311435392:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147208.091124:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147208.091759:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.091802:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310276736 00000100:00100000:3.0:1746147208.091810:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310276736 00000100:00100000:1.0:1746147208.091811:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:3.0:1746147208.092381:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1159168->2097151) req@ffff88012bab5180 x1830967310276736/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.092391:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab5180 with x1830967310276736 ext(1159168->2097151) 00010000:00010000:3.0:1746147208.092401:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 16 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.092416:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 16 pid: 12225 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746147208.092422:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bab5180 00000100:00100000:3.0:1746147208.092448:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310276608 00000100:00100000:3.0:1746147208.092452:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310276608 00000100:00100000:1.0:1746147208.092468:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1687 00002000:00100000:3.0:1746147208.092471:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88012bab5880 x1830967310276608/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147208.092476:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310276736:12345-192.168.204.25@tcp:3:cat.0 00002000:00100000:3.0:1746147208.092477:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab5880 with x1830967310276608 ext(1048576->2097151) 00002000:00010000:3.0:1746147208.092480:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bab5880 00000100:00100000:3.0:1746147208.092493:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7210 00000100:00100000:3.0:1746147208.092497:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2000:x1830967310276608:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147208.093289:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311435392:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147208.093320:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x31399394250621e8 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea0a expref: 26 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.093334:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbef000, rc 0) 00000100:00100000:3.0:1746147208.093362:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2752:x1830967310276224:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3708us (4372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147208.093370:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19677 00000100:00100000:0.0:1746147208.093376:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.093395:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310276864 00000100:00100000:3.0:1746147208.093398:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310276864 00002000:00100000:3.0:1746147208.093416:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1159167) req@ffff88011db14380 x1830967310276864/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.093424:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14380 with x1830967310276864 ext(1048576->1159167) 00010000:00010000:3.0:1746147208.093429:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 18 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.093437:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 18 pid: 12225 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746147208.093448:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011db14380 00000100:00100000:3.0:1746147208.093467:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1688 00000100:00100000:3.0:1746147208.093472:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310276864:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147208.100244:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310276864:12345-192.168.204.25@tcp:4:cat.0 Request processed in 6757us (6853us total) trans 21474842579 rc 0/0 00000100:00100000:0.0:1746147208.100259:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1688 00002000:00100000:0.0:1746147208.100272:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1159167) req@ffff88011db14380 x1830967310276864/t21474842579(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/448 e 0 to 0 dl 1746147219 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147208.100286:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14380 with x1830967310276864 ext(1048576->1159167) 00010000:00010000:0.0:1746147208.100297:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 20 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746147208.100312:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 20 pid: 12225 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746147208.100319:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011db14380 00000100:00100000:3.0:1746147208.103881:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2000:x1830967310276608:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11370us (12056us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147208.103894:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7210 00002000:00100000:3.0:1746147208.103906:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88012bab5880 x1830967310276608/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.103919:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab5880 with x1830967310276608 ext(1048576->2097151) 00002000:00010000:3.0:1746147208.104051:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bab5880 00000100:00100000:1.0:1746147208.105168:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310276736:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12688us (13408us total) trans 0 rc 937984/937984 00000100:00100000:1.0:1746147208.105177:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1687 00002000:00100000:1.0:1746147208.105184:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1159168->2097151) req@ffff88012bab5180 x1830967310276736/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:H/200/0 rc 937984/937984 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.105193:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab5180 with x1830967310276736 ext(1159168->2097151) 00010000:00010000:1.0:1746147208.105202:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 18 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.105218:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 18 pid: 12225 timeout: 846 lvb_type: 0 00002000:00010000:1.0:1746147208.105224:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bab5180 00000100:00100000:0.0:1746147208.111948:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.112187:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.112260:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310277120 00000100:00100000:2.0:1746147208.112269:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310277120 00010000:00010000:2.0:1746147208.112306:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 18 pid: 12225 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.112341:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8924 00000100:00100000:2.0:1746147208.112349:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310277120:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147208.112362:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147208.112384:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 18 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.112396:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 18 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.112421:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093715200/0x31399394250621c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e7 expref: 18 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.112452:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.112455:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.112463:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x31399394250621e8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea0a expref: 25 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.112470:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x31399394250621e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea0a expref: 25 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.112546:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x31399394250621e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea0a expref: 25 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147208.112639:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311435520:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147208.112690:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310276992 00000100:00100000:3.0:1746147208.112695:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310276992 00000100:00100000:3.0:1746147208.113150:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19678 00000100:00100000:3.0:1746147208.113157:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2751:x1830967310276992:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147208.113172:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147208.113182:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d42000/0x31399394250621ef lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea11 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.113196:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147208.113197:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147208.113201:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d42000/0x31399394250621ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea11 expref: 19 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.113211:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d42000/0x31399394250621ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea11 expref: 19 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.113219:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d42000, rc 0) 00000100:00100000:2.0:1746147208.113364:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147208.113688:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2751:x1830967310276992:12345-192.168.204.25@tcp:101:cat.0 Request processed in 529us (1751us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147208.113694:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19678 00000100:00100000:2.0:1746147208.115662:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311435520:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147208.115682:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147208.115836:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310277120:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3486us (3646us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.115846:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8924 00000100:00100000:0.0:1746147208.119836:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.120066:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.120183:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310277376 00000100:00100000:1.0:1746147208.120193:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310277376 00002000:00100000:1.0:1746147208.120247:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88011db14700 x1830967310277376/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.120257:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14700 with x1830967310277376 ext(1048576->2097151) 00002000:00010000:1.0:1746147208.120263:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db14700 00000100:00100000:1.0:1746147208.120283:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310277632 00000100:00100000:1.0:1746147208.120285:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310277632 00002000:00100000:1.0:1746147208.120296:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88011db14000 x1830967310277632/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.120303:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14000 with x1830967310277632 ext(1048576->2097151) 00002000:00010000:1.0:1746147208.120306:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db14000 00000100:00100000:1.0:1746147208.120331:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7211 00000100:00100000:1.0:1746147208.120339:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310277376:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147208.120438:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7212 00000100:00100000:2.0:1746147208.120447:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310277632:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147208.133248:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310277376:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12897us (13409us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147208.133263:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7211 00002000:00100000:1.0:1746147208.133276:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88011db14700 x1830967310277376/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.133286:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14700 with x1830967310277376 ext(1048576->2097151) 00002000:00010000:1.0:1746147208.133293:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db14700 00000100:00100000:3.0:1746147208.136456:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310277632:12345-192.168.204.25@tcp:3:cat.0 Request processed in 15999us (16378us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147208.136469:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7212 00002000:00100000:3.0:1746147208.136480:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88011db14000 x1830967310277632/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.136489:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14000 with x1830967310277632 ext(1048576->2097151) 00002000:00010000:3.0:1746147208.136494:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db14000 00000100:00100000:0.0:1746147208.153580:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.153637:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.153874:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310277888 00000100:00100000:1.0:1746147208.153884:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310277888 00002000:00100000:1.0:1746147208.153931:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88011db14e00 x1830967310277888/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.153941:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14e00 with x1830967310277888 ext(2097152->4194303) 00002000:00010000:1.0:1746147208.153946:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db14e00 00000100:00100000:1.0:1746147208.153973:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310278144 00000100:00100000:1.0:1746147208.153976:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310278144 00002000:00100000:1.0:1746147208.153990:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88011db14a80 x1830967310278144/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.154001:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14a80 with x1830967310278144 ext(2097152->4194303) 00002000:00010000:1.0:1746147208.154004:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db14a80 00000100:00100000:1.0:1746147208.154033:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7213 00000100:00100000:1.0:1746147208.154041:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310277888:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147208.155520:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7214 00000100:00100000:3.0:1746147208.155531:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2002:x1830967310278144:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147208.160258:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.160320:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.160418:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310278400 00000100:00100000:1.0:1746147208.160429:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310278400 00002000:00100000:1.0:1746147208.160476:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88011db15500 x1830967310278400/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.160486:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db15500 with x1830967310278400 ext(2097152->4194303) 00002000:00010000:1.0:1746147208.160492:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db15500 00000100:00100000:1.0:1746147208.160509:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310278656 00000100:00100000:1.0:1746147208.160511:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310278656 00002000:00100000:1.0:1746147208.160526:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88011db17480 x1830967310278656/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.160533:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db17480 with x1830967310278656 ext(2097152->4194303) 00002000:00010000:1.0:1746147208.160537:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db17480 00000100:00100000:1.0:1746147208.160550:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7215 00000100:00100000:1.0:1746147208.160558:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310278400:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147208.161875:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7216 00000100:00100000:2.0:1746147208.161885:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2000:x1830967310278656:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147208.177497:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310277888:12345-192.168.204.25@tcp:3:cat.0 Request processed in 23444us (23915us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147208.177511:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7213 00002000:00100000:1.0:1746147208.177525:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88011db14e00 x1830967310277888/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.177541:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14e00 with x1830967310277888 ext(2097152->4194303) 00002000:00010000:1.0:1746147208.177547:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db14e00 00000100:00100000:3.0:1746147208.185185:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2002:x1830967310278144:12345-192.168.204.25@tcp:3:cat.0 Request processed in 29646us (31537us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147208.185196:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7214 00002000:00100000:3.0:1746147208.185355:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88011db14a80 x1830967310278144/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.185364:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db14a80 with x1830967310278144 ext(2097152->4194303) 00002000:00010000:3.0:1746147208.185370:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db14a80 00000100:00100000:1.0:1746147208.200131:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310278400:12345-192.168.204.25@tcp:3:cat.0 Request processed in 39565us (39876us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147208.200141:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7215 00002000:00100000:1.0:1746147208.200152:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88011db15500 x1830967310278400/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.200160:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db15500 with x1830967310278400 ext(2097152->4194303) 00002000:00010000:1.0:1746147208.200165:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011db15500 00000100:00100000:0.0:1746147208.201586:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.202167:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310278784 00000100:00100000:3.0:1746147208.202177:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310278784 00000100:00100000:3.0:1746147208.202657:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19679 00000100:00100000:3.0:1746147208.202666:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011db16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2000:x1830967310278784:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147208.202683:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147208.202697:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x31399394250621f6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea18 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.202729:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147208.202731:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147208.202739:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x31399394250621f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea18 expref: 49 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147208.202752:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x31399394250621f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea18 expref: 49 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147208.202761:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43600, rc 0) 00000100:00100000:3.0:1746147208.202812:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2000:x1830967310278784:12345-192.168.204.25@tcp:101:cat.0 Request processed in 148us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147208.202817:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19679 00000100:00100000:3.0:1746147208.204226:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011db17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2000:x1830967310278656:12345-192.168.204.25@tcp:3:cat.0 Request processed in 42338us (43902us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147208.204234:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7216 00002000:00100000:3.0:1746147208.204241:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88011db17480 x1830967310278656/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.204249:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011db17480 with x1830967310278656 ext(2097152->4194303) 00002000:00010000:3.0:1746147208.204254:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011db17480 00000100:00100000:0.0:1746147208.211323:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.211406:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.211633:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310279040 00000100:00100000:3.0:1746147208.211642:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310279040 00002000:00100000:3.0:1746147208.211680:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880091d94a80 x1830967310279040/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.211690:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94a80 with x1830967310279040 ext(4194304->4890623) 00002000:00010000:3.0:1746147208.211694:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d94a80 00000100:00100000:1.0:1746147208.212134:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310279296 00000100:00100000:1.0:1746147208.212138:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310279296 00000100:00100000:1.0:1746147208.212170:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16405 00000100:00100000:1.0:1746147208.212176:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2756:x1830967310279296:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147208.212189:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147208.212205:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092562400/0x31399394250621fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea1f expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.212260:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425062204 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212270:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425062204 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212280:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425062204 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212291:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x313993942506220b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212296:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x313993942506220b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212301:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x313993942506220b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212377:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563800/0x3139939425062212 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212384:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092563800/0x3139939425062212 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212390:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092563800/0x3139939425062212 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:1.0:1746147208.212398:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147208.212454:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563800/0x3139939425062212 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212459:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092563800/0x3139939425062212 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212464:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092563800/0x3139939425062212 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212469:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092563800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147208.212472:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092563800/0x3139939425062212 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212477:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092563800/0x3139939425062212 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212485:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147208.212488:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147208.212491:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092563800/0x3139939425062212 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212495:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092563800/0x3139939425062212 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212522:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425062204 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212527:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425062204 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212531:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425062204 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212535:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092563a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147208.212537:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425062204 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212541:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425062204 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212547:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147208.212549:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147208.212552:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425062204 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212556:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092563a00/0x3139939425062204 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212563:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x313993942506220b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212567:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x313993942506220b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212571:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x313993942506220b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212575:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092562000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147208.212577:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x313993942506220b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212581:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x313993942506220b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212586:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f027200) 00010000:00010000:1.0:1746147208.212588:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147208.212589:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x313993942506220b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212594:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092562000/0x313993942506220b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:1.0:1746147208.212622:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092562400/0x31399394250621fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea1f expref: 32 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.212628:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092562400/0x31399394250621fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea1f expref: 32 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.212635:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092562400, rc 0) 00000100:00100000:1.0:1746147208.212677:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2756:x1830967310279296:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 501us (1271us total) trans 8589937286 rc 301/301 00000100:00100000:1.0:1746147208.212683:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16405 00000100:00100000:3.0:1746147208.213233:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7217 00000100:00100000:3.0:1746147208.213242:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310279040:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147208.219927:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.221225:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310279552 00000100:00100000:1.0:1746147208.221235:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310279552 00002000:00100000:1.0:1746147208.221281:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880097ebbb80 x1830967310279552/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.221292:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097ebbb80 with x1830967310279552 ext(4194304->4890623) 00002000:00010000:1.0:1746147208.221297:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097ebbb80 00000100:00100000:1.0:1746147208.221329:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7218 00000100:00100000:1.0:1746147208.221336:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310279552:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147208.222853:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310279040:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9604us (11528us total) trans 0 rc 696320/696320 00000100:00100000:3.0:1746147208.222863:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7217 00002000:00100000:3.0:1746147208.222872:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880091d94a80 x1830967310279040/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.222880:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94a80 with x1830967310279040 ext(4194304->4890623) 00002000:00010000:3.0:1746147208.222885:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d94a80 00000100:00100000:1.0:1746147208.235615:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310279552:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14268us (15685us total) trans 0 rc 696320/696320 00000100:00100000:1.0:1746147208.235628:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7218 00002000:00100000:1.0:1746147208.235642:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880097ebbb80 x1830967310279552/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.235650:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097ebbb80 with x1830967310279552 ext(4194304->4890623) 00002000:00010000:1.0:1746147208.235655:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097ebbb80 00000100:00100000:0.0:1746147208.236167:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.236250:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310279808 00000100:00100000:3.0:1746147208.236257:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310279808 00000100:00100000:3.0:1746147208.236291:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6115 00000100:00100000:3.0:1746147208.236296:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2752:x1830967310279808:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147208.238454:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2752:x1830967310279808:12345-192.168.204.25@tcp:35:cat.0 Request processed in 2145us (2352us total) trans 8589937287 rc 0/0 00000100:00100000:3.0:1746147208.238463:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6115 00000100:00100000:0.0:1746147208.250345:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.250434:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310280064 00000100:00100000:3.0:1746147208.250442:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310280064 00000100:00100000:3.0:1746147208.250481:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6116 00000100:00100000:3.0:1746147208.250488:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2751:x1830967310280064:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147208.250658:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2751:x1830967310280064:12345-192.168.204.25@tcp:35:cat.0 Request processed in 169us (321us total) trans 8589937288 rc 0/0 00000100:00100000:3.0:1746147208.250664:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6116 00000100:00100000:0.0:1746147208.257461:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.258202:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310280320 00000100:00100000:2.0:1746147208.258212:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310280320 00000100:00100000:2.0:1746147208.258458:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16406 00000100:00100000:2.0:1746147208.258467:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2758:x1830967310280320:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147208.258492:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147208.258511:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98200/0x3139939425062220 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea26 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.258585:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062227 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258599:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062227 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258609:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062227 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258624:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x313993942506222e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258631:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x313993942506222e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258637:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x313993942506222e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258746:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425062235 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258757:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425062235 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258763:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425062235 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:2.0:1746147208.258773:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147208.258846:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425062235 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258854:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425062235 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258859:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425062235 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258864:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f239e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147208.258868:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425062235 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258873:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425062235 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258884:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147208.258888:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147208.258892:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425062235 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258896:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f239e00/0x3139939425062235 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258958:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062227 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258964:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062227 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258968:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062227 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258972:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062227 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258976:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d99600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147208.258978:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062227 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258982:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062227 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258990:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147208.258992:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147208.258995:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062227 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.258999:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062227 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.259008:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x313993942506222e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.259013:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x313993942506222e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.259018:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x313993942506222e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.259021:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d99c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147208.259023:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x313993942506222e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.259028:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x313993942506222e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.259034:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096e23a00) 00010000:00010000:2.0:1746147208.259036:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147208.259038:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x313993942506222e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.259042:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x313993942506222e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147208.259079:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98200/0x3139939425062220 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea26 expref: 14 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.259086:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98200/0x3139939425062220 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea26 expref: 14 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.259128:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d98200, rc 0) 00000100:00100000:2.0:1746147208.259182:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2758:x1830967310280320:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 714us (1726us total) trans 8589937289 rc 301/301 00000100:00100000:2.0:1746147208.259189:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16406 00000100:00100000:0.0:1746147208.281997:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.282123:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310280448 00000100:00100000:1.0:1746147208.282132:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310280448 00000100:00100000:1.0:1746147208.285641:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19680 00000100:00100000:1.0:1746147208.285660:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2758:x1830967310280448:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147208.285677:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147208.285694:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092563800/0x3139939425062243 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea2d expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.285729:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x31399394250621da lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9fc expref: 35 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.285737:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x31399394250621f6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea18 expref: 48 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147208.285743:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147208.285745:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147208.285747:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092563800/0x3139939425062243 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1925120->2097151] (req 1925120->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea2d expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.285772:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x31399394250621f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea18 expref: 48 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147208.285791:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x31399394250621f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea18 expref: 48 pid: 12201 timeout: 846 lvb_type: 1 00000100:00100000:1.0:1746147208.285802:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311435648:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147208.285902:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x31399394250621da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9fc expref: 35 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.285910:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x31399394250621da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9fc expref: 35 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746147208.285917:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311435776:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147208.285933:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147208.290159:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.290189:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.290207:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310280576 00000100:00100000:0.0:1746147208.290213:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310280576 00010000:00010000:0.0:1746147208.290239:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x31399394250621f6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea18 expref: 49 pid: 12201 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746147208.290268:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310280704 00000100:00100000:0.0:1746147208.290270:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310280704 00010000:00010000:0.0:1746147208.290277:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x31399394250621da lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9fc expref: 36 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746147208.290289:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8925 00000100:00100000:0.0:1746147208.290294:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2001:x1830967310280576:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147208.290304:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147208.290319:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x31399394250621f6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea18 expref: 49 pid: 12201 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746147208.290328:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x31399394250621f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea18 expref: 49 pid: 12201 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746147208.290346:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147208.290376:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2001:x1830967310280576:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 82us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147208.290384:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8925 00000100:00100000:0.0:1746147208.290394:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8926 00000100:00100000:0.0:1746147208.290397:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+36:2003:x1830967310280704:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147208.290402:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147208.290407:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x31399394250621da lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9fc expref: 36 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746147208.290414:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x31399394250621da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9fc expref: 36 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746147208.290422:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147208.290424:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147208.290429:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092563800/0x3139939425062243 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea2d expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.290435:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092563800/0x3139939425062243 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea2d expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.290460:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092563800/0x3139939425062243 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea2d expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147208.290468:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311435904:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147208.290510:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff180 going to sleep for 11 seconds 00010000:00010000:1.0:1746147208.290645:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d43600/0x31399394250621f6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea18 expref: 48 pid: 12201 timeout: 846 lvb_type: 1 00000100:00100000:1.0:1746147208.290659:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311435648:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147208.290670:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092543a00/0x31399394250621da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9fc expref: 36 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746147208.290682:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311435776:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147208.290708:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092563800/0x3139939425062243 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea2d expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.290716:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563800, rc 0) 00000100:00100000:1.0:1746147208.290738:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+35:2758:x1830967310280448:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5086us (8749us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147208.290744:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19680 00000100:00100000:2.0:1746147208.294253:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.294372:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311435904:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147208.294390:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147208.294439:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2003:x1830967310280704:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4037us (4245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147208.294448:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8926 00000100:00100000:1.0:1746147208.294715:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310280960 00000100:00100000:1.0:1746147208.294720:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310280960 00002000:00100000:1.0:1746147208.294750:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x96:0x0] (1925120->1929215) req@ffff880097eb8380 x1830967310280960/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.294758:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097eb8380 with x1830967310280960 ext(1925120->1929215) 00002000:00010000:1.0:1746147208.294761:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097eb8380 00000100:00100000:1.0:1746147208.295503:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7219 00000100:00100000:1.0:1746147208.295510:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2000:x1830967310280960:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147208.295602:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2000:x1830967310280960:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 93us (1359us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147208.295607:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7219 00002000:00100000:1.0:1746147208.295611:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x96:0x0] (1925120->1929215) req@ffff880097eb8380 x1830967310280960/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/4536 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.295624:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097eb8380 with x1830967310280960 ext(1925120->1929215) 00002000:00010000:1.0:1746147208.295626:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097eb8380 00000100:00100000:0.0:1746147208.300510:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.300650:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310281088 00000100:00100000:1.0:1746147208.300661:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310281088 00000100:00100000:1.0:1746147208.300727:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19681 00000100:00100000:1.0:1746147208.300738:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2758:x1830967310281088:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147208.300756:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147208.300775:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x313993942506224a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea34 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.300803:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x31399394250621d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9f5 expref: 47 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.300811:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250621e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea03 expref: 35 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.300817:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147208.300819:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147208.300823:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x313993942506224a lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->1241087] (req 1048576->1241087) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea34 expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.300853:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250621e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea03 expref: 35 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.300865:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250621e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea03 expref: 35 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746147208.300881:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311436032:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147208.302940:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x31399394250621d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9f5 expref: 47 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.302951:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x31399394250621d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9f5 expref: 47 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746147208.302962:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311436160:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147208.303061:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147208.304075:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311436032:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147208.305373:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.307780:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310281216 00000100:00100000:2.0:1746147208.307791:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310281216 00010000:00010000:2.0:1746147208.307825:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250621e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea03 expref: 36 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.307857:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8927 00000100:00100000:2.0:1746147208.307863:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+36:2000:x1830967310281216:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147208.307874:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147208.307892:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250621e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea03 expref: 36 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.307902:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250621e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea03 expref: 36 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.307920:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbefa00/0x31399394250621e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea03 expref: 36 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.307952:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147208.307994:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+35:2000:x1830967310281216:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 131us (2625us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.308000:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8927 00000100:00100000:2.0:1746147208.308513:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.308577:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311436160:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147208.308600:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x313993942506224a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->1241087] (req 1048576->1241087) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea34 expref: 34 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.308610:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563600, rc 0) 00000100:00100000:1.0:1746147208.308633:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2758:x1830967310281088:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7898us (8133us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147208.308639:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19681 00000100:00100000:0.0:1746147208.308761:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310281344 00000100:00100000:0.0:1746147208.308765:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310281344 00010000:00010000:0.0:1746147208.308778:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x31399394250621d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9f5 expref: 48 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746147208.308794:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8928 00000100:00100000:0.0:1746147208.308799:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2000:x1830967310281344:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147208.308805:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147208.308813:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x31399394250621d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9f5 expref: 48 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746147208.308821:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x31399394250621d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9f5 expref: 48 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746147208.308833:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x31399394250621d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9f5 expref: 48 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746147208.308844:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147208.308846:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147208.308851:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x313993942506224a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea34 expref: 33 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.308858:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x313993942506224a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea34 expref: 33 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.308883:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x313993942506224a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea34 expref: 33 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147208.308892:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f55f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311436288:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147208.308938:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147208.310892:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f55f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311436288:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147208.310907:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147208.311053:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2000:x1830967310281344:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2145us (2433us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.311065:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8928 00000100:00100000:0.0:1746147208.311880:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.311947:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310281600 00000100:00100000:3.0:1746147208.311951:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310281600 00002000:00100000:3.0:1746147208.311983:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1236992->1241087) req@ffff880129f55500 x1830967310281600/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.311992:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55500 with x1830967310281600 ext(1236992->1241087) 00002000:00010000:3.0:1746147208.311995:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f55500 00000100:00100000:3.0:1746147208.312021:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7220 00000100:00100000:3.0:1746147208.312027:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2001:x1830967310281600:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147208.312131:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2001:x1830967310281600:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 104us (252us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147208.312136:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7220 00002000:00100000:3.0:1746147208.312140:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1236992->1241087) req@ffff880129f55500 x1830967310281600/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/4536 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.312147:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55500 with x1830967310281600 ext(1236992->1241087) 00002000:00010000:3.0:1746147208.312150:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f55500 00000100:00100000:0.0:1746147208.314557:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.314994:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310281856 00000100:00100000:2.0:1746147208.315002:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310281856 00000100:00100000:2.0:1746147208.315058:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6117 00000100:00100000:2.0:1746147208.315065:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2758:x1830967310281856:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147208.315609:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2758:x1830967310281856:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 544us (1057us total) trans 8589937290 rc 0/0 00000100:00100000:2.0:1746147208.315616:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6117 00000100:00100000:0.0:1746147208.359860:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.359954:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310281984 00000100:00100000:1.0:1746147208.359962:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310281984 00000100:00100000:1.0:1746147208.360012:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19682 00000100:00100000:1.0:1746147208.360020:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2756:x1830967310281984:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147208.360036:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147208.360051:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062251 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea3b expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.360085:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425062060 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e90e expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.360117:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d95600/0x31399394250620c9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e969 expref: 13 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147208.360123:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d9bc00/0x3139939425062075 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e923 expref: 17 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.360128:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147208.360130:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147208.360132:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062251 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2347008->3145727] (req 2347008->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea3b expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.360157:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d9bc00/0x3139939425062075 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e923 expref: 17 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.360166:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d9bc00/0x3139939425062075 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e923 expref: 17 pid: 12225 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746147208.360175:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311436416:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147208.360258:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d95600/0x31399394250620c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e969 expref: 13 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147208.360266:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d95600/0x31399394250620c9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e969 expref: 13 pid: 13695 timeout: 846 lvb_type: 1 00000100:00100000:1.0:1746147208.360274:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311436544:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147208.360298:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425062060 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e90e expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.360305:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425062060 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e90e expref: 27 pid: 9585 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746147208.360312:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311436672:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147208.360325:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147208.363499:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.363600:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310282112 00000100:00100000:2.0:1746147208.363607:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310282112 00010000:00010000:2.0:1746147208.363634:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95600/0x31399394250620c9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e969 expref: 14 pid: 13695 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746147208.363666:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8929 00000100:00100000:2.0:1746147208.363671:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310282112:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147208.363674:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311436416:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147208.363683:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311436544:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147208.363687:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147208.363690:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311436672:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147208.363715:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d95600/0x31399394250620c9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e969 expref: 14 pid: 13695 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746147208.363720:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062251 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [2347008->3145727] (req 2347008->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea3b expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.363725:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d95600/0x31399394250620c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e969 expref: 14 pid: 13695 timeout: 846 lvb_type: 1 00010000:00010000:2.0:1746147208.363911:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d95600/0x31399394250620c9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e969 expref: 14 pid: 13695 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746147208.363914:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563a00, rc 0) 00010000:00010000:2.0:1746147208.363939:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147208.363958:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2756:x1830967310281984:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3938us (4106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.363960:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310282112:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 289us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147208.363965:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19682 00000100:00100000:2.0:1746147208.363966:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8929 00000100:00100000:0.0:1746147208.366360:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.366480:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310282240 00000100:00100000:2.0:1746147208.366488:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310282240 00010000:00010000:2.0:1746147208.366519:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425062060 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e90e expref: 27 pid: 9585 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.366986:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8930 00000100:00100000:2.0:1746147208.366993:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310282240:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147208.367007:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147208.367026:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425062060 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e90e expref: 27 pid: 9585 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.367037:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425062060 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e90e expref: 27 pid: 9585 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.367057:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984eea00/0x3139939425062060 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e90e expref: 27 pid: 9585 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.367071:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147208.367153:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310282240:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 160us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.367159:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8930 00000100:00100000:1.0:1746147208.368117:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.368456:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310282368 00000100:00100000:3.0:1746147208.368463:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310282368 00010000:00010000:3.0:1746147208.368485:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d9bc00/0x3139939425062075 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e923 expref: 18 pid: 12225 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746147208.368515:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8931 00000100:00100000:3.0:1746147208.368520:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310282368:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147208.368531:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147208.368543:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d9bc00/0x3139939425062075 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e923 expref: 18 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.368553:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d9bc00/0x3139939425062075 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e923 expref: 18 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.368568:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d9bc00/0x3139939425062075 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e923 expref: 18 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.368581:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147208.368583:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147208.368589:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062251 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea3b expref: 25 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.368596:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062251 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea3b expref: 25 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.368622:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062251 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea3b expref: 25 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147208.368634:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311436800:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147208.368688:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147208.371433:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.371672:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310282624 00000100:00100000:0.0:1746147208.371679:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310282624 00000100:00100000:1.0:1746147208.371732:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.371747:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310282880 00000100:00100000:1.0:1746147208.371750:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310282880 00002000:00100000:1.0:1746147208.371775:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2347008->2351103) req@ffff88012bab5f80 x1830967310282880/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.371784:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab5f80 with x1830967310282880 ext(2347008->2351103) 00002000:00010000:1.0:1746147208.371788:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bab5f80 00000100:00100000:1.0:1746147208.371800:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7221 00000100:00100000:1.0:1746147208.371805:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310282880:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147208.371981:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16407 00000100:00100000:0.0:1746147208.371987:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2765:x1830967310282624:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147208.372006:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147208.372021:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80200/0x3139939425062258 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea42 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.372078:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942506225f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.372106:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942506225f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.372116:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942506225f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.372127:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x3139939425062266 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00000100:00100000:3.0:1746147208.372324:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311436800:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147208.372338:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147208.372362:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2002:x1830967310282368:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3842us (4273us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147208.372370:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8931 00000100:00100000:1.0:1746147208.372467:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310282880:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 660us (733us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147208.372473:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7221 00002000:00100000:1.0:1746147208.372478:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2347008->2351103) req@ffff88012bab5f80 x1830967310282880/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/4536 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.372486:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab5f80 with x1830967310282880 ext(2347008->2351103) 00002000:00010000:1.0:1746147208.372489:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bab5f80 00010000:00010000:0.0:1746147208.373343:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x3139939425062266 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373352:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x3139939425062266 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373460:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x313993942506226d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373469:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x313993942506226d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373475:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x313993942506226d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:0.0:1746147208.373483:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147208.373557:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x313993942506226d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373564:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x313993942506226d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373569:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x313993942506226d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373574:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db81800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147208.373577:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x313993942506226d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373583:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x313993942506226d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373592:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147208.373596:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147208.373600:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x313993942506226d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373605:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81800/0x313993942506226d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373630:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942506225f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373634:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942506225f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373639:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942506225f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373643:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db81200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147208.373646:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942506225f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373650:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942506225f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373657:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147208.373660:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147208.373662:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942506225f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373666:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81200/0x313993942506225f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373672:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x3139939425062266 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373675:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x3139939425062266 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373680:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x3139939425062266 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373683:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db81400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147208.373685:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x3139939425062266 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373689:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x3139939425062266 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373694:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094553900) 00010000:00010000:0.0:1746147208.373695:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147208.373710:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x3139939425062266 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373715:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db81400/0x3139939425062266 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:0.0:1746147208.373757:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80200/0x3139939425062258 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea42 expref: 34 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.373765:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db80200/0x3139939425062258 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea42 expref: 34 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.373771:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80200, rc 0) 00000100:00100000:0.0:1746147208.373811:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2765:x1830967310282624:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1824us (2385us total) trans 8589937291 rc 301/301 00000100:00100000:0.0:1746147208.373818:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16407 00000100:00100000:0.0:1746147208.382247:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.382328:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.382724:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310283136 00000100:00100000:1.0:1746147208.382779:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.382834:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310283136 00000100:00100000:3.0:1746147208.382836:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310283264 00000100:00100000:3.0:1746147208.382840:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310283264 00000100:00100000:3.0:1746147208.382878:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310283392 00000100:00100000:3.0:1746147208.382880:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310283392 00000100:00100000:3.0:1746147208.382896:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19683 00000100:00100000:3.0:1746147208.382904:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2001:x1830967310283264:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147208.382927:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147208.382945:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x313993942506227b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea50 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147208.382975:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19684 00000100:00100000:1.0:1746147208.382982:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2001:x1830967310283392:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147208.382989:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147208.382996:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062282 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea57 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147208.383001:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311436928:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147208.383014:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311437056:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147208.383049:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16408 00000100:00100000:2.0:1746147208.383055:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2767:x1830967310283136:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147208.383067:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147208.383073:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00010000:00010000:2.0:1746147208.383077:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98200/0x3139939425062289 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea49 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.383163:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x3139939425062290 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.383175:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x3139939425062290 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00000100:00100000:1.0:1746147208.383319:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489900 going to sleep for 11 seconds 00010000:00010000:2.0:1746147208.383737:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x3139939425062290 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.383753:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062297 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.383759:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062297 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.383765:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062297 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.383899:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x313993942506229e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.383908:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x313993942506229e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.383914:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x313993942506229e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:2.0:1746147208.383927:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147208.384010:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x313993942506229e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.384017:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x313993942506229e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.384022:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x313993942506229e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.384027:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d99a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147208.384030:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x313993942506229e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.384035:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x313993942506229e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.384044:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147208.384047:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147208.384050:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x313993942506229e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.384054:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99a00/0x313993942506229e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.384679:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x3139939425062290 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.384686:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x3139939425062290 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.384691:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x3139939425062290 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.384707:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d99c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147208.384709:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x3139939425062290 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.384714:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x3139939425062290 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.384721:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147208.384724:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147208.384726:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x3139939425062290 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.384731:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99c00/0x3139939425062290 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.384739:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062297 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.384743:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062297 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.384748:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062297 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.384752:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d99600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147208.384754:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062297 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.384759:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062297 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.384764:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096e23e00) 00010000:00010000:2.0:1746147208.384766:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746147208.384907:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.385049:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310283520 00000100:00100000:3.0:1746147208.385055:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310283520 00000100:00100000:3.0:1746147208.385113:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19685 00000100:00100000:3.0:1746147208.385120:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2756:x1830967310283520:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147208.385133:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147208.385145:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093708c00/0x31399394250622ac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea5e expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.385165:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425062044 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8f9 expref: 33 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.385173:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d95800/0x31399394250620b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e970 expref: 23 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147208.385184:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f01ac00/0x313993942506204b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e900 expref: 52 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.385190:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147208.385192:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147208.385195:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093708c00/0x31399394250622ac lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->2248703] (req 2097152->2248703) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea5e expref: 52 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.385223:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f01ac00/0x313993942506204b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e900 expref: 52 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.385234:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f01ac00/0x313993942506204b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e900 expref: 52 pid: 12225 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746147208.385244:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311437184:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147208.385306:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d95800/0x31399394250620b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e970 expref: 23 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147208.385315:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d95800/0x31399394250620b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e970 expref: 23 pid: 13695 timeout: 846 lvb_type: 1 00000100:00100000:3.0:1746147208.385322:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311437312:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147208.385344:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425062044 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8f9 expref: 33 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.385355:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425062044 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8f9 expref: 33 pid: 1136 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746147208.385363:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311437440:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147208.385377:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00010000:00010000:2.0:1746147208.385637:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062297 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.385643:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d99600/0x3139939425062297 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:2.0:1746147208.385686:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98200/0x3139939425062289 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea49 expref: 16 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.385692:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98200/0x3139939425062289 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea49 expref: 16 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.385709:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d98200, rc 0) 00000100:00100000:2.0:1746147208.385737:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2767:x1830967310283136:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2683us (3499us total) trans 8589937292 rc 301/301 00000100:00100000:2.0:1746147208.385744:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16408 00002000:00010000:2.0:1746147208.387329:0:12201:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime: 1746147207 -> 1746147208 00002000:00010000:2.0:1746147208.387336:0:12201:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime: 1746147207 -> 1746147208 00002000:00010000:2.0:1746147208.387338:0:12201:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime: 1746147207 -> 1746147208 00000100:00100000:2.0:1746147208.387368:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311436928:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147208.387395:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x313993942506227b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea50 expref: 52 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147208.387407:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x313993942506227b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea50 expref: 52 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147208.387416:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d42600, rc 0) 00000100:00100000:2.0:1746147208.387449:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2001:x1830967310283264:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4545us (5121us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147208.387456:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19683 00002000:00010000:0.0:1746147208.388436:0:10340:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime: 1746147207 -> 1746147208 00002000:00010000:0.0:1746147208.388441:0:10340:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime: 1746147207 -> 1746147208 00002000:00010000:0.0:1746147208.388442:0:10340:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime: 1746147207 -> 1746147208 00000100:00100000:0.0:1746147208.388454:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311437056:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147208.388612:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062282 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea57 expref: 50 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147208.388623:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062282 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea57 expref: 50 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147208.388645:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092562c00, rc 0) 00000100:00100000:0.0:1746147208.388672:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2001:x1830967310283392:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5691us (5893us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147208.388678:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19684 00000100:00100000:0.0:1746147208.392777:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.392841:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310283648 00000100:00100000:2.0:1746147208.392848:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310283648 00000100:00100000:0.0:1746147208.392871:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.392898:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.392983:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19686 00000100:00100000:2.0:1746147208.392990:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967310283648:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147208.393005:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147208.393021:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33000/0x31399394250622b3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea65 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147208.393038:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310283776 00000100:00100000:3.0:1746147208.393043:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310283776 00010000:00010000:3.0:1746147208.393063:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95800/0x31399394250620b4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e970 expref: 24 pid: 13695 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746147208.393065:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311437568:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147208.393082:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310283904 00000100:00100000:3.0:1746147208.393084:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310283904 00010000:00010000:3.0:1746147208.393115:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f01ac00/0x313993942506204b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e900 expref: 49 pid: 12225 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746147208.393147:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8932 00000100:00100000:3.0:1746147208.393153:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2000:x1830967310283776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147208.393162:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147208.393179:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d95800/0x31399394250620b4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e970 expref: 24 pid: 13695 timeout: 846 lvb_type: 1 00010000:00010000:3.0:1746147208.393188:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d95800/0x31399394250620b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e970 expref: 24 pid: 13695 timeout: 846 lvb_type: 1 00010000:00010000:3.0:1746147208.393207:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147208.393508:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2000:x1830967310283776:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 354us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147208.393514:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8932 00000100:00100000:1.0:1746147208.393523:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8933 00000100:00100000:2.0:1746147208.393528:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147208.393557:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2002:x1830967310283904:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147208.393567:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147208.393579:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f01ac00/0x313993942506204b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e900 expref: 49 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.393588:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f01ac00/0x313993942506204b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e900 expref: 49 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.393599:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147208.393624:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2002:x1830967310283904:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 69us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147208.393791:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8933 00010000:00010000:3.0:1746147208.393816:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f01ac00/0x313993942506204b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e900 expref: 48 pid: 12225 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746147208.393837:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311437184:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147208.393848:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95800/0x31399394250620b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e970 expref: 23 pid: 13695 timeout: 846 lvb_type: 1 00000100:00100000:3.0:1746147208.393855:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009988b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311437312:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147208.393861:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311437440:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147208.393881:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093708c00/0x31399394250622ac lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->2248703] (req 2097152->2248703) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea5e expref: 47 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.393888:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093708c00, rc 0) 00000100:00100000:3.0:1746147208.393905:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2756:x1830967310283520:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8786us (9001us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147208.393910:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19685 00000100:00100000:1.0:1746147208.394746:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.394764:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310284032 00000100:00100000:1.0:1746147208.394768:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310284032 00010000:00010000:1.0:1746147208.394786:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425062044 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8f9 expref: 34 pid: 1136 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746147208.394815:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8934 00000100:00100000:1.0:1746147208.394821:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2001:x1830967310284032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147208.394830:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147208.394840:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425062044 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8f9 expref: 34 pid: 1136 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.394853:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425062044 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8f9 expref: 34 pid: 1136 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.394867:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ff4600/0x3139939425062044 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e8f9 expref: 34 pid: 1136 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.394879:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147208.394880:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147208.394885:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093708c00/0x31399394250622ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea5e expref: 46 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.394892:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093708c00/0x31399394250622ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea5e expref: 46 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.394914:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093708c00/0x31399394250622ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea5e expref: 46 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147208.394923:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311437696:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147208.394971:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489d80 going to sleep for 11 seconds 00002000:00010000:2.0:1746147208.396663:0:10340:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746147207 -> 1746147208 00002000:00010000:2.0:1746147208.396669:0:10340:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746147206 -> 1746147208 00002000:00010000:2.0:1746147208.396671:0:10340:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime: 1746147207 -> 1746147208 00000100:00100000:2.0:1746147208.396685:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311437568:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147208.396715:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33000/0x31399394250622b3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea65 expref: 18 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147208.396726:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33000/0x31399394250622b3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea65 expref: 18 pid: 10340 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147208.396728:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311437696:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147208.396736:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33000, rc 0) 00010000:00010000:1.0:1746147208.396739:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147208.396766:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967310283648:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3776us (3996us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147208.396768:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2001:x1830967310284032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1948us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.396773:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19686 00000100:00100000:1.0:1746147208.396774:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8934 00000100:00100000:0.0:1746147208.400378:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.400475:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.400690:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310284416 00000100:00100000:2.0:1746147208.400707:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310284416 00000100:00100000:1.0:1746147208.400711:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310284288 00000100:00100000:1.0:1746147208.400716:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310284288 00000100:00100000:2.0:1746147208.400748:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19687 00002000:00100000:1.0:1746147208.400749:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (2244608->2248703) req@ffff8801322e9c00 x1830967310284288/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746147208.400755:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2765:x1830967310284416:12345-192.168.204.25@tcp:101:cat.0 00002000:00100000:1.0:1746147208.400758:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801322e9c00 with x1830967310284288 ext(2244608->2248703) 00002000:00010000:1.0:1746147208.400762:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801322e9c00 00010000:00010000:2.0:1746147208.400768:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147208.400777:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7222 00010000:00010000:2.0:1746147208.400782:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x31399394250622ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea6c expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147208.400782:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2003:x1830967310284288:12345-192.168.204.25@tcp:3:multiop.0 00010000:00010000:2.0:1746147208.400802:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092563800/0x3139939425062243 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea2d expref: 32 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.400809:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147208.400810:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147208.400813:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x31399394250622ba lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea6c expref: 49 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.400836:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092563800/0x3139939425062243 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea2d expref: 32 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147208.400893:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2003:x1830967310284288:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 111us (523us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147208.400898:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7222 00002000:00100000:1.0:1746147208.400903:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (2244608->2248703) req@ffff8801322e9c00 x1830967310284288/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/4536 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.400909:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801322e9c00 with x1830967310284288 ext(2244608->2248703) 00002000:00010000:1.0:1746147208.400911:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801322e9c00 00010000:00010000:2.0:1746147208.400974:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092563800/0x3139939425062243 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea2d expref: 32 pid: 12225 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.400984:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311437824:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147208.401034:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147208.406584:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.406631:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.406687:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311437824:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147208.406722:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x31399394250622ba lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea6c expref: 48 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.406743:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33200, rc 0) 00000100:00100000:2.0:1746147208.406800:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2765:x1830967310284416:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6044us (6324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.406807:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19687 00000100:00100000:2.0:1746147208.406835:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310284672 00000100:00100000:2.0:1746147208.406840:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310284672 00000100:00100000:2.0:1746147208.406865:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19688 00000100:00100000:2.0:1746147208.406871:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2767:x1830967310284672:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147208.406882:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147208.406894:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x31399394250622c1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea73 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.406913:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147208.406917:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x31399394250622c1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea73 expref: 34 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.406924:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x31399394250622c1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea73 expref: 34 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.406930:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32400, rc 0) 00000100:00100000:2.0:1746147208.406945:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2767:x1830967310284672:12345-192.168.204.25@tcp:101:cat.0 Request processed in 74us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.406949:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19688 00000100:00100000:3.0:1746147208.407018:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310284544 00000100:00100000:3.0:1746147208.407021:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310284544 00002000:00100000:3.0:1746147208.407044:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1925120->2097151) req@ffff8801322e8e00 x1830967310284544/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.407051:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801322e8e00 with x1830967310284544 ext(1925120->2097151) 00010000:00010000:3.0:1746147208.407057:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092563800/0x3139939425062243 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea2d expref: 34 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.407067:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092563800/0x3139939425062243 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea2d expref: 34 pid: 12225 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746147208.407072:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801322e8e00 00000100:00100000:3.0:1746147208.407105:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1689 00000100:00100000:3.0:1746147208.407110:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2001:x1830967310284544:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147208.411679:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.411804:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310284928 00000100:00100000:2.0:1746147208.411814:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310284928 00000100:00100000:2.0:1746147208.412496:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6118 00000100:00100000:2.0:1746147208.412505:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b9a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2756:x1830967310284928:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147208.412671:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b9a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2756:x1830967310284928:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 167us (1000us total) trans 8589937293 rc 0/0 00000100:00100000:2.0:1746147208.412677:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6118 00000100:00100000:3.0:1746147208.416652:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+36:2001:x1830967310284544:12345-192.168.204.25@tcp:4:cat.0 Request processed in 9532us (10286us total) trans 17179875197 rc 0/0 00000100:00100000:3.0:1746147208.416663:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1689 00002000:00100000:3.0:1746147208.416673:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1925120->2097151) req@ffff8801322e8e00 x1830967310284544/t17179875197(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/448 e 0 to 0 dl 1746147219 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.416682:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801322e8e00 with x1830967310284544 ext(1925120->2097151) 00010000:00010000:3.0:1746147208.416690:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092563800/0x3139939425062243 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea2d expref: 36 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.416713:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092563800/0x3139939425062243 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea2d expref: 36 pid: 12225 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746147208.416719:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801322e8e00 00000001:00080000:1.0:1746147208.420146:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875197 is committed 00000001:00080000:1.0:1746147208.420159:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875196 is committed 00000001:00080000:1.0:1746147208.420168:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875193 is committed 00000001:00080000:1.0:1746147208.420217:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875158 is committed 00000100:00100000:0.0:1746147208.424664:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.424811:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310285056 00000100:00100000:1.0:1746147208.424820:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310285056 00010000:00010000:1.0:1746147208.424851:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092563800/0x3139939425062243 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea2d expref: 8 pid: 12225 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746147208.425258:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8935 00000100:00100000:1.0:1746147208.425266:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310285056:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147208.425282:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147208.425299:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092563800/0x3139939425062243 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea2d expref: 8 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.425312:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092563800/0x3139939425062243 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea2d expref: 8 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.425332:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092563800/0x3139939425062243 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1925120->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea2d expref: 8 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.425350:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147208.425352:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147208.425360:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x31399394250622ba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea6c expref: 23 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.425367:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x31399394250622ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea6c expref: 23 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.425374:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147208.425375:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147208.425378:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x31399394250622c1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea73 expref: 7 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.425384:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x31399394250622c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea73 expref: 7 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.425410:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x31399394250622c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea73 expref: 7 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147208.425425:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311437952:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147208.426326:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x31399394250622ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea6c expref: 23 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147208.426335:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311438080:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147208.426375:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147208.430610:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311438080:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147208.434651:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.434825:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310285312 00000100:00100000:3.0:1746147208.434834:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310285312 00002000:00100000:3.0:1746147208.434872:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8801322ea300 x1830967310285312/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.434881:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801322ea300 with x1830967310285312 ext(1048576->2097151) 00002000:00010000:3.0:1746147208.434886:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801322ea300 00000100:00100000:3.0:1746147208.434920:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7223 00000100:00100000:3.0:1746147208.434928:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310285312:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147208.435645:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311437952:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147208.435663:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147208.435689:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2000:x1830967310285056:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 10424us (11033us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.435711:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8935 00000100:00100000:0.0:1746147208.442233:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.442338:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310285568 00000100:00100000:1.0:1746147208.442347:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310285568 00002000:00100000:1.0:1746147208.442386:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8801322e9180 x1830967310285568/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.442396:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801322e9180 with x1830967310285568 ext(1048576->2097151) 00002000:00010000:1.0:1746147208.442401:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801322e9180 00000100:00100000:1.0:1746147208.442456:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7224 00000100:00100000:1.0:1746147208.442463:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2001:x1830967310285568:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147208.446171:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.446172:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.446249:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310286080 00000100:00100000:3.0:1746147208.446256:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310286080 00000100:00100000:2.0:1746147208.446264:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310285824 00000100:00100000:2.0:1746147208.446268:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310285824 00000100:00100000:3.0:1746147208.446308:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16409 00000100:00100000:3.0:1746147208.446316:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2770:x1830967310286080:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147208.446333:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147208.446348:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093709600/0x31399394250622c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea7a expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.446402:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093709000/0x31399394250622cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.446412:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093709000/0x31399394250622cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.446421:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093709000/0x31399394250622cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.446431:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x31399394250622d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.446435:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x31399394250622d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.446440:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x31399394250622d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00002000:00100000:2.0:1746147208.446459:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1241088->2097151) req@ffff880099889880 x1830967310285824/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147208.446468:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099889880 with x1830967310285824 ext(1241088->2097151) 00002000:00010000:2.0:1746147208.446474:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099889880 00010000:00010000:3.0:1746147208.446514:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x31399394250622dd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.446521:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x31399394250622dd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.446527:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x31399394250622dd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147208.446534:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147208.446587:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x31399394250622dd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.446594:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x31399394250622dd lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.446600:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x31399394250622dd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.446605:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093709200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147208.446608:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x31399394250622dd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.446614:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x31399394250622dd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.446623:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147208.446625:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147208.446628:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x31399394250622dd lrc: 2/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.446632:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x31399394250622dd lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00000100:00100000:0.0:1746147208.447109:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310285312:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12181us (12463us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147208.447119:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7223 00002000:00100000:0.0:1746147208.447125:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8801322ea300 x1830967310285312/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147208.447132:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801322ea300 with x1830967310285312 ext(1048576->2097151) 00002000:00010000:0.0:1746147208.447136:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801322ea300 00000100:00100000:0.0:1746147208.447149:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7225 00000100:00100000:0.0:1746147208.447155:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310285824:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:3.0:1746147208.447500:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093709000/0x31399394250622cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.447511:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093709000/0x31399394250622cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.447516:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093709000/0x31399394250622cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.447520:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093709000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147208.447523:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093709000/0x31399394250622cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.447527:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093709000/0x31399394250622cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.447535:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147208.447537:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147208.447539:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093709000/0x31399394250622cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.447544:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093709000/0x31399394250622cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.447551:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x31399394250622d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.447555:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x31399394250622d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.447559:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x31399394250622d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.447562:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093708200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147208.447564:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x31399394250622d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.447571:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x31399394250622d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.447576:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009823a100) 00010000:00010000:3.0:1746147208.447578:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147208.447579:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x31399394250622d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.447583:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093708200/0x31399394250622d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.447620:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093709600/0x31399394250622c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea7a expref: 17 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.447625:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093709600/0x31399394250622c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea7a expref: 17 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.447632:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093709600, rc 0) 00000100:00100000:3.0:1746147208.447646:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2770:x1830967310286080:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1332us (1476us total) trans 8589937294 rc 301/301 00000100:00100000:3.0:1746147208.447652:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16409 00000100:00100000:1.0:1746147208.456757:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310285568:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14283us (14523us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147208.456767:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7224 00002000:00100000:1.0:1746147208.456782:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8801322e9180 x1830967310285568/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.456791:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801322e9180 with x1830967310285568 ext(1048576->2097151) 00002000:00010000:1.0:1746147208.456797:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801322e9180 00000100:00100000:0.0:1746147208.456877:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310285824:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9721us (10714us total) trans 0 rc 856064/856064 00000100:00100000:0.0:1746147208.456884:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7225 00002000:00100000:0.0:1746147208.456890:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1241088->2097151) req@ffff880099889880 x1830967310285824/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 856064/856064 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147208.456897:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099889880 with x1830967310285824 ext(1241088->2097151) 00002000:00010000:0.0:1746147208.456901:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099889880 00000100:00100000:0.0:1746147208.464207:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.464373:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310286208 00000100:00100000:2.0:1746147208.464381:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310286208 00000100:00100000:2.0:1746147208.464429:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19689 00000100:00100000:2.0:1746147208.464436:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801322ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2765:x1830967310286208:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147208.464452:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147208.464467:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250622eb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea81 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.464496:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x313993942506224a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea34 expref: 6 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.464503:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147208.464504:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147208.464507:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250622eb lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea81 expref: 25 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.464533:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x313993942506224a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea34 expref: 6 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.464543:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x313993942506224a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea34 expref: 6 pid: 12225 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.464553:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311438208:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147208.464642:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147208.469021:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311438208:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147208.469048:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250622eb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea81 expref: 25 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.469064:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d42600, rc 0) 00000100:00100000:2.0:1746147208.469264:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801322ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2765:x1830967310286208:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4827us (5183us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.469272:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19689 00000100:00100000:0.0:1746147208.470771:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.470911:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310286336 00000100:00100000:1.0:1746147208.470920:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310286336 00002000:00100000:1.0:1746147208.470961:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1241087) req@ffff88009514f100 x1830967310286336/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.470969:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514f100 with x1830967310286336 ext(1048576->1241087) 00010000:00010000:1.0:1746147208.470978:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x313993942506224a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea34 expref: 7 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.470991:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x313993942506224a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea34 expref: 7 pid: 12225 timeout: 846 lvb_type: 0 00002000:00010000:1.0:1746147208.470997:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009514f100 00000100:00100000:0.0:1746147208.471954:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1690 00000100:00100000:0.0:1746147208.471966:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2001:x1830967310286336:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147208.472423:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.472509:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310286464 00000100:00100000:3.0:1746147208.472514:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310286464 00000100:00100000:3.0:1746147208.472552:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19690 00000100:00100000:3.0:1746147208.472558:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2767:x1830967310286464:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147208.472566:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147208.472581:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x31399394250622f2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea88 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.472603:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147208.472608:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x31399394250622f2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea88 expref: 10 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.472618:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x31399394250622f2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea88 expref: 10 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.472625:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cd3400, rc 0) 00000100:00100000:3.0:1746147208.472649:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2767:x1830967310286464:12345-192.168.204.25@tcp:101:cat.0 Request processed in 91us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147208.472654:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19690 00000100:00100000:2.0:1746147208.476811:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310286336:12345-192.168.204.25@tcp:4:cat.0 Request processed in 4841us (6038us total) trans 17179875198 rc 0/0 00000100:00100000:2.0:1746147208.476823:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1690 00002000:00100000:2.0:1746147208.476834:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1241087) req@ffff88009514f100 x1830967310286336/t17179875198(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/448 e 0 to 0 dl 1746147219 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147208.476843:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514f100 with x1830967310286336 ext(1048576->1241087) 00010000:00010000:2.0:1746147208.476852:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x313993942506224a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea34 expref: 10 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.476865:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x313993942506224a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea34 expref: 10 pid: 12225 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746147208.476872:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009514f100 00000100:00100000:0.0:1746147208.481911:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.482137:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310286592 00000100:00100000:2.0:1746147208.482145:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310286592 00010000:00010000:2.0:1746147208.482178:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x313993942506224a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea34 expref: 10 pid: 12225 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.482218:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8936 00000100:00100000:2.0:1746147208.482226:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310286592:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147208.482238:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147208.482255:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x313993942506224a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea34 expref: 10 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.482266:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x313993942506224a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea34 expref: 10 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.482289:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092563600/0x313993942506224a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea34 expref: 10 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.482315:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.482317:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.482323:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250622eb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea81 expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.482330:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250622eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea81 expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.482337:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.482338:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.482341:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x31399394250622f2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea88 expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.482346:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x31399394250622f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea88 expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.482373:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x31399394250622f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea88 expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147208.482508:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311438336:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147208.482586:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250622eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea81 expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147208.482597:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311438464:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147208.482613:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147208.486799:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.486914:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310286848 00000100:00100000:3.0:1746147208.486926:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310286848 00002000:00100000:3.0:1746147208.486966:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88012ca13100 x1830967310286848/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.486975:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca13100 with x1830967310286848 ext(1048576->2097151) 00000100:00100000:2.0:1746147208.486976:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311438336:192.168.204.25@tcp:105: 00002000:00010000:3.0:1746147208.486979:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca13100 00000100:00100000:2.0:1746147208.486986:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311438464:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147208.487002:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147208.487011:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7226 00000100:00100000:3.0:1746147208.487018:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310286848:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147208.487035:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310286592:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4809us (5132us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.487044:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8936 00000100:00100000:3.0:1746147208.488198:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.488221:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310287104 00000100:00100000:3.0:1746147208.488225:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310287104 00002000:00100000:3.0:1746147208.488251:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88009988b800 x1830967310287104/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.488260:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009988b800 with x1830967310287104 ext(1048576->2097151) 00002000:00010000:3.0:1746147208.488263:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009988b800 00000100:00100000:3.0:1746147208.488289:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7227 00000100:00100000:3.0:1746147208.488296:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310287104:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147208.495820:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310286848:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8793us (9019us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147208.495832:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7226 00002000:00100000:3.0:1746147208.495842:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88012ca13100 x1830967310286848/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.495851:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca13100 with x1830967310286848 ext(1048576->2097151) 00002000:00010000:3.0:1746147208.495856:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca13100 00000100:00100000:3.0:1746147208.503076:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009988b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310287104:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14770us (14872us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147208.503106:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7227 00002000:00100000:3.0:1746147208.503118:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88009988b800 x1830967310287104/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.503127:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009988b800 with x1830967310287104 ext(1048576->2097151) 00002000:00010000:3.0:1746147208.503132:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009988b800 00000100:00100000:0.0:1746147208.514760:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.515296:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310287360 00000100:00100000:2.0:1746147208.515304:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310287360 00000100:00100000:2.0:1746147208.515357:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19691 00000100:00100000:2.0:1746147208.515363:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2002:x1830967310287360:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147208.515377:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147208.515391:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a73e00/0x31399394250622f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea8f expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147208.515432:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311438592:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147208.515802:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.515857:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.515881:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.515903:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310287616 00000100:00100000:0.0:1746147208.515906:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310287616 00000100:00100000:3.0:1746147208.515947:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310287872 00000100:00100000:3.0:1746147208.515950:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310287872 00000100:00100000:3.0:1746147208.515970:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19692 00000100:00100000:3.0:1746147208.515975:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967310287872:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147208.515983:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147208.515992:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e573e00/0x3139939425062300 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea96 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147208.516019:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311438720:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147208.516048:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310287744 00000100:00100000:3.0:1746147208.516051:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310287744 00000100:00100000:2.0:1746147208.516692:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147208.516723:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00002000:00100000:0.0:1746147208.517834:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (2248704->4194303) req@ffff88012ca10000 x1830967310287616/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.517835:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880099150e00 x1830967310287744/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 504/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.517845:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150e00 with x1830967310287744 ext(2097152->4194303) 00002000:00100000:0.0:1746147208.517845:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca10000 with x1830967310287616 ext(2248704->4194303) 00002000:00010000:3.0:1746147208.517849:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099150e00 00002000:00010000:0.0:1746147208.517849:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca10000 00000100:00100000:3.0:1746147208.517928:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7228 00000100:00100000:3.0:1746147208.517936:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310287744:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147208.517958:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7229 00000100:00100000:0.0:1746147208.517966:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310287616:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147208.521645:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311438592:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147208.521671:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a73e00/0x31399394250622f9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea8f expref: 18 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147208.521689:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a73e00/0x31399394250622f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea8f expref: 18 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147208.521719:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a73e00, rc 0) 00000100:00100000:2.0:1746147208.521758:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2002:x1830967310287360:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6393us (7004us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147208.521766:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19691 00002000:00010000:2.0:1746147208.524577:0:12201:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime: 1746147207 -> 1746147208 00002000:00010000:2.0:1746147208.524588:0:12201:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime: 1746147206 -> 1746147208 00002000:00010000:2.0:1746147208.524590:0:12201:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime: 1746147207 -> 1746147208 00000100:00100000:2.0:1746147208.524614:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311438720:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147208.524657:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e573e00/0x3139939425062300 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea96 expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147208.524674:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e573e00/0x3139939425062300 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea96 expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147208.524687:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e573e00, rc 0) 00000100:00100000:2.0:1746147208.524758:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967310287872:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8778us (8872us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147208.524767:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19692 00000100:00100000:0.0:1746147208.536359:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.536612:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310288000 00000100:00100000:2.0:1746147208.536624:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310288000 00000100:00100000:2.0:1746147208.536706:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19693 00000100:00100000:2.0:1746147208.536718:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2767:x1830967310288000:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147208.536739:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147208.536763:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d43400/0x3139939425062307 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ea9d expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.536797:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062251 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea3b expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.536807:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147208.536809:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147208.536813:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d43400/0x3139939425062307 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea9d expref: 18 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.536851:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062251 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea3b expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.536865:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062251 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea3b expref: 27 pid: 12225 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.536878:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311438848:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147208.536979:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147208.537453:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310287616:12345-192.168.204.25@tcp:3:cat.0 Request processed in 19481us (21644us total) trans 0 rc 1945600/1945600 00000100:00100000:1.0:1746147208.537463:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7229 00002000:00100000:1.0:1746147208.537471:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (2248704->4194303) req@ffff88012ca10000 x1830967310287616/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 1945600/1945600 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.537480:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca10000 with x1830967310287616 ext(2248704->4194303) 00002000:00010000:1.0:1746147208.537485:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca10000 00000100:00100000:3.0:1746147208.541062:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310287744:12345-192.168.204.25@tcp:3:cat.0 Request processed in 23120us (25197us total) trans 0 rc 1298432/1298432 00000100:00100000:3.0:1746147208.541073:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7228 00002000:00100000:3.0:1746147208.541082:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880099150e00 x1830967310287744/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 504/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 1298432/1298432 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.541121:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150e00 with x1830967310287744 ext(2097152->4194303) 00010000:00010000:3.0:1746147208.541131:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062251 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea3b expref: 26 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.541145:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062251 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea3b expref: 26 pid: 12225 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746147208.541151:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099150e00 00000100:00100000:0.0:1746147208.542259:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.542391:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311438848:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147208.542416:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d43400/0x3139939425062307 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea9d expref: 18 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.542429:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43400, rc 0) 00000100:00100000:3.0:1746147208.542462:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2767:x1830967310288000:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5747us (6117us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147208.542468:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19693 00000100:00100000:3.0:1746147208.542492:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310288128 00000100:00100000:3.0:1746147208.542496:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310288128 00002000:00100000:3.0:1746147208.542523:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2347008->3145727) req@ffff880099151c00 x1830967310288128/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.542531:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151c00 with x1830967310288128 ext(2347008->3145727) 00010000:00010000:3.0:1746147208.542535:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062251 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea3b expref: 26 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.542545:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062251 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea3b expref: 26 pid: 12225 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746147208.542557:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099151c00 00000100:00100000:1.0:1746147208.543896:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1691 00000100:00100000:1.0:1746147208.543906:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310288128:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147208.557439:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.557800:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310288256 00000100:00100000:3.0:1746147208.557808:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310288256 00000100:00100000:3.0:1746147208.557848:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19694 00000100:00100000:3.0:1746147208.557855:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e21a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2765:x1830967310288256:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147208.557869:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147208.557883:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a57800/0x313993942506230e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eaa4 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.557911:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147208.557913:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147208.557917:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a57800/0x313993942506230e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaa4 expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.557927:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a57800/0x313993942506230e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaa4 expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.557937:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57800, rc 0) 00000100:00100000:3.0:1746147208.557993:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e21a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2765:x1830967310288256:12345-192.168.204.25@tcp:101:cat.0 Request processed in 137us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147208.557998:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19694 00000100:00100000:2.0:1746147208.564864:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310288128:12345-192.168.204.25@tcp:4:cat.0 Request processed in 20951us (22603us total) trans 21474842580 rc 0/0 00000100:00100000:2.0:1746147208.564874:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1691 00002000:00100000:2.0:1746147208.564890:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2347008->3145727) req@ffff880099151c00 x1830967310288128/t21474842580(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/448 e 0 to 0 dl 1746147219 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147208.564898:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151c00 with x1830967310288128 ext(2347008->3145727) 00010000:00010000:2.0:1746147208.564909:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062251 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea3b expref: 29 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.564927:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062251 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea3b expref: 29 pid: 12225 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746147208.564933:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099151c00 00000100:00100000:0.0:1746147208.573398:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.574202:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310288384 00000100:00100000:2.0:1746147208.574210:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310288384 00010000:00010000:2.0:1746147208.574243:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062251 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea3b expref: 29 pid: 12225 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.574283:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8937 00000100:00100000:2.0:1746147208.574289:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310288384:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147208.574302:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147208.574319:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062251 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea3b expref: 29 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.574330:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062251 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea3b expref: 29 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.574346:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062251 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2347008->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea3b expref: 29 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.574373:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.574375:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.574381:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d43400/0x3139939425062307 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea9d expref: 17 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.574393:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d43400/0x3139939425062307 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea9d expref: 17 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.574400:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.574401:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.574404:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a57800/0x313993942506230e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaa4 expref: 28 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.574409:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a57800/0x313993942506230e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaa4 expref: 28 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.574434:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098a57800/0x313993942506230e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaa4 expref: 28 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147208.574445:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311438976:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147208.575222:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d43400/0x3139939425062307 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea9d expref: 17 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147208.575232:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311439104:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147208.576732:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147208.578652:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311438976:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147208.582478:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.582639:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310288640 00000100:00100000:2.0:1746147208.582648:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310288640 00002000:00100000:2.0:1746147208.582709:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88012bab7480 x1830967310288640/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147208.582725:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab7480 with x1830967310288640 ext(3145728->4194303) 00002000:00010000:2.0:1746147208.582731:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bab7480 00000100:00100000:2.0:1746147208.582762:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7230 00000100:00100000:2.0:1746147208.582769:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310288640:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147208.583393:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311439104:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147208.583422:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147208.583472:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310288384:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 9183us (10082us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147208.583480:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8937 00000100:00100000:0.0:1746147208.583839:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.584018:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310288896 00000100:00100000:1.0:1746147208.584022:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310288896 00002000:00100000:1.0:1746147208.584193:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880099150a80 x1830967310288896/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.584206:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150a80 with x1830967310288896 ext(2097152->3145727) 00002000:00010000:1.0:1746147208.584209:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099150a80 00000100:00100000:1.0:1746147208.584223:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7231 00000100:00100000:1.0:1746147208.584227:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310288896:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147208.591609:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310288640:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8828us (9131us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147208.591622:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7230 00002000:00100000:2.0:1746147208.591634:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88012bab7480 x1830967310288640/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147208.591644:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab7480 with x1830967310288640 ext(3145728->4194303) 00002000:00010000:2.0:1746147208.591649:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bab7480 00000100:00100000:1.0:1746147208.593932:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310288896:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9692us (10082us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147208.593944:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7231 00002000:00100000:1.0:1746147208.593956:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880099150a80 x1830967310288896/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.593964:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150a80 with x1830967310288896 ext(2097152->3145727) 00002000:00010000:1.0:1746147208.593970:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099150a80 00000100:00100000:0.0:1746147208.601033:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.601286:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310289152 00000100:00100000:1.0:1746147208.601297:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310289152 00002000:00100000:1.0:1746147208.601355:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880099151880 x1830967310289152/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.601366:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151880 with x1830967310289152 ext(4194304->4890623) 00002000:00010000:1.0:1746147208.601372:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099151880 00000100:00100000:1.0:1746147208.601478:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7232 00000100:00100000:1.0:1746147208.601490:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310289152:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147208.603347:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.605189:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310289280 00000100:00100000:3.0:1746147208.605200:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310289280 00000100:00100000:3.0:1746147208.605255:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19695 00000100:00100000:3.0:1746147208.605265:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2767:x1830967310289280:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147208.605283:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147208.605305:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x3139939425062315 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eaab expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.605335:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093708c00/0x31399394250622ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea5e expref: 24 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.605344:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147208.605345:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147208.605348:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x3139939425062315 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaab expref: 10 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.605379:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093708c00/0x31399394250622ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea5e expref: 24 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.605391:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093708c00/0x31399394250622ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea5e expref: 24 pid: 12225 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746147208.605404:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311439232:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147208.605500:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147208.610670:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310289152:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9172us (9640us total) trans 0 rc 696320/696320 00000100:00100000:1.0:1746147208.610681:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7232 00002000:00100000:1.0:1746147208.610702:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880099151880 x1830967310289152/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.610712:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151880 with x1830967310289152 ext(4194304->4890623) 00002000:00010000:1.0:1746147208.610718:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099151880 00000100:00100000:3.0:1746147208.610899:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311439232:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147208.610925:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x3139939425062315 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaab expref: 10 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.610941:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098447e00, rc 0) 00000100:00100000:3.0:1746147208.610961:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2767:x1830967310289280:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5699us (7619us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147208.610968:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19695 00000100:00100000:0.0:1746147208.611197:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.611354:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310289408 00000100:00100000:1.0:1746147208.611360:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310289408 00002000:00100000:1.0:1746147208.611390:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->2248703) req@ffff880099151f80 x1830967310289408/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.611397:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151f80 with x1830967310289408 ext(2097152->2248703) 00010000:00010000:1.0:1746147208.611402:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093708c00/0x31399394250622ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea5e expref: 25 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.611415:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093708c00/0x31399394250622ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea5e expref: 25 pid: 12225 timeout: 846 lvb_type: 0 00002000:00010000:1.0:1746147208.611421:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099151f80 00000100:00100000:1.0:1746147208.611911:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1692 00000100:00100000:1.0:1746147208.611920:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967310289408:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147208.616541:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.616983:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310289536 00000100:00100000:3.0:1746147208.616992:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310289536 00000100:00100000:3.0:1746147208.617047:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19696 00000100:00100000:3.0:1746147208.617055:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310289536:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147208.617075:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147208.617112:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098446600/0x313993942506231c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eab2 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147208.617170:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311439360:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147208.617260:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147208.617311:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967310289408:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5390us (6113us total) trans 17179875199 rc 0/0 00000100:00100000:1.0:1746147208.617319:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1692 00002000:00100000:1.0:1746147208.617330:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->2248703) req@ffff880099151f80 x1830967310289408/t17179875199(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/448 e 0 to 0 dl 1746147219 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.617338:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151f80 with x1830967310289408 ext(2097152->2248703) 00010000:00010000:1.0:1746147208.617343:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093708c00/0x31399394250622ac lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea5e expref: 29 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.617356:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093708c00/0x31399394250622ac lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea5e expref: 29 pid: 12225 timeout: 846 lvb_type: 0 00002000:00010000:1.0:1746147208.617362:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099151f80 00000100:00100000:3.0:1746147208.621817:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311439360:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147208.621854:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098446600/0x313993942506231c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eab2 expref: 28 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147208.621869:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098446600/0x313993942506231c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eab2 expref: 28 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147208.621901:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098446600, rc 0) 00000100:00100000:3.0:1746147208.621951:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310289536:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4896us (5419us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147208.621960:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19696 00000100:00100000:3.0:1746147208.637404:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.637569:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310289664 00000100:00100000:2.0:1746147208.637578:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310289664 00010000:00010000:2.0:1746147208.637617:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093708c00/0x31399394250622ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea5e expref: 27 pid: 12225 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.637653:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8938 00000100:00100000:2.0:1746147208.637660:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967310289664:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147208.637674:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147208.637703:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093708c00/0x31399394250622ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea5e expref: 27 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.637716:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093708c00/0x31399394250622ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea5e expref: 27 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.637739:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093708c00/0x31399394250622ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2248703) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea5e expref: 27 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.637767:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.637769:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.637777:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x3139939425062315 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaab expref: 9 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.637785:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x3139939425062315 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaab expref: 9 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.637817:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x3139939425062315 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaab expref: 9 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147208.637829:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311439488:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147208.637910:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147208.638634:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.639202:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310289792 00000100:00100000:3.0:1746147208.639207:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310289792 00000100:00100000:3.0:1746147208.639354:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19697 00000100:00100000:3.0:1746147208.639361:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310289792:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147208.639376:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147208.639391:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098446600/0x3139939425062323 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eab9 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.639413:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147208.639415:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147208.639420:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098446600/0x3139939425062323 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eab9 expref: 28 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147208.639432:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098446600/0x3139939425062323 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eab9 expref: 28 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147208.639441:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098446600, rc 0) 00000100:00100000:3.0:1746147208.639482:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310289792:12345-192.168.204.25@tcp:101:cat.0 Request processed in 122us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147208.639488:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19697 00000100:00100000:0.0:1746147208.643843:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.643999:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310289920 00000100:00100000:2.0:1746147208.644009:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310289920 00000100:00100000:2.0:1746147208.644064:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19698 00000100:00100000:2.0:1746147208.644072:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2770:x1830967310289920:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147208.644114:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147208.644132:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x313993942506232a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eac0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.644162:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x31399394250622ba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea6c expref: 27 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.644175:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x31399394250622c1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea73 expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.644180:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.644182:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.644185:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x313993942506232a lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1474560->2097151] (req 1474560->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eac0 expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.644917:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x31399394250622c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea73 expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.644931:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x31399394250622c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea73 expref: 11 pid: 10340 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.644946:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311439616:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147208.645041:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x31399394250622ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea6c expref: 27 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.645050:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x31399394250622ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea6c expref: 27 pid: 10340 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.645058:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311439744:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147208.645078:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147208.646350:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.647201:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310290176 00000100:00100000:3.0:1746147208.647209:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310290176 00000100:00100000:0.0:1746147208.647430:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.647511:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311439488:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147208.647531:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147208.647569:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967310289664:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 9909us (10174us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.647579:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8938 00000100:00100000:2.0:1746147208.647619:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310290432 00000100:00100000:2.0:1746147208.647622:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310290432 00000100:00100000:2.0:1746147208.647643:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6119 00000100:00100000:2.0:1746147208.647649:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2765:x1830967310290432:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:0.0:1746147208.647955:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.648072:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16410 00000100:00100000:3.0:1746147208.648078:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2772:x1830967310290176:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147208.648103:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147208.648122:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098446200/0x3139939425062331 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eac7 expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.648178:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098447000/0x3139939425062338 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648190:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098447000/0x3139939425062338 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648201:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098447000/0x3139939425062338 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648216:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942506233f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648222:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942506233f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648228:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942506233f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648305:0:16099:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0cce00/0x3139939425062346 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648313:0:16099:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0cce00/0x3139939425062346 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648319:0:16099:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0cce00/0x3139939425062346 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16099 initiator: MDT0 00000004:00200000:3.0:1746147208.648326:0:16099:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147208.648391:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0cce00/0x3139939425062346 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648398:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0cce00/0x3139939425062346 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648403:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0cce00/0x3139939425062346 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648409:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0cce00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147208.648413:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0cce00/0x3139939425062346 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648419:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0cce00/0x3139939425062346 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648430:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147208.648433:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147208.648436:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0cce00/0x3139939425062346 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648441:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0cce00/0x3139939425062346 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648457:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098447000/0x3139939425062338 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648462:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098447000/0x3139939425062338 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648466:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098447000/0x3139939425062338 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648471:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098447000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147208.648473:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098447000/0x3139939425062338 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648477:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098447000/0x3139939425062338 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648482:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147208.648483:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147208.648486:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098447000/0x3139939425062338 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648491:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098447000/0x3139939425062338 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648496:0:16099:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942506233f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648501:0:16099:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942506233f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648506:0:16099:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942506233f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648510:0:16099:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098447a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147208.648512:0:16099:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942506233f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648516:0:16099:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942506233f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648520:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009823af00) 00010000:00010000:3.0:1746147208.648522:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147208.648523:0:16099:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942506233f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648527:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098447a00/0x313993942506233f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16099 initiator: MDT0 00010000:00010000:3.0:1746147208.648557:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098446200/0x3139939425062331 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eac7 expref: 37 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.648565:0:16099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098446200/0x3139939425062331 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eac7 expref: 37 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.648571:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098446200, rc 0) 00000100:00100000:3.0:1746147208.648595:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2772:x1830967310290176:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 518us (2251us total) trans 8589937295 rc 301/301 00000100:00100000:3.0:1746147208.648605:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16410 00000100:00100000:3.0:1746147208.648642:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311439616:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147208.648650:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311439744:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147208.648667:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x313993942506232a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1474560->2097151] (req 1474560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eac0 expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.648680:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504f400, rc 0) 00000100:00100000:3.0:1746147208.648715:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2770:x1830967310289920:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4644us (4882us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147208.648721:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19698 00000100:00100000:3.0:1746147208.648806:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310290560 00000100:00100000:3.0:1746147208.648810:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310290560 00010000:00010000:3.0:1746147208.648823:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x31399394250622c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea73 expref: 11 pid: 10340 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746147208.648846:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8939 00000100:00100000:3.0:1746147208.648851:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2000:x1830967310290560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147208.648861:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147208.648877:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x31399394250622c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea73 expref: 11 pid: 10340 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.648887:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x31399394250622c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea73 expref: 11 pid: 10340 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.648902:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x31399394250622c1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea73 expref: 11 pid: 10340 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.648911:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147208.648926:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310290560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 75us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147208.648932:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8939 00000100:00100000:0.0:1746147208.649287:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.649841:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2765:x1830967310290432:12345-192.168.204.25@tcp:35:cat.0 Request processed in 2191us (2411us total) trans 8589937296 rc 0/0 00000100:00100000:2.0:1746147208.649849:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6119 00000100:00100000:3.0:1746147208.651298:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310290688 00000100:00100000:3.0:1746147208.651306:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310290688 00010000:00010000:3.0:1746147208.651340:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x31399394250622ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea6c expref: 27 pid: 10340 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746147208.651380:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8940 00000100:00100000:3.0:1746147208.651387:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310290688:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147208.651400:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147208.651417:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x31399394250622ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea6c expref: 27 pid: 10340 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.651430:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x31399394250622ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea6c expref: 27 pid: 10340 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.651450:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33200/0x31399394250622ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea6c expref: 27 pid: 10340 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.651464:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147208.651466:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147208.651474:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x313993942506232a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eac0 expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.651487:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x313993942506232a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eac0 expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.651518:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x313993942506232a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eac0 expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147208.651531:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311439872:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147208.651616:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147208.654930:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.654968:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.655047:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.655072:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310290944 00000100:00100000:0.0:1746147208.655079:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310290944 00002000:00100000:0.0:1746147208.655149:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff8800769d8a80 x1830967310290944/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147208.655159:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769d8a80 with x1830967310290944 ext(2097152->4194303) 00002000:00010000:0.0:1746147208.655165:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769d8a80 00000100:00100000:0.0:1746147208.655180:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310291200 00000100:00100000:0.0:1746147208.655182:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310291200 00002000:00100000:0.0:1746147208.655197:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800769aed80 x1830967310291200/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147208.655204:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769aed80 with x1830967310291200 ext(3145728->4194303) 00002000:00010000:0.0:1746147208.655208:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769aed80 00000100:00100000:0.0:1746147208.655215:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310291456 00000100:00100000:0.0:1746147208.655217:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310291456 00002000:00100000:0.0:1746147208.655225:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x96:0x0] (1474560->1478655) req@ffff8800769af800 x1830967310291456/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147208.655231:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769af800 with x1830967310291456 ext(1474560->1478655) 00002000:00010000:0.0:1746147208.655233:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769af800 00000100:00100000:0.0:1746147208.655244:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7233 00000100:00100000:0.0:1746147208.655250:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2003:x1830967310290944:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147208.655436:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7234 00000100:00100000:1.0:1746147208.655445:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310291200:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147208.655839:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7235 00000100:00100000:3.0:1746147208.655849:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2002:x1830967310291456:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147208.656076:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2002:x1830967310291456:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 107us (906us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147208.656084:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7235 00002000:00100000:3.0:1746147208.656110:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1474560->1478655) req@ffff8800769af800 x1830967310291456/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/4536 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.656119:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769af800 with x1830967310291456 ext(1474560->1478655) 00002000:00010000:3.0:1746147208.656123:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769af800 00000100:00100000:3.0:1746147208.656173:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311439872:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147208.656193:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147208.656219:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310290688:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4832us (6932us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147208.656227:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8940 00000100:00100000:2.0:1746147208.662254:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.662429:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310291584 00000100:00100000:2.0:1746147208.662439:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310291584 00000100:00100000:2.0:1746147208.662487:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19699 00000100:00100000:2.0:1746147208.662495:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2772:x1830967310291584:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147208.662514:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147208.662533:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eace expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.662562:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x3139939425062315 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaab expref: 11 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.662570:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098446600/0x3139939425062323 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eab9 expref: 27 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147208.662582:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.662584:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.662587:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3391488->3633151] (req 3391488->3633151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 27 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.662618:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098446600/0x3139939425062323 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eab9 expref: 27 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147208.662630:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098446600/0x3139939425062323 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eab9 expref: 27 pid: 12225 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746147208.662643:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311440000:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147208.662734:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x3139939425062315 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaab expref: 11 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.662743:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x3139939425062315 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaab expref: 11 pid: 12225 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.662750:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311440128:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147208.662768:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147208.662863:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.663052:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310291200:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 7607us (8081us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147208.663061:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7234 00002000:00100000:1.0:1746147208.663070:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800769aed80 x1830967310291200/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.663079:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769aed80 with x1830967310291200 ext(3145728->4194303) 00002000:00010000:1.0:1746147208.663084:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769aed80 00000100:00100000:2.0:1746147208.664252:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310291712 00000100:00100000:2.0:1746147208.664261:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310291712 00000100:00100000:2.0:1746147208.664304:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19700 00000100:00100000:2.0:1746147208.664311:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2770:x1830967310291712:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147208.664324:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147208.664339:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506235b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ead5 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.664362:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250622eb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea81 expref: 27 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.664369:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x31399394250622f2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea88 expref: 13 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.664375:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.664376:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.664379:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506235b lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->1433599] (req 1048576->1433599) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ead5 expref: 13 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.664403:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x31399394250622f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea88 expref: 13 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.664412:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x31399394250622f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea88 expref: 13 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.664423:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311440256:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147208.664506:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250622eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea81 expref: 27 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.664515:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250622eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea81 expref: 27 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.664523:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311440384:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147208.664542:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147208.667044:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311440000:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147208.667057:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311440128:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147208.667130:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3391488->3633151] (req 3391488->3633151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 27 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.667147:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e5c6600, rc 0) 00000100:00100000:2.0:1746147208.667195:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2772:x1830967310291584:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4696us (4946us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.667204:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19699 00000100:00100000:0.0:1746147208.667767:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.667862:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310291840 00000100:00100000:2.0:1746147208.667870:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310291840 00010000:00010000:2.0:1746147208.668028:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098446600/0x3139939425062323 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eab9 expref: 27 pid: 12225 timeout: 846 lvb_type: 1 00000100:00100000:2.0:1746147208.668053:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8941 00000100:00100000:2.0:1746147208.668061:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310291840:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147208.668073:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147208.668106:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098446600/0x3139939425062323 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eab9 expref: 27 pid: 12225 timeout: 846 lvb_type: 1 00010000:00010000:2.0:1746147208.668116:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098446600/0x3139939425062323 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eab9 expref: 27 pid: 12225 timeout: 846 lvb_type: 1 00010000:00010000:2.0:1746147208.668140:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098446600/0x3139939425062323 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eab9 expref: 27 pid: 12225 timeout: 846 lvb_type: 1 00010000:00010000:2.0:1746147208.668355:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147208.668386:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310291840:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 326us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.668392:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8941 00000100:00100000:2.0:1746147208.673446:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.673554:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311440256:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147208.673564:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311440384:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147208.673592:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506235b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->1433599] (req 1048576->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ead5 expref: 13 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.673615:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e5c6e00, rc 0) 00000100:00100000:0.0:1746147208.673679:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2770:x1830967310291712:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 9368us (10815us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147208.673688:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19700 00000100:00100000:2.0:1746147208.674422:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.674622:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2003:x1830967310290944:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 19371us (19701us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746147208.674633:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7233 00002000:00100000:0.0:1746147208.674642:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff8800769d8a80 x1830967310290944/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147208.674651:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769d8a80 with x1830967310290944 ext(2097152->4194303) 00010000:00010000:0.0:1746147208.674661:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x3139939425062315 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaab expref: 11 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746147208.674674:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x3139939425062315 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaab expref: 11 pid: 12225 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746147208.674681:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800769d8a80 00000100:00100000:1.0:1746147208.674784:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310292096 00000100:00100000:1.0:1746147208.674791:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310292096 00010000:00010000:1.0:1746147208.674818:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250622eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea81 expref: 26 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746147208.674837:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310291968 00000100:00100000:1.0:1746147208.674839:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310291968 00010000:00010000:1.0:1746147208.674847:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x31399394250622f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea88 expref: 11 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746147208.674860:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8942 00000100:00100000:1.0:1746147208.674866:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310292096:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147208.674878:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147208.674896:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250622eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea81 expref: 26 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.674905:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8943 00010000:00010000:1.0:1746147208.674906:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250622eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea81 expref: 26 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.674911:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2000:x1830967310291968:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147208.674917:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147208.674927:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x31399394250622f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea88 expref: 11 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.674927:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d42600/0x31399394250622eb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea81 expref: 26 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.674934:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x31399394250622f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea88 expref: 11 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.674946:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cd3400/0x31399394250622f2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea88 expref: 11 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.674947:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147208.674949:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147208.674955:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506235b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ead5 expref: 10 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.675020:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506235b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ead5 expref: 10 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.675173:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147208.675193:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310291968:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 283us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.675199:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8943 00010000:00010000:1.0:1746147208.675363:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506235b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ead5 expref: 9 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147208.675375:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311440512:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147208.675509:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147208.679783:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.680122:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310292224 00000100:00100000:2.0:1746147208.680129:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310292224 00000100:00100000:1.0:1746147208.680144:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311440512:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147208.680165:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147208.680178:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19701 00000100:00100000:2.0:1746147208.680186:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2767:x1830967310292224:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147208.680202:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147208.680211:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310292096:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5344us (6774us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147208.680219:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7000/0x3139939425062362 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eadc expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147208.680220:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8942 00010000:00010000:2.0:1746147208.680240:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.680245:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3391488->3633151] (req 3391488->3633151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.680251:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147208.680254:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7000/0x3139939425062362 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eadc expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.680285:0:10340:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3391488->3633151] (req 3391488->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.680294:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7000/0x3139939425062362 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eadc expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.680303:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e5c7000, rc 0) 00000100:00100000:2.0:1746147208.680324:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2767:x1830967310292224:12345-192.168.204.25@tcp:101:cat.0 Request processed in 139us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.680329:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19701 00000100:00100000:0.0:1746147208.681086:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.681142:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310292352 00000100:00100000:1.0:1746147208.681146:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310292352 00010000:00010000:1.0:1746147208.681164:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x3139939425062315 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaab expref: 11 pid: 12225 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746147208.681192:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8944 00000100:00100000:1.0:1746147208.681197:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2000:x1830967310292352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147208.681206:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147208.681224:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x3139939425062315 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaab expref: 11 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.681235:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x3139939425062315 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaab expref: 11 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.681250:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098447e00/0x3139939425062315 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaab expref: 11 pid: 12225 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.681262:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147208.681264:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147208.681269:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.681276:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.681301:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 24 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.681311:0:7227:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 24 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746147208.681323:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311440768:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147208.682076:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147208.682270:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.682290:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310292608 00000100:00100000:0.0:1746147208.682293:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310292608 00002000:00100000:0.0:1746147208.682324:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1429504->1433599) req@ffff88009455f100 x1830967310292608/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147208.682516:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455f100 with x1830967310292608 ext(1429504->1433599) 00002000:00010000:0.0:1746147208.682521:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009455f100 00000100:00100000:0.0:1746147208.682549:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7236 00000100:00100000:0.0:1746147208.682556:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2003:x1830967310292608:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147208.682680:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2003:x1830967310292608:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 124us (410us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147208.682686:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7236 00002000:00100000:0.0:1746147208.682700:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1429504->1433599) req@ffff88009455f100 x1830967310292608/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/4536 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147208.682707:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455f100 with x1830967310292608 ext(1429504->1433599) 00002000:00010000:0.0:1746147208.682710:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009455f100 00000100:00100000:2.0:1746147208.682753:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.682777:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310292864 00000100:00100000:0.0:1746147208.682781:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310292864 00002000:00100000:0.0:1746147208.682793:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (3391488->3395583) req@ffff880097eb9f80 x1830967310292864/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746147208.682837:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311440768:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147208.682854:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147208.682877:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310292352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1680us (1792us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147208.682885:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8944 00002000:00100000:0.0:1746147208.682954:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097eb9f80 with x1830967310292864 ext(3391488->3395583) 00010000:00010000:0.0:1746147208.682962:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 25 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746147208.682974:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 25 pid: 12201 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746147208.682981:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097eb9f80 00000100:00100000:0.0:1746147208.683003:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1693 00000100:00100000:0.0:1746147208.683010:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310292864:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147208.683074:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310292864:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 64us (321us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147208.683079:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1693 00002000:00100000:0.0:1746147208.683084:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (3391488->3395583) req@ffff880097eb9f80 x1830967310292864/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/4536 e 0 to 0 dl 1746147219 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147208.683107:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097eb9f80 with x1830967310292864 ext(3391488->3395583) 00010000:00010000:0.0:1746147208.683111:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 25 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746147208.683120:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 25 pid: 12201 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746147208.683125:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097eb9f80 00000100:00100000:0.0:1746147208.685946:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.685999:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.686011:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310293120 00000100:00100000:2.0:1746147208.686020:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310293120 00000100:00100000:1.0:1746147208.686053:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310293376 00000100:00100000:1.0:1746147208.686058:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310293376 00000100:00100000:2.0:1746147208.686080:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6120 00000100:00100000:2.0:1746147208.686113:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2770:x1830967310293120:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147208.686329:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2770:x1830967310293120:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 241us (393us total) trans 8589937297 rc 0/0 00000100:00100000:2.0:1746147208.686335:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6120 00002000:00100000:1.0:1746147208.686392:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (3629056->3633151) req@ffff88009455d500 x1830967310293376/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.686402:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455d500 with x1830967310293376 ext(3629056->3633151) 00010000:00010000:1.0:1746147208.686412:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 25 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.686426:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 25 pid: 12201 timeout: 846 lvb_type: 0 00002000:00010000:1.0:1746147208.686438:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009455d500 00000100:00100000:1.0:1746147208.686451:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1694 00000100:00100000:1.0:1746147208.686456:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310293376:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147208.687314:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310293376:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 854us (1311us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147208.687320:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1694 00002000:00100000:1.0:1746147208.687326:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (3629056->3633151) req@ffff88009455d500 x1830967310293376/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/4536 e 0 to 0 dl 1746147219 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.687335:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455d500 with x1830967310293376 ext(3629056->3633151) 00010000:00010000:1.0:1746147208.687341:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 25 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.687350:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 25 pid: 12201 timeout: 846 lvb_type: 0 00002000:00010000:1.0:1746147208.687356:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009455d500 00000100:00100000:0.0:1746147208.691872:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.691932:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.691952:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310293760 00000100:00100000:2.0:1746147208.691962:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310293760 00000100:00100000:1.0:1746147208.691990:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310293888 00000100:00100000:1.0:1746147208.691995:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310293888 00000100:00100000:2.0:1746147208.692024:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6121 00000100:00100000:2.0:1746147208.692032:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2772:x1830967310293760:12345-192.168.204.25@tcp:35:multiop.0 00002000:00100000:1.0:1746147208.692034:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (3391488->3633151) req@ffff880095124700 x1830967310293888/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.692045:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095124700 with x1830967310293888 ext(3391488->3633151) 00010000:00010000:1.0:1746147208.692056:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 25 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.692075:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 25 pid: 12201 timeout: 846 lvb_type: 0 00002000:00010000:1.0:1746147208.692083:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095124700 00000100:00100000:1.0:1746147208.692123:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1695 00000100:00100000:1.0:1746147208.692129:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310293888:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147208.692541:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2772:x1830967310293760:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 510us (679us total) trans 8589937298 rc 0/0 00000100:00100000:2.0:1746147208.692546:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6121 00000100:00100000:1.0:1746147208.696111:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967310293888:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 3956us (4151us total) trans 17179875200 rc 0/0 00000100:00100000:1.0:1746147208.696125:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1695 00002000:00100000:1.0:1746147208.696137:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (3391488->3633151) req@ffff880095124700 x1830967310293888/t17179875200(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/448 e 0 to 0 dl 1746147219 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.696148:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095124700 with x1830967310293888 ext(3391488->3633151) 00010000:00010000:1.0:1746147208.696158:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 27 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.696173:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 27 pid: 12201 timeout: 846 lvb_type: 0 00002000:00010000:1.0:1746147208.696181:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095124700 00000100:00100000:0.0:1746147208.699212:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.699260:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310294016 00000100:00100000:1.0:1746147208.699270:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310294016 00010000:00010000:1.0:1746147208.699307:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 27 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:2.0:1746147208.699491:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8945 00000100:00100000:2.0:1746147208.699502:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967310294016:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147208.699517:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147208.699539:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 27 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.699552:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 27 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.699575:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6600/0x3139939425062354 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3391488->3633151) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eace expref: 27 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.699593:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.699595:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.699603:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7000/0x3139939425062362 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eadc expref: 9 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.699611:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7000/0x3139939425062362 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eadc expref: 9 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.699652:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7000/0x3139939425062362 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eadc expref: 9 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147208.699665:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311440896:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147208.699762:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147208.703784:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311440896:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147208.703807:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147208.703955:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967310294016:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4453us (4750us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.703967:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8945 00000100:00100000:0.0:1746147208.708387:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.708804:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310294272 00000100:00100000:1.0:1746147208.708815:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310294272 00002000:00100000:1.0:1746147208.708862:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff880095126300 x1830967310294272/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.708873:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095126300 with x1830967310294272 ext(3145728->4194303) 00002000:00010000:1.0:1746147208.708879:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095126300 00000100:00100000:1.0:1746147208.708912:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7237 00000100:00100000:1.0:1746147208.708919:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310294272:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147208.719614:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310294272:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 10683us (11225us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147208.719628:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7237 00002000:00100000:0.0:1746147208.719640:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff880095126300 x1830967310294272/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147208.719655:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095126300 with x1830967310294272 ext(3145728->4194303) 00002000:00010000:0.0:1746147208.719661:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095126300 00000100:00100000:0.0:1746147208.724354:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.724486:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310294528 00000100:00100000:2.0:1746147208.724496:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310294528 00002000:00100000:2.0:1746147208.724544:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880095126680 x1830967310294528/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147208.724554:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095126680 with x1830967310294528 ext(4194304->4890623) 00002000:00010000:2.0:1746147208.724560:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095126680 00000100:00100000:2.0:1746147208.724580:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7238 00000100:00100000:2.0:1746147208.724589:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310294528:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147208.730413:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310294528:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5813us (6059us total) trans 0 rc 696320/696320 00000100:00100000:2.0:1746147208.730430:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7238 00002000:00100000:2.0:1746147208.730442:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880095126680 x1830967310294528/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147208.730452:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095126680 with x1830967310294528 ext(4194304->4890623) 00002000:00010000:2.0:1746147208.730458:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095126680 00000100:00100000:0.0:1746147208.735865:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.736621:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310294784 00000100:00100000:2.0:1746147208.736633:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310294784 00000100:00100000:2.0:1746147208.736700:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6122 00000100:00100000:2.0:1746147208.736708:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2767:x1830967310294784:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147208.737052:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2767:x1830967310294784:12345-192.168.204.25@tcp:35:cat.0 Request processed in 343us (1199us total) trans 8589937299 rc 0/0 00000100:00100000:2.0:1746147208.737061:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6122 00010000:00010000:0.0:1746147208.807340:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147208.853580:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.854155:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310295040 00000100:00100000:2.0:1746147208.854166:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310295040 00000100:00100000:2.0:1746147208.854233:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6123 00000100:00100000:2.0:1746147208.854241:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+6:2739:x1830967310295040:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147208.856129:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2739:x1830967310295040:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 1882us (2553us total) trans 8589937300 rc 0/0 00000100:00100000:2.0:1746147208.856138:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6123 00000100:00100000:0.0:1746147208.859611:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.859711:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310295296 00000100:00100000:2.0:1746147208.859721:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310295296 00000100:00100000:2.0:1746147208.859782:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6124 00000100:00100000:2.0:1746147208.859791:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079239850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2739:x1830967310295296:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147208.863437:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079239850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2739:x1830967310295296:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 3633us (3821us total) trans 8589937301 rc 0/0 00000100:00100000:2.0:1746147208.863453:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6124 00000100:00100000:0.0:1746147208.888142:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.888279:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310295552 00000100:00100000:1.0:1746147208.888289:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310295552 00000100:00100000:0.0:1746147208.888993:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.890046:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310295808 00000100:00100000:1.0:1746147208.890055:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310295808 00000100:00100000:1.0:1746147208.890121:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16411 00000100:00100000:1.0:1746147208.890129:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2782:x1830967310295552:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147208.890155:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147208.890175:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136348600/0x3139939425062369 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eae3 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.890253:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425062370 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.890266:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425062370 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.890277:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425062370 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.890293:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425062377 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.890298:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425062377 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.890302:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425062377 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147208.890878:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16412 00000100:00100000:0.0:1746147208.890886:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2783:x1830967310295808:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147208.890895:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147208.890903:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x313993942506237e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eaea expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.890933:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062385 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.890939:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062385 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.890946:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062385 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.890953:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942506238c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.890958:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942506238c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.890963:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942506238c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.891032:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7e600/0x3139939425062393 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.891041:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7e600/0x3139939425062393 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.891046:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7e600/0x3139939425062393 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:0.0:1746147208.891054:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147208.891136:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062385 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.891141:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062385 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.891147:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062385 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.891152:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062385 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.891156:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c7fa00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147208.891160:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062385 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.891165:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062385 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.891174:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147208.891177:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147208.891181:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062385 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.891186:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062385 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.891200:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942506238c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.891204:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942506238c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.891209:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942506238c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.891212:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c7f000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147208.891214:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942506238c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.891217:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942506238c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.891221:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a46adc00) 00010000:00010000:0.0:1746147208.891223:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147208.891224:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942506238c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.891228:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x313993942506238c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147208.891253:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x313993942506237e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaea expref: 40 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.891262:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7e600/0x3139939425062393 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaea expref: 39 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.891268:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147208.891270:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147208.891272:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c7e600, rc 0) 00000100:00100000:0.0:1746147208.891317:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2783:x1830967310295808:12345-192.168.204.25@tcp:101:cat.0 Request processed in 432us (2325us total) trans 8589937302 rc 0/0 00000100:00100000:0.0:1746147208.891322:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16412 00010000:00010000:1.0:1746147208.891782:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136349200/0x31399394250623a1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.891791:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136349200/0x31399394250623a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.891796:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136349200/0x31399394250623a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:1.0:1746147208.891800:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147208.891829:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425062370 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.891834:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425062370 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.891838:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425062370 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.891841:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425062370 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.891845:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136348a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147208.891847:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425062370 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.891852:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425062370 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.891858:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147208.891860:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147208.891862:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425062370 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.891867:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136348a00/0x3139939425062370 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.891882:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425062377 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.891887:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425062377 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.891891:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425062377 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.891894:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136349a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147208.891896:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425062377 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.891899:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425062377 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.891904:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a46adc00) 00010000:00010000:1.0:1746147208.891905:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147208.891906:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425062377 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.891910:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136349a00/0x3139939425062377 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.891933:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136348600/0x3139939425062369 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eae3 expref: 21 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.891941:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136349200/0x31399394250623a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eae3 expref: 20 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.891946:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147208.891948:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147208.891949:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136349200, rc 0) 00000100:00100000:1.0:1746147208.891970:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2782:x1830967310295552:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1843us (3840us total) trans 8589937303 rc 0/0 00000100:00100000:1.0:1746147208.891975:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16411 00000100:00100000:0.0:1746147208.900032:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.900073:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.900121:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.900159:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310295936 00000100:00100000:0.0:1746147208.900168:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310295936 00000100:00100000:0.0:1746147208.900203:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310296064 00000100:00100000:0.0:1746147208.900204:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310296064 00000100:00100000:0.0:1746147208.900213:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310296192 00000100:00100000:0.0:1746147208.900214:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310296192 00000100:00100000:0.0:1746147208.900226:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19702 00000100:00100000:0.0:1746147208.900234:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967310295936:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147208.900253:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147208.900271:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ffb200/0x31399394250623af lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eaf1 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147208.900322:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311441024:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147208.900401:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095affd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147208.900419:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19703 00000100:00100000:0.0:1746147208.900424:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967310296064:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147208.900432:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147208.900438:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093708200/0x31399394250623b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eaf8 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147208.900455:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311441152:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147208.900470:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147208.900481:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19704 00000100:00100000:0.0:1746147208.900485:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967310296192:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147208.900489:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147208.900494:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250623bd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eaff expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.900502:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147208.900504:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147208.900511:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250623bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaff expref: 31 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147208.900523:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250623bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaff expref: 31 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147208.900533:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093709c00, rc 0) 00000100:00100000:0.0:1746147208.900550:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967310296192:12345-192.168.204.25@tcp:101:cat.0 Request processed in 64us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147208.900555:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19704 00000100:00100000:0.0:1746147208.901568:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.902492:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.902514:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.902634:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310296320 00000100:00100000:2.0:1746147208.902642:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310296320 00000100:00100000:0.0:1746147208.903929:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.904003:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311441152:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147208.904035:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093708200/0x31399394250623b6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaf8 expref: 30 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147208.904048:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093708200/0x31399394250623b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaf8 expref: 30 pid: 1398 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147208.904123:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310296704 00000100:00100000:3.0:1746147208.904129:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310296704 00002000:00100000:3.0:1746147208.904160:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->1474559) req@ffff8801312ef480 x1830967310296704/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.904168:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ef480 with x1830967310296704 ext(1048576->1474559) 00002000:00010000:3.0:1746147208.904172:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312ef480 00000100:00100000:3.0:1746147208.904186:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310296960 00000100:00100000:3.0:1746147208.904187:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310296960 00002000:00100000:3.0:1746147208.904194:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1433600->2097151) req@ffff8801312ed500 x1830967310296960/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.904200:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ed500 with x1830967310296960 ext(1433600->2097151) 00002000:00010000:3.0:1746147208.904202:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312ed500 00000100:00100000:3.0:1746147208.904216:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7239 00000100:00100000:3.0:1746147208.904222:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310296704:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147208.905021:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7240 00000100:00100000:3.0:1746147208.905028:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310296960:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147208.906027:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311441024:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147208.906055:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ffb200/0x31399394250623af lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaf1 expref: 29 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147208.906066:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ffb200/0x31399394250623af lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaf1 expref: 29 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147208.906080:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ffb200, rc 0) 00000100:00100000:3.0:1746147208.906129:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967310295936:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5895us (6108us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147208.906137:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19702 00000100:00100000:2.0:1746147208.907441:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310296448 00000100:00100000:2.0:1746147208.907451:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310296448 00000100:00100000:1.0:1746147208.907526:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 987 00000100:00100000:1.0:1746147208.907536:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967310296320:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147208.907550:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147208.907571:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7e600/0x3139939425062393 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaea expref: 39 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.907587:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147208.907591:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147208.907623:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310296320:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 90us (6059us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147208.907628:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 987 00000100:00100000:1.0:1746147208.907640:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 988 00000100:00100000:1.0:1746147208.907644:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310296448:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147208.907653:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147208.907660:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136349200/0x31399394250623a1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eae3 expref: 20 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.907667:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147208.907670:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147208.907678:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310296448:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 34us (5188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147208.907682:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 988 00010000:00010000:0.0:1746147208.907995:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093708200, rc 0) 00000100:00100000:0.0:1746147208.908037:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310296064:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7612us (7962us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147208.908044:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19703 00000100:00100000:1.0:1746147208.921318:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310296704:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17084us (18791us total) trans 0 rc 425984/425984 00000100:00100000:1.0:1746147208.921332:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7239 00002000:00100000:1.0:1746147208.921344:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->1474559) req@ffff8801312ef480 x1830967310296704/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 425984/425984 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147208.921354:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ef480 with x1830967310296704 ext(1048576->1474559) 00002000:00010000:1.0:1746147208.921360:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312ef480 00000100:00100000:1.0:1746147208.923919:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.924276:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310297216 00000100:00100000:3.0:1746147208.924285:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310297216 00000100:00100000:3.0:1746147208.924334:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16413 00000100:00100000:3.0:1746147208.924342:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2785:x1830967310297216:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147208.924365:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147208.924384:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x31399394250623c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb06 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.924486:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250623cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147208.924500:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95400/0x31399394250621a9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9d2 expref: 37 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.924507:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9a800/0x31399394250621be lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e0 expref: 20 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.924513:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250623cb lrc: 5/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147208.924542:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9a800/0x31399394250621be lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e0 expref: 20 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.924552:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9a800/0x31399394250621be lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e0 expref: 20 pid: 16099 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746147208.924561:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311441280:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147208.924648:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95400/0x31399394250621a9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9d2 expref: 37 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.924656:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95400/0x31399394250621a9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9d2 expref: 37 pid: 16099 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746147208.924663:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311441408:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147208.924680:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011e48fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147208.927667:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310296960:12345-192.168.204.25@tcp:3:cat.0 Request processed in 22624us (23726us total) trans 0 rc 663552/663552 00000100:00100000:3.0:1746147208.927681:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7240 00002000:00100000:3.0:1746147208.927701:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1433600->2097151) req@ffff8801312ed500 x1830967310296960/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 663552/663552 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.927711:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ed500 with x1830967310296960 ext(1433600->2097151) 00002000:00010000:3.0:1746147208.927717:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312ed500 00000100:00100000:0.0:1746147208.931473:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.931516:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310297600 00000100:00100000:1.0:1746147208.931518:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.931526:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310297600 00000100:00100000:1.0:1746147208.931537:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310297472 00000100:00100000:1.0:1746147208.931539:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310297472 00000100:00100000:1.0:1746147208.931586:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19705 00000100:00100000:1.0:1746147208.931602:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2783:x1830967310297472:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147208.931619:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147208.931637:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136348a00/0x31399394250623d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb0d expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.931669:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x313993942506232a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eac0 expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147208.931673:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311441280:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147208.931676:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147208.931678:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147208.931681:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136348a00/0x31399394250623d2 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb0d expref: 28 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147208.931684:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311441408:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147208.931714:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x313993942506232a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eac0 expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147208.931716:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250623cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147208.931724:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x313993942506232a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eac0 expref: 9 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746147208.931734:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311441536:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147208.931800:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147208.932821:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16414 00000100:00100000:0.0:1746147208.932828:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2787:x1830967310297600:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147208.932845:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147208.933172:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093708600/0x31399394250623d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb14 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.933298:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093708c00/0x31399394250623e0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147208.933313:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093708c00/0x31399394250623e0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147208.933320:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093708c00/0x31399394250623e0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147208.937507:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.937555:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.937603:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.937656:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310297728 00000100:00100000:1.0:1746147208.937667:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310297728 00000100:00100000:3.0:1746147208.937698:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310298112 00000100:00100000:3.0:1746147208.937702:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310298112 00010000:00010000:1.0:1746147208.937714:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9a800/0x31399394250621be lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e0 expref: 21 pid: 16099 timeout: 846 lvb_type: 0 00002000:00100000:3.0:1746147208.937737:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3145727) req@ffff8800933f4a80 x1830967310298112/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147208.937742:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310297856 00000100:00100000:1.0:1746147208.937744:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310297856 00002000:00100000:3.0:1746147208.937747:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f4a80 with x1830967310298112 ext(2097152->3145727) 00002000:00010000:3.0:1746147208.937753:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800933f4a80 00010000:00010000:1.0:1746147208.937754:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95400/0x31399394250621a9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9d2 expref: 40 pid: 16099 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746147208.937777:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8946 00000100:00100000:1.0:1746147208.937785:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967310297728:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147208.937799:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147208.937805:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9a800/0x31399394250621be lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e0 expref: 21 pid: 16099 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.937817:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9a800/0x31399394250621be lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e0 expref: 21 pid: 16099 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.937838:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9a800/0x31399394250621be lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9e0 expref: 21 pid: 16099 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746147208.937948:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8947 00000100:00100000:0.0:1746147208.937955:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967310297856:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147208.937963:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147208.937967:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95400/0x31399394250621a9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9d2 expref: 40 pid: 16099 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746147208.937975:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95400/0x31399394250621a9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9d2 expref: 40 pid: 16099 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746147208.937987:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95400/0x31399394250621a9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9d2 expref: 40 pid: 16099 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746147208.938042:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7241 00000100:00100000:3.0:1746147208.938049:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310298112:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:1.0:1746147208.938672:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147208.938677:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250623cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147208.938700:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250623cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147208.938707:0:13715:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250623cb lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147208.938715:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093708c00/0x31399394250623e0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.938720:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093708c00/0x31399394250623e0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.938723:0:13715:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093708c00/0x31399394250623e0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147208.938746:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147208.938774:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147208.938778:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147208.938791:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310297728:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1006us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147208.938799:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8946 00000100:00100000:0.0:1746147208.938800:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967310297856:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 845us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147208.938806:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8947 00010000:00010000:1.0:1746147208.938825:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250623cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147208.938832:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250623cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:1.0:1746147208.938849:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147208.938858:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093708c00/0x31399394250623e0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147208.938865:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093708c00/0x31399394250623e0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:0.0:1746147208.938876:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147208.938973:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093708600/0x31399394250623d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb14 expref: 40 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.938989:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093708c00/0x31399394250623e0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb14 expref: 39 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.938995:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147208.938997:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147208.939000:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093708c00, rc 0) 00000100:00100000:0.0:1746147208.939020:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2787:x1830967310297600:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6193us (7560us total) trans 8589937304 rc 0/0 00000100:00100000:0.0:1746147208.939027:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16414 00000100:00100000:0.0:1746147208.939489:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311441536:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147208.939513:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136348a00/0x31399394250623d2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb0d expref: 28 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.939526:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136348a00, rc 0) 00000100:00100000:0.0:1746147208.939548:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2783:x1830967310297472:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7948us (8031us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147208.939555:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19705 00000100:00100000:0.0:1746147208.939973:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147208.940038:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310298240 00000100:00100000:3.0:1746147208.940045:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310298240 00002000:00100000:3.0:1746147208.940076:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1474560->2097151) req@ffff8800933f7480 x1830967310298240/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.940086:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f7480 with x1830967310298240 ext(1474560->2097151) 00010000:00010000:3.0:1746147208.940120:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x313993942506232a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eac0 expref: 12 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.940133:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x313993942506232a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eac0 expref: 12 pid: 12201 timeout: 846 lvb_type: 0 00002000:00010000:3.0:1746147208.940140:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800933f7480 00000100:00100000:3.0:1746147208.940169:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1696 00000100:00100000:3.0:1746147208.940177:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967310298240:12345-192.168.204.25@tcp:4:cat.0 00010000:00010000:1.0:1746147208.943498:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x31399394250623c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb06 expref: 21 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.943529:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250623cb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb06 expref: 20 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.943539:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147208.943542:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147208.943546:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0afa00, rc 0) 00000100:00100000:1.0:1746147208.943612:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2785:x1830967310297216:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 19270us (19704us total) trans 8589937305 rc 0/0 00000100:00100000:1.0:1746147208.943620:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16413 00000100:00100000:3.0:1746147208.945619:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310298112:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7559us (8003us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147208.945633:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7241 00002000:00100000:3.0:1746147208.945645:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3145727) req@ffff8800933f4a80 x1830967310298112/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147208.945656:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f4a80 with x1830967310298112 ext(2097152->3145727) 00002000:00010000:3.0:1746147208.945662:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800933f4a80 00000100:00100000:2.0:1746147208.951602:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967310298240:12345-192.168.204.25@tcp:4:cat.0 Request processed in 11413us (11616us total) trans 17179875201 rc 0/0 00000100:00100000:2.0:1746147208.951617:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1696 00002000:00100000:2.0:1746147208.951629:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1474560->2097151) req@ffff8800933f7480 x1830967310298240/t17179875201(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:584/0 lens 488/448 e 0 to 0 dl 1746147219 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147208.951638:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f7480 with x1830967310298240 ext(1474560->2097151) 00010000:00010000:2.0:1746147208.951648:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x313993942506232a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eac0 expref: 12 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.951663:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x313993942506232a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eac0 expref: 12 pid: 12201 timeout: 846 lvb_type: 0 00002000:00010000:2.0:1746147208.951670:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800933f7480 00000100:00100000:2.0:1746147208.951759:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.951812:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310298368 00000100:00100000:0.0:1746147208.951820:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310298368 00000100:00100000:0.0:1746147208.951864:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19706 00000100:00100000:0.0:1746147208.951871:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2787:x1830967310298368:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147208.951885:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147208.951901:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x31399394250623f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb1b expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.951933:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x31399394250621e8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea0a expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.951941:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d42000/0x31399394250621ef lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea11 expref: 17 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.951947:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147208.951949:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147208.951952:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x31399394250623f5 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1409024->1441791] (req 1409024->1441791) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb1b expref: 29 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.951985:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d42000/0x31399394250621ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea11 expref: 17 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.951994:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d42000/0x31399394250621ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea11 expref: 17 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746147208.952005:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311441664:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147208.952262:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x31399394250621e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea0a expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.952272:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x31399394250621e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea0a expref: 29 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746147208.952281:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311441792:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147208.952313:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095affd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147208.975607:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.975746:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147208.975772:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310298752 00000100:00100000:3.0:1746147208.975777:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310298496 00000100:00100000:3.0:1746147208.975781:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310298496 00000100:00100000:0.0:1746147208.975781:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310298752 00010000:00010000:0.0:1746147208.975817:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x31399394250621e8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea0a expref: 30 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746147208.975824:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19707 00000100:00100000:3.0:1746147208.975832:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310298496:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147208.975837:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8948 00000100:00100000:0.0:1746147208.975841:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310298752:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147208.975847:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147208.975853:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147208.975863:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae000/0x31399394250623fc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb22 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147208.975872:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x31399394250621e8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea0a expref: 30 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746147208.975882:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x31399394250621e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea0a expref: 30 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746147208.975903:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147208.975910:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311441920:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147208.975939:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310298752:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 97us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147208.975944:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8948 00000100:00100000:0.0:1746147208.976044:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.976132:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311441664:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147208.976143:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbef000/0x31399394250621e8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea0a expref: 29 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746147208.976160:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311441792:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147208.976192:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x31399394250623f5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1409024->1441791] (req 1409024->1441791) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb1b expref: 28 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.976205:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093709200, rc 0) 00000100:00100000:1.0:1746147208.976223:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2787:x1830967310298368:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 24354us (24464us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147208.976228:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19706 00000100:00100000:3.0:1746147208.977721:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011e48fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147208.977766:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310298624 00000100:00100000:2.0:1746147208.977774:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310298624 00010000:00010000:2.0:1746147208.977798:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d42000/0x31399394250621ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea11 expref: 18 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746147208.977820:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.977840:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310298880 00000100:00100000:2.0:1746147208.977842:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310298880 00010000:00010000:2.0:1746147208.977855:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x313993942506232a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eac0 expref: 14 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746147208.977857:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8949 00000100:00100000:1.0:1746147208.977866:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310298624:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147208.977869:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8950 00000100:00100000:2.0:1746147208.977873:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310298880:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147208.977877:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147208.977879:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147208.977892:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x313993942506232a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eac0 expref: 14 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.977892:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d42000/0x31399394250621ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea11 expref: 18 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.977900:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d42000/0x31399394250621ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea11 expref: 18 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.977901:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x313993942506232a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eac0 expref: 14 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746147208.977918:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d42000/0x31399394250621ef lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea11 expref: 18 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:2.0:1746147208.977919:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.977921:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147208.977928:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136348a00/0x31399394250623d2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb0d expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.977928:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147208.977929:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147208.977933:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x31399394250623f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1441791) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb1b expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.977936:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136348a00/0x31399394250623d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb0d expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.977938:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x31399394250623f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1441791) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb1b expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147208.977959:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136348a00/0x31399394250623d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb0d expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147208.977959:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x31399394250623f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1441791) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb1b expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147208.977968:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311442176:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147208.977968:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311442048:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147208.978609:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147208.978624:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caad80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147208.984213:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147208.984238:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311442048:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147208.984261:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147208.984272:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147208.984279:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310299136 00000100:00100000:2.0:1746147208.984286:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310299136 00000100:00100000:0.0:1746147208.984298:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310299392 00000100:00100000:0.0:1746147208.984301:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310299392 00002000:00100000:2.0:1746147208.984328:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1409024->1413119) req@ffff88012e6e1880 x1830967310299136/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147208.984328:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88012e6e1f80 x1830967310299392/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/0 e 0 to 0 dl 1746147219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147208.984337:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e6e1f80 with x1830967310299392 ext(1048576->2097151) 00002000:00100000:2.0:1746147208.984342:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e6e1880 with x1830967310299136 ext(1409024->1413119) 00002000:00010000:0.0:1746147208.984342:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e6e1f80 00002000:00010000:2.0:1746147208.984345:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e6e1880 00000100:00100000:2.0:1746147208.984366:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7242 00000100:00100000:2.0:1746147208.984374:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310299136:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147208.984401:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310298624:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6535us (8355us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147208.984409:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8949 00000100:00100000:2.0:1746147208.984485:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310299136:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 112us (283us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147208.984490:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7242 00002000:00100000:2.0:1746147208.984495:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1409024->1413119) req@ffff88012e6e1880 x1830967310299136/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/4536 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147208.984502:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e6e1880 with x1830967310299136 ext(1409024->1413119) 00002000:00010000:2.0:1746147208.984504:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e6e1880 00010000:00010000:3.0:1746147208.984534:0:12225:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff880099888700 x1830967311441920) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x313993942506232a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eac0 expref: 14 pid: 12201 timeout: 846 lvb_type: 0 00010000:00010000:3.0:1746147208.984563:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009504f400/0x313993942506232a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1474560->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eac0 expref: 14 pid: 12201 timeout: 846 lvb_type: 0 00000100:00100000:3.0:1746147208.984590:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311441920:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147208.984615:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae000/0x31399394250623fc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb22 expref: 13 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147208.984624:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae000/0x31399394250623fc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb22 expref: 13 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147208.984631:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0ae000, rc 0) 00000100:00100000:3.0:1746147208.984655:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310298496:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8824us (9061us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147208.984662:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19707 00000100:00100000:0.0:1746147208.984788:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7243 00000100:00100000:0.0:1746147208.984794:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967310299392:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147208.985409:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311442176:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147208.985420:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147208.985440:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310298880:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7566us (7621us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147208.985447:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8950 00000100:00100000:2.0:1746147209.001377:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746147209.001399:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967311442304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746147209.001470:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147209.001573:0:12153:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311442304 00000100:00100000:1.0:1746147209.001581:0:12153:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311442304 00000100:00100000:1.0:1746147209.001631:0:12153:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1746147209.001638:0:12153:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3765:x1830967311442304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1746147209.001661:0:12153:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1313993792 pending 2363392 free 3905277952 avail 3673755648 00000100:00100000:1.0:1746147209.001720:0:12153:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3765:x1830967311442304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147209.001727:0:12153:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:3.0:1746147209.001758:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967311442304:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1746147209.001840:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147209.006636:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.006736:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.007333:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.007682:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310299648 00000100:00100000:3.0:1746147209.007699:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310299648 00000100:00100000:3.0:1746147209.007744:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310299520 00000100:00100000:3.0:1746147209.007747:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310299520 00000100:00100000:3.0:1746147209.007773:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19708 00000100:00100000:3.0:1746147209.007780:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967310299648:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147209.007798:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147209.007816:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0afc00/0x3139939425062403 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb30 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147209.007859:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19709 00000100:00100000:2.0:1746147209.007866:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310299520:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:3.0:1746147209.007871:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311442432:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147209.007874:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147209.007885:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b64a800/0x313993942506240a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb29 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.007898:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147209.007900:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147209.007909:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b64a800/0x313993942506240a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb29 expref: 12 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147209.007928:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b64a800/0x313993942506240a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb29 expref: 12 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147209.007939:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011e48fa80 going to sleep for 11 seconds 00010000:00010000:2.0:1746147209.007939:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b64a800, rc 0) 00000100:00080000:3.0:1746147209.007953:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147209.007961:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310299520:12345-192.168.204.25@tcp:101:cat.0 Request processed in 95us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147209.007967:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19709 00000100:00100000:0.0:1746147209.008029:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310299904 00000100:00100000:0.0:1746147209.008033:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310299904 00002000:00100000:0.0:1746147209.008061:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1437696->1441791) req@ffff880097ebb800 x1830967310299904/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147209.008071:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097ebb800 with x1830967310299904 ext(1437696->1441791) 00002000:00010000:0.0:1746147209.008076:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097ebb800 00000100:00100000:0.0:1746147209.008108:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7244 00000100:00100000:0.0:1746147209.008114:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310299904:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147209.008224:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310299904:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 110us (891us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147209.008229:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7244 00002000:00100000:0.0:1746147209.008233:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1437696->1441791) req@ffff880097ebb800 x1830967310299904/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/4536 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147209.008240:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097ebb800 with x1830967310299904 ext(1437696->1441791) 00002000:00010000:0.0:1746147209.008242:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097ebb800 00000100:00100000:0.0:1746147209.009975:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967310299392:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 25172us (25693us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147209.009984:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7243 00002000:00100000:0.0:1746147209.009993:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88012e6e1f80 x1830967310299392/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:584/0 lens 488/440 e 0 to 0 dl 1746147219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147209.010001:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e6e1f80 with x1830967310299392 ext(1048576->2097151) 00002000:00010000:0.0:1746147209.010006:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e6e1f80 00002000:00010000:3.0:1746147209.017505:0:12225:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746147207 -> 1746147208 00002000:00010000:3.0:1746147209.017513:0:12225:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746147207 -> 1746147208 00002000:00010000:3.0:1746147209.017515:0:12225:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746147207 -> 1746147208 00000100:00100000:3.0:1746147209.017540:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311442432:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147209.017574:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0afc00/0x3139939425062403 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb30 expref: 18 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.017587:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0afc00/0x3139939425062403 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb30 expref: 18 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.017619:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0afc00, rc 0) 00000100:00100000:3.0:1746147209.017675:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967310299648:12345-192.168.204.25@tcp:101:cat.0 Request processed in 9892us (11046us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147209.017695:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19708 00000100:00100000:0.0:1746147209.018464:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.019181:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310300032 00000100:00100000:3.0:1746147209.019190:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310300032 00000100:00100000:3.0:1746147209.019376:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19710 00000100:00100000:3.0:1746147209.019383:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2783:x1830967310300032:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147209.020113:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147209.020135:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae400/0x3139939425062411 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb37 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.020169:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506235b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ead5 expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.020177:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147209.020179:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147209.020183:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae400/0x3139939425062411 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb37 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.020212:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506235b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ead5 expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.020225:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506235b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ead5 expref: 11 pid: 10340 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746147209.020244:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311442560:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147209.020319:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011e48fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147209.020437:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147209.020656:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310300160 00000100:00100000:1.0:1746147209.020662:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310300160 00000100:00100000:1.0:1746147209.020702:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19711 00000100:00100000:1.0:1746147209.020709:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310300160:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147209.020718:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147209.020730:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098ff6a00/0x3139939425062418 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb3e expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147209.020762:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311442688:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147209.020790:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147209.022395:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311442560:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147209.022422:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae400/0x3139939425062411 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb37 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.022435:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0ae400, rc 0) 00000100:00100000:3.0:1746147209.022469:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2783:x1830967310300032:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3086us (4007us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147209.022476:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19710 00000100:00100000:0.0:1746147209.022608:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147209.022812:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311442688:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147209.022837:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098ff6a00/0x3139939425062418 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb3e expref: 18 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147209.022847:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098ff6a00/0x3139939425062418 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb3e expref: 18 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147209.022860:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098ff6a00, rc 0) 00000100:00100000:1.0:1746147209.022881:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310300160:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2173us (2445us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147209.022886:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19711 00000100:00100000:2.0:1746147209.022896:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310300288 00000100:00100000:2.0:1746147209.022902:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310300288 00002000:00100000:2.0:1746147209.022940:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1433599) req@ffff88012e6e2680 x1830967310300288/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.022949:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e6e2680 with x1830967310300288 ext(1048576->1433599) 00010000:00010000:2.0:1746147209.022956:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506235b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ead5 expref: 12 pid: 10340 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746147209.022970:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506235b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ead5 expref: 12 pid: 10340 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746147209.022977:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e6e2680 00000100:00100000:2.0:1746147209.022996:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1697 00000100:00100000:2.0:1746147209.023003:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967310300288:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147209.037060:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310300288:12345-192.168.204.25@tcp:4:cat.0 Request processed in 14045us (14440us total) trans 17179875202 rc 0/0 00000100:00100000:2.0:1746147209.037074:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1697 00002000:00100000:2.0:1746147209.037086:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1433599) req@ffff88012e6e2680 x1830967310300288/t17179875202(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/448 e 0 to 0 dl 1746147220 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.037122:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e6e2680 with x1830967310300288 ext(1048576->1433599) 00010000:00010000:2.0:1746147209.037134:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506235b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ead5 expref: 14 pid: 10340 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746147209.037151:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506235b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ead5 expref: 14 pid: 10340 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746147209.037159:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e6e2680 00000100:00100000:0.0:1746147209.037594:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.037658:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310300544 00000100:00100000:2.0:1746147209.037665:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310300544 00000100:00100000:2.0:1746147209.037721:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6125 00000100:00100000:2.0:1746147209.037729:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2782:x1830967310300544:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147209.037908:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2782:x1830967310300544:12345-192.168.204.25@tcp:35:cat.0 Request processed in 180us (315us total) trans 8589937306 rc 0/0 00000100:00100000:2.0:1746147209.037914:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6125 00000100:00100000:0.0:1746147209.050191:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.053032:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310300672 00000100:00100000:2.0:1746147209.053047:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310300672 00010000:00010000:2.0:1746147209.053144:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506235b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ead5 expref: 14 pid: 10340 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746147209.053199:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8951 00000100:00100000:2.0:1746147209.053207:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310300672:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147209.053610:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147209.053634:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506235b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ead5 expref: 14 pid: 10340 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746147209.053647:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506235b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ead5 expref: 14 pid: 10340 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746147209.053671:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c6e00/0x313993942506235b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ead5 expref: 14 pid: 10340 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746147209.053711:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147209.053713:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147209.053721:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae400/0x3139939425062411 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb37 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.053730:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae400/0x3139939425062411 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb37 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.053769:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae400/0x3139939425062411 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb37 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147209.053788:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311442816:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147209.054354:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147209.056292:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311442816:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147209.056314:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147209.056894:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310300672:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3685us (6711us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147209.056907:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8951 00000100:00100000:0.0:1746147209.059576:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.059617:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.059857:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310301184 00000100:00100000:2.0:1746147209.059866:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310301184 00002000:00100000:2.0:1746147209.059913:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88012e6e0a80 x1830967310301184/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 504/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.059923:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e6e0a80 with x1830967310301184 ext(1048576->2097151) 00002000:00010000:2.0:1746147209.059928:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e6e0a80 00000100:00100000:2.0:1746147209.059958:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310301056 00000100:00100000:2.0:1746147209.059961:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310301056 00002000:00100000:2.0:1746147209.059975:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88012e6e0e00 x1830967310301056/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.059981:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e6e0e00 with x1830967310301056 ext(1048576->2097151) 00002000:00010000:2.0:1746147209.059985:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e6e0e00 00000100:00100000:2.0:1746147209.059999:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7245 00000100:00100000:2.0:1746147209.060006:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310301184:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147209.060836:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7246 00000100:00100000:2.0:1746147209.060842:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310301056:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147209.075207:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310301184:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 15188us (15625us total) trans 0 rc 1015808/1015808 00000100:00100000:2.0:1746147209.075221:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7245 00002000:00100000:2.0:1746147209.075234:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88012e6e0a80 x1830967310301184/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 504/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.075245:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e6e0a80 with x1830967310301184 ext(1048576->2097151) 00002000:00010000:2.0:1746147209.075251:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e6e0a80 00000100:00100000:0.0:1746147209.075453:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147209.075518:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310301312 00000100:00100000:1.0:1746147209.075526:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310301312 00000100:00100000:1.0:1746147209.075570:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19712 00000100:00100000:1.0:1746147209.075577:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2785:x1830967310301312:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147209.075598:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147209.075623:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x313993942506241f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb45 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.075651:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136348a00/0x31399394250623d2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb0d expref: 30 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.075660:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b64a800/0x313993942506240a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb29 expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147209.075671:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147209.075673:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147209.075676:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x313993942506241f lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1847296->2097151] (req 1847296->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb45 expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.075717:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b64a800/0x313993942506240a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb29 expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147209.075730:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b64a800/0x313993942506240a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb29 expref: 14 pid: 1854 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746147209.075742:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311442944:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147209.076354:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310301056:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 15509us (16732us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147209.076362:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7246 00002000:00100000:2.0:1746147209.076367:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88012e6e0e00 x1830967310301056/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.076375:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e6e0e00 with x1830967310301056 ext(1048576->2097151) 00002000:00010000:2.0:1746147209.076379:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e6e0e00 00010000:00010000:1.0:1746147209.076484:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136348a00/0x31399394250623d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb0d expref: 28 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.076493:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136348a00/0x31399394250623d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb0d expref: 28 pid: 1398 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746147209.076501:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311443072:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147209.076648:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147209.079534:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.080128:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310301440 00000100:00100000:2.0:1746147209.080138:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310301440 00010000:00010000:2.0:1746147209.080179:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b64a800/0x313993942506240a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb29 expref: 15 pid: 1854 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746147209.080212:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8952 00000100:00100000:2.0:1746147209.080220:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e6e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310301440:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147209.080234:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147209.080254:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b64a800/0x313993942506240a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb29 expref: 15 pid: 1854 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746147209.080272:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b64a800/0x313993942506240a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb29 expref: 15 pid: 1854 timeout: 847 lvb_type: 1 00010000:00010000:2.0:1746147209.080301:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147209.080360:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310301440:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 140us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147209.080367:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8952 00010000:00010000:1.0:1746147209.080494:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b64a800/0x313993942506240a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb29 expref: 14 pid: 1854 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746147209.080520:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311442944:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147209.081019:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311443072:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147209.081049:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x313993942506241f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1847296->2097151] (req 1847296->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb45 expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.081059:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55cdc00, rc 0) 00000100:00100000:1.0:1746147209.081084:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2785:x1830967310301312:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5508us (5632us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147209.081115:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19712 00000100:00100000:0.0:1746147209.086007:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.086117:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310301568 00000100:00100000:2.0:1746147209.086127:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310301568 00010000:00010000:2.0:1746147209.086165:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136348a00/0x31399394250623d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb0d expref: 29 pid: 1398 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746147209.086205:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8953 00000100:00100000:2.0:1746147209.086213:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310301568:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147209.086228:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147209.086249:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136348a00/0x31399394250623d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb0d expref: 29 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746147209.086260:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136348a00/0x31399394250623d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb0d expref: 29 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746147209.086284:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136348a00/0x31399394250623d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb0d expref: 29 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746147209.086317:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147209.086320:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147209.086327:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x313993942506241f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb45 expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.086335:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x313993942506241f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb45 expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.086369:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x313993942506241f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb45 expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147209.086383:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311443200:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147209.086478:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147209.089429:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311443200:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147209.089464:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147209.089539:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310301568:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3322us (3539us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147209.089554:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8953 00000100:00100000:2.0:1746147209.089828:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.090076:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310301824 00000100:00100000:3.0:1746147209.090085:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310301824 00002000:00100000:3.0:1746147209.090157:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x96:0x0] (1847296->1851391) req@ffff880097eb8e00 x1830967310301824/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147209.090166:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097eb8e00 with x1830967310301824 ext(1847296->1851391) 00002000:00010000:3.0:1746147209.090171:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097eb8e00 00000100:00100000:3.0:1746147209.090200:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7247 00000100:00100000:3.0:1746147209.090207:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2003:x1830967310301824:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147209.090331:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2003:x1830967310301824:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 125us (504us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147209.090336:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7247 00002000:00100000:3.0:1746147209.090341:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x96:0x0] (1847296->1851391) req@ffff880097eb8e00 x1830967310301824/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/4536 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147209.090353:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097eb8e00 with x1830967310301824 ext(1847296->1851391) 00002000:00010000:3.0:1746147209.090355:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097eb8e00 00000100:00100000:0.0:1746147209.095766:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147209.096407:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310301952 00000100:00100000:1.0:1746147209.096417:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310301952 00000100:00100000:1.0:1746147209.096480:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19713 00000100:00100000:1.0:1746147209.096488:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2785:x1830967310301952:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147209.096509:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147209.096693:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.096797:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.096844:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310302336 00000100:00100000:3.0:1746147209.096848:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310302336 00002000:00100000:3.0:1746147209.096881:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88009885ad80 x1830967310302336/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147209.096891:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885ad80 with x1830967310302336 ext(2097152->4194303) 00002000:00010000:3.0:1746147209.096897:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009885ad80 00000100:00100000:3.0:1746147209.096911:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310302464 00000100:00100000:3.0:1746147209.096913:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310302464 00002000:00100000:3.0:1746147209.096925:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880098858e00 x1830967310302464/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147209.096932:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098858e00 with x1830967310302464 ext(2097152->3145727) 00002000:00010000:3.0:1746147209.096936:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098858e00 00000100:00100000:3.0:1746147209.096947:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7248 00000100:00100000:3.0:1746147209.096952:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009885ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310302336:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:1.0:1746147209.097434:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1600/0x3139939425062426 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb4c expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.097464:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae400/0x3139939425062411 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb37 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.097472:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147209.097474:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147209.097477:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1600/0x3139939425062426 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->1654783] (req 1048576->1654783) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb4c expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.097511:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae400/0x3139939425062411 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb37 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.097522:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae400/0x3139939425062411 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb37 expref: 29 pid: 12225 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746147209.097536:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311443328:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147209.097615:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147209.097918:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7249 00000100:00100000:0.0:1746147209.097926:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310302464:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147209.103303:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311443328:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147209.103336:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1600/0x3139939425062426 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->1654783] (req 1048576->1654783) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb4c expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.103357:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6e1600, rc 0) 00000100:00100000:2.0:1746147209.103393:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2785:x1830967310301952:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6905us (7636us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147209.103402:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19713 00000100:00100000:2.0:1746147209.110191:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.110343:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310302592 00000100:00100000:3.0:1746147209.110353:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310302592 00010000:00010000:3.0:1746147209.110392:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae400/0x3139939425062411 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb37 expref: 30 pid: 12225 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746147209.110430:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8954 00000100:00100000:3.0:1746147209.110437:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f79450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310302592:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147209.110449:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147209.110471:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae400/0x3139939425062411 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb37 expref: 30 pid: 12225 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.110483:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae400/0x3139939425062411 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb37 expref: 30 pid: 12225 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.110510:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae400/0x3139939425062411 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb37 expref: 30 pid: 12225 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.110529:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147209.110531:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147209.110539:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1600/0x3139939425062426 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb4c expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.110548:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1600/0x3139939425062426 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb4c expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.110584:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1600/0x3139939425062426 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb4c expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147209.110597:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311443456:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147209.110666:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011e48fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147209.110820:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310302464:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12892us (14020us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147209.110830:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7249 00002000:00100000:1.0:1746147209.110841:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880098858e00 x1830967310302464/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.110851:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098858e00 with x1830967310302464 ext(2097152->3145727) 00002000:00010000:1.0:1746147209.110856:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098858e00 00000100:00100000:2.0:1746147209.118325:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009885ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310302336:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21357us (21626us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147209.118339:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7248 00002000:00100000:2.0:1746147209.118353:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88009885ad80 x1830967310302336/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.118363:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009885ad80 with x1830967310302336 ext(2097152->4194303) 00002000:00010000:2.0:1746147209.118371:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009885ad80 00000100:00100000:3.0:1746147209.118562:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311443456:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147209.118582:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147209.118605:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f79450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310302592:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8169us (8426us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147209.118613:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8954 00000100:00100000:0.0:1746147209.120866:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.120927:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310302848 00000100:00100000:2.0:1746147209.120939:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310302848 00002000:00100000:2.0:1746147209.120984:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x97:0x0] (1650688->1654783) req@ffff880097d74a80 x1830967310302848/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.120995:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d74a80 with x1830967310302848 ext(1650688->1654783) 00002000:00010000:2.0:1746147209.121001:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d74a80 00000100:00100000:2.0:1746147209.121217:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7250 00000100:00100000:2.0:1746147209.121224:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2002:x1830967310302848:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147209.121489:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2002:x1830967310302848:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 265us (631us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147209.121496:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7250 00002000:00100000:2.0:1746147209.121502:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x97:0x0] (1650688->1654783) req@ffff880097d74a80 x1830967310302848/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/4536 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.121510:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d74a80 with x1830967310302848 ext(1650688->1654783) 00002000:00010000:2.0:1746147209.121512:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d74a80 00000100:00100000:0.0:1746147209.128253:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.128490:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310302976 00000100:00100000:2.0:1746147209.128501:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310302976 00000100:00100000:2.0:1746147209.128560:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19714 00000100:00100000:2.0:1746147209.128568:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310302976:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147209.128589:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147209.128609:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b64b000/0x313993942506242d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb53 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147209.128665:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311443584:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147209.128763:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147209.128816:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.129065:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310303104 00000100:00100000:3.0:1746147209.129069:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310303104 00000100:00100000:3.0:1746147209.129120:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19715 00000100:00100000:3.0:1746147209.129125:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967310303104:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147209.129132:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147209.129139:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae000/0x3139939425062434 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb5a expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147209.129162:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311443712:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147209.129192:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00002000:00010000:2.0:1746147209.134384:0:1398:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime: 1746147208 -> 1746147209 00002000:00010000:2.0:1746147209.134394:0:1398:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime: 1746147208 -> 1746147209 00000100:00100000:2.0:1746147209.134422:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311443584:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147209.134461:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b64b000/0x313993942506242d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb53 expref: 30 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147209.134474:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b64b000/0x313993942506242d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb53 expref: 30 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147209.134491:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b64b000, rc 0) 00000100:00100000:2.0:1746147209.134543:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967310302976:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5975us (6305us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147209.134552:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19714 00002000:00010000:3.0:1746147209.134942:0:12225:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime: 1746147208 -> 1746147209 00002000:00010000:3.0:1746147209.134945:0:12225:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime: 1746147208 -> 1746147209 00000100:00100000:3.0:1746147209.134955:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311443712:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147209.134972:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae000/0x3139939425062434 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb5a expref: 28 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.134980:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae000/0x3139939425062434 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb5a expref: 28 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.134991:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0ae000, rc 0) 00000100:00100000:3.0:1746147209.135015:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967310303104:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5890us (6199us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147209.135020:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19715 00000100:00100000:0.0:1746147209.140154:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.140241:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310303232 00000100:00100000:3.0:1746147209.140251:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310303232 00000100:00100000:3.0:1746147209.140307:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19716 00000100:00100000:3.0:1746147209.140315:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310303232:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147209.140333:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147209.140354:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae800/0x313993942506243b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb61 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147209.140417:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311443840:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147209.142875:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147209.143134:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.143228:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.143432:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310303360 00000100:00100000:3.0:1746147209.143439:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310303360 00000100:00100000:3.0:1746147209.143484:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19717 00000100:00100000:3.0:1746147209.143492:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967310303360:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147209.143509:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147209.143527:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae400/0x3139939425062442 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb68 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147209.143580:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311443968:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147209.143648:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147209.143679:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310303616 00000100:00100000:3.0:1746147209.143691:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310303616 00000100:00100000:3.0:1746147209.143729:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16415 00000100:00100000:3.0:1746147209.143734:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2791:x1830967310303616:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147209.143747:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147209.143760:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7e600/0x3139939425062449 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb6f expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.143826:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062450 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.143843:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062450 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.143855:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062450 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.143867:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425062457 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.143872:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425062457 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.143877:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425062457 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.143969:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x313993942506245e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.143977:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x313993942506245e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.143982:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x313993942506245e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147209.143990:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147209.144065:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062450 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.144071:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062450 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.144077:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062450 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.144082:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c7fa00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147209.144087:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062450 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.144117:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062450 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.144128:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147209.144131:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147209.144134:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062450 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.144139:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x3139939425062450 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.144149:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425062457 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.144153:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425062457 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.144158:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425062457 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.144161:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c7f000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147209.144163:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425062457 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.144168:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425062457 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.144174:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880095a3e500) 00010000:00010000:3.0:1746147209.144175:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147209.144177:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425062457 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.144185:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425062457 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.144219:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7e600/0x3139939425062449 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb6f expref: 42 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.144231:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x313993942506245e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb6f expref: 41 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.144238:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147209.144240:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147209.144242:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c7fc00, rc 0) 00000100:00100000:3.0:1746147209.144268:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2791:x1830967310303616:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 533us (1039us total) trans 8589937307 rc 0/0 00000100:00100000:3.0:1746147209.144274:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16415 00000100:00080000:3.0:1746147209.144294:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147209.145023:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311443840:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147209.145044:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae800/0x313993942506243b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb61 expref: 30 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.145053:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae800/0x313993942506243b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb61 expref: 30 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.145060:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0ae800, rc 0) 00000100:00100000:3.0:1746147209.145104:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967310303232:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4776us (4946us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147209.145114:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19716 00000100:00100000:0.0:1746147209.145970:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.146077:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310303872 00000100:00100000:2.0:1746147209.146083:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310303872 00000100:00100000:2.0:1746147209.146139:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6126 00000100:00100000:2.0:1746147209.146146:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2791:x1830967310303872:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147209.146343:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2791:x1830967310303872:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 197us (374us total) trans 8589937308 rc 0/0 00000100:00100000:2.0:1746147209.146350:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6126 00000100:00100000:3.0:1746147209.146447:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311443968:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147209.146468:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae400/0x3139939425062442 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb68 expref: 28 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.146479:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0ae400/0x3139939425062442 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb68 expref: 28 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.146487:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0ae400, rc 0) 00000100:00100000:3.0:1746147209.146505:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310303360:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3015us (3377us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147209.146511:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19717 00000100:00100000:0.0:1746147209.151656:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.151767:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.151867:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310304128 00000100:00100000:2.0:1746147209.151877:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310304128 00000100:00100000:2.0:1746147209.152261:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310304000 00000100:00100000:2.0:1746147209.152264:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310304000 00000100:00100000:3.0:1746147209.152342:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19718 00000100:00100000:3.0:1746147209.152361:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967310304128:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147209.152381:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147209.152400:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f01a200/0x313993942506246c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb7d expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147209.152462:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311444096:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147209.152542:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147209.152662:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19719 00000100:00100000:2.0:1746147209.152668:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967310304000:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147209.152675:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147209.152692:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b64ac00/0x3139939425062473 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb76 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147209.152991:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311444224:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147209.153028:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caae40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147209.155793:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311444224:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147209.155829:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b64ac00/0x3139939425062473 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb76 expref: 30 pid: 12225 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147209.155831:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311444096:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147209.155846:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b64ac00/0x3139939425062473 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb76 expref: 30 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.155850:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f01a200/0x313993942506246c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb7d expref: 30 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.155865:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f01a200/0x313993942506246c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb7d expref: 29 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.155873:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f01a200, rc 0) 00010000:00010000:2.0:1746147209.155874:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b64ac00, rc 0) 00000100:00100000:3.0:1746147209.156392:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967310304128:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4032us (4747us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147209.156401:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19718 00000100:00100000:2.0:1746147209.156535:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967310304000:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3866us (4767us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147209.156541:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19719 00000100:00100000:0.0:1746147209.167867:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.169009:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310304384 00000100:00100000:2.0:1746147209.169024:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310304384 00000100:00100000:2.0:1746147209.171309:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6127 00000100:00100000:2.0:1746147209.171326:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2783:x1830967310304384:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147209.171557:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2783:x1830967310304384:12345-192.168.204.25@tcp:35:cat.0 Request processed in 237us (3700us total) trans 8589937309 rc 0/0 00000100:00100000:2.0:1746147209.171564:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6127 00000100:00100000:0.0:1746147209.173160:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.173211:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310304512 00000100:00100000:2.0:1746147209.173219:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310304512 00000100:00100000:3.0:1746147209.174439:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19720 00000100:00100000:3.0:1746147209.174451:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2791:x1830967310304512:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147209.174466:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147209.174487:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f01a800/0x313993942506247a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb84 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.174518:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d43400/0x3139939425062307 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea9d expref: 16 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.174526:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a57800/0x313993942506230e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaa4 expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.174532:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147209.174534:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147209.174537:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f01a800/0x313993942506247a lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2461696->2818047] (req 2461696->2818047) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb84 expref: 29 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.174568:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a57800/0x313993942506230e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaa4 expref: 29 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.174579:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a57800/0x313993942506230e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaa4 expref: 29 pid: 12201 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746147209.174591:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311444352:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147209.174677:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d43400/0x3139939425062307 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea9d expref: 16 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.174695:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d43400/0x3139939425062307 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea9d expref: 16 pid: 12201 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746147209.174702:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311444480:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147209.174719:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147209.176328:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099889500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311444352:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147209.176339:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311444480:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147209.176362:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f01a800/0x313993942506247a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2461696->2818047] (req 2461696->2818047) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb84 expref: 29 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.176376:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f01a800, rc 0) 00000100:00100000:3.0:1746147209.176404:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2791:x1830967310304512:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1956us (3248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147209.176411:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19720 00000100:00100000:0.0:1746147209.183168:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.183338:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310304640 00000100:00100000:3.0:1746147209.183349:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310304640 00010000:00010000:3.0:1746147209.183391:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a57800/0x313993942506230e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaa4 expref: 29 pid: 12201 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746147209.183424:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8955 00000100:00100000:3.0:1746147209.183432:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094526680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310304640:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147209.183447:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147209.183470:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a57800/0x313993942506230e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaa4 expref: 29 pid: 12201 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.183483:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a57800/0x313993942506230e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaa4 expref: 29 pid: 12201 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.183509:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a57800/0x313993942506230e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaa4 expref: 29 pid: 12201 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.183600:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147209.184452:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094526680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310304640:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1018us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147209.184461:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8955 00000100:00100000:0.0:1746147209.186838:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.186932:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310304768 00000100:00100000:3.0:1746147209.186941:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310304768 00010000:00010000:3.0:1746147209.186977:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d43400/0x3139939425062307 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea9d expref: 17 pid: 12201 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746147209.187005:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8956 00000100:00100000:3.0:1746147209.187012:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967310304768:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147209.187025:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147209.187045:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d43400/0x3139939425062307 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea9d expref: 17 pid: 12201 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.187058:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d43400/0x3139939425062307 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea9d expref: 17 pid: 12201 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.187082:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d43400/0x3139939425062307 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ea9d expref: 17 pid: 12201 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.187405:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147209.187408:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147209.187416:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f01a800/0x313993942506247a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2818047) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb84 expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.187425:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f01a800/0x313993942506247a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2818047) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb84 expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.187462:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f01a800/0x313993942506247a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2818047) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb84 expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147209.187475:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311444608:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147209.188334:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147209.189126:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311444608:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147209.189145:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147209.189223:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967310304768:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2209us (2395us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147209.189235:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8956 00000100:00100000:0.0:1746147209.190532:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.190655:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310305024 00000100:00100000:2.0:1746147209.190663:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310305024 00002000:00100000:2.0:1746147209.190711:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2461696->2465791) req@ffff880096898380 x1830967310305024/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.190721:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096898380 with x1830967310305024 ext(2461696->2465791) 00002000:00010000:2.0:1746147209.190726:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096898380 00000100:00100000:2.0:1746147209.190754:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7251 00000100:00100000:2.0:1746147209.190761:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310305024:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147209.190888:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310305024:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 127us (360us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147209.190894:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7251 00002000:00100000:2.0:1746147209.190899:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2461696->2465791) req@ffff880096898380 x1830967310305024/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/4536 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.190906:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096898380 with x1830967310305024 ext(2461696->2465791) 00002000:00010000:2.0:1746147209.190909:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096898380 00000100:00100000:0.0:1746147209.196198:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147209.196366:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310305280 00000100:00100000:1.0:1746147209.196377:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310305280 00002000:00100000:1.0:1746147209.196430:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2813952->2818047) req@ffff880096899500 x1830967310305280/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.196440:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096899500 with x1830967310305280 ext(2813952->2818047) 00002000:00010000:1.0:1746147209.196446:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096899500 00000100:00100000:1.0:1746147209.196952:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7252 00000100:00100000:1.0:1746147209.196961:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310305280:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147209.198208:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310305280:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 1246us (2018us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147209.198216:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7252 00002000:00100000:1.0:1746147209.198224:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2813952->2818047) req@ffff880096899500 x1830967310305280/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/4536 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.198238:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096899500 with x1830967310305280 ext(2813952->2818047) 00002000:00010000:1.0:1746147209.198242:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096899500 00000100:00100000:0.0:1746147209.275602:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.275700:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310305536 00000100:00100000:3.0:1746147209.275710:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310305536 00000100:00100000:3.0:1746147209.275760:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16416 00000100:00100000:3.0:1746147209.275768:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2797:x1830967310305536:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147209.275791:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147209.275811:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4600/0x3139939425062481 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb8b expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.275890:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4800/0x3139939425062488 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.275905:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4800/0x3139939425062488 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.275916:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4800/0x3139939425062488 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.275929:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x313993942506248f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.275934:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x313993942506248f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.275939:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x313993942506248f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.276039:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ac00/0x3139939425062496 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.276049:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ac00/0x3139939425062496 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.276055:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ac00/0x3139939425062496 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:3.0:1746147209.276067:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147209.276175:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4800/0x3139939425062488 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.276181:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4800/0x3139939425062488 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.276186:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4800/0x3139939425062488 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.276191:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4800/0x3139939425062488 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.276196:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a9b4800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147209.276200:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4800/0x3139939425062488 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.276205:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4800/0x3139939425062488 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.276215:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147209.276217:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147209.276221:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4800/0x3139939425062488 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.276226:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4800/0x3139939425062488 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.276252:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x313993942506248f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.276257:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x313993942506248f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.276265:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x313993942506248f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.276269:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a9b4e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147209.276271:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x313993942506248f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.276274:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x313993942506248f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.276279:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880095a3e300) 00010000:00010000:3.0:1746147209.276281:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147209.276283:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x313993942506248f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.276287:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4e00/0x313993942506248f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.276320:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4600/0x3139939425062481 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb8b expref: 24 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.276329:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ac00/0x3139939425062496 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb8b expref: 23 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.276335:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147209.276336:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147209.276338:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f01ac00, rc 0) 00000100:00100000:3.0:1746147209.277473:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2797:x1830967310305536:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1698us (1870us total) trans 8589937310 rc 0/0 00000100:00100000:3.0:1746147209.277482:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16416 00000100:00100000:0.0:1746147209.281299:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.281358:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.281753:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310305664 00000100:00100000:3.0:1746147209.281762:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310305664 00000100:00100000:3.0:1746147209.281801:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310305792 00000100:00100000:3.0:1746147209.281802:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310305792 00000100:00100000:3.0:1746147209.281818:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19721 00000100:00100000:3.0:1746147209.281825:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2002:x1830967310305664:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147209.281844:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147209.281863:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009400ba00/0x31399394250624a4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb92 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147209.281904:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19722 00000100:00100000:2.0:1746147209.281913:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310305792:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:3.0:1746147209.281915:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311444736:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147209.281920:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147209.281930:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x31399394250624ab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eb99 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147209.281956:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311444864:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147209.282001:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147209.282082:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa6c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746147209.284295:0:12225:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746147208 -> 1746147209 00002000:00010000:2.0:1746147209.284302:0:12225:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746147208 -> 1746147209 00002000:00010000:2.0:1746147209.284304:0:12225:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime: 1746147208 -> 1746147209 00000100:00100000:2.0:1746147209.284327:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311444864:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147209.284360:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x31399394250624ab lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb99 expref: 19 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147209.284375:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x31399394250624ab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb99 expref: 19 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147209.284403:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b64a200, rc 0) 00000100:00100000:2.0:1746147209.284605:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310305792:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2691us (3244us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147209.284614:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19722 00002000:00010000:3.0:1746147209.285323:0:1398:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746147208 -> 1746147209 00002000:00010000:3.0:1746147209.285327:0:1398:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746147208 -> 1746147209 00002000:00010000:3.0:1746147209.285329:0:1398:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746147208 -> 1746147209 00000100:00100000:3.0:1746147209.285339:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311444736:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147209.285358:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009400ba00/0x31399394250624a4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb92 expref: 17 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.285367:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009400ba00/0x31399394250624a4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb92 expref: 17 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.285377:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400ba00, rc 0) 00000100:00100000:3.0:1746147209.286857:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967310305664:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5024us (5562us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147209.286866:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19721 00000100:00100000:0.0:1746147209.296668:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.300016:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147209.305850:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310306048 00000100:00100000:1.0:1746147209.305862:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310306048 00002000:00100000:1.0:1746147209.305917:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->1847295) req@ffff8800a5576680 x1830967310306048/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.305927:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5576680 with x1830967310306048 ext(1048576->1847295) 00002000:00010000:1.0:1746147209.305932:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5576680 00000100:00100000:1.0:1746147209.306066:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310306176 00000100:00100000:1.0:1746147209.306070:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310306176 00002000:00100000:1.0:1746147209.306083:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x97:0x0] (1654784->2097151) req@ffff8800a5574700 x1830967310306176/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.306112:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5574700 with x1830967310306176 ext(1654784->2097151) 00002000:00010000:1.0:1746147209.306115:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5574700 00000100:00100000:2.0:1746147209.306159:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7253 00000100:00100000:2.0:1746147209.306176:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7254 00000100:00100000:2.0:1746147209.306181:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2002:x1830967310306176:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147209.306492:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967310306048:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147209.319759:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967310306048:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13579us (23090us total) trans 0 rc 798720/798720 00000100:00100000:3.0:1746147209.319771:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7253 00002000:00100000:3.0:1746147209.319780:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->1847295) req@ffff8800a5576680 x1830967310306048/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 798720/798720 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147209.319790:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5576680 with x1830967310306048 ext(1048576->1847295) 00002000:00010000:3.0:1746147209.319795:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5576680 00000100:00100000:2.0:1746147209.320875:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2002:x1830967310306176:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14686us (20861us total) trans 0 rc 442368/442368 00000100:00100000:2.0:1746147209.320886:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7254 00002000:00100000:2.0:1746147209.320896:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1654784->2097151) req@ffff8800a5574700 x1830967310306176/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 442368/442368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.320905:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5574700 with x1830967310306176 ext(1654784->2097151) 00002000:00010000:2.0:1746147209.320911:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5574700 00000100:00100000:0.0:1746147209.327637:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.328294:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310306432 00000100:00100000:3.0:1746147209.328305:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310306432 00000100:00100000:3.0:1746147209.329265:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19723 00000100:00100000:3.0:1746147209.329275:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2797:x1830967310306432:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147209.329291:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147209.329307:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x31399394250624b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eba0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.329337:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x31399394250623f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1441791) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb1b expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.329343:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147209.329345:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147209.329347:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x31399394250624b2 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eba0 expref: 17 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.329374:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x31399394250623f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1441791) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb1b expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.329385:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x31399394250623f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1441791) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb1b expref: 27 pid: 1398 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746147209.329399:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311444992:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147209.329491:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147209.335243:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.335542:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311444992:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147209.335564:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x31399394250624b2 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eba0 expref: 17 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.335579:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400b800, rc 0) 00000100:00100000:2.0:1746147209.335624:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2797:x1830967310306432:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6352us (7997us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147209.335631:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19723 00000100:00100000:0.0:1746147209.335797:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.336039:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310306688 00000100:00100000:3.0:1746147209.336045:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310306688 00000100:00100000:3.0:1746147209.336079:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16417 00000100:00100000:3.0:1746147209.336085:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2800:x1830967310306688:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147209.336122:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147209.336135:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400bc00/0x31399394250624b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eba7 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.336191:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336201:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336210:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336220:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ba00/0x31399394250624c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336225:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ba00/0x31399394250624c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336230:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ba00/0x31399394250624c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336300:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b400/0x31399394250624ce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336309:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b400/0x31399394250624ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336315:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b400/0x31399394250624ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:3.0:1746147209.336322:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147209.336375:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624c0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336381:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624c0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336386:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336391:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336396:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009400a600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147209.336399:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336404:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624c0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336412:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147209.336414:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147209.336417:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624c0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336422:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336438:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ba00/0x31399394250624c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336443:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ba00/0x31399394250624c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336447:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ba00/0x31399394250624c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336451:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009400ba00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147209.336453:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ba00/0x31399394250624c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336457:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ba00/0x31399394250624c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336462:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880095a3ef00) 00010000:00010000:3.0:1746147209.336464:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147209.336466:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ba00/0x31399394250624c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336470:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400ba00/0x31399394250624c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.336498:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400bc00/0x31399394250624b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eba7 expref: 46 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.336506:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b400/0x31399394250624ce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eba7 expref: 45 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.336511:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147209.336514:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147209.336516:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400b400, rc 0) 00000100:00100000:3.0:1746147209.336538:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2800:x1830967310306688:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 453us (1303us total) trans 8589937311 rc 0/0 00000100:00100000:3.0:1746147209.336543:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16417 00000100:00100000:2.0:1746147209.336845:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310306816 00000100:00100000:2.0:1746147209.336849:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310306816 00002000:00100000:2.0:1746147209.336873:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1409024->1441791) req@ffff88012b8b0e00 x1830967310306816/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.336882:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b0e00 with x1830967310306816 ext(1409024->1441791) 00010000:00010000:2.0:1746147209.336889:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x31399394250623f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb1b expref: 28 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746147209.336900:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x31399394250623f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb1b expref: 28 pid: 1398 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746147209.336907:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b8b0e00 00000100:00100000:2.0:1746147209.336920:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1698 00000100:00100000:2.0:1746147209.336925:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310306816:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147209.340467:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.340536:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.340574:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310307072 00000100:00100000:0.0:1746147209.340575:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310307200 00000100:00100000:0.0:1746147209.340583:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310307200 00000100:00100000:3.0:1746147209.340585:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310307072 00000100:00100000:3.0:1746147209.340644:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6128 00000100:00100000:0.0:1746147209.340647:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 989 00000100:00100000:3.0:1746147209.340652:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2800:x1830967310307072:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147209.340654:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2000:x1830967310307200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147209.340668:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147209.340705:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b400/0x31399394250624ce lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eba7 expref: 46 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147209.340726:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147209.340732:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147209.340777:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2000:x1830967310307200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 123us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147209.340783:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 989 00000100:00100000:3.0:1746147209.341354:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2800:x1830967310307072:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 701us (896us total) trans 8589937312 rc 0/0 00000100:00100000:3.0:1746147209.341361:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6128 00000100:00100000:0.0:1746147209.342158:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310306816:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 5231us (6358us total) trans 21474842581 rc 0/0 00000100:00100000:0.0:1746147209.342168:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1698 00002000:00100000:0.0:1746147209.342176:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1409024->1441791) req@ffff88012b8b0e00 x1830967310306816/t21474842581(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/448 e 0 to 0 dl 1746147220 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147209.342184:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b0e00 with x1830967310306816 ext(1409024->1441791) 00010000:00010000:0.0:1746147209.342193:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x31399394250623f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb1b expref: 30 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746147209.342206:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x31399394250623f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb1b expref: 30 pid: 1398 timeout: 847 lvb_type: 0 00002000:00010000:0.0:1746147209.342212:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b8b0e00 00000100:00100000:0.0:1746147209.358537:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.358635:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310307328 00000100:00100000:2.0:1746147209.358647:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310307328 00010000:00010000:2.0:1746147209.358690:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x31399394250623f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb1b expref: 30 pid: 1398 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746147209.358733:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8957 00000100:00100000:2.0:1746147209.358739:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310307328:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147209.358752:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147209.358768:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x31399394250623f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb1b expref: 30 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746147209.358779:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x31399394250623f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1441791) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb1b expref: 30 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746147209.358797:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093709200/0x31399394250623f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1441791) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb1b expref: 30 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746147209.359084:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147209.359087:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147209.359128:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x31399394250624b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eba0 expref: 16 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.359381:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x31399394250624b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eba0 expref: 16 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.359412:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x31399394250624b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eba0 expref: 16 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147209.359423:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311445120:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147209.359997:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147209.363862:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.363973:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310307584 00000100:00100000:2.0:1746147209.363983:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310307584 00000100:00100000:3.0:1746147209.364314:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16418 00000100:00100000:3.0:1746147209.366232:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2802:x1830967310307584:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147209.366261:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147209.366284:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400bc00/0x31399394250624dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ebae expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.366368:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366382:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366392:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366405:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a400/0x31399394250624ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366411:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a400/0x31399394250624ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366416:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a400/0x31399394250624ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366518:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b400/0x31399394250624f1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366528:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b400/0x31399394250624f1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366533:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b400/0x31399394250624f1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:3.0:1746147209.366542:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147209.366621:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624e3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366627:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624e3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366632:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366637:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366641:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009400a600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147209.366645:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366650:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624e3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366663:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147209.366665:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147209.366669:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624e3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366674:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a600/0x31399394250624e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366703:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a400/0x31399394250624ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366707:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a400/0x31399394250624ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366711:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a400/0x31399394250624ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366715:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009400a400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147209.366716:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a400/0x31399394250624ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366720:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a400/0x31399394250624ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366724:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880095a3e500) 00010000:00010000:3.0:1746147209.366726:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147209.366728:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a400/0x31399394250624ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366731:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400a400/0x31399394250624ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.366763:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400bc00/0x31399394250624dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebae expref: 26 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.366774:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b400/0x31399394250624f1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebae expref: 25 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.366778:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147209.366780:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147209.366782:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400b400, rc 0) 00000100:00100000:3.0:1746147209.366850:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2802:x1830967310307584:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 630us (2999us total) trans 8589937313 rc 0/0 00000100:00100000:3.0:1746147209.367805:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16418 00000100:00100000:1.0:1746147209.367864:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.368022:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311445120:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147209.368040:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147209.368524:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310307840 00000100:00100000:0.0:1746147209.368532:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310307840 00002000:00100000:0.0:1746147209.368572:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88012bab4000 x1830967310307840/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147209.368581:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab4000 with x1830967310307840 ext(1048576->2097151) 00002000:00010000:0.0:1746147209.368586:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bab4000 00000100:00100000:0.0:1746147209.368619:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7255 00000100:00100000:0.0:1746147209.368627:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967310307840:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147209.370374:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310307328:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 11625us (11840us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147209.370386:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8957 00000100:00100000:3.0:1746147209.383368:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.383398:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.383417:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310308224 00000100:00100000:3.0:1746147209.383426:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310308224 00000100:00100000:3.0:1746147209.383469:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6129 00000100:00100000:3.0:1746147209.383476:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2802:x1830967310308224:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147209.383663:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2802:x1830967310308224:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 186us (262us total) trans 8589937314 rc 0/0 00000100:00100000:3.0:1746147209.383670:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6129 00000100:00100000:0.0:1746147209.383916:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310307968 00000100:00100000:0.0:1746147209.383920:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310307968 00000100:00100000:0.0:1746147209.383951:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 990 00000100:00100000:0.0:1746147209.383955:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2000:x1830967310307968:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147209.383964:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147209.383987:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b400/0x31399394250624f1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebae expref: 26 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147209.384004:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147209.384009:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147209.384028:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099889500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2000:x1830967310307968:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 73us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147209.384034:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 990 00000100:00100000:0.0:1746147209.385601:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967310307840:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16967us (17729us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147209.385611:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7255 00002000:00100000:0.0:1746147209.385621:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88012bab4000 x1830967310307840/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147209.385631:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab4000 with x1830967310307840 ext(1048576->2097151) 00002000:00010000:0.0:1746147209.385635:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bab4000 00000100:00100000:1.0:1746147209.398221:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.398291:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310308480 00000100:00100000:3.0:1746147209.398301:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310308480 00000100:00100000:3.0:1746147209.398357:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16419 00000100:00100000:3.0:1746147209.398365:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2806:x1830967310308480:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147209.398386:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147209.398404:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x31399394250624ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ebb5 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.398483:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425062506 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398495:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425062506 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398505:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425062506 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398515:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942506250d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398520:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942506250d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398525:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942506250d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398611:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425062514 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398619:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425062514 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398624:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425062514 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:3.0:1746147209.398631:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147209.398723:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425062506 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398729:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425062506 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398738:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425062506 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398744:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425062506 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398749:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0c600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147209.398752:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425062506 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398758:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425062506 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398768:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147209.398770:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147209.398774:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425062506 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398777:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c600/0x3139939425062506 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398787:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942506250d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398790:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942506250d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398793:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942506250d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398797:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0c800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147209.398798:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942506250d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398806:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942506250d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398811:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880095a3e800) 00010000:00010000:3.0:1746147209.398813:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147209.398814:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942506250d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398818:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0c800/0x313993942506250d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147209.398854:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d600/0x31399394250624ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebb5 expref: 48 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.398864:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425062514 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebb5 expref: 47 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.398870:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147209.398872:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147209.398874:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0ca00, rc 0) 00000100:00100000:3.0:1746147209.398935:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2806:x1830967310308480:12345-192.168.204.25@tcp:101:cat.0 Request processed in 570us (725us total) trans 8589937315 rc 0/0 00000100:00100000:3.0:1746147209.398941:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16419 00000100:00100000:0.0:1746147209.403704:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.403792:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310308608 00000100:00100000:2.0:1746147209.403803:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310308608 00000100:00100000:2.0:1746147209.403848:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19724 00000100:00100000:2.0:1746147209.403856:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2797:x1830967310308608:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147209.403873:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147209.403892:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425062522 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ebbc expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.403926:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f01a800/0x313993942506247a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2818047) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb84 expref: 28 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.403938:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147209.403940:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147209.403943:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425062522 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebbc expref: 18 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.403974:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f01a800/0x313993942506247a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2818047) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb84 expref: 28 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.403986:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f01a800/0x313993942506247a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2818047) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb84 expref: 28 pid: 1398 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746147209.403998:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311445248:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147209.404112:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147209.404706:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.404734:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.404770:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147209.404973:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310308736 00000100:00100000:1.0:1746147209.404978:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310308736 00000100:00100000:1.0:1746147209.405020:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310308864 00000100:00100000:2.0:1746147209.405021:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310308992 00000100:00100000:1.0:1746147209.405022:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310308864 00000100:00100000:2.0:1746147209.405026:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310308992 00000100:00100000:1.0:1746147209.405037:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19725 00000100:00100000:1.0:1746147209.405044:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967310308736:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147209.405053:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147209.405060:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19726 00010000:00010000:1.0:1746147209.405065:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425062529 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ebc3 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147209.405066:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967310308864:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147209.405074:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147209.405083:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4c00/0x3139939425062530 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ebca expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147209.405120:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311445376:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147209.405126:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311445504:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147209.405157:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19727 00000100:00100000:1.0:1746147209.405164:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8540 going to sleep for 11 seconds 00000100:00100000:2.0:1746147209.405165:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147209.405173:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967310308992:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147209.405181:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147209.405188:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x3139939425062537 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ebd1 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.405200:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147209.405202:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147209.405208:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x3139939425062537 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd1 expref: 30 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147209.405222:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x3139939425062537 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd1 expref: 30 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147209.405231:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9b4800, rc 0) 00000100:00100000:2.0:1746147209.405254:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967310308992:12345-192.168.204.25@tcp:101:cat.0 Request processed in 92us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147209.405260:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19727 00000100:00100000:0.0:1746147209.411919:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.412529:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311445248:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147209.412561:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425062522 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebbc expref: 18 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.412580:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b64a200, rc 0) 00000100:00100000:3.0:1746147209.412642:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2797:x1830967310308608:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8785us (8947us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147209.412651:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19724 00000100:00100000:2.0:1746147209.412766:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310309120 00000100:00100000:0.0:1746147209.412766:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.412774:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310309120 00000100:00100000:0.0:1746147209.412786:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310309248 00000100:00100000:0.0:1746147209.412789:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310309248 00000100:00100000:2.0:1746147209.412813:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 991 00002000:00100000:0.0:1746147209.412817:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2461696->2818047) req@ffff8800947e6680 x1830967310309248/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746147209.412818:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2001:x1830967310309120:12345-192.168.204.25@tcp:103:ldlm_bl.0 00002000:00100000:0.0:1746147209.412825:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e6680 with x1830967310309248 ext(2461696->2818047) 00010000:00010000:2.0:1746147209.412831:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147209.412831:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f01a800/0x313993942506247a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb84 expref: 30 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746147209.412843:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f01a800/0x313993942506247a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb84 expref: 30 pid: 1398 timeout: 847 lvb_type: 0 00002000:00010000:0.0:1746147209.412849:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947e6680 00010000:00010000:2.0:1746147209.412855:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0ca00/0x3139939425062514 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebb5 expref: 47 pid: 7237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147209.412860:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1699 00000100:00100000:0.0:1746147209.412864:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310309248:12345-192.168.204.25@tcp:4:multiop.0 00010000:00010000:2.0:1746147209.412872:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147209.412875:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147209.412892:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2001:x1830967310309120:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 74us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147209.412898:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 991 00002000:00010000:1.0:1746147209.412931:0:10340:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime: 1746147208 -> 1746147209 00000100:00100000:1.0:1746147209.412947:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311445376:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147209.412966:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425062529 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebc3 expref: 30 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147209.412976:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d94800/0x3139939425062529 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebc3 expref: 30 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147209.413001:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94800, rc 0) 00000100:00100000:1.0:1746147209.413021:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967310308736:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7977us (8314us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147209.413026:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19725 00002000:00010000:3.0:1746147209.413212:0:9584:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime: 1746147208 -> 1746147209 00000100:00100000:3.0:1746147209.413222:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311445504:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147209.413236:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4c00/0x3139939425062530 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebca expref: 28 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.413244:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4c00/0x3139939425062530 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebca expref: 28 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.413254:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9b4c00, rc 0) 00000100:00100000:3.0:1746147209.413270:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967310308864:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8204us (8536us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147209.413276:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19726 00000100:00100000:2.0:1746147209.422238:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967310309248:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 9359us (9459us total) trans 21474842582 rc 0/0 00000100:00100000:2.0:1746147209.422253:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1699 00002000:00100000:2.0:1746147209.422267:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2461696->2818047) req@ffff8800947e6680 x1830967310309248/t21474842582(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/448 e 0 to 0 dl 1746147220 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.422277:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e6680 with x1830967310309248 ext(2461696->2818047) 00010000:00010000:2.0:1746147209.422289:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f01a800/0x313993942506247a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb84 expref: 32 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746147209.422304:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f01a800/0x313993942506247a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb84 expref: 32 pid: 1398 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746147209.422311:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947e6680 00000100:00100000:0.0:1746147209.427543:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.428153:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310309376 00000100:00100000:3.0:1746147209.428162:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310309376 00000100:00100000:3.0:1746147209.428227:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19728 00000100:00100000:3.0:1746147209.428234:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2806:x1830967310309376:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147209.428254:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147209.428277:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942506253e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ebd8 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.428309:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x313993942506241f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb45 expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.428322:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147209.428324:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147209.428327:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942506253e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd8 expref: 28 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.428363:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x313993942506241f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb45 expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.428373:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x313993942506241f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb45 expref: 13 pid: 1398 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746147209.428386:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095127480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311445632:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147209.429765:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147209.430198:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.431883:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310309504 00000100:00100000:3.0:1746147209.431895:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310309504 00010000:00010000:3.0:1746147209.432002:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f01a800/0x313993942506247a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb84 expref: 32 pid: 1398 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746147209.432038:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8958 00000100:00100000:3.0:1746147209.432045:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f79050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310309504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147209.432063:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147209.432086:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f01a800/0x313993942506247a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb84 expref: 32 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.432126:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f01a800/0x313993942506247a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->2818047) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb84 expref: 32 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.432150:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f01a800/0x313993942506247a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->2818047) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb84 expref: 32 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.432172:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147209.432174:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147209.432181:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425062522 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebbc expref: 17 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.432189:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425062522 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebbc expref: 17 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.432225:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425062522 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebbc expref: 17 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147209.432237:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311445760:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147209.433217:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.433280:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147209.433309:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310309632 00000100:00100000:3.0:1746147209.433313:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310309632 00002000:00100000:3.0:1746147209.433349:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1847296->2097151) req@ffff8800947e6a00 x1830967310309632/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147209.433359:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e6a00 with x1830967310309632 ext(1847296->2097151) 00010000:00010000:3.0:1746147209.433367:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x313993942506241f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb45 expref: 14 pid: 1398 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746147209.433433:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095127480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311445632:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147209.433458:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942506253e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd8 expref: 28 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.433469:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0ca00, rc 0) 00000100:00100000:2.0:1746147209.433504:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2806:x1830967310309376:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5269us (5972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147209.433512:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19728 00010000:00010000:3.0:1746147209.433832:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x313993942506241f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb45 expref: 14 pid: 1398 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746147209.433840:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800947e6a00 00000100:00100000:3.0:1746147209.433857:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1700 00000100:00100000:3.0:1746147209.433864:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310309632:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147209.443071:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311445760:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147209.443113:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147209.443159:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f79050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967310309504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 11113us (12963us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147209.443169:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8958 00000100:00100000:0.0:1746147209.445824:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.445974:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310309760 00000100:00100000:2.0:1746147209.445983:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310309760 00000100:00100000:2.0:1746147209.446421:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19729 00000100:00100000:2.0:1746147209.446430:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2800:x1830967310309760:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147209.446449:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147209.446469:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ebdf expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.446496:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425062522 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebbc expref: 17 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.446504:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147209.446505:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147209.446508:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3166208->3792895] (req 3166208->3792895) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 32 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.446539:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425062522 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebbc expref: 17 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.446548:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425062522 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebbc expref: 17 pid: 1398 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746147209.446559:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311445888:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147209.447125:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310309632:12345-192.168.204.25@tcp:4:cat.0 Request processed in 13261us (13913us total) trans 17179875203 rc 0/0 00000100:00100000:3.0:1746147209.447135:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1700 00002000:00100000:3.0:1746147209.447145:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1847296->2097151) req@ffff8800947e6a00 x1830967310309632/t17179875203(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/448 e 0 to 0 dl 1746147220 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147209.447153:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e6a00 with x1830967310309632 ext(1847296->2097151) 00010000:00010000:3.0:1746147209.447160:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x313993942506241f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb45 expref: 16 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.447170:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x313993942506241f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb45 expref: 16 pid: 1398 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746147209.447175:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800947e6a00 00000100:00100000:2.0:1746147209.447574:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147209.450728:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.450985:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310310016 00000100:00100000:3.0:1746147209.450994:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310310016 00002000:00100000:3.0:1746147209.451036:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88011e486300 x1830967310310016/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147209.451046:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e486300 with x1830967310310016 ext(2097152->4194303) 00010000:00010000:3.0:1746147209.451056:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425062522 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebbc expref: 18 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.451072:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425062522 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebbc expref: 18 pid: 1398 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746147209.451078:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011e486300 00000100:00100000:3.0:1746147209.451120:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1701 00000100:00100000:3.0:1746147209.451126:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310310016:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147209.452255:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311445888:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147209.452282:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3166208->3792895] (req 3166208->3792895) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 32 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.452297:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b64ac00, rc 0) 00000100:00100000:2.0:1746147209.452357:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2800:x1830967310309760:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5928us (6541us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147209.452364:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19729 00000100:00100000:0.0:1746147209.454743:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.455200:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310310144 00000100:00100000:3.0:1746147209.455208:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310310144 00010000:00010000:3.0:1746147209.455243:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x313993942506241f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb45 expref: 16 pid: 1398 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746147209.455269:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8959 00000100:00100000:3.0:1746147209.455276:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967310310144:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147209.455289:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147209.455310:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x313993942506241f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb45 expref: 16 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.455321:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x313993942506241f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb45 expref: 16 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.455345:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a55cdc00/0x313993942506241f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb45 expref: 16 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.455362:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147209.455365:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147209.455373:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942506253e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd8 expref: 27 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.455381:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942506253e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd8 expref: 27 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.455416:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942506253e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd8 expref: 27 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147209.455429:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311446016:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147209.457788:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147209.466177:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.467004:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311446016:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147209.467026:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147209.467075:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2002:x1830967310310144:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 11798us (12339us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147209.467099:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8959 00000100:00100000:1.0:1746147209.467557:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310310400 00000100:00100000:1.0:1746147209.467565:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310310400 00002000:00100000:1.0:1746147209.467606:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880093146300 x1830967310310400/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.467616:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093146300 with x1830967310310400 ext(1048576->2097151) 00002000:00010000:1.0:1746147209.467620:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093146300 00000100:00100000:1.0:1746147209.468791:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7256 00000100:00100000:1.0:1746147209.468803:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310310400:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147209.474303:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310310016:12345-192.168.204.25@tcp:3:cat.0 Request processed in 23165us (23573us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147209.474315:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1701 00002000:00100000:3.0:1746147209.474327:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88011e486300 x1830967310310016/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147209.474337:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e486300 with x1830967310310016 ext(2097152->4194303) 00010000:00010000:3.0:1746147209.474348:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425062522 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebbc expref: 18 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.474368:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425062522 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebbc expref: 18 pid: 1398 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746147209.474376:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011e486300 00000100:00100000:0.0:1746147209.488884:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.489200:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310310528 00000100:00100000:2.0:1746147209.489210:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310310528 00000100:00100000:2.0:1746147209.489257:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19730 00000100:00100000:2.0:1746147209.489265:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2797:x1830967310310528:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147209.489284:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147209.489301:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x313993942506254c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ebe6 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.489328:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147209.489334:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3166208->3792895] (req 3166208->3792895) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 31 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.489340:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147209.489344:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x313993942506254c lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebe6 expref: 19 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.489379:0:9584:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3166208->3792895] (req 3166208->3792895) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 31 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.489395:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x313993942506254c lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebe6 expref: 19 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.489406:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0da00, rc 0) 00000100:00100000:2.0:1746147209.489447:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2797:x1830967310310528:12345-192.168.204.25@tcp:101:cat.0 Request processed in 183us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147209.489452:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19730 00000100:00100000:0.0:1746147209.489559:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147209.489714:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310310400:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 20915us (23549us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147209.489723:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7256 00002000:00100000:1.0:1746147209.489732:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880093146300 x1830967310310400/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.489741:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093146300 with x1830967310310400 ext(1048576->2097151) 00002000:00010000:1.0:1746147209.489745:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093146300 00000100:00100000:3.0:1746147209.490158:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310310656 00000100:00100000:3.0:1746147209.490163:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310310656 00010000:00010000:3.0:1746147209.490185:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425062522 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebbc expref: 19 pid: 1398 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746147209.490215:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8960 00000100:00100000:3.0:1746147209.490221:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310310656:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147209.490230:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147209.490246:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425062522 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebbc expref: 19 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.490258:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425062522 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebbc expref: 19 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.490275:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b64a200/0x3139939425062522 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebbc expref: 19 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.490297:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147209.490298:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147209.490305:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 31 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.490316:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 31 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.490337:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 31 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.490347:0:7227:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 31 pid: 9584 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746147209.490358:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311446272:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147209.492902:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147209.494007:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311446272:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147209.494027:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147209.494076:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310310656:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3853us (4515us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147209.494086:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8960 00000100:00100000:0.0:1746147209.496075:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.496150:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.496232:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310311040 00000100:00100000:2.0:1746147209.496242:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310311040 00000100:00100000:2.0:1746147209.496296:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19731 00000100:00100000:2.0:1746147209.496303:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2806:x1830967310311040:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147209.496321:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147209.496339:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425062553 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ebed expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.496369:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1600/0x3139939425062426 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb4c expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.496376:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147209.496378:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147209.496382:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425062553 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebed expref: 29 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.496410:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1600/0x3139939425062426 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb4c expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.496427:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1600/0x3139939425062426 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb4c expref: 14 pid: 1398 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746147209.496438:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311446400:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147209.496515:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147209.496601:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310310912 00000100:00100000:1.0:1746147209.496605:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310310912 00002000:00100000:1.0:1746147209.496641:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3166208->3170303) req@ffff8800968a2a00 x1830967310310912/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.496651:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a2a00 with x1830967310310912 ext(3166208->3170303) 00010000:00010000:1.0:1746147209.496658:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 32 pid: 9584 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746147209.496667:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 32 pid: 9584 timeout: 847 lvb_type: 0 00002000:00010000:1.0:1746147209.496673:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800968a2a00 00000100:00100000:1.0:1746147209.496695:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1702 00000100:00100000:1.0:1746147209.496701:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967310310912:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147209.496813:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967310310912:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 111us (662us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147209.496819:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1702 00002000:00100000:1.0:1746147209.496824:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3166208->3170303) req@ffff8800968a2a00 x1830967310310912/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/4536 e 0 to 0 dl 1746147220 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.496836:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a2a00 with x1830967310310912 ext(3166208->3170303) 00010000:00010000:1.0:1746147209.496840:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 32 pid: 9584 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746147209.496848:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 32 pid: 9584 timeout: 847 lvb_type: 0 00002000:00010000:1.0:1746147209.496854:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800968a2a00 00000100:00100000:3.0:1746147209.501082:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311446400:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147209.501083:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147209.501139:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425062553 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebed expref: 29 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.501159:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0c600, rc 0) 00000100:00100000:3.0:1746147209.501205:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2806:x1830967310311040:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4901us (5136us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147209.501213:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19731 00000100:00100000:3.0:1746147209.501253:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310311168 00000100:00100000:3.0:1746147209.501259:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310311168 00002000:00100000:3.0:1746147209.501294:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1654783) req@ffff8800968a3800 x1830967310311168/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147209.501303:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a3800 with x1830967310311168 ext(1048576->1654783) 00010000:00010000:3.0:1746147209.501310:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1600/0x3139939425062426 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb4c expref: 15 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.501320:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1600/0x3139939425062426 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb4c expref: 15 pid: 1398 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746147209.501327:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968a3800 00000100:00100000:3.0:1746147209.502174:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1703 00000100:00100000:3.0:1746147209.502184:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310311168:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147209.503332:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147209.503444:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310311424 00000100:00100000:1.0:1746147209.503450:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310311424 00002000:00100000:1.0:1746147209.503480:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3788800->3792895) req@ffff880097eb8000 x1830967310311424/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.503490:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097eb8000 with x1830967310311424 ext(3788800->3792895) 00010000:00010000:1.0:1746147209.503498:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 32 pid: 9584 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746147209.503510:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 32 pid: 9584 timeout: 847 lvb_type: 0 00002000:00010000:1.0:1746147209.503517:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097eb8000 00000100:00100000:1.0:1746147209.503541:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1704 00000100:00100000:1.0:1746147209.503546:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310311424:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147209.504436:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310311424:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 887us (1104us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147209.504443:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1704 00002000:00100000:1.0:1746147209.504450:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3788800->3792895) req@ffff880097eb8000 x1830967310311424/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/4536 e 0 to 0 dl 1746147220 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.504458:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097eb8000 with x1830967310311424 ext(3788800->3792895) 00010000:00010000:1.0:1746147209.504464:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 32 pid: 9584 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746147209.504473:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 32 pid: 9584 timeout: 847 lvb_type: 0 00002000:00010000:1.0:1746147209.504479:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097eb8000 00000100:00100000:0.0:1746147209.510466:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147209.510868:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310311680 00000100:00100000:1.0:1746147209.510878:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310311680 00002000:00100000:1.0:1746147209.510925:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3166208->3792895) req@ffff8800968a3480 x1830967310311680/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.510934:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a3480 with x1830967310311680 ext(3166208->3792895) 00010000:00010000:1.0:1746147209.510943:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 32 pid: 9584 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746147209.510955:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 32 pid: 9584 timeout: 847 lvb_type: 0 00002000:00010000:1.0:1746147209.510962:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800968a3480 00000100:00100000:1.0:1746147209.510994:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1705 00000100:00100000:1.0:1746147209.511002:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967310311680:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147209.518892:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310311168:12345-192.168.204.25@tcp:4:cat.0 Request processed in 16698us (17808us total) trans 17179875204 rc 0/0 00000100:00100000:0.0:1746147209.518906:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1703 00002000:00100000:0.0:1746147209.518917:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1654783) req@ffff8800968a3800 x1830967310311168/t17179875204(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/448 e 0 to 0 dl 1746147220 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147209.518928:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a3800 with x1830967310311168 ext(1048576->1654783) 00010000:00010000:0.0:1746147209.518939:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1600/0x3139939425062426 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb4c expref: 17 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746147209.518952:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1600/0x3139939425062426 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb4c expref: 17 pid: 1398 timeout: 847 lvb_type: 0 00002000:00010000:0.0:1746147209.518959:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968a3800 00000100:00100000:2.0:1746147209.524347:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.524440:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310311808 00000100:00100000:3.0:1746147209.524449:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310311808 00010000:00010000:3.0:1746147209.524491:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1600/0x3139939425062426 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb4c expref: 17 pid: 1398 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746147209.524533:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8961 00000100:00100000:3.0:1746147209.524541:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2002:x1830967310311808:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147209.524555:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147209.524573:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1600/0x3139939425062426 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb4c expref: 17 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.524583:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1600/0x3139939425062426 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb4c expref: 17 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.524609:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1600/0x3139939425062426 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb4c expref: 17 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.524627:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147209.524629:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147209.525527:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425062553 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebed expref: 28 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.525541:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425062553 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebed expref: 28 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.525580:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425062553 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebed expref: 28 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147209.525592:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311446528:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147209.525708:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147209.527965:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310311680:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 16954us (17502us total) trans 21474842583 rc 0/0 00000100:00100000:1.0:1746147209.527982:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1705 00002000:00100000:1.0:1746147209.527994:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3166208->3792895) req@ffff8800968a3480 x1830967310311680/t21474842583(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/448 e 0 to 0 dl 1746147220 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.528004:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a3480 with x1830967310311680 ext(3166208->3792895) 00010000:00010000:1.0:1746147209.528015:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 34 pid: 9584 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746147209.528030:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 34 pid: 9584 timeout: 847 lvb_type: 0 00002000:00010000:1.0:1746147209.528035:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800968a3480 00000100:00100000:3.0:1746147209.530039:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311446528:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147209.530062:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147209.530124:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967310311808:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5583us (5787us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147209.530134:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8961 00000100:00100000:0.0:1746147209.543393:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.543437:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.543490:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.543562:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310312320 00000100:00100000:3.0:1746147209.543572:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310312320 00000100:00100000:1.0:1746147209.543578:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310312192 00000100:00100000:1.0:1746147209.543582:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310312192 00010000:00010000:3.0:1746147209.543611:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 34 pid: 9584 timeout: 847 lvb_type: 0 00002000:00100000:1.0:1746147209.543618:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88009f3e4450 x1830967310312192/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.543628:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e4450 with x1830967310312192 ext(1048576->2097151) 00002000:00010000:1.0:1746147209.543632:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3e4450 00000100:00100000:3.0:1746147209.543649:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8962 00000100:00100000:1.0:1746147209.543651:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310312448 00000100:00100000:1.0:1746147209.543654:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310312448 00000100:00100000:3.0:1746147209.543663:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7257 00002000:00100000:1.0:1746147209.543666:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800968a1880 x1830967310312448/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746147209.543669:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310312192:12345-192.168.204.25@tcp:3:multiop.0 00002000:00100000:1.0:1746147209.543672:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a1880 with x1830967310312448 ext(1048576->2097151) 00002000:00010000:1.0:1746147209.543686:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968a1880 00000100:00100000:1.0:1746147209.543708:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7258 00000100:00100000:1.0:1746147209.543713:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967310312448:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147209.554051:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310312320:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147209.554078:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147209.554119:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 36 pid: 9584 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746147209.554135:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 36 pid: 9584 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746147209.554158:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b64ac00/0x3139939425062545 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->3792895) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebdf expref: 36 pid: 9584 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746147209.554177:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147209.554179:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147209.554186:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x313993942506254c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebe6 expref: 17 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.554193:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x313993942506254c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebe6 expref: 17 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.554257:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x313993942506254c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebe6 expref: 17 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147209.554271:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311446656:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147209.554955:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147209.564345:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311446656:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147209.564370:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147209.564440:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967310312320:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 20784us (20947us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147209.564451:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8962 00000100:00100000:0.0:1746147209.567369:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.567648:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310312192:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 23975us (24264us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147209.567661:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7257 00002000:00100000:3.0:1746147209.567673:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88009f3e4450 x1830967310312192/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147209.567692:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3e4450 with x1830967310312192 ext(1048576->2097151) 00002000:00010000:3.0:1746147209.567698:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3e4450 00000100:00100000:2.0:1746147209.568184:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310312704 00000100:00100000:2.0:1746147209.568193:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310312704 00002000:00100000:2.0:1746147209.568227:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880096cfb480 x1830967310312704/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.568235:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfb480 with x1830967310312704 ext(3145728->4194303) 00002000:00010000:2.0:1746147209.568239:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cfb480 00000100:00100000:2.0:1746147209.568268:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7259 00000100:00100000:2.0:1746147209.568275:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310312704:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147209.572783:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967310312448:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 29057us (29333us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147209.572795:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7258 00002000:00100000:1.0:1746147209.572807:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800968a1880 x1830967310312448/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.572817:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a1880 with x1830967310312448 ext(1048576->2097151) 00002000:00010000:1.0:1746147209.572823:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968a1880 00000100:00100000:2.0:1746147209.580903:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310312704:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12617us (13532us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147209.580916:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7259 00002000:00100000:2.0:1746147209.580928:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880096cfb480 x1830967310312704/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.580945:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfb480 with x1830967310312704 ext(3145728->4194303) 00002000:00010000:2.0:1746147209.580950:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cfb480 00000100:00100000:0.0:1746147209.586227:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.586269:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.586355:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.586499:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310312960 00000100:00100000:3.0:1746147209.586508:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310312960 00000100:00100000:3.0:1746147209.586549:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310312832 00000100:00100000:3.0:1746147209.586551:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310312832 00000100:00100000:3.0:1746147209.586575:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310313088 00000100:00100000:3.0:1746147209.586577:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310313088 00000100:00100000:3.0:1746147209.586593:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19732 00000100:00100000:3.0:1746147209.586602:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2002:x1830967310312960:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147209.586619:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19733 00010000:00010000:3.0:1746147209.586623:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147209.586628:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2002:x1830967310312832:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147209.586635:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147209.586642:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x313993942506255a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ebfb expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.586644:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ff4e00/0x3139939425062561 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ebf4 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.586665:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147209.586665:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147209.586667:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147209.586667:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147209.586685:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff4e00/0x3139939425062561 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebf4 expref: 19 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.586689:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x313993942506255a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebfb expref: 19 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.586701:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x313993942506255a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebfb expref: 19 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147209.586701:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ff4e00/0x3139939425062561 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebf4 expref: 19 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.586711:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e04a00, rc 0) 00010000:00010000:1.0:1746147209.586711:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4e00, rc 0) 00000100:00100000:1.0:1746147209.586756:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2002:x1830967310312832:12345-192.168.204.25@tcp:101:cat.0 Request processed in 130us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147209.586761:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19733 00000100:00100000:1.0:1746147209.586779:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19734 00000100:00100000:1.0:1746147209.586784:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2806:x1830967310313088:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147209.586791:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147209.586801:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425062568 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec02 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.586814:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147209.586816:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147209.586820:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425062568 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec02 expref: 34 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.586830:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425062568 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec02 expref: 34 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.586837:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff5c00, rc 0) 00000100:00100000:3.0:1746147209.587256:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310312960:12345-192.168.204.25@tcp:101:cat.0 Request processed in 654us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147209.587260:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2806:x1830967310313088:12345-192.168.204.25@tcp:101:cat.0 Request processed in 474us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147209.587262:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19732 00000100:00100000:1.0:1746147209.587265:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19734 00000100:00100000:0.0:1746147209.595419:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.595562:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310313472 00000100:00100000:2.0:1746147209.595570:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310313472 00002000:00100000:2.0:1746147209.595609:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880096cf9f80 x1830967310313472/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.595618:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9f80 with x1830967310313472 ext(4194304->4890623) 00002000:00010000:2.0:1746147209.595622:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cf9f80 00000100:00100000:2.0:1746147209.595702:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7260 00000100:00100000:2.0:1746147209.595710:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310313472:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147209.597146:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147209.597389:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310313600 00000100:00100000:1.0:1746147209.597394:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310313600 00002000:00100000:1.0:1746147209.597424:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff8801312eed80 x1830967310313600/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.597432:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312eed80 with x1830967310313600 ext(2097152->4194303) 00002000:00010000:1.0:1746147209.597436:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312eed80 00000100:00100000:1.0:1746147209.597448:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7261 00000100:00100000:1.0:1746147209.597453:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310313600:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147209.605290:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310313472:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9572us (9870us total) trans 0 rc 696320/696320 00000100:00100000:2.0:1746147209.605302:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7260 00002000:00100000:2.0:1746147209.605313:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880096cf9f80 x1830967310313472/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.605321:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9f80 with x1830967310313472 ext(4194304->4890623) 00002000:00010000:2.0:1746147209.605326:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cf9f80 00000100:00100000:0.0:1746147209.613797:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.613969:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310313856 00000100:00100000:2.0:1746147209.613981:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310313856 00000100:00100000:1.0:1746147209.614018:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310313600:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16562us (16873us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147209.614027:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7261 00002000:00100000:1.0:1746147209.614037:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff8801312eed80 x1830967310313600/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.614046:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312eed80 with x1830967310313600 ext(2097152->4194303) 00002000:00010000:1.0:1746147209.614051:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312eed80 00000100:00100000:2.0:1746147209.614113:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6130 00000100:00100000:2.0:1746147209.614119:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079239450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2797:x1830967310313856:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147209.614327:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079239450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2797:x1830967310313856:12345-192.168.204.25@tcp:35:cat.0 Request processed in 207us (537us total) trans 8589937316 rc 0/0 00000100:00100000:2.0:1746147209.614336:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6130 00000100:00100000:0.0:1746147209.628325:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.628388:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310314112 00000100:00100000:2.0:1746147209.628396:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310314112 00000100:00100000:2.0:1746147209.628450:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16420 00000100:00100000:2.0:1746147209.628458:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2810:x1830967310314112:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147209.628479:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147209.628495:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x313993942506256f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec09 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.628557:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062576 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628568:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062576 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628576:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062576 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628587:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942506257d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628591:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942506257d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628596:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942506257d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628669:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae800/0x3139939425062584 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628689:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae800/0x3139939425062584 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628695:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae800/0x3139939425062584 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147209.628704:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147209.628842:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062576 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628848:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062576 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628853:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062576 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628858:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f01a800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147209.628861:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062576 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628866:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062576 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628875:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147209.628878:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147209.628881:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062576 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628885:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01a800/0x3139939425062576 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628911:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942506257d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628917:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942506257d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628925:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942506257d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628929:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0ae400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147209.628931:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942506257d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628935:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942506257d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628940:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096e23e00) 00010000:00010000:2.0:1746147209.628943:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147209.628944:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942506257d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628949:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae400/0x313993942506257d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.628980:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x313993942506256f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec09 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.628991:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae800/0x3139939425062584 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec09 expref: 28 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.628996:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147209.628998:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147209.629000:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0ae800, rc 0) 00000100:00100000:2.0:1746147209.629053:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2810:x1830967310314112:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 595us (734us total) trans 8589937317 rc 0/0 00000100:00100000:2.0:1746147209.629059:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16420 00000100:00100000:0.0:1746147209.629430:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147209.629490:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310314368 00000100:00100000:1.0:1746147209.629495:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310314368 00002000:00100000:1.0:1746147209.629522:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880096cf9c00 x1830967310314368/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.629532:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9c00 with x1830967310314368 ext(4194304->4890623) 00002000:00010000:1.0:1746147209.629535:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cf9c00 00000100:00100000:1.0:1746147209.629558:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7262 00000100:00100000:1.0:1746147209.629564:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310314368:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147209.631558:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.632183:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310314624 00000100:00100000:2.0:1746147209.632191:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310314624 00000100:00100000:2.0:1746147209.632231:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6131 00000100:00100000:2.0:1746147209.632238:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2810:x1830967310314624:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147209.632687:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2810:x1830967310314624:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 448us (1133us total) trans 8589937318 rc 0/0 00000100:00100000:2.0:1746147209.632693:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6131 00000100:00100000:0.0:1746147209.633329:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.633368:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310314752 00000100:00100000:3.0:1746147209.633373:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310314752 00000100:00100000:3.0:1746147209.633404:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 992 00000100:00100000:3.0:1746147209.633409:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2000:x1830967310314752:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147209.633416:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147209.633437:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae800/0x3139939425062584 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec09 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.633625:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147209.633629:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147209.633666:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2000:x1830967310314752:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 256us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147209.633672:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 992 00000100:00100000:1.0:1746147209.635808:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310314368:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6238us (6372us total) trans 0 rc 696320/696320 00000100:00100000:1.0:1746147209.635817:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7262 00002000:00100000:1.0:1746147209.635826:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880096cf9c00 x1830967310314368/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.635835:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9c00 with x1830967310314368 ext(4194304->4890623) 00002000:00010000:1.0:1746147209.635839:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cf9c00 00000100:00100000:0.0:1746147209.648127:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.648895:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310315008 00000100:00100000:3.0:1746147209.648904:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310315008 00000100:00100000:3.0:1746147209.648955:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6132 00000100:00100000:3.0:1746147209.648963:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2806:x1830967310315008:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147209.649156:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2806:x1830967310315008:12345-192.168.204.25@tcp:35:cat.0 Request processed in 192us (1034us total) trans 8589937319 rc 0/0 00000100:00100000:3.0:1746147209.649161:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6132 00000100:00100000:0.0:1746147209.686926:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.687018:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310315136 00000100:00100000:2.0:1746147209.687025:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310315136 00000100:00100000:2.0:1746147209.687079:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19735 00000100:00100000:2.0:1746147209.687087:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2810:x1830967310315136:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147209.687127:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147209.687142:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae200/0x3139939425062592 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec10 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.687405:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x31399394250624b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eba0 expref: 19 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.687414:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x3139939425062537 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd1 expref: 33 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147209.687420:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147209.687422:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147209.687425:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae200/0x3139939425062592 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1134592->1773567] (req 1134592->1773567) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec10 expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.687450:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x3139939425062537 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd1 expref: 33 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147209.687462:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x3139939425062537 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd1 expref: 33 pid: 12225 timeout: 847 lvb_type: 1 00000100:00100000:2.0:1746147209.687472:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311446784:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147209.688080:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x31399394250624b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eba0 expref: 19 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.688389:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x31399394250624b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eba0 expref: 19 pid: 1398 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746147209.688400:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311446912:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147209.688954:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147209.694203:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311446784:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147209.694216:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311446912:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147209.694238:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae200/0x3139939425062592 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1134592->1773567] (req 1134592->1773567) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec10 expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.694255:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0ae200, rc 0) 00000100:00100000:2.0:1746147209.694290:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2810:x1830967310315136:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7204us (7371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147209.694297:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19735 00000100:00100000:0.0:1746147209.696002:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.696242:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310315264 00000100:00100000:3.0:1746147209.696249:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310315264 00010000:00010000:3.0:1746147209.696278:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x31399394250624b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eba0 expref: 19 pid: 1398 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746147209.696301:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8963 00000100:00100000:3.0:1746147209.696306:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310315264:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147209.696317:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147209.696332:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x31399394250624b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eba0 expref: 19 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.696341:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x31399394250624b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eba0 expref: 19 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.696359:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x31399394250624b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eba0 expref: 19 pid: 1398 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.696385:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147209.696413:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310315264:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 107us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147209.696419:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8963 00000100:00100000:0.0:1746147209.701259:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147209.702081:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310315392 00000100:00100000:1.0:1746147209.702111:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310315392 00010000:00010000:1.0:1746147209.702143:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x3139939425062537 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd1 expref: 34 pid: 12225 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746147209.702182:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8964 00000100:00100000:1.0:1746147209.702189:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967310315392:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147209.702202:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147209.702218:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x3139939425062537 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd1 expref: 34 pid: 12225 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746147209.702230:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x3139939425062537 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd1 expref: 34 pid: 12225 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746147209.702248:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x3139939425062537 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd1 expref: 34 pid: 12225 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746147209.702277:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147209.702280:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147209.702285:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae200/0x3139939425062592 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1773567) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec10 expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.702292:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae200/0x3139939425062592 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1773567) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec10 expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.702320:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae200/0x3139939425062592 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1773567) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec10 expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147209.702331:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311447040:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147209.702395:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147209.707444:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311447040:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147209.707464:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147209.707501:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967310315392:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5312us (6249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147209.707510:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8964 00000100:00100000:0.0:1746147209.709786:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147209.710083:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310315648 00000100:00100000:1.0:1746147209.710116:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310315648 00002000:00100000:1.0:1746147209.710154:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1134592->1138687) req@ffff880096cf8700 x1830967310315648/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.710163:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf8700 with x1830967310315648 ext(1134592->1138687) 00002000:00010000:1.0:1746147209.710168:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cf8700 00000100:00100000:1.0:1746147209.710199:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7263 00000100:00100000:1.0:1746147209.710206:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310315648:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147209.710314:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310315648:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 108us (533us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147209.710320:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7263 00002000:00100000:1.0:1746147209.710324:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1134592->1138687) req@ffff880096cf8700 x1830967310315648/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/4536 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.710330:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf8700 with x1830967310315648 ext(1134592->1138687) 00002000:00010000:1.0:1746147209.710333:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cf8700 00000100:00100000:2.0:1746147209.726169:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.726837:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310315904 00000100:00100000:0.0:1746147209.726845:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310315904 00002000:00100000:0.0:1746147209.726884:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1769472->1773567) req@ffff880097ebb100 x1830967310315904/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147209.726894:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097ebb100 with x1830967310315904 ext(1769472->1773567) 00002000:00010000:0.0:1746147209.726900:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097ebb100 00000100:00100000:0.0:1746147209.726936:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7264 00000100:00100000:0.0:1746147209.726943:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310315904:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147209.728372:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310315904:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 1426us (2209us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147209.728381:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7264 00002000:00100000:0.0:1746147209.728388:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1769472->1773567) req@ffff880097ebb100 x1830967310315904/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/4536 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147209.728395:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097ebb100 with x1830967310315904 ext(1769472->1773567) 00002000:00010000:0.0:1746147209.728398:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097ebb100 00000100:00100000:0.0:1746147209.741168:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.741264:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310316160 00000100:00100000:2.0:1746147209.741273:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310316160 00000100:00100000:2.0:1746147209.741319:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16421 00000100:00100000:2.0:1746147209.741325:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2814:x1830967310316160:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147209.741344:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147209.741358:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x3139939425062599 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec17 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.741826:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0af600/0x31399394250625a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.741836:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0af600/0x31399394250625a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.741844:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0af600/0x31399394250625a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.741854:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x31399394250625a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.741858:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x31399394250625a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.741862:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x31399394250625a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.741932:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x31399394250625ae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.741940:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x31399394250625ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.741944:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x31399394250625ae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147209.741955:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147209.742007:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0af600/0x31399394250625a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.742012:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0af600/0x31399394250625a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.742016:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0af600/0x31399394250625a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.742020:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0af600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147209.742023:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0af600/0x31399394250625a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.742027:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0af600/0x31399394250625a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.742035:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147209.742037:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147209.742040:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0af600/0x31399394250625a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.742044:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0af600/0x31399394250625a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.742056:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x31399394250625a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.742059:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x31399394250625a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.742063:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x31399394250625a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.742070:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0afc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147209.742072:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x31399394250625a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.742076:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x31399394250625a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.742079:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096e23a00) 00010000:00010000:2.0:1746147209.742081:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147209.742082:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x31399394250625a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.742086:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afc00/0x31399394250625a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147209.742130:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0ae000/0x3139939425062599 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec17 expref: 50 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.742138:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x31399394250625ae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec17 expref: 49 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.742142:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147209.742143:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147209.742145:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c7fa00, rc 0) 00000100:00100000:2.0:1746147209.742196:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2814:x1830967310316160:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 870us (1035us total) trans 8589937320 rc 0/0 00000100:00100000:2.0:1746147209.742201:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16421 00000100:00100000:0.0:1746147209.746834:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.746885:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147209.746977:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310316544 00000100:00100000:1.0:1746147209.746985:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310316544 00000100:00100000:2.0:1746147209.747172:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310316416 00000100:00100000:2.0:1746147209.747177:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310316416 00000100:00100000:2.0:1746147209.747643:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6133 00000100:00100000:2.0:1746147209.747651:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2814:x1830967310316416:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147209.747901:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2814:x1830967310316416:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 250us (1073us total) trans 8589937321 rc 0/0 00000100:00100000:2.0:1746147209.747907:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6133 00000100:00100000:1.0:1746147209.748054:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 993 00000100:00100000:1.0:1746147209.748062:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2002:x1830967310316544:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147209.748072:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147209.748105:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fa00/0x31399394250625ae lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec17 expref: 50 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.748131:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147209.748135:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147209.748154:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2002:x1830967310316544:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 93us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147209.748160:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 993 00010000:00010000:1.0:1746147209.809280:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147209.820816:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.820925:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310316672 00000100:00100000:2.0:1746147209.820941:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310316672 00000100:00100000:2.0:1746147209.821015:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19736 00000100:00100000:2.0:1746147209.821022:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2814:x1830967310316672:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147209.821037:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147209.821055:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250625bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec1e expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.821080:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae200/0x3139939425062592 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1773567) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec10 expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.821126:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147209.821129:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147209.821133:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250625bc lrc: 4/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1265664->1921023] (req 1265664->1921023) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec1e expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.821160:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae200/0x3139939425062592 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1773567) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec10 expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.821169:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae200/0x3139939425062592 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1773567) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec10 expref: 17 pid: 1854 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746147209.821184:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311447168:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147209.821278:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caae40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147209.825133:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311447168:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147209.825176:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250625bc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1265664->1921023] (req 1265664->1921023) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec1e expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.825195:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0ae000, rc 0) 00000100:00100000:2.0:1746147209.825251:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2814:x1830967310316672:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4228us (4446us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147209.825260:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19736 00000100:00100000:0.0:1746147209.826844:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.827323:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310316800 00000100:00100000:2.0:1746147209.827332:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310316800 00002000:00100000:2.0:1746147209.827377:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1134592->1773567) req@ffff880096cfa680 x1830967310316800/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.827387:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfa680 with x1830967310316800 ext(1134592->1773567) 00010000:00010000:2.0:1746147209.827396:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae200/0x3139939425062592 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1773567) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec10 expref: 18 pid: 1854 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746147209.827412:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae200/0x3139939425062592 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1773567) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec10 expref: 18 pid: 1854 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746147209.827418:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096cfa680 00000100:00100000:2.0:1746147209.828371:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1706 00000100:00100000:2.0:1746147209.828381:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310316800:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147209.842172:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310316800:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 13779us (15320us total) trans 21474842584 rc 0/0 00000100:00100000:2.0:1746147209.842188:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1706 00002000:00100000:2.0:1746147209.842203:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1134592->1773567) req@ffff880096cfa680 x1830967310316800/t21474842584(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/448 e 0 to 0 dl 1746147220 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.842214:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfa680 with x1830967310316800 ext(1134592->1773567) 00010000:00010000:2.0:1746147209.842224:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae200/0x3139939425062592 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1773567) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec10 expref: 20 pid: 1854 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746147209.842241:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae200/0x3139939425062592 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1773567) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec10 expref: 20 pid: 1854 timeout: 847 lvb_type: 0 00002000:00010000:2.0:1746147209.842248:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096cfa680 00000100:00100000:0.0:1746147209.848261:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.849268:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147209.849363:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310316928 00000100:00100000:1.0:1746147209.849373:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310316928 00010000:00010000:1.0:1746147209.849410:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae200/0x3139939425062592 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1773567) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec10 expref: 20 pid: 1854 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746147209.849441:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8965 00000100:00100000:1.0:1746147209.849450:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310316928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147209.849467:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147209.849487:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae200/0x3139939425062592 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1134592->1773567) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec10 expref: 20 pid: 1854 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746147209.849500:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae200/0x3139939425062592 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1134592->1773567) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec10 expref: 20 pid: 1854 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746147209.849524:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae200/0x3139939425062592 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1134592->1773567) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec10 expref: 20 pid: 1854 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746147209.849548:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147209.849550:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147209.849557:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250625bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1921023) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec1e expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.849566:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250625bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1921023) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec1e expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.849599:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250625bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1921023) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec1e expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147209.849613:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311447296:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147209.849706:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147209.850587:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310317184 00000100:00100000:3.0:1746147209.850601:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310317184 00000100:00100000:3.0:1746147209.850694:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16422 00000100:00100000:3.0:1746147209.850702:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2818:x1830967310317184:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147209.850722:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147209.850737:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x31399394250625c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec25 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.850802:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04c00/0x31399394250625ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.850812:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04c00/0x31399394250625ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.850821:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04c00/0x31399394250625ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.850832:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x31399394250625d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.850836:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x31399394250625d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.850841:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x31399394250625d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.850922:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x31399394250625d8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.850931:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x31399394250625d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.850935:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x31399394250625d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147209.850942:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147209.851007:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04c00/0x31399394250625ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.851012:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04c00/0x31399394250625ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.851017:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04c00/0x31399394250625ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.851023:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096e04c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147209.851026:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04c00/0x31399394250625ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.851031:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04c00/0x31399394250625ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.851039:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147209.851041:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147209.851044:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04c00/0x31399394250625ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.851048:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04c00/0x31399394250625ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.851071:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x31399394250625d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.851075:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x31399394250625d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.851079:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x31399394250625d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.851083:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096e04800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147209.851085:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x31399394250625d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.851120:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x31399394250625d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.851126:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f2c4500) 00010000:00010000:3.0:1746147209.851127:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147209.851129:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x31399394250625d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.851134:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04800/0x31399394250625d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147209.851164:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x31399394250625c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec25 expref: 31 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.851172:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x31399394250625d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec25 expref: 30 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.851177:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147209.851178:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147209.851180:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05600, rc 0) 00000100:00100000:3.0:1746147209.851230:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2818:x1830967310317184:12345-192.168.204.25@tcp:101:cat.0 Request processed in 528us (1964us total) trans 8589937322 rc 0/0 00000100:00100000:3.0:1746147209.851235:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16422 00000100:00100000:1.0:1746147209.852129:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311447296:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147209.852148:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147209.852198:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310316928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2748us (3948us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147209.852207:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8965 00000100:00100000:1.0:1746147209.853106:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.853157:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310317440 00000100:00100000:2.0:1746147209.853165:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310317440 00002000:00100000:2.0:1746147209.853201:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1265664->1269759) req@ffff88012bab7100 x1830967310317440/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.853210:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab7100 with x1830967310317440 ext(1265664->1269759) 00002000:00010000:2.0:1746147209.853214:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bab7100 00000100:00100000:2.0:1746147209.853236:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7265 00000100:00100000:2.0:1746147209.853242:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310317440:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147209.853657:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.853716:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147209.853801:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310317696 00000100:00100000:1.0:1746147209.853807:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310317696 00000100:00100000:1.0:1746147209.853845:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 994 00000100:00100000:1.0:1746147209.853852:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095122300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2002:x1830967310317696:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147209.853865:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147209.853891:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x31399394250625d8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec25 expref: 30 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147209.853901:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310317568 00000100:00100000:3.0:1746147209.853906:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310317568 00010000:00010000:1.0:1746147209.853919:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147209.853924:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147209.853932:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19737 00000100:00100000:3.0:1746147209.853936:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2003:x1830967310317568:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147209.853945:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147209.853955:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095122300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2002:x1830967310317696:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 102us (237us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147209.853960:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x31399394250625e6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec2c expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147209.853961:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 994 00000100:00100000:2.0:1746147209.854158:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310317440:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 915us (1072us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147209.854165:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7265 00002000:00100000:2.0:1746147209.854172:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1265664->1269759) req@ffff88012bab7100 x1830967310317440/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/4536 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.854180:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab7100 with x1830967310317440 ext(1265664->1269759) 00002000:00010000:2.0:1746147209.854183:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bab7100 00000100:00100000:3.0:1746147209.854242:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311447424:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147209.854301:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147209.857297:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311447424:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147209.857326:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x31399394250625e6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec2c expref: 20 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.857337:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e05e00/0x31399394250625e6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec2c expref: 20 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147209.857983:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05e00, rc 0) 00000100:00100000:3.0:1746147209.858040:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2003:x1830967310317568:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4100us (4381us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147209.858046:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19737 00000100:00100000:0.0:1746147209.864489:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.864580:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310317952 00000100:00100000:2.0:1746147209.864588:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310317952 00002000:00100000:2.0:1746147209.864625:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1916928->1921023) req@ffff880095122680 x1830967310317952/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.864635:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095122680 with x1830967310317952 ext(1916928->1921023) 00002000:00010000:2.0:1746147209.864640:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095122680 00000100:00100000:2.0:1746147209.864681:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7266 00000100:00100000:2.0:1746147209.864688:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310317952:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147209.864795:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310317952:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 108us (315us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147209.864801:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7266 00002000:00100000:2.0:1746147209.864806:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1916928->1921023) req@ffff880095122680 x1830967310317952/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/4536 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.864813:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095122680 with x1830967310317952 ext(1916928->1921023) 00002000:00010000:2.0:1746147209.864815:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095122680 00000100:00100000:0.0:1746147209.871214:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.871263:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.871361:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310318208 00000100:00100000:2.0:1746147209.871371:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310318208 00002000:00100000:2.0:1746147209.871413:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880095121500 x1830967310318208/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.871421:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095121500 with x1830967310318208 ext(1048576->2097151) 00002000:00010000:2.0:1746147209.871427:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095121500 00000100:00100000:2.0:1746147209.871455:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310318464 00000100:00100000:2.0:1746147209.871457:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310318464 00002000:00100000:2.0:1746147209.871468:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880095120700 x1830967310318464/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.871473:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095120700 with x1830967310318464 ext(1048576->2097151) 00002000:00010000:2.0:1746147209.871476:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095120700 00000100:00100000:2.0:1746147209.871487:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7267 00000100:00100000:2.0:1746147209.871493:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2002:x1830967310318208:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147209.871862:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7268 00000100:00100000:1.0:1746147209.871870:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2002:x1830967310318464:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147209.879151:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.879231:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310318720 00000100:00100000:2.0:1746147209.879243:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310318720 00000100:00100000:2.0:1746147209.879308:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16423 00000100:00100000:2.0:1746147209.879315:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2821:x1830967310318720:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147209.879333:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147209.879350:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6600/0x31399394250625ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec33 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.879412:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7400/0x31399394250625f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879423:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7400/0x31399394250625f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879432:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7400/0x31399394250625f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879448:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6000/0x31399394250625fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879458:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6000/0x31399394250625fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879463:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6000/0x31399394250625fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879577:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7c00/0x3139939425062602 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879586:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7c00/0x3139939425062602 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879591:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7c00/0x3139939425062602 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:2.0:1746147209.879599:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147209.879658:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7400/0x31399394250625f4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879664:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7400/0x31399394250625f4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879679:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7400/0x31399394250625f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879685:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7400/0x31399394250625f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879689:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800990c7400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147209.879692:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7400/0x31399394250625f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879697:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7400/0x31399394250625f4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879710:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147209.879712:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147209.879715:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7400/0x31399394250625f4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879720:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7400/0x31399394250625f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879745:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6000/0x31399394250625fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879750:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6000/0x31399394250625fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879754:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6000/0x31399394250625fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879758:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800990c6000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147209.879760:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6000/0x31399394250625fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879764:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6000/0x31399394250625fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879770:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096e23300) 00010000:00010000:2.0:1746147209.879772:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147209.879774:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6000/0x31399394250625fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879778:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6000/0x31399394250625fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.879809:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c6600/0x31399394250625ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec33 expref: 52 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.879819:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7c00/0x3139939425062602 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec33 expref: 51 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.879825:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147209.879826:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147209.879828:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7c00, rc 0) 00000100:00100000:2.0:1746147209.879884:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2821:x1830967310318720:12345-192.168.204.25@tcp:101:cat.0 Request processed in 569us (744us total) trans 8589937323 rc 0/0 00000100:00100000:2.0:1746147209.879889:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16423 00000100:00100000:1.0:1746147209.882798:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2002:x1830967310318464:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10922us (11527us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147209.882807:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7268 00002000:00100000:1.0:1746147209.882816:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880095120700 x1830967310318464/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.882826:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095120700 with x1830967310318464 ext(1048576->2097151) 00002000:00010000:1.0:1746147209.882830:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095120700 00000100:00100000:3.0:1746147209.889393:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310318208:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17891us (18177us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147209.889404:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7267 00002000:00100000:3.0:1746147209.889585:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880095121500 x1830967310318208/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147209.889596:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095121500 with x1830967310318208 ext(1048576->2097151) 00002000:00010000:3.0:1746147209.889601:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095121500 00000100:00100000:0.0:1746147209.889610:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.889633:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310318848 00000100:00100000:0.0:1746147209.889640:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310318848 00000100:00100000:0.0:1746147209.889922:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 995 00000100:00100000:0.0:1746147209.889930:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2000:x1830967310318848:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147209.889941:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147209.889961:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990c7c00/0x3139939425062602 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec33 expref: 51 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147209.890061:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147209.890065:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147209.890083:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2000:x1830967310318848:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 155us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147209.890108:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 995 00000100:00100000:0.0:1746147209.895355:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.897414:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310319104 00000100:00100000:3.0:1746147209.897424:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310319104 00002000:00100000:3.0:1746147209.897468:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880095121f80 x1830967310319104/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 504/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147209.897477:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095121f80 with x1830967310319104 ext(1048576->2097151) 00002000:00010000:3.0:1746147209.897481:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095121f80 00000100:00100000:3.0:1746147209.897519:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7269 00000100:00100000:3.0:1746147209.897530:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310319104:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147209.900545:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.901018:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310319232 00000100:00100000:3.0:1746147209.901025:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310319232 00000100:00100000:3.0:1746147209.901073:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19738 00000100:00100000:3.0:1746147209.901080:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2818:x1830967310319232:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147209.901121:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147209.901135:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e04000/0x3139939425062610 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec3a expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.901159:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250625bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1921023) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec1e expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.901166:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147209.901167:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147209.901170:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e04000/0x3139939425062610 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec3a expref: 20 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.901194:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250625bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1921023) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec1e expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.901204:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250625bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1921023) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec1e expref: 35 pid: 1854 timeout: 847 lvb_type: 0 00000100:00100000:3.0:1746147209.901218:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311447552:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147209.901379:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147209.902511:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310319104:12345-192.168.204.25@tcp:3:cat.0 Request processed in 4982us (7167us total) trans 0 rc 393216/393216 00000100:00100000:3.0:1746147209.902519:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7269 00002000:00100000:3.0:1746147209.902527:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880095121f80 x1830967310319104/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 504/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 393216/393216 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147209.902535:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095121f80 with x1830967310319104 ext(1048576->2097151) 00010000:00010000:3.0:1746147209.902541:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250625bc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec1e expref: 34 pid: 1854 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.902551:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250625bc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec1e expref: 34 pid: 1854 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746147209.902557:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095121f80 00000100:00100000:3.0:1746147209.905162:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311447552:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147209.905187:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e04000/0x3139939425062610 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec3a expref: 20 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147209.905202:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e04000, rc 0) 00000100:00100000:3.0:1746147209.905777:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2818:x1830967310319232:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4694us (5236us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147209.905785:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19738 00000100:00100000:0.0:1746147209.907943:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.908185:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310319360 00000100:00100000:3.0:1746147209.908195:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310319360 00002000:00100000:3.0:1746147209.908239:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1265664->1921023) req@ffff88011e485880 x1830967310319360/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147209.908249:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e485880 with x1830967310319360 ext(1265664->1921023) 00010000:00010000:3.0:1746147209.908259:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250625bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec1e expref: 34 pid: 1854 timeout: 847 lvb_type: 0 00010000:00010000:3.0:1746147209.908272:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250625bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec1e expref: 34 pid: 1854 timeout: 847 lvb_type: 0 00002000:00010000:3.0:1746147209.908279:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011e485880 00000100:00100000:1.0:1746147209.909456:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1707 00000100:00100000:1.0:1746147209.909466:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310319360:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147209.921552:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.921591:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310319488 00000100:00100000:2.0:1746147209.921598:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310319488 00000100:00100000:1.0:1746147209.921598:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310319360:12345-192.168.204.25@tcp:4:cat.0 Request processed in 12134us (13661us total) trans 21474842585 rc 0/0 00000100:00100000:1.0:1746147209.921608:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1707 00002000:00100000:1.0:1746147209.921619:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1265664->1921023) req@ffff88011e485880 x1830967310319360/t21474842585(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:585/0 lens 488/448 e 0 to 0 dl 1746147220 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147209.921629:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e485880 with x1830967310319360 ext(1265664->1921023) 00000100:00100000:2.0:1746147209.921638:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19739 00010000:00010000:1.0:1746147209.921638:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250625bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec1e expref: 37 pid: 1854 timeout: 847 lvb_type: 0 00000100:00100000:2.0:1746147209.921644:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967310319488:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147209.921651:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250625bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec1e expref: 37 pid: 1854 timeout: 847 lvb_type: 0 00010000:00010000:2.0:1746147209.921657:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1746147209.921657:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011e485880 00010000:00010000:2.0:1746147209.921679:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c7600/0x3139939425062617 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec41 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147209.922892:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311447680:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147209.922974:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147209.930564:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.930693:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311447680:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147209.930723:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c7600/0x3139939425062617 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec41 expref: 37 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147209.930737:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c7600/0x3139939425062617 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec41 expref: 37 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147209.930759:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7600, rc 0) 00000100:00100000:2.0:1746147209.930806:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967310319488:12345-192.168.204.25@tcp:101:cat.0 Request processed in 9161us (9260us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147209.930813:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19739 00000100:00100000:1.0:1746147209.931065:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310319616 00000100:00100000:1.0:1746147209.931071:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310319616 00010000:00010000:1.0:1746147209.931198:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250625bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec1e expref: 36 pid: 1854 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746147209.931228:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8966 00000100:00100000:1.0:1746147209.931234:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967310319616:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147209.931245:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147209.931253:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250625bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec1e expref: 36 pid: 1854 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746147209.931262:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250625bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1921023) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec1e expref: 36 pid: 1854 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746147209.931276:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae000/0x31399394250625bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1921023) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec1e expref: 36 pid: 1854 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746147209.931997:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147209.932000:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147209.932008:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e04000/0x3139939425062610 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec3a expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.932020:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e04000/0x3139939425062610 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec3a expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.932049:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096e04000/0x3139939425062610 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec3a expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147209.932059:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311447808:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147209.933295:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147209.936415:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147209.936535:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311447808:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147209.936561:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147209.937499:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310319744 00000100:00100000:2.0:1746147209.937506:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310319744 00000100:00100000:2.0:1746147209.937543:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19740 00000100:00100000:2.0:1746147209.937550:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310319744:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147209.937564:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147209.937580:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942506261e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec48 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.937598:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147209.937599:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147209.937605:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942506261e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec48 expref: 37 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147209.937618:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942506261e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec48 expref: 37 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147209.937627:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7800, rc 0) 00000100:00100000:1.0:1746147209.937686:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967310319616:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6452us (7129us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147209.937694:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8966 00000100:00100000:2.0:1746147209.937820:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310319744:12345-192.168.204.25@tcp:101:cat.0 Request processed in 270us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147209.937825:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19740 00000100:00100000:0.0:1746147209.946912:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.951128:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147209.953713:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310320000 00000100:00100000:0.0:1746147209.953725:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310320000 00000100:00100000:2.0:1746147209.953761:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310320256 00002000:00100000:0.0:1746147209.953766:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88011e486d80 x1830967310320000/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746147209.953767:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310320256 00002000:00100000:0.0:1746147209.953775:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e486d80 with x1830967310320000 ext(1048576->2097151) 00002000:00010000:0.0:1746147209.953779:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e486d80 00000100:00100000:2.0:1746147209.953797:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6134 00000100:00100000:0.0:1746147209.953797:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7270 00000100:00100000:2.0:1746147209.953803:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2821:x1830967310320256:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:0.0:1746147209.953803:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310320000:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147209.953968:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2821:x1830967310320256:12345-192.168.204.25@tcp:35:cat.0 Request processed in 164us (2879us total) trans 8589937324 rc 0/0 00000100:00100000:2.0:1746147209.953974:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6134 00000100:00100000:2.0:1746147209.967213:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310320000:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13398us (20295us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147209.967224:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7270 00002000:00100000:2.0:1746147209.967234:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88011e486d80 x1830967310320000/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147209.967243:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e486d80 with x1830967310320000 ext(1048576->2097151) 00002000:00010000:2.0:1746147209.967249:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e486d80 00000100:00100000:0.0:1746147209.984221:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.984425:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310320512 00000100:00100000:2.0:1746147209.984432:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310320512 00000100:00100000:2.0:1746147209.984480:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16424 00000100:00100000:2.0:1746147209.984487:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2824:x1830967310320512:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147209.984505:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147209.984520:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425062625 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec4f expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.984575:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506262c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.984585:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506262c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.984593:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506262c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.984603:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x3139939425062633 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.984607:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x3139939425062633 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.984611:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x3139939425062633 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.984692:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x313993942506263a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.984700:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x313993942506263a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.984705:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x313993942506263a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:2.0:1746147209.984712:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147209.984761:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506262c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.984766:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506262c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.984771:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506262c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.984775:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506262c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.984779:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093715000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147209.984781:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506262c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.984787:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506262c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.984794:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147209.984797:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147209.984799:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506262c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.984803:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506262c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.985600:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x3139939425062633 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.985606:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x3139939425062633 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.985610:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x3139939425062633 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.985613:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093714c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147209.985615:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x3139939425062633 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.985619:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x3139939425062633 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.985626:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096e23a00) 00010000:00010000:2.0:1746147209.985628:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147209.985629:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x3139939425062633 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.985633:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093714c00/0x3139939425062633 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147209.985679:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715e00/0x3139939425062625 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec4f expref: 32 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.985690:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x313993942506263a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec4f expref: 31 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147209.985696:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147209.985697:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147209.985699:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715200, rc 0) 00000100:00100000:2.0:1746147209.985752:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2824:x1830967310320512:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1265us (1537us total) trans 8589937325 rc 0/0 00000100:00100000:2.0:1746147209.985758:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16424 00000100:00100000:0.0:1746147209.985968:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147209.986290:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310320768 00000100:00100000:3.0:1746147209.986296:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310320768 00002000:00100000:3.0:1746147209.986330:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88011e487800 x1830967310320768/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/0 e 0 to 0 dl 1746147220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147209.986340:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e487800 with x1830967310320768 ext(2097152->3145727) 00002000:00010000:3.0:1746147209.986343:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e487800 00000100:00100000:3.0:1746147209.986802:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7271 00000100:00100000:3.0:1746147209.986810:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310320768:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147209.995371:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147209.995718:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310320896 00000100:00100000:1.0:1746147209.995727:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310320896 00000100:00100000:1.0:1746147209.995796:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 996 00000100:00100000:1.0:1746147209.995805:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2000:x1830967310320896:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147209.995819:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147209.995846:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x313993942506263a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec4f expref: 31 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147209.995881:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147209.995886:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147209.995929:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2000:x1830967310320896:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 125us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147209.995936:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 996 00000100:00100000:0.0:1746147209.997376:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147209.997480:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310321152 00000100:00100000:2.0:1746147209.997488:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310321152 00000100:00100000:2.0:1746147209.997523:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6135 00000100:00100000:2.0:1746147209.997530:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2824:x1830967310321152:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147209.997696:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2824:x1830967310321152:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 165us (325us total) trans 8589937326 rc 0/0 00000100:00100000:2.0:1746147209.997702:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6135 00000100:00100000:2.0:1746147210.001140:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310320768:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14322us (15163us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147210.001152:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7271 00002000:00100000:2.0:1746147210.001162:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88011e487800 x1830967310320768/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:585/0 lens 488/440 e 0 to 0 dl 1746147220 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.001171:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e487800 with x1830967310320768 ext(2097152->3145727) 00002000:00010000:2.0:1746147210.001177:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e487800 00000100:00100000:0.0:1746147210.020776:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.020871:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310321280 00000100:00100000:2.0:1746147210.020880:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310321280 00000100:00100000:2.0:1746147210.020921:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19741 00000100:00100000:2.0:1746147210.020928:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e21a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2824:x1830967310321280:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147210.020944:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.020961:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425062648 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec56 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.020987:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7000/0x3139939425062362 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eadc expref: 19 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.020995:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250623bd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaff expref: 28 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147210.021001:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.021002:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.021005:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425062648 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3727360->3960831] (req 3727360->3960831) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec56 expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.021032:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250623bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaff expref: 28 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147210.021042:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250623bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaff expref: 28 pid: 1853 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746147210.021052:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311447936:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.021177:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7000/0x3139939425062362 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eadc expref: 19 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.021185:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7000/0x3139939425062362 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eadc expref: 19 pid: 10340 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.021192:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311448064:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.021210:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147210.026971:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311447936:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.026983:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311448064:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.027011:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425062648 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3727360->3960831] (req 3727360->3960831) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec56 expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.027027:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715e00, rc 0) 00000100:00100000:2.0:1746147210.027066:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e21a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2824:x1830967310321280:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6138us (6300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.027074:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19741 00000100:00100000:0.0:1746147210.028929:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.028970:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.029044:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310321408 00000100:00100000:1.0:1746147210.029051:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310321408 00010000:00010000:1.0:1746147210.029122:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250623bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaff expref: 29 pid: 1853 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746147210.029142:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310321536 00000100:00100000:1.0:1746147210.029145:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310321536 00010000:00010000:1.0:1746147210.029153:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7000/0x3139939425062362 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eadc expref: 19 pid: 10340 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746147210.029167:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8967 00000100:00100000:1.0:1746147210.029173:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310321408:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147210.029185:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147210.029201:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250623bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaff expref: 29 pid: 1853 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746147210.029210:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250623bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaff expref: 29 pid: 1853 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746147210.029229:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093709c00/0x31399394250623bd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eaff expref: 29 pid: 1853 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746147210.029245:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147210.029290:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310321408:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 117us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.029298:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8967 00000100:00100000:1.0:1746147210.029332:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8968 00000100:00100000:1.0:1746147210.029337:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2002:x1830967310321536:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147210.029343:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147210.029349:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7000/0x3139939425062362 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eadc expref: 19 pid: 10340 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.029358:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7000/0x3139939425062362 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eadc expref: 19 pid: 10340 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.029369:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7000/0x3139939425062362 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eadc expref: 19 pid: 10340 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.029377:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.029379:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.029384:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425062648 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->3960831) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec56 expref: 18 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.029391:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425062648 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->3960831) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec56 expref: 18 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.029413:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425062648 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->3960831) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec56 expref: 18 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147210.029423:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311448192:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147210.029464:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8900 going to sleep for 11 seconds 00000100:00080000:3.0:1746147210.029792:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147210.037958:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.038364:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310321792 00000100:00100000:2.0:1746147210.038373:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310321792 00002000:00100000:2.0:1746147210.038416:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (3727360->3731455) req@ffff88011e485c00 x1830967310321792/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.038424:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e485c00 with x1830967310321792 ext(3727360->3731455) 00002000:00010000:2.0:1746147210.038429:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e485c00 00000100:00100000:1.0:1746147210.038563:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311448192:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147210.038581:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147210.038622:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2002:x1830967310321536:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 9284us (9650us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.038631:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8968 00000100:00100000:2.0:1746147210.039051:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7272 00000100:00100000:2.0:1746147210.039058:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310321792:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147210.039168:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310321792:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 110us (1218us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147210.039173:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7272 00002000:00100000:2.0:1746147210.039177:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (3727360->3731455) req@ffff88011e485c00 x1830967310321792/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/4536 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.039184:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e485c00 with x1830967310321792 ext(3727360->3731455) 00002000:00010000:2.0:1746147210.039186:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e485c00 00000100:00100000:0.0:1746147210.041675:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.041788:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310322048 00000100:00100000:1.0:1746147210.041794:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310322048 00000100:00080000:3.0:1746147210.041995:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147210.042036:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6136 00000100:00100000:1.0:1746147210.042043:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079239050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2818:x1830967310322048:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147210.042995:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079239050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2818:x1830967310322048:12345-192.168.204.25@tcp:35:cat.0 Request processed in 949us (1332us total) trans 8589937327 rc 0/0 00000100:00100000:1.0:1746147210.043002:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6136 00000100:00100000:0.0:1746147210.047701:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.047805:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310322304 00000100:00100000:3.0:1746147210.047814:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310322304 00002000:00100000:3.0:1746147210.047854:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (3956736->3960831) req@ffff88011e485500 x1830967310322304/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.047871:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e485500 with x1830967310322304 ext(3956736->3960831) 00002000:00010000:3.0:1746147210.047876:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e485500 00000100:00100000:3.0:1746147210.047989:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7273 00000100:00100000:3.0:1746147210.047998:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310322304:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147210.049223:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310322304:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 1223us (1526us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147210.049230:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7273 00002000:00100000:3.0:1746147210.049238:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (3956736->3960831) req@ffff88011e485500 x1830967310322304/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/4536 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.049245:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e485500 with x1830967310322304 ext(3956736->3960831) 00002000:00010000:3.0:1746147210.049249:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e485500 00000100:00100000:0.0:1746147210.077153:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.077323:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310322432 00000100:00100000:2.0:1746147210.077335:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310322432 00000100:00100000:2.0:1746147210.077405:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16425 00000100:00100000:2.0:1746147210.077411:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2827:x1830967310322432:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147210.077428:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.077443:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7000/0x313993942506264f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec5d expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.077501:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6800/0x3139939425062656 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00000100:00080000:3.0:1746147210.077504:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746147210.077513:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6800/0x3139939425062656 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147210.077524:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6800/0x3139939425062656 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147210.077540:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506265d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147210.077546:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506265d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147210.077554:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506265d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147210.077610:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147210.077618:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250623cb lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb06 expref: 31 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.077625:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093708c00/0x31399394250623e0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb14 expref: 50 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.077630:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147210.077654:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093708c00/0x31399394250623e0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb14 expref: 50 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.077664:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093708c00/0x31399394250623e0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb14 expref: 50 pid: 7237 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.077684:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311448320:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.077776:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250623cb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb06 expref: 31 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.077783:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250623cb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb06 expref: 31 pid: 6215 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.077790:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311448448:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.077807:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.080445:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.080595:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311448320:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.080604:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311448448:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.080626:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:1.0:1746147210.080895:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310322944 00000100:00100000:1.0:1746147210.080902:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310322944 00000100:00100000:1.0:1746147210.080959:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6137 00000100:00100000:1.0:1746147210.080967:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:30600:x1830967310322944:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746147210.081111:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.081282:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310322688 00000100:00100000:2.0:1746147210.081285:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310322688 00000100:00100000:2.0:1746147210.081311:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6138 00000100:00100000:2.0:1746147210.081316:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:26824:x1830967310322688:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147210.082308:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:26824:x1830967310322688:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 988us (1195us total) trans 8589937329 rc 0/0 00000100:00100000:2.0:1746147210.082315:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6138 00000100:00100000:1.0:1746147210.082404:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:30600:x1830967310322944:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 1438us (1965us total) trans 8589937328 rc 0/0 00000100:00100000:1.0:1746147210.082410:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6137 00000100:00100000:0.0:1746147210.087013:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.087160:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.087211:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310323072 00000100:00100000:0.0:1746147210.087220:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310323072 00010000:00010000:0.0:1746147210.087251:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250623cb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb06 expref: 33 pid: 6215 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746147210.087276:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310323200 00000100:00100000:0.0:1746147210.087278:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310323200 00010000:00010000:0.0:1746147210.087288:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093708c00/0x31399394250623e0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb14 expref: 52 pid: 7237 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746147210.087302:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8969 00000100:00100000:0.0:1746147210.087308:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2000:x1830967310323072:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147210.087319:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147210.087324:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250623cb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb06 expref: 33 pid: 6215 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746147210.087333:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250623cb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb06 expref: 33 pid: 6215 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746147210.087351:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0afa00/0x31399394250623cb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb06 expref: 33 pid: 6215 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746147210.087366:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147210.087370:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087376:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087381:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087385:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147210.087425:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2000:x1830967310323072:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 116us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.087432:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8969 00000100:00100000:0.0:1746147210.087445:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8970 00000100:00100000:0.0:1746147210.087449:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2003:x1830967310323200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147210.087457:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147210.087460:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093708c00/0x31399394250623e0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb14 expref: 52 pid: 7237 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746147210.087468:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093708c00/0x31399394250623e0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb14 expref: 52 pid: 7237 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746147210.087478:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093708c00/0x31399394250623e0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb14 expref: 52 pid: 7237 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746147210.087487:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147210.087489:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087495:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087502:0:13715:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087529:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147210.087543:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2003:x1830967310323200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 93us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.087548:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8970 00010000:00010000:0.0:1746147210.087621:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087627:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:0.0:1746147210.087680:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:0.0:1746147210.087685:0:7237:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746147210.087699:0:7237:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087708:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087716:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6800/0x3139939425062656 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087720:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6800/0x3139939425062656 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087725:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6800/0x3139939425062656 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087729:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6800/0x3139939425062656 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087733:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800936b6800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147210.087736:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6800/0x3139939425062656 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087741:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6800/0x3139939425062656 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087747:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147210.087749:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147210.087752:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6800/0x3139939425062656 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087756:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b6800/0x3139939425062656 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087765:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506265d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087769:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506265d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087773:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506265d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087777:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093715000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147210.087779:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506265d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087783:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506265d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087788:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096e23100) 00010000:00010000:0.0:1746147210.087790:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147210.087792:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506265d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087796:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715000/0x313993942506265d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147210.087820:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936b7000/0x313993942506264f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec5d expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.087830:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec5d expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.087839:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147210.087841:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147210.087842:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715200, rc 0) 00000100:00100000:0.0:1746147210.087865:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2827:x1830967310322432:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 10455us (10719us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.087871:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16425 00000100:00100000:0.0:1746147210.091196:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.091276:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310323328 00000100:00100000:2.0:1746147210.091284:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310323328 00000100:00100000:2.0:1746147210.091356:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19742 00000100:00100000:2.0:1746147210.091363:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2000:x1830967310323328:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147210.091380:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.091395:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x313993942506266b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec64 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.091416:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.091418:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.091427:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x313993942506266b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec64 expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147210.091441:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x313993942506266b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec64 expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147210.091452:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e6e00, rc 0) 00000100:00100000:2.0:1746147210.091489:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967310323328:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 127us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.091495:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19742 00000100:00100000:0.0:1746147210.091577:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00080000:3.0:1746147210.091820:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147210.091895:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310323456 00000100:00100000:2.0:1746147210.091898:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310323456 00000100:00100000:2.0:1746147210.091912:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19743 00000100:00100000:2.0:1746147210.091916:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967310323456:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147210.091922:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.091928:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312e6800/0x3139939425062672 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec6b expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.091937:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.091939:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.091942:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6800/0x3139939425062672 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec6b expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147210.091949:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312e6800/0x3139939425062672 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec6b expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147210.091956:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e6800, rc 0) 00000100:00100000:2.0:1746147210.091973:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310323456:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 56us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.091977:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19743 00000100:00100000:0.0:1746147210.092197:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.092242:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310323584 00000100:00100000:3.0:1746147210.092245:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310323584 00000100:00100000:3.0:1746147210.092268:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19744 00000100:00100000:3.0:1746147210.092273:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310323584:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147210.092279:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147210.092289:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425062679 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec72 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.092300:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.092301:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.092305:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425062679 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec72 expref: 14 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147210.092319:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425062679 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec72 expref: 14 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147210.092325:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e04800, rc 0) 00000100:00100000:3.0:1746147210.092345:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310323584:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 72us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.092350:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19744 00000100:00080000:2.0:1746147210.092624:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147210.092763:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.092821:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.092962:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310323712 00000100:00100000:1.0:1746147210.092966:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310323712 00000100:00100000:1.0:1746147210.092992:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310323840 00000100:00100000:1.0:1746147210.092994:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310323840 00000100:00100000:1.0:1746147210.093007:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19745 00000100:00100000:1.0:1746147210.093012:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310323712:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147210.093019:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147210.093027:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425062680 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec79 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.093038:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.093039:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.093044:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425062680 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec79 expref: 15 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.093053:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425062680 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec79 expref: 15 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.093060:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1600, rc 0) 00000100:00100000:1.0:1746147210.093114:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310323712:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 77us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.093119:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19745 00000100:00100000:1.0:1746147210.093129:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19746 00000100:00100000:1.0:1746147210.093133:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310323840:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147210.093139:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147210.093146:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425062687 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec80 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147210.093177:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311448576:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147210.093233:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8540 going to sleep for 11 seconds 00002000:00010000:1.0:1746147210.095994:0:1853:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime: 1746147208 -> 1746147209 00002000:00010000:1.0:1746147210.096000:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime: 1746147208 -> 1746147209 00002000:00010000:1.0:1746147210.096003:0:1853:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime: 1746147208 -> 1746147209 00000100:00100000:1.0:1746147210.096022:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311448576:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147210.096047:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425062687 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec80 expref: 10 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.096059:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x3139939425062687 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec80 expref: 10 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.096342:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1a00, rc 0) 00000100:00100000:1.0:1746147210.096384:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310323840:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3249us (3562us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147210.096391:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19746 00000100:00100000:0.0:1746147210.099600:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.100556:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310324096 00000100:00100000:2.0:1746147210.100565:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310324096 00000100:00100000:2.0:1746147210.100614:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16426 00000100:00100000:2.0:1746147210.100621:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2827:x1830967310324096:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147210.100637:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.100652:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506268e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec87 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.100744:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425062695 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147210.100755:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec5d expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.100762:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425062695 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147210.100785:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec5d expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.100795:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec5d expref: 10 pid: 7237 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.100805:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311448704:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.100884:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147210.103541:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311448704:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.103566:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425062695 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147210.104926:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.105017:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310324224 00000100:00100000:1.0:1746147210.105023:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310324224 00010000:00010000:1.0:1746147210.105051:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec5d expref: 11 pid: 7237 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746147210.105073:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8971 00000100:00100000:1.0:1746147210.105079:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310324224:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147210.105108:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147210.105114:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec5d expref: 11 pid: 7237 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.105124:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec5d expref: 11 pid: 7237 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.105142:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x3139939425062664 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec5d expref: 11 pid: 7237 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.105171:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147210.105175:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425062695 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147210.105183:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425062695 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147210.105189:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425062695 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147210.105787:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147210.105835:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310324224:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 755us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.105841:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8971 00010000:00010000:3.0:1746147210.106530:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425062695 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.106538:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425062695 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:3.0:1746147210.106554:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147210.106662:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506268e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec87 expref: 11 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.106732:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425062695 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec87 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.106738:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147210.106740:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147210.106742:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e6600, rc 0) 00000100:00100000:3.0:1746147210.106847:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2827:x1830967310324096:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 6225us (7253us total) trans 8589937330 rc 0/0 00000100:00100000:3.0:1746147210.106853:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16426 00000100:00100000:0.0:1746147210.108882:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.108955:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310324352 00000100:00100000:3.0:1746147210.108963:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310324352 00000100:00100000:3.0:1746147210.109009:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16427 00000100:00100000:3.0:1746147210.109016:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2827:x1830967310324352:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147210.109034:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147210.109048:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x31399394250626a3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec8e expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.109149:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x31399394250626aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.109162:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425062695 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec87 expref: 11 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.109168:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x31399394250626aa lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.109191:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425062695 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec87 expref: 11 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.109200:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425062695 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec87 expref: 11 pid: 7237 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.109210:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311448832:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147210.109288:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147210.111256:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311448832:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147210.111274:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x31399394250626aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147210.111890:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.112054:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310324480 00000100:00100000:1.0:1746147210.112059:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310324480 00010000:00010000:1.0:1746147210.112083:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425062695 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec87 expref: 12 pid: 7237 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746147210.112246:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8972 00000100:00100000:1.0:1746147210.112253:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310324480:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147210.112264:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147210.112268:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425062695 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec87 expref: 12 pid: 7237 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.112278:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425062695 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec87 expref: 12 pid: 7237 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.112299:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6600/0x3139939425062695 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec87 expref: 12 pid: 7237 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.112323:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147210.112328:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x31399394250626aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147210.112335:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x31399394250626aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147210.112342:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x31399394250626aa lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147210.112563:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147210.112698:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x31399394250626aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147210.112705:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x31399394250626aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:2.0:1746147210.112748:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:2.0:1746147210.112751:0:7237:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147210.112767:0:7237:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x31399394250626aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147210.112791:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e04e00/0x31399394250626a3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec8e expref: 12 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.112814:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x31399394250626aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec8e expref: 11 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.112820:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147210.112822:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147210.112824:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05600, rc 0) 00000100:00100000:1.0:1746147210.112886:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310324480:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 633us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.112893:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8972 00000100:00100000:2.0:1746147210.113961:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2827:x1830967310324352:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4943us (5081us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.113969:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16427 00000100:00100000:0.0:1746147210.117274:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.118285:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310324608 00000100:00100000:1.0:1746147210.118294:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310324608 00000100:00100000:1.0:1746147210.118348:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19747 00000100:00100000:1.0:1746147210.118355:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310324608:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147210.118370:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147210.118388:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b0800/0x31399394250626b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec95 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147210.118443:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311448960:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147210.118527:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147210.120238:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311448960:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147210.120260:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b0800/0x31399394250626b1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec95 expref: 10 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.120270:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b0800/0x31399394250626b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec95 expref: 10 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.120279:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b0800, rc 0) 00000100:00100000:1.0:1746147210.120308:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310324608:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1953us (3042us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147210.120315:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19747 00000100:00100000:0.0:1746147210.122163:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.122237:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310324864 00000100:00100000:2.0:1746147210.122244:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310324864 00000100:00100000:2.0:1746147210.122278:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16428 00000100:00100000:2.0:1746147210.122284:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2827:x1830967310324864:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147210.122299:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.122312:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6400/0x31399394250626b8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ec9c expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.122388:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x31399394250626bf lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147210.122399:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x31399394250626bf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147210.122408:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x31399394250626bf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:2.0:1746147210.122417:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147210.122489:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6400/0x31399394250626b8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec9c expref: 13 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.122857:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x31399394250626bf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec9c expref: 12 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.122864:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147210.122866:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147210.122869:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e6000, rc 0) 00000100:00100000:2.0:1746147210.122943:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2827:x1830967310324864:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 659us (784us total) trans 8589937331 rc 0/0 00000100:00100000:2.0:1746147210.122948:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16428 00000100:00100000:0.0:1746147210.124725:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.124788:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310324992 00000100:00100000:1.0:1746147210.124793:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310324992 00000100:00100000:1.0:1746147210.124828:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19748 00000100:00100000:1.0:1746147210.124833:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310324992:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1746147210.124859:0:1853:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1000/0x31399394250626cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.124874:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x313993942506208a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e931 expref: 19 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.124881:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x31399394250620ec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e97e expref: 35 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.124887:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x31399394250620bb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e94d expref: 15 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.124908:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.124911:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.124914:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1000/0x31399394250626cd lrc: 6/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.124941:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x31399394250620bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e94d expref: 15 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.124952:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x31399394250620bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e94d expref: 15 pid: 13695 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746147210.124963:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311449088:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147210.125417:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x31399394250620ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e97e expref: 35 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.125425:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x31399394250620ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e97e expref: 35 pid: 1136 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746147210.125433:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311449216:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147210.125611:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.125631:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310325248 00000100:00100000:3.0:1746147210.125635:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310325248 00000100:00100000:3.0:1746147210.125657:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19749 00000100:00100000:0.0:1746147210.125658:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.125726:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310325504 00000100:00100000:2.0:1746147210.125730:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310325504 00000100:00100000:2.0:1746147210.125765:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19750 00000100:00100000:2.0:1746147210.125771:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310325504:12345-192.168.204.25@tcp:1:lfs.0 00000100:00100000:3.0:1746147210.125854:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310325248:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147210.125873:0:10340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096e05e00/0x31399394250626d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.125884:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425062553 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebed expref: 27 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.125891:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6800/0x3139939425062672 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec6b expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147210.125898:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x313993942506255a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebfb expref: 17 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147210.125902:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.125904:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.125906:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05e00/0x31399394250626d4 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.125921:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x313993942506255a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebfb expref: 17 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.126132:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x313993942506208a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e931 expref: 19 pid: 13695 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147210.126138:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147210.126140:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x313993942506208a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e931 expref: 19 pid: 13695 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746147210.126147:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310325120 00000100:00100000:1.0:1746147210.126149:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311449472:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147210.126149:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310325120 00000100:00100000:0.0:1746147210.126165:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19751 00000100:00100000:0.0:1746147210.126170:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310325120:12345-192.168.204.25@tcp:1:lfs.0 00000100:00100000:1.0:1746147210.126173:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8540 going to sleep for 11 seconds 00010000:00010000:0.0:1746147210.126184:0:1398:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092542a00/0x31399394250626db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.126194:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942506253e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd8 expref: 27 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147210.126195:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147210.126200:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x313993942506266b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec64 expref: 10 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147210.126206:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ff4e00/0x3139939425062561 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebf4 expref: 17 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147210.126208:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310325376 00000100:00100000:1.0:1746147210.126210:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310325376 00010000:00010000:0.0:1746147210.126211:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147210.126212:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147210.126214:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092542a00/0x31399394250626db lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147210.126226:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19752 00010000:00010000:0.0:1746147210.126227:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097ff4e00/0x3139939425062561 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebf4 expref: 17 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147210.126230:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310325376:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147210.126234:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097ff4e00/0x3139939425062561 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebf4 expref: 17 pid: 1853 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746147210.126242:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311449600:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147210.126244:0:12225:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33200/0x31399394250626e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.126252:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e04000/0x3139939425062610 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec3a expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.126258:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425062679 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec72 expref: 17 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147210.126262:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x313993942506266b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec64 expref: 10 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.126264:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942506261e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec48 expref: 35 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.126269:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147210.126269:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x313993942506266b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec64 expref: 10 pid: 1854 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746147210.126271:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.126273:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33200/0x31399394250626e2 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.126281:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093146300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311449728:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147210.126284:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942506261e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec48 expref: 35 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.126291:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942506261e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec48 expref: 35 pid: 1854 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746147210.126298:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311449856:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147210.126299:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942506253e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd8 expref: 27 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.126317:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425062679 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec72 expref: 17 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147210.126318:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942506253e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd8 expref: 27 pid: 9584 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.126323:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425062679 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec72 expref: 17 pid: 10340 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746147210.126325:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311449984:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147210.126330:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311450112:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147210.126337:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095affd80 going to sleep for 11 seconds 00010000:00010000:1.0:1746147210.126345:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e04000/0x3139939425062610 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec3a expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.126352:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e04000/0x3139939425062610 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec3a expref: 19 pid: 1854 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746147210.126359:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311450240:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147210.126365:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.126370:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.126377:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310325632 00000100:00100000:0.0:1746147210.126379:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310325632 00000100:00100000:0.0:1746147210.126399:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19753 00000100:00100000:0.0:1746147210.126404:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310325632:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147210.126417:0:9584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092543000/0x31399394250626e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.126419:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x313993942506255a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebfb expref: 17 pid: 10340 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.126425:0:12201:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250626f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.126426:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425062648 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->3960831) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec56 expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147210.126427:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311449344:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147210.126431:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147210.126432:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147210.126434:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092543000/0x31399394250626e9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.126442:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x313993942506254c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebe6 expref: 19 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.126449:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425062648 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->3960831) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec56 expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.126450:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e6800/0x3139939425062672 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec6b expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147210.126454:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425062680 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec79 expref: 17 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147210.126456:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425062648 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->3960831) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec56 expref: 17 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.126457:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801312e6800/0x3139939425062672 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec6b expref: 11 pid: 1854 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.126461:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425062568 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec02 expref: 35 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.126463:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311450368:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147210.126464:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311450496:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.126466:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.126467:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.126469:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250626f0 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.126475:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095aff180 going to sleep for 11 seconds 00010000:00010000:3.0:1746147210.126479:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425062553 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebed expref: 27 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.126483:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425062568 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec02 expref: 35 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.126486:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425062553 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebed expref: 27 pid: 10340 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.126490:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425062568 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec02 expref: 35 pid: 1853 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.126493:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311450624:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.126498:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311450752:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147210.126506:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746147210.126524:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425062680 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec79 expref: 17 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147210.126532:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425062680 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec79 expref: 17 pid: 1853 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746147210.126543:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311450880:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.126562:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x313993942506254c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebe6 expref: 19 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.126569:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x313993942506254c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebe6 expref: 19 pid: 9584 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.126576:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311451008:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.126605:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caae40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147210.128411:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311449088:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147210.128420:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311449216:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147210.128705:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.128851:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310325760 00000100:00100000:1.0:1746147210.128857:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310325760 00010000:00010000:1.0:1746147210.128885:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x31399394250620bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e94d expref: 18 pid: 13695 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746147210.128907:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8973 00000100:00100000:1.0:1746147210.128912:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310325760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147210.128922:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147210.128939:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x31399394250620bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e94d expref: 18 pid: 13695 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746147210.128948:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x31399394250620bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e94d expref: 18 pid: 13695 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746147210.128966:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x31399394250620bb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e94d expref: 18 pid: 13695 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746147210.128994:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147210.129028:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310325760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 115us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.129033:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8973 00000100:00100000:0.0:1746147210.129747:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.129794:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310325888 00000100:00100000:2.0:1746147210.129799:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310325888 00010000:00010000:2.0:1746147210.129837:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x31399394250620ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e97e expref: 36 pid: 1136 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746147210.129864:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8974 00000100:00100000:2.0:1746147210.129869:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f78850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310325888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147210.129876:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147210.129886:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x31399394250620ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e97e expref: 36 pid: 1136 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.129894:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x31399394250620ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e97e expref: 36 pid: 1136 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.129907:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d95e00/0x31399394250620ec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e97e expref: 36 pid: 1136 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.129928:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147210.129950:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f78850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967310325888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 80us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.129955:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8974 00000100:00080000:0.0:1746147210.130608:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147210.131146:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311449600:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147210.135857:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311449472:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147210.135881:0:1853:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800993b1000/0x31399394250626cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147210.136457:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311449856:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147210.136466:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311450112:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147210.136467:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093146300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311449728:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147210.136472:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311450240:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147210.136477:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311449984:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147210.136485:0:12225:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33200/0x31399394250626e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.136494:0:1398:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092542a00/0x31399394250626db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147210.136567:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.136621:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.136643:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310326528 00000100:00100000:2.0:1746147210.136648:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310326528 00010000:00010000:2.0:1746147210.136684:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942506253e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd8 expref: 28 pid: 9584 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.136705:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310326656 00000100:00100000:2.0:1746147210.136708:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310326656 00010000:00010000:2.0:1746147210.136717:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff4e00/0x3139939425062561 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebf4 expref: 18 pid: 1853 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746147210.136730:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8975 00000100:00100000:2.0:1746147210.136736:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967310326528:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147210.136737:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8976 00000100:00100000:1.0:1746147210.136743:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310326656:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147210.136747:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147210.136764:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942506253e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd8 expref: 28 pid: 9584 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.136773:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942506253e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd8 expref: 28 pid: 9584 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.136797:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0ca00/0x313993942506253e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebd8 expref: 28 pid: 9584 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.136814:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147210.136848:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310326528:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 112us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.136853:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8975 00000100:00100000:2.0:1746147210.136890:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.136904:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310326784 00000100:00100000:2.0:1746147210.136906:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310326784 00010000:00010000:2.0:1746147210.136916:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6800/0x3139939425062672 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec6b expref: 12 pid: 1854 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746147210.136930:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8977 00000100:00100000:2.0:1746147210.136934:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310326784:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147210.136940:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147210.136947:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801312e6800/0x3139939425062672 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec6b expref: 12 pid: 1854 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.136954:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801312e6800/0x3139939425062672 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec6b expref: 12 pid: 1854 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.136965:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147210.136979:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310326784:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 44us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.136986:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8977 00010000:00010000:1.0:1746147210.137008:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147210.137017:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ff4e00/0x3139939425062561 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebf4 expref: 18 pid: 1853 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746147210.137025:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ff4e00/0x3139939425062561 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebf4 expref: 18 pid: 1853 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746147210.137031:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147210.137036:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ff4e00/0x3139939425062561 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebf4 expref: 18 pid: 1853 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746147210.137041:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310326016 00000100:00100000:2.0:1746147210.137044:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310326016 00010000:00010000:1.0:1746147210.137049:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147210.137053:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x313993942506266b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec64 expref: 12 pid: 1854 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746147210.137086:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8978 00000100:00100000:1.0:1746147210.137109:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310326016:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147210.137116:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147210.137120:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311450368:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147210.137124:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x313993942506266b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec64 expref: 12 pid: 1854 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746147210.137131:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x313993942506266b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec64 expref: 12 pid: 1854 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746147210.137131:0:9584:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092543000/0x31399394250626e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.137139:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x313993942506266b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec64 expref: 12 pid: 1854 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746147210.137146:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.137148:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.137151:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092542a00/0x31399394250626db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.137160:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147210.137162:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092542a00/0x31399394250626db lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.137169:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310326272 00000100:00100000:0.0:1746147210.137171:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310326272 00010000:00010000:1.0:1746147210.137178:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147210.137182:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425062679 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec72 expref: 17 pid: 10340 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746147210.137193:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310326016:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 85us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.137193:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8979 00000100:00100000:0.0:1746147210.137198:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310326272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147210.137199:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8978 00010000:00010000:0.0:1746147210.137204:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147210.137214:0:1398:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092542a00/0x31399394250626db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.137214:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425062679 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec72 expref: 17 pid: 10340 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746147210.137220:0:1398:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092542a00/0x31399394250626db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.137221:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425062679 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec72 expref: 17 pid: 10340 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746147210.137232:0:1398:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092542a00/0x31399394250626db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.137233:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e04800/0x3139939425062679 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec72 expref: 17 pid: 10340 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746147210.137238:0:1398:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092542a00/0x31399394250626db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.137244:0:1398:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092542a00/0x31399394250626db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.137245:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147210.137249:0:1398:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092542a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147210.137252:0:1398:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092542a00/0x31399394250626db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.137257:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310326272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 59us (97us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147210.137262:0:1398:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092542a00/0x31399394250626db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.137262:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8979 00010000:00010000:1.0:1746147210.137271:0:1398:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092542a00/0x31399394250626db lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.137276:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092542a00/0x31399394250626db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.137285:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.137293:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310326912 00000100:00100000:0.0:1746147210.137295:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310326912 00010000:00010000:0.0:1746147210.137303:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x313993942506255a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebfb expref: 18 pid: 10340 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746147210.137312:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310325120:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 11141us (11173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.137315:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8980 00000100:00100000:1.0:1746147210.137319:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19751 00000100:00100000:0.0:1746147210.137319:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310326912:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147210.137324:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147210.137331:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x313993942506255a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebfb expref: 18 pid: 10340 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746147210.137336:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310326656:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 594us (715us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147210.137339:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x313993942506255a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebfb expref: 18 pid: 10340 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746147210.137341:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8976 00010000:00010000:0.0:1746147210.137354:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147210.137365:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967310326912:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 45us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.137370:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8980 00000100:00100000:0.0:1746147210.137780:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.137892:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.138111:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310326144 00000100:00100000:3.0:1746147210.138115:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310326144 00010000:00010000:3.0:1746147210.138131:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942506261e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec48 expref: 35 pid: 1854 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746147210.138146:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310326400 00000100:00100000:3.0:1746147210.138148:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310326400 00010000:00010000:3.0:1746147210.138165:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x313993942506208a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e931 expref: 20 pid: 13695 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746147210.138178:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8981 00000100:00100000:3.0:1746147210.138182:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f78050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967310326144:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147210.138189:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147210.138196:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942506261e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec48 expref: 35 pid: 1854 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746147210.138205:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942506261e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec48 expref: 35 pid: 1854 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746147210.138217:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c7800/0x313993942506261e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec48 expref: 35 pid: 1854 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746147210.138229:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147210.138244:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f78050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967310326144:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 61us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.138249:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8981 00000100:00100000:3.0:1746147210.138273:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8982 00000100:00100000:3.0:1746147210.138277:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310326400:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147210.138282:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147210.138289:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x313993942506208a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e931 expref: 20 pid: 13695 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746147210.138297:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x313993942506208a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e931 expref: 20 pid: 13695 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746147210.138307:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e0800/0x313993942506208a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e931 expref: 20 pid: 13695 timeout: 848 lvb_type: 1 00010000:00010000:3.0:1746147210.138315:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.138316:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.138319:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1000/0x31399394250626cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.138326:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1000/0x31399394250626cd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.138338:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147210.138349:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310326400:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 72us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.138354:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8982 00010000:00010000:3.0:1746147210.138378:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x313993942506255a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebfb expref: 16 pid: 10340 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746147210.138385:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311449344:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147210.138395:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6800/0x3139939425062672 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec6b expref: 9 pid: 1854 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746147210.138402:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311450496:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147210.138410:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311450624:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147210.138425:0:10340:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096e05e00/0x31399394250626d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.139578:0:1853:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800993b1000/0x31399394250626cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.139587:0:1853:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b1000/0x31399394250626cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.139603:0:1853:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1000/0x31399394250626cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.139609:0:1853:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1000/0x31399394250626cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.139741:0:1853:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800993b1000/0x31399394250626cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.139747:0:1853:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800993b1000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147210.139750:0:1853:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800993b1000/0x31399394250626cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.139755:0:1853:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800993b1000/0x31399394250626cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.139767:0:1853:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800993b1000/0x31399394250626cd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.139771:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1000/0x31399394250626cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147210.139813:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310324992:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 14977us (15087us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.139820:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19748 00000100:00080000:0.0:1746147210.139850:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147210.139920:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.140003:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311450752:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.140012:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311450880:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147210.140012:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.140018:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311451008:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.140034:0:12201:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250626f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.140040:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.140050:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310327296 00000100:00100000:0.0:1746147210.140051:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.140053:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310327040 00000100:00100000:1.0:1746147210.140055:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310327296 00000100:00100000:3.0:1746147210.140058:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310327040 00000100:00100000:0.0:1746147210.140063:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147210.140072:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425062553 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebed expref: 27 pid: 10340 timeout: 848 lvb_type: 0 00002000:00100000:3.0:1746147210.140084:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (3727360->3960831) req@ffff8800968a3100 x1830967310327040/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746147210.140109:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310327168 00000100:00100000:0.0:1746147210.140109:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.140111:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310327168 00002000:00100000:3.0:1746147210.140112:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a3100 with x1830967310327040 ext(3727360->3960831) 00010000:00010000:3.0:1746147210.140119:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425062648 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->3960831) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec56 expref: 16 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.140122:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e04000/0x3139939425062610 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec3a expref: 19 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.140129:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425062648 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->3960831) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec56 expref: 16 pid: 1854 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746147210.140135:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968a3100 00000100:00100000:1.0:1746147210.140152:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310327552 00000100:00100000:3.0:1746147210.140153:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310327424 00000100:00100000:1.0:1746147210.140153:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310327552 00000100:00100000:3.0:1746147210.140156:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310327424 00010000:00010000:1.0:1746147210.140163:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425062568 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec02 expref: 34 pid: 1853 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.140166:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425062680 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec79 expref: 15 pid: 1853 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746147210.140171:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310327680 00000100:00100000:1.0:1746147210.140172:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310327680 00000100:00100000:3.0:1746147210.140178:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8983 00010000:00010000:1.0:1746147210.140179:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x313993942506254c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebe6 expref: 20 pid: 9584 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.140183:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967310327296:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147210.140188:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8984 00010000:00010000:3.0:1746147210.140191:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147210.140193:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310327168:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147210.140199:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147210.140202:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425062553 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebed expref: 27 pid: 10340 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.140207:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e04000/0x3139939425062610 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec3a expref: 20 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.140210:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425062553 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebed expref: 27 pid: 10340 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.140215:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e04000/0x3139939425062610 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec3a expref: 20 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.140226:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0c600/0x3139939425062553 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebed expref: 27 pid: 10340 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.140226:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e04000/0x3139939425062610 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec3a expref: 20 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.140235:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.140235:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.140236:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.140236:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.140239:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e05e00/0x31399394250626d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.140239:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33200/0x31399394250626e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.140246:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05e00/0x31399394250626d4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.140246:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33200/0x31399394250626e2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.140259:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147210.140261:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147210.140278:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967310327296:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 95us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.140283:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8983 00000100:00100000:3.0:1746147210.140293:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8985 00000100:00100000:3.0:1746147210.140298:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310327552:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147210.140303:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147210.140312:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425062568 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec02 expref: 34 pid: 1853 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746147210.140317:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8986 00010000:00010000:3.0:1746147210.140319:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425062568 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec02 expref: 34 pid: 1853 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746147210.140325:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310327424:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147210.140329:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ff5c00/0x3139939425062568 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec02 expref: 34 pid: 1853 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746147210.140333:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147210.140341:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147210.140341:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425062680 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec79 expref: 15 pid: 1853 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746147210.140351:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425062680 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec79 expref: 15 pid: 1853 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746147210.140363:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1600/0x3139939425062680 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec79 expref: 15 pid: 1853 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746147210.140375:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147210.140382:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8987 00000100:00100000:2.0:1746147210.140388:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310327680:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147210.140593:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147210.140604:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x313993942506254c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebe6 expref: 19 pid: 9584 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.140612:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x313993942506254c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebe6 expref: 19 pid: 9584 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.140622:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0da00/0x313993942506254c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ebe6 expref: 19 pid: 9584 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.140633:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.140635:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.140637:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250626f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.140642:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250626f0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.140654:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147210.141157:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310327168:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 963us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.141164:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8984 00000100:00100000:3.0:1746147210.141167:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967310327552:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 866us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.141173:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8985 00010000:00010000:1.0:1746147210.141183:0:12225:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33200/0x31399394250626e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.141189:0:12225:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33200/0x31399394250626e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.141197:0:10340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096e05e00/0x31399394250626d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.141201:0:12225:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33200/0x31399394250626e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.141204:0:10340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e05e00/0x31399394250626d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.141207:0:12225:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33200/0x31399394250626e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.141213:0:12225:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33200/0x31399394250626e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.141215:0:10340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096e05e00/0x31399394250626d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.141218:0:12225:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147210.141221:0:12225:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33200/0x31399394250626e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.141222:0:10340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05e00/0x31399394250626d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.141228:0:10340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096e05e00/0x31399394250626d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.141231:0:12225:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33200/0x31399394250626e2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.141233:0:10340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096e05e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147210.141236:0:10340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096e05e00/0x31399394250626d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.141240:0:12225:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33200/0x31399394250626e2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.141241:0:10340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096e05e00/0x31399394250626d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.141245:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33200/0x31399394250626e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.141255:0:10340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096e05e00/0x31399394250626d4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.141260:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e05e00/0x31399394250626d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147210.141278:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310325376:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 15047us (15082us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.141296:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2001:x1830967310325248:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 15445us (15685us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.141303:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19749 00000100:00100000:1.0:1746147210.141332:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19752 00000100:00100000:3.0:1746147210.141341:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1708 00000100:00100000:3.0:1746147210.141347:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967310327040:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147210.142322:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967310327680:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1929us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.142329:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8987 00010000:00010000:3.0:1746147210.142511:0:12201:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250626f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.142520:0:12201:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250626f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.142536:0:12201:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250626f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.142542:0:12201:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250626f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.142548:0:12201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250626f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.142558:0:12201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e7a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147210.142560:0:12201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250626f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.142566:0:12201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250626f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.142575:0:12201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250626f0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.142581:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250626f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.142725:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310327424:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2399us (2658us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.142732:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8986 00000100:00100000:3.0:1746147210.143181:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310325504:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 17408us (17520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.143188:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19750 00000100:00100000:0.0:1746147210.153303:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310327040:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 11947us (13384us total) trans 17179875205 rc 0/0 00000100:00100000:0.0:1746147210.153316:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1708 00002000:00100000:0.0:1746147210.153327:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (3727360->3960831) req@ffff8800968a3100 x1830967310327040/t17179875205(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/448 e 0 to 0 dl 1746147221 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147210.153337:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a3100 with x1830967310327040 ext(3727360->3960831) 00010000:00010000:0.0:1746147210.153347:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425062648 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->3960831) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec56 expref: 18 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746147210.153362:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425062648 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->3960831) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec56 expref: 18 pid: 1854 timeout: 848 lvb_type: 0 00002000:00010000:0.0:1746147210.153369:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968a3100 00000100:00100000:0.0:1746147210.158537:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.158605:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310327808 00000100:00100000:2.0:1746147210.158613:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310327808 00010000:00010000:2.0:1746147210.158648:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425062648 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->3960831) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec56 expref: 18 pid: 1854 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.158695:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8988 00000100:00100000:2.0:1746147210.158703:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310327808:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147210.158716:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147210.158735:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425062648 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3727360->3960831) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec56 expref: 18 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.158746:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425062648 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3727360->3960831) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec56 expref: 18 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.158770:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093715e00/0x3139939425062648 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3727360->3960831) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec56 expref: 18 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.158798:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.158800:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.158803:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092543000/0x31399394250626e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.158810:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092543000/0x31399394250626e9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.158828:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147210.158876:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2003:x1830967310327808:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 174us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.158882:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8988 00010000:00010000:0.0:1746147210.158990:0:9584:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092543000/0x31399394250626e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.158999:0:9584:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092543000/0x31399394250626e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.159014:0:9584:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092543000/0x31399394250626e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.159021:0:9584:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092543000/0x31399394250626e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.159027:0:9584:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092543000/0x31399394250626e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.159033:0:9584:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092543000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147210.159036:0:9584:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092543000/0x31399394250626e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.159043:0:9584:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092543000/0x31399394250626e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.159053:0:9584:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092543000/0x31399394250626e9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.159059:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092543000/0x31399394250626e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.159127:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2001:x1830967310325632:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 32721us (32760us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.159135:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19753 00000100:00100000:0.0:1746147210.165299:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.166165:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310328064 00000100:00100000:2.0:1746147210.166174:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310328064 00000100:00100000:2.0:1746147210.166221:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16429 00000100:00100000:2.0:1746147210.166228:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2827:x1830967310328064:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:2.0:1746147210.166273:0:7237:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147210.166296:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05600/0x31399394250626aa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec8e expref: 12 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.166330:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147210.166333:0:7237:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147210.166355:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147210.166368:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x313993942506245e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb6f expref: 50 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.166374:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ac00/0x3139939425062496 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb8b expref: 31 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.166378:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425062139 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a1 expref: 50 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.166383:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x313993942506214e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9b6 expref: 31 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.166388:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147210.166414:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x313993942506214e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9b6 expref: 31 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.166425:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x313993942506214e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9b6 expref: 31 pid: 9138 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.166436:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311451136:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.166530:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425062139 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a1 expref: 50 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.166537:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425062139 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a1 expref: 50 pid: 9138 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.166549:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311451264:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.167069:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ac00/0x3139939425062496 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb8b expref: 31 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.167077:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ac00/0x3139939425062496 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb8b expref: 31 pid: 7237 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.167084:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311451392:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.167158:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x313993942506245e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb6f expref: 50 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.167164:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x313993942506245e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb6f expref: 50 pid: 6215 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.167171:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311451520:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.167187:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.173520:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.176281:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.176331:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.176460:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311451136:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.176471:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311451264:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.176479:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311451392:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.176486:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311451520:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.176509:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147210.176904:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.177037:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310328320 00000100:00100000:3.0:1746147210.177044:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310328320 00010000:00010000:3.0:1746147210.177075:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425062139 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a1 expref: 51 pid: 9138 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.177127:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310328192 00000100:00100000:3.0:1746147210.177130:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310328192 00010000:00010000:3.0:1746147210.177140:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x313993942506214e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9b6 expref: 32 pid: 9138 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.177151:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310328448 00000100:00100000:3.0:1746147210.177153:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310328448 00010000:00010000:3.0:1746147210.177159:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x313993942506245e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb6f expref: 52 pid: 6215 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.177171:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310328576 00000100:00100000:3.0:1746147210.177173:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310328576 00010000:00010000:3.0:1746147210.177179:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ac00/0x3139939425062496 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb8b expref: 33 pid: 7237 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.177188:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8989 00000100:00100000:3.0:1746147210.177192:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+52:2000:x1830967310328320:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147210.177204:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147210.177208:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425062139 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a1 expref: 52 pid: 9138 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.177216:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425062139 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a1 expref: 52 pid: 9138 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.177233:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d200/0x3139939425062139 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9a1 expref: 52 pid: 9138 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.177247:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147210.177251:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.177257:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147210.177293:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+51:2000:x1830967310328320:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 100us (3782us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.177299:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8989 00000100:00100000:3.0:1746147210.177313:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8990 00000100:00100000:3.0:1746147210.177317:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2002:x1830967310328192:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147210.177323:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147210.177327:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x313993942506214e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9b6 expref: 33 pid: 9138 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.177334:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x313993942506214e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9b6 expref: 33 pid: 9138 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.177345:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0de00/0x313993942506214e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7e9b6 expref: 33 pid: 9138 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.177352:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147210.177355:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.177359:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147210.177373:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2002:x1830967310328192:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 56us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.177378:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8990 00000100:00100000:3.0:1746147210.177387:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8991 00000100:00100000:3.0:1746147210.177391:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+50:2002:x1830967310328448:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147210.177398:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147210.177401:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x313993942506245e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb6f expref: 50 pid: 6215 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.177407:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x313993942506245e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb6f expref: 50 pid: 6215 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.177416:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x313993942506245e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb6f expref: 50 pid: 6215 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.177424:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147210.177426:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.177431:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147210.177443:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2002:x1830967310328448:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 52us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.177448:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8991 00000100:00100000:3.0:1746147210.177455:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8992 00000100:00100000:3.0:1746147210.177459:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2002:x1830967310328576:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147210.177464:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147210.177467:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ac00/0x3139939425062496 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb8b expref: 31 pid: 7237 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.177474:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ac00/0x3139939425062496 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb8b expref: 31 pid: 7237 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.177482:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f01ac00/0x3139939425062496 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eb8b expref: 31 pid: 7237 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.177488:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147210.177492:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.177500:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.177504:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.177519:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147210.177532:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2002:x1830967310328576:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 73us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.177536:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8992 00010000:00010000:3.0:1746147210.177624:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.177630:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000040:00080000:3.0:1746147210.177840:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1236, 88 off116624 00000004:00080000:3.0:1746147210.177846:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748167756585ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147210.177887:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1238, 88 off116800 00000004:00080000:3.0:1746147210.177893:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748167803122ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147210.177917:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1239, 88 off116888 00000004:00080000:3.0:1746147210.177921:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748167831280ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147210.177933:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1237, 88 off116712 00000004:00080000:3.0:1746147210.177936:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748167846720ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147210.177946:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1238, 88 off116800 00000004:00080000:3.0:1746147210.177949:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748167859719ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147210.177959:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1240, 88 off116976 00000004:00080000:3.0:1746147210.177961:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748167871763ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147210.177971:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1241, 88 off117064 00000004:00080000:3.0:1746147210.177974:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748167884452ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147210.177984:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1242, 88 off117152 00000004:00080000:3.0:1746147210.177986:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748167896694ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147210.177996:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1239, 88 off116888 00000004:00080000:3.0:1746147210.177998:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748167908775ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147210.178008:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1243, 88 off117240 00000004:00080000:3.0:1746147210.178011:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748167921655ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147210.178021:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1240, 88 off116976 00000004:00080000:3.0:1746147210.178023:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748167933920ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147210.178032:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1244, 88 off117328 00000004:00080000:3.0:1746147210.178035:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748167945424ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147210.178045:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1241, 88 off117064 00000004:00080000:3.0:1746147210.178048:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748167958152ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147210.178058:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1242, 88 off117152 00000004:00080000:3.0:1746147210.178060:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748167970727ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147210.178071:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1243, 88 off117240 00000004:00080000:3.0:1746147210.178074:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748167984140ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147210.178084:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1244, 88 off117328 00000004:00080000:3.0:1746147210.178086:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748167996544ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147210.178122:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1245, 88 off117416 00000004:00080000:3.0:1746147210.178125:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748168035520ns, next at 694367916532ns, rc = 0 00000001:00080000:0.0:1746147210.180357:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937332 is committed 00000004:00080000:0.0:1746147210.180368:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1222 committed 00000004:00080000:0.0:1746147210.180374:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1224 committed 00000004:00080000:0.0:1746147210.181519:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1223 committed 00000004:00080000:0.0:1746147210.181523:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1222 committed 00000004:00080000:0.0:1746147210.181524:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1221 committed 00000004:00080000:0.0:1746147210.181525:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1221 committed 00000004:00080000:0.0:1746147210.181527:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1220 committed 00000004:00080000:0.0:1746147210.181528:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1220 committed 00000004:00080000:0.0:1746147210.181530:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1219 committed 00000004:00080000:0.0:1746147210.181533:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1219 committed 00000004:00080000:0.0:1746147210.181534:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1218 committed 00000004:00080000:0.0:1746147210.181536:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1217 committed 00000004:00080000:0.0:1746147210.181537:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1218 committed 00000004:00080000:0.0:1746147210.181538:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1217 committed 00000004:00080000:0.0:1746147210.181540:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1216 committed 00000004:00080000:0.0:1746147210.181542:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1215 committed 00000004:00080000:0.0:1746147210.181543:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1216 committed 00000001:00080000:0.0:1746147210.181555:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937329 is committed 00000001:00080000:0.0:1746147210.181561:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937328 is committed 00000100:00100000:1.0:1746147210.182068:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746147210.182704:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311452160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147210.182758:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147210.182795:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746147210.182799:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311452032:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147210.182811:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147210.182821:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311452544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147210.182830:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147210.182848:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311452160 00000100:00100000:3.0:1746147210.182854:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311452160 00000100:00100000:3.0:1746147210.182885:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311452032 00000100:00100000:3.0:1746147210.182887:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311452032 00000100:00100000:3.0:1746147210.182894:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311452544 00000100:00100000:3.0:1746147210.182895:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311452544 00000100:00100000:3.0:1746147210.182905:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19754 00000100:00100000:3.0:1746147210.182910:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3765:x1830967311452160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147210.183020:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3765:x1830967311452160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (262us total) trans 17179875206 rc 0/0 00000100:00100000:3.0:1746147210.183026:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19754 00000100:00100000:3.0:1746147210.183037:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19755 00000100:00100000:3.0:1746147210.183040:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3765:x1830967311452032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147210.183074:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147210.183077:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147210.183079:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147210.183081:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147210.183082:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746147210.183109:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3765:x1830967311452032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (296us total) trans 17179875207 rc 0/0 00000100:00100000:3.0:1746147210.183113:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19755 00000100:00100000:3.0:1746147210.183121:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19756 00000100:00100000:3.0:1746147210.183124:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3765:x1830967311452544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147210.183164:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3765:x1830967311452544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 39us (333us total) trans 17179875208 rc 0/0 00000100:00100000:3.0:1746147210.183171:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19756 00000100:00100000:3.0:1746147210.183190:0:3765:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875193 gen 2 00000004:00080000:3.0:1746147210.183194:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097096300, transno 17179875069 00000004:00080000:3.0:1746147210.183198:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097096680, transno 17179875070 00000004:00080000:3.0:1746147210.183200:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097095f80, transno 17179875071 00000004:00080000:3.0:1746147210.183202:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b6e300, transno 17179875072 00000004:00080000:3.0:1746147210.183203:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b6df80, transno 17179875073 00000004:00080000:3.0:1746147210.183205:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097095880, transno 17179875074 00000004:00080000:3.0:1746147210.183207:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b6fb80, transno 17179875075 00000004:00080000:3.0:1746147210.183209:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097094700, transno 17179875076 00000004:00080000:3.0:1746147210.183211:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098858000, transno 17179875080 00000004:00080000:3.0:1746147210.183214:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c70380, transno 17179875081 00000004:00080000:3.0:1746147210.183215:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097097800, transno 17179875082 00000004:00080000:3.0:1746147210.183217:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098859f80, transno 17179875083 00000004:00080000:3.0:1746147210.183219:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094527480, transno 17179875084 00000004:00080000:3.0:1746147210.183221:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c70000, transno 17179875085 00000004:00080000:3.0:1746147210.183223:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009885aa00, transno 17179875086 00000004:00080000:3.0:1746147210.183225:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097097b80, transno 17179875087 00000004:00080000:3.0:1746147210.183227:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096898a80, transno 17179875089 00000004:00080000:3.0:1746147210.183230:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096899880, transno 17179875090 00000004:00080000:3.0:1746147210.183232:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096899180, transno 17179875091 00000004:00080000:3.0:1746147210.183234:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096898000, transno 17179875092 00000004:00080000:3.0:1746147210.183235:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009689a300, transno 17179875093 00000004:00080000:3.0:1746147210.183237:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f8e00, transno 17179875094 00000004:00080000:3.0:1746147210.183239:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f9f80, transno 17179875095 00000004:00080000:3.0:1746147210.183241:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096898700, transno 17179875096 00000004:00080000:3.0:1746147210.183243:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4395180, transno 17179875110 00000004:00080000:3.0:1746147210.183246:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4397100, transno 17179875111 00000004:00080000:3.0:1746147210.183249:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4396a00, transno 17179875112 00000004:00080000:3.0:1746147210.183250:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4397b80, transno 17179875113 00000004:00080000:3.0:1746147210.183252:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4397480, transno 17179875114 00000004:00080000:3.0:1746147210.183254:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5575180, transno 17179875115 00000004:00080000:3.0:1746147210.183257:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f55c00, transno 17179875116 00000004:00080000:3.0:1746147210.183259:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4395c00, transno 17179875117 00000004:00080000:3.0:1746147210.183260:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d6d880, transno 17179875122 00000004:00080000:3.0:1746147210.183262:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d6ed80, transno 17179875123 00000004:00080000:3.0:1746147210.183264:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d6fb80, transno 17179875124 00000004:00080000:3.0:1746147210.183266:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d6dc00, transno 17179875125 00000004:00080000:3.0:1746147210.183268:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d5f80, transno 17179875126 00000004:00080000:3.0:1746147210.183270:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d6300, transno 17179875127 00000004:00080000:3.0:1746147210.183272:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947e4a80, transno 17179875128 00000004:00080000:3.0:1746147210.183274:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d6df80, transno 17179875129 00000004:00080000:3.0:1746147210.183276:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094184380, transno 17179875130 00000004:00080000:3.0:1746147210.183279:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094185c00, transno 17179875131 00000004:00080000:3.0:1746147210.183281:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b6c700, transno 17179875132 00000004:00080000:3.0:1746147210.183283:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b6f100, transno 17179875133 00000004:00080000:3.0:1746147210.183285:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b6c380, transno 17179875134 00000004:00080000:3.0:1746147210.183286:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094187800, transno 17179875135 00000004:00080000:3.0:1746147210.183288:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b6ea00, transno 17179875136 00000004:00080000:3.0:1746147210.183290:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b6ca80, transno 17179875137 00000004:00080000:3.0:1746147210.183292:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258f800, transno 17179875147 00000004:00080000:3.0:1746147210.183294:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258dc00, transno 17179875148 00000004:00080000:3.0:1746147210.183296:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258df80, transno 17179875149 00000004:00080000:3.0:1746147210.183298:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258c700, transno 17179875150 00000004:00080000:3.0:1746147210.183300:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258fb80, transno 17179875151 00000004:00080000:3.0:1746147210.183302:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258e680, transno 17179875152 00000004:00080000:3.0:1746147210.183304:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258ed80, transno 17179875153 00000004:00080000:3.0:1746147210.183306:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258ca80, transno 17179875154 00000004:00080000:3.0:1746147210.183308:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cc700, transno 17179875159 00000004:00080000:3.0:1746147210.183310:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800769d8700, transno 17179875160 00000004:00080000:3.0:1746147210.183312:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cd180, transno 17179875161 00000004:00080000:3.0:1746147210.183314:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800769d9180, transno 17179875162 00000004:00080000:3.0:1746147210.183316:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cf800, transno 17179875163 00000004:00080000:3.0:1746147210.183318:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800769d9500, transno 17179875164 00000004:00080000:3.0:1746147210.183319:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3ce680, transno 17179875165 00000004:00080000:3.0:1746147210.183321:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800769d8380, transno 17179875166 00000004:00080000:3.0:1746147210.183324:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095122a00, transno 17179875167 00000004:00080000:3.0:1746147210.183326:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095122d80, transno 17179875168 00000004:00080000:3.0:1746147210.183327:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095123b80, transno 17179875169 00000004:00080000:3.0:1746147210.183330:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095123480, transno 17179875170 00000004:00080000:3.0:1746147210.183332:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095120380, transno 17179875171 00000004:00080000:3.0:1746147210.183334:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095123100, transno 17179875172 00000004:00080000:3.0:1746147210.183336:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095120000, transno 17179875173 00000004:00080000:3.0:1746147210.183338:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095123800, transno 17179875174 00000004:00080000:3.0:1746147210.183340:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095124a80, transno 17179875178 00000004:00080000:3.0:1746147210.183342:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095127b80, transno 17179875179 00000004:00080000:3.0:1746147210.183343:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095124e00, transno 17179875180 00000004:00080000:3.0:1746147210.183345:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095124000, transno 17179875181 00000004:00080000:3.0:1746147210.183347:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095126d80, transno 17179875182 00000004:00080000:3.0:1746147210.183348:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095125c00, transno 17179875183 00000004:00080000:3.0:1746147210.183350:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095125f80, transno 17179875184 00000004:00080000:3.0:1746147210.183351:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095127100, transno 17179875185 00000004:00080000:3.0:1746147210.183354:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e6e3100, transno 17179875186 00000004:00080000:3.0:1746147210.183355:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132126300, transno 17179875187 00000004:00080000:3.0:1746147210.183357:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e6e3480, transno 17179875188 00000004:00080000:3.0:1746147210.183359:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca11880, transno 17179875189 00000004:00080000:3.0:1746147210.183361:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e6e2d80, transno 17179875190 00000004:00080000:3.0:1746147210.183363:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e6e3b80, transno 17179875191 00000004:00080000:3.0:1746147210.183365:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e6e3800, transno 17179875192 00000004:00080000:3.0:1746147210.183366:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca10a80, transno 17179875193 00000100:00100000:3.0:1746147210.183371:0:3765:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8801312efb80 x1830967311452032/t17179875207(17179875207) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147226 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:3.0:1746147210.183379:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312efb80/2, rc 0, transno 17179875207 00000100:00100000:3.0:1746147210.183383:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311452032:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147210.183394:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ec380/2, rc 0, transno 17179875208 00000100:00100000:3.0:1746147210.183396:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311452544:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147210.183402:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ee680/2, rc 0, transno 17179875206 00000100:00100000:3.0:1746147210.183404:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311452160:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147210.183747:0:8112:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 5 in flight, 88 done 00000004:00010000:3.0:1746147210.183783:0:7237:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800968a0380 reply state ffff880131114800 transno 8589937332 ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.183797:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.183804:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147210.183807:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746147210.183810:0:7237:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746147210.183868:0:7237:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746147210.183879:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2827:x1830967310328064:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 17650us (18586us total) trans 8589937332 rc 0/0 00000100:00100000:3.0:1746147210.183885:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16429 00010000:00010000:3.0:1746147210.183903:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.183909:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.183917:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.183922:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093715200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147210.183925:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.183930:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.183937:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147210.183939:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147210.183941:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.183946:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093715200/0x31399394250626f7 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00000100:00100000:3.0:1746147210.184062:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311451776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147210.184083:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147210.184114:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311452288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147210.184126:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147210.184137:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746147210.184141:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311451904:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147210.184152:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147210.184163:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311452416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147210.184174:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147210.184190:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311451776 00000100:00100000:3.0:1746147210.184194:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311451776 00000100:00100000:3.0:1746147210.184212:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311452288 00000100:00100000:3.0:1746147210.184213:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311452288 00000100:00100000:3.0:1746147210.184221:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311451904 00000100:00100000:3.0:1746147210.184223:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311451904 00000100:00100000:3.0:1746147210.184230:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311452416 00000100:00100000:3.0:1746147210.184232:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311452416 00000100:00100000:3.0:1746147210.184242:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19757 00000100:00100000:3.0:1746147210.184246:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3766:x1830967311451776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147210.184310:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3766:x1830967311451776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (226us total) trans 17179875209 rc 0/0 00000100:00100000:3.0:1746147210.184315:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19757 00000100:00100000:3.0:1746147210.184323:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19758 00000100:00100000:3.0:1746147210.184327:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3766:x1830967311452288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147210.184362:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:3.0:1746147210.184365:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147210.184367:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147210.184368:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147210.184370:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:3.0:1746147210.184387:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3766:x1830967311452288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (260us total) trans 17179875210 rc 0/0 00000100:00100000:3.0:1746147210.184392:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19758 00000100:00100000:3.0:1746147210.184400:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19759 00000100:00100000:3.0:1746147210.184404:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3766:x1830967311451904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147210.184452:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3766:x1830967311451904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (297us total) trans 17179875211 rc 0/0 00000100:00100000:3.0:1746147210.184456:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19759 00000100:00100000:3.0:1746147210.184465:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19760 00000100:00100000:3.0:1746147210.184469:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3766:x1830967311452416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147210.184515:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3766:x1830967311452416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (340us total) trans 17179875212 rc 0/0 00000100:00100000:3.0:1746147210.184520:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19760 00000004:00080000:3.0:1746147210.184542:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ec000/2, rc 0, transno 17179875211 00000100:00100000:3.0:1746147210.184546:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311451904:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147210.184552:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ed180/2, rc 0, transno 17179875212 00000100:00100000:3.0:1746147210.184554:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311452416:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147210.184560:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312edf80/2, rc 0, transno 17179875209 00000100:00100000:3.0:1746147210.184562:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311451776:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147210.184566:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312eca80/2, rc 0, transno 17179875210 00000100:00100000:3.0:1746147210.184568:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311452288:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746147210.184701:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147210.184763:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311451648:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147210.184784:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147210.184800:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311451648 00000100:00100000:1.0:1746147210.184802:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311451648 00000100:00100000:1.0:1746147210.184819:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19761 00000100:00100000:1.0:1746147210.184822:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3764:x1830967311451648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147210.184869:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3764:x1830967311451648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (85us total) trans 17179875213 rc 0/0 00000100:00100000:1.0:1746147210.184873:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19761 00000004:00080000:1.0:1746147210.184887:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ef100/2, rc 0, transno 17179875213 00000100:00100000:1.0:1746147210.184890:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311451648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.185025:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311452928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.185045:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.185057:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311453440:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.185066:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.185073:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746147210.185076:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311452800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.185086:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.185115:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311453312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.185126:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.185137:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311452928 00000100:00100000:2.0:1746147210.185139:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311452928 00000100:00100000:2.0:1746147210.185158:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311453440 00000100:00100000:2.0:1746147210.185159:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311453440 00000100:00100000:2.0:1746147210.185166:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311452800 00000100:00100000:2.0:1746147210.185168:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311452800 00000100:00100000:2.0:1746147210.185175:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311453312 00000100:00100000:2.0:1746147210.185176:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311453312 00000100:00100000:2.0:1746147210.185185:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19762 00000100:00100000:2.0:1746147210.185189:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3767:x1830967311452928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.185254:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3767:x1830967311452928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (207us total) trans 21474842586 rc 0/0 00000100:00100000:2.0:1746147210.185259:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19762 00000100:00100000:2.0:1746147210.185269:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19763 00000100:00100000:2.0:1746147210.185273:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3767:x1830967311453440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147210.185308:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147210.185311:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147210.185313:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147210.185314:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147210.185316:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:2.0:1746147210.185333:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3767:x1830967311453440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (266us total) trans 21474842587 rc 0/0 00000100:00100000:2.0:1746147210.185337:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19763 00000100:00100000:2.0:1746147210.185346:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19764 00000100:00100000:2.0:1746147210.185350:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3767:x1830967311452800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.185395:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3767:x1830967311452800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (308us total) trans 21474842588 rc 0/0 00000100:00100000:2.0:1746147210.185400:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19764 00000100:00100000:2.0:1746147210.185408:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19765 00000100:00100000:2.0:1746147210.185412:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3767:x1830967311453312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.185454:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3767:x1830967311453312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (326us total) trans 21474842589 rc 0/0 00000100:00100000:2.0:1746147210.185459:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19765 00000100:00080000:2.0:1746147210.185472:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1746147210.185484:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097ebaa00/2, rc 0, transno 21474842588 00000100:00100000:2.0:1746147210.185489:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311452800:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147210.185495:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097ebb480/2, rc 0, transno 21474842589 00000100:00100000:2.0:1746147210.185497:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311453312:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147210.185502:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097eb9500/2, rc 0, transno 21474842586 00000100:00100000:2.0:1746147210.185505:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311452928:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147210.185509:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097ebad80/2, rc 0, transno 21474842587 00000100:00100000:2.0:1746147210.185512:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311453440:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.185565:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311452672:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.185582:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.185593:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311453184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.185604:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.185611:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311453696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.185620:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.185629:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746147210.185632:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311453056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.185643:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.185649:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311453568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.185659:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.185685:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311452672 00000100:00100000:2.0:1746147210.185687:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311452672 00000100:00100000:2.0:1746147210.185700:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311453184 00000100:00100000:2.0:1746147210.185702:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311453184 00000100:00100000:2.0:1746147210.185710:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311453696 00000100:00100000:2.0:1746147210.185711:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311453696 00000100:00100000:2.0:1746147210.185718:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311453056 00000100:00100000:2.0:1746147210.185719:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311453056 00000100:00100000:2.0:1746147210.185726:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311453568 00000100:00100000:2.0:1746147210.185727:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311453568 00000100:00100000:2.0:1746147210.185734:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19766 00000100:00100000:2.0:1746147210.185738:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3765:x1830967311452672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.185789:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3765:x1830967311452672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (207us total) trans 21474842590 rc 0/0 00000100:00100000:2.0:1746147210.185794:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19766 00000100:00100000:2.0:1746147210.185802:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19767 00000100:00100000:2.0:1746147210.185806:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3765:x1830967311453184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.185851:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3765:x1830967311453184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (246us total) trans 21474842591 rc 0/0 00000100:00100000:2.0:1746147210.185856:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19767 00000100:00100000:2.0:1746147210.185865:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19768 00000100:00100000:2.0:1746147210.185869:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3765:x1830967311453696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.185912:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3765:x1830967311453696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (290us total) trans 21474842592 rc 0/0 00000100:00100000:2.0:1746147210.185917:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19768 00000100:00100000:2.0:1746147210.185924:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19769 00000100:00100000:2.0:1746147210.185928:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3765:x1830967311453056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147210.185961:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746147210.185963:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147210.185965:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147210.185966:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147210.185968:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:2.0:1746147210.185985:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3765:x1830967311453056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (340us total) trans 21474842593 rc 0/0 00000100:00100000:2.0:1746147210.185990:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19769 00000100:00100000:2.0:1746147210.185998:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19770 00000100:00100000:2.0:1746147210.186002:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3765:x1830967311453568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147210.186036:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:2.0:1746147210.186038:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147210.186039:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147210.186041:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147210.186042:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:2.0:1746147210.186059:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3765:x1830967311453568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (398us total) trans 21474842594 rc 0/0 00000100:00100000:2.0:1746147210.186064:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19770 00000004:00080000:2.0:1746147210.186087:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097eb9880/2, rc 0, transno 21474842593 00000100:00100000:2.0:1746147210.186110:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311453056:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147210.186118:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097eb8a80/2, rc 0, transno 21474842594 00000100:00100000:2.0:1746147210.186120:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311453568:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147210.186126:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097eb9c00/2, rc 0, transno 21474842590 00000100:00100000:2.0:1746147210.186128:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311452672:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147210.186133:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097eba300/2, rc 0, transno 21474842591 00000100:00100000:2.0:1746147210.186134:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311453184:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147210.186139:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097eb9f80/2, rc 0, transno 21474842592 00000100:00100000:2.0:1746147210.186141:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311453696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147210.195364:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.195440:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310328704 00000100:00100000:3.0:1746147210.195448:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310328704 00000100:00100000:3.0:1746147210.195486:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16430 00000100:00100000:3.0:1746147210.195493:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2827:x1830967310328704:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147210.195511:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147210.195526:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x31399394250626fe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eca3 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.195571:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x31399394250626fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eca3 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.195583:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x31399394250626fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eca3 expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.195603:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147210.195605:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147210.195608:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05a00, rc 0) 00000100:00100000:3.0:1746147210.195661:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2827:x1830967310328704:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 168us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.195677:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16430 00000100:00100000:0.0:1746147210.208517:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.208644:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310328832 00000100:00100000:2.0:1746147210.208651:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310328832 00000100:00100000:2.0:1746147210.208711:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16431 00000100:00100000:2.0:1746147210.208718:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2827:x1830967310328832:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147210.208735:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.208751:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03cc00/0x3139939425062705 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ecaa expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.208822:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x313993942506270c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.208833:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x313993942506270c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.208847:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x313993942506270c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147210.208868:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:2.0:1746147210.208872:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147210.208886:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x313993942506270c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.208905:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03cc00/0x3139939425062705 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecaa expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.208936:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x313993942506270c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecaa expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.208944:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147210.208946:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147210.208948:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03c200, rc 0) 00000100:00100000:2.0:1746147210.208987:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2827:x1830967310328832:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 269us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.208993:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16431 00000100:00100000:0.0:1746147210.220268:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.220522:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310328960 00000100:00100000:1.0:1746147210.220530:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310328960 00000100:00100000:1.0:1746147210.220583:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19771 00000100:00100000:1.0:1746147210.220591:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310328960:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147210.220607:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147210.220627:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32e00/0x3139939425062713 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ecb1 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147210.220646:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x93:0x0] initial LVB size: 1048576, mtime: 0x68141787, atime: 0x68141786, ctime: 0x68141787, blocks: 0x7e8 00010000:00010000:1.0:1746147210.220675:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.220678:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.220686:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32e00/0x3139939425062713 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecb1 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.220699:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32e00/0x3139939425062713 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecb1 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.220709:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32e00, rc 0) 00000100:00100000:1.0:1746147210.220763:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310328960:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 172us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.220768:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19771 00000100:00100000:0.0:1746147210.222559:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.222591:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.222627:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.222640:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310329088 00000100:00100000:2.0:1746147210.222647:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310329088 00000100:00100000:1.0:1746147210.222720:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310329344 00000100:00100000:2.0:1746147210.222721:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310329600 00000100:00100000:2.0:1746147210.222724:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310329600 00000100:00100000:1.0:1746147210.222724:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310329344 00000100:00100000:2.0:1746147210.222739:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19772 00000100:00100000:2.0:1746147210.222745:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967310329088:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:1.0:1746147210.222749:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19773 00000100:00100000:1.0:1746147210.222755:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967310329600:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147210.222757:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147210.222762:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.222771:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f03d800/0x313993942506271a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ecb8 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.222773:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33c00/0x3139939425062721 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ecd4 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147210.222794:0:12225:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x96:0x0] initial LVB size: 2097152, mtime: 0x68141789, atime: 0x68141789, ctime: 0x68141789, blocks: 0x808 00002000:00010000:1.0:1746147210.222794:0:12201:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x98:0x0] initial LVB size: 4194304, mtime: 0x68141789, atime: 0x68141788, ctime: 0x68141789, blocks: 0x1008 00010000:00010000:2.0:1746147210.222807:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.222807:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.222809:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.222809:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.222816:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03d800/0x313993942506271a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecb8 expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.222816:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33c00/0x3139939425062721 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecd4 expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147210.222827:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f03d800/0x313993942506271a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecb8 expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.222827:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33c00/0x3139939425062721 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecd4 expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.222834:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33c00, rc 0) 00010000:00010000:2.0:1746147210.222835:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03d800, rc 0) 00000100:00100000:0.0:1746147210.222879:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19774 00000100:00100000:0.0:1746147210.222889:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310329344:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147210.222897:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147210.222906:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800936b7600/0x3139939425062728 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ecc6 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147210.222909:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310329600:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 153us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.222914:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19773 00002000:00010000:0.0:1746147210.222918:0:1398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x68141789, atime: 0x68141789, ctime: 0x68141789, blocks: 0x808 00010000:00010000:0.0:1746147210.222926:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147210.222927:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147210.222931:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800936b7600/0x3139939425062728 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecc6 expref: 14 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147210.222940:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800936b7600/0x3139939425062728 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecc6 expref: 14 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147210.222947:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936b7600, rc 0) 00000100:00100000:0.0:1746147210.222963:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310329344:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 79us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.222965:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310329088:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 218us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.222971:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19772 00000100:00100000:0.0:1746147210.222975:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19774 00000100:00100000:0.0:1746147210.223444:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.223472:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.223532:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310329216 00000100:00100000:3.0:1746147210.223536:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310329216 00000100:00100000:3.0:1746147210.223563:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310329472 00000100:00100000:3.0:1746147210.223566:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310329472 00000100:00100000:3.0:1746147210.223578:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19775 00000100:00100000:3.0:1746147210.223583:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310329216:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147210.223589:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147210.223598:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a20800/0x313993942506272f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ecbf expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147210.223607:0:12225:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x97:0x0] initial LVB size: 2097152, mtime: 0x68141789, atime: 0x68141789, ctime: 0x68141789, blocks: 0x800 00010000:00010000:3.0:1746147210.223615:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.223616:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.223620:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a20800/0x313993942506272f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecbf expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147210.223629:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a20800/0x313993942506272f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecbf expref: 10 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147210.223635:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a20800, rc 0) 00000100:00100000:3.0:1746147210.223672:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310329216:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 79us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.224039:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19776 00000100:00100000:2.0:1746147210.224048:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310329472:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:3.0:1746147210.224054:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19775 00010000:00010000:2.0:1746147210.224055:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.224064:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062736 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eccd expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147210.224075:0:1398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4886560, mtime: 0x68141789, atime: 0x68141789, ctime: 0x68141789, blocks: 0x1558 00010000:00010000:2.0:1746147210.224083:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.224084:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.224106:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062736 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eccd expref: 15 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147210.224121:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062736 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eccd expref: 15 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147210.224194:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03d200, rc 0) 00000100:00100000:2.0:1746147210.224652:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310329472:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 605us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.224658:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19776 00000100:00100000:0.0:1746147210.231721:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.231761:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.231792:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.231821:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.231833:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.231851:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310329728 00000100:00100000:1.0:1746147210.231860:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310329728 00000100:00100000:1.0:1746147210.231900:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310329984 00000100:00100000:1.0:1746147210.231902:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310329984 00000100:00100000:1.0:1746147210.231914:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310330240 00000100:00100000:1.0:1746147210.231916:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310330240 00000100:00100000:2.0:1746147210.231919:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310329856 00000100:00100000:2.0:1746147210.231923:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310329856 00000100:00100000:1.0:1746147210.231924:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310330112 00000100:00100000:1.0:1746147210.231925:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310330112 00000100:00100000:1.0:1746147210.231936:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19777 00000100:00100000:1.0:1746147210.231942:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310329728:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147210.231997:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19778 00000100:00100000:2.0:1746147210.232003:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310329984:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147210.232073:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.232076:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310329728:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 133us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.232087:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19777 00000100:00100000:1.0:1746147210.232128:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310330368 00000100:00100000:1.0:1746147210.232130:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310330368 00000100:00100000:1.0:1746147210.232142:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19779 00000100:00100000:1.0:1746147210.232146:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310330240:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147210.232172:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310330240:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 25us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.232176:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19779 00000100:00100000:1.0:1746147210.232183:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19780 00000100:00100000:1.0:1746147210.232187:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310330112:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147210.232205:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310330112:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 18us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.232209:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19780 00000100:00100000:1.0:1746147210.232215:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19781 00000100:00100000:1.0:1746147210.232218:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310329856:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147210.232236:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310329856:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 17us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.232240:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19781 00000100:00100000:1.0:1746147210.232246:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19782 00000100:00100000:1.0:1746147210.232249:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310330368:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147210.232265:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310330368:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 15us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.232269:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19782 00000100:00100000:2.0:1746147210.232345:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310329984:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 341us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.232351:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19778 00000100:00100000:0.0:1746147210.239543:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.239583:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.239613:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.239636:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.239650:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.239681:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.239713:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310330624 00000100:00100000:0.0:1746147210.239721:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310330624 00000100:00100000:0.0:1746147210.239751:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310330880 00000100:00100000:0.0:1746147210.239753:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310330880 00000100:00100000:0.0:1746147210.239766:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19783 00000100:00100000:0.0:1746147210.239772:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310330624:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147210.239867:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310330624:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 95us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.239872:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19783 00000100:00100000:0.0:1746147210.239885:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310331136 00000100:00100000:0.0:1746147210.239887:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310331136 00000100:00100000:0.0:1746147210.239896:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310330496 00000100:00100000:0.0:1746147210.239898:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310330496 00000100:00100000:0.0:1746147210.239905:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310330752 00000100:00100000:0.0:1746147210.239906:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310330752 00000100:00100000:0.0:1746147210.239914:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310331008 00000100:00100000:0.0:1746147210.239915:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310331008 00000100:00100000:0.0:1746147210.239924:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19784 00000100:00100000:0.0:1746147210.239927:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310330880:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147210.239959:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310330880:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.239963:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19784 00000100:00100000:0.0:1746147210.239970:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19785 00000100:00100000:0.0:1746147210.239974:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310331136:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147210.239995:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310331136:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 21us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.239999:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19785 00000100:00100000:0.0:1746147210.240006:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19786 00000100:00100000:0.0:1746147210.240010:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310330496:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147210.240032:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310330496:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 22us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.240037:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19786 00000100:00100000:0.0:1746147210.240045:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19787 00000100:00100000:0.0:1746147210.240049:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310330752:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147210.240071:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310330752:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 21us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.240075:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19787 00000100:00100000:0.0:1746147210.240083:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19788 00000100:00100000:0.0:1746147210.240087:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310331008:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147210.240141:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310331008:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 53us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.240146:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19788 00000100:00100000:0.0:1746147210.243470:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.244717:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310331264 00000100:00100000:1.0:1746147210.244726:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310331264 00000100:00100000:1.0:1746147210.244774:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19789 00000100:00100000:1.0:1746147210.244781:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310331264:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:1.0:1746147210.244969:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147210.244972:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147210.244978:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147210.244980:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147210.244981:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746147210.245026:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310331264:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 245us (1564us total) trans 17179875214 rc 0/0 00000100:00100000:1.0:1746147210.245032:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19789 00000100:00100000:0.0:1746147210.250227:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.250287:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310331392 00000100:00100000:2.0:1746147210.250295:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310331392 00000100:00100000:2.0:1746147210.250340:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19790 00000100:00100000:2.0:1746147210.250346:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2002:x1830967310331392:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:2.0:1746147210.250494:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147210.250497:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147210.250499:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147210.250501:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147210.250502:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:2.0:1746147210.250552:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2002:x1830967310331392:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 206us (334us total) trans 21474842595 rc 0/0 00000100:00100000:2.0:1746147210.250559:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19790 00000100:00100000:0.0:1746147210.256270:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.256345:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310331648 00000100:00100000:2.0:1746147210.256353:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310331648 00000100:00100000:2.0:1746147210.256415:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7274 00000100:00100000:2.0:1746147210.256422:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2003:x1830967310331648:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147210.256452:0:29474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f03dc00/0x313993942506273d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.256464:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.256465:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.256470:0:29474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03dc00/0x313993942506273d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.256482:0:29474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f03dc00/0x313993942506273d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.262557:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.262609:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.262781:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310331904 00000100:00100000:2.0:1746147210.262790:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310331904 00000100:00100000:2.0:1746147210.262832:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310332160 00000100:00100000:2.0:1746147210.262834:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310332160 00000100:00100000:2.0:1746147210.262858:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7275 00000100:00100000:2.0:1746147210.262864:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310331904:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147210.262893:0:29478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f03c000/0x3139939425062744 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.262905:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.262907:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.262911:0:29478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03c000/0x3139939425062744 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.262922:0:29478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f03c000/0x3139939425062744 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147210.262967:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7276 00000100:00100000:3.0:1746147210.262975:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310332160:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147210.262990:0:29476:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095a20400/0x313993942506274b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.262998:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.262999:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.263002:0:29476:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a20400/0x313993942506274b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.263010:0:29476:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a20400/0x313993942506274b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.269032:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.269064:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.269106:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.269125:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310332416 00000100:00100000:2.0:1746147210.269135:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310332416 00000100:00100000:0.0:1746147210.269136:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.269149:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310332672 00000100:00100000:0.0:1746147210.269152:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310332672 00000100:00100000:0.0:1746147210.269180:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310332928 00000100:00100000:2.0:1746147210.269182:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310333184 00000100:00100000:0.0:1746147210.269182:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310332928 00000100:00100000:2.0:1746147210.269185:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310333184 00000100:00100000:0.0:1746147210.269200:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7277 00000100:00100000:0.0:1746147210.269206:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2003:x1830967310332672:12345-192.168.204.25@tcp:3:lfs.0 00000100:00100000:2.0:1746147210.269208:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7278 00000100:00100000:2.0:1746147210.269213:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2003:x1830967310332416:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147210.269234:0:29475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097c87200/0x3139939425062759 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.269234:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425062752 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.269245:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147210.269245:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.269246:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147210.269246:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.269250:0:29475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c87200/0x3139939425062759 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.269250:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425062752 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.269260:0:29475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c87200/0x3139939425062759 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.269260:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425062752 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147210.269867:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7279 00000100:00100000:2.0:1746147210.269873:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967310332928:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147210.269890:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880097c86200/0x3139939425062760 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.269898:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.269899:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.269902:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c86200/0x3139939425062760 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.269911:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097c86200/0x3139939425062760 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147210.271702:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7280 00000100:00100000:1.0:1746147210.271715:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2002:x1830967310333184:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147210.271743:0:9589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062767 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.271752:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.271754:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.271758:0:9589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062767 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.271767:0:9589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062767 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147210.272198:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.272217:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310333440 00000100:00100000:3.0:1746147210.272223:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310333440 00000100:00100000:3.0:1746147210.272256:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7281 00000100:00100000:3.0:1746147210.272262:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2002:x1830967310333440:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147210.272277:0:13334:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095a20600/0x313993942506276e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.272285:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.272286:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.272289:0:13334:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a20600/0x313993942506276e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.272301:0:13334:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a20600/0x313993942506276e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.279776:0:29474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f03dc00/0x313993942506273d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.279793:0:29474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03dc00/0x313993942506273d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.279800:0:29474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f03dc00/0x313993942506273d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.279807:0:29474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f03dc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147210.279810:0:29474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f03dc00/0x313993942506273d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.279817:0:29474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f03dc00/0x313993942506273d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.279832:0:29474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f03dc00/0x313993942506273d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.279837:0:29474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f03dc00/0x313993942506273d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147210.279930:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2003:x1830967310331648:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 23503us (23662us total) trans 0 rc 1032192/1032192 00000100:00100000:2.0:1746147210.279941:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7274 00010000:00010000:3.0:1746147210.280521:0:29476:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095a20400/0x313993942506274b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.280531:0:29476:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095a20400/0x313993942506274b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.280537:0:29476:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095a20400/0x313993942506274b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.280542:0:29476:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a20400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147210.280544:0:29476:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a20400/0x313993942506274b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.280550:0:29476:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a20400/0x313993942506274b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.280560:0:29476:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095a20400/0x313993942506274b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.280565:0:29476:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a20400/0x313993942506274b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147210.280619:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967310332160:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 17644us (18008us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147210.280630:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7276 00010000:00010000:3.0:1746147210.285770:0:29478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f03c000/0x3139939425062744 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.285785:0:29478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03c000/0x3139939425062744 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.285793:0:29478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f03c000/0x3139939425062744 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.285800:0:29478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f03c000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147210.285804:0:29478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f03c000/0x3139939425062744 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.285811:0:29478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f03c000/0x3139939425062744 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.285827:0:29478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f03c000/0x3139939425062744 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.285833:0:29478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f03c000/0x3139939425062744 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147210.285913:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967310331904:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 23043us (23359us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147210.285924:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7275 00010000:00010000:2.0:1746147210.290546:0:29475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097c87200/0x3139939425062759 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.290562:0:29475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097c87200/0x3139939425062759 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.290569:0:29475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097c87200/0x3139939425062759 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.290575:0:29475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c87200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147210.290578:0:29475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097c87200/0x3139939425062759 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.290584:0:29475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097c87200/0x3139939425062759 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.290598:0:29475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097c87200/0x3139939425062759 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.290603:0:29475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c87200/0x3139939425062759 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147210.290696:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2003:x1830967310332416:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 21478us (21668us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147210.290706:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7278 00010000:00010000:3.0:1746147210.293513:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880097c86200/0x3139939425062760 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.293528:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097c86200/0x3139939425062760 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.293535:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097c86200/0x3139939425062760 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.293541:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c86200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147210.293545:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097c86200/0x3139939425062760 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.293552:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097c86200/0x3139939425062760 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.293568:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097c86200/0x3139939425062760 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.293573:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097c86200/0x3139939425062760 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147210.293640:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2003:x1830967310332928:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 23763us (24529us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147210.293649:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7279 00010000:00010000:3.0:1746147210.302048:0:13334:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095a20600/0x313993942506276e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.302064:0:13334:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095a20600/0x313993942506276e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.302075:0:13334:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095a20600/0x313993942506276e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.302082:0:13334:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a20600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147210.302086:0:13334:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a20600/0x313993942506276e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.302125:0:13334:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a20600/0x313993942506276e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.302144:0:13334:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095a20600/0x313993942506276e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.302149:0:13334:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a20600/0x313993942506276e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147210.302231:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2002:x1830967310333440:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 29964us (30029us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147210.302241:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7281 00010000:00010000:1.0:1746147210.305609:0:9589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062767 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.305624:0:9589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062767 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.305632:0:9589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062767 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.305640:0:9589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800993b1a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147210.305646:0:9589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062767 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.305654:0:9589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062767 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.305684:0:9589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062767 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.305691:0:9589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062767 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147210.305985:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2002:x1830967310333184:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 34268us (36841us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147210.305995:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7280 00010000:00010000:2.0:1746147210.308751:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425062752 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.308768:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425062752 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.308776:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425062752 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.308782:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c33e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147210.308786:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425062752 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.308792:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425062752 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.308812:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425062752 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.308819:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x3139939425062752 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147210.308925:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2003:x1830967310332672:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 39713us (39855us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147210.308933:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7277 00000100:00100000:0.0:1746147210.318153:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.318217:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310333696 00000100:00100000:2.0:1746147210.318227:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310333696 00000100:00100000:2.0:1746147210.318281:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16432 00000100:00100000:2.0:1746147210.318288:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2827:x1830967310333696:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:2.0:1746147210.318337:0:6215:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147210.318359:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f03c200/0x313993942506270c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecaa expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.318377:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147210.318382:0:6215:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147210.318418:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425062775 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.318428:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425062775 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.318435:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425062775 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00010000:2.0:1746147210.318949:0:6215:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009514b480 reply state ffff88009f349000 transno 8589937333 ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425062775 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.318959:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425062775 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.318964:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147210.318966:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746147210.318968:0:6215:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746147210.319049:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2827:x1830967310333696:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 760us (903us total) trans 8589937333 rc 0/0 00000100:00100000:2.0:1746147210.319056:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16432 00000100:00100000:0.0:1746147210.322040:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.322120:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310333824 00000100:00100000:1.0:1746147210.322127:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310333824 00000100:00100000:1.0:1746147210.322166:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19791 00000100:00100000:1.0:1746147210.322171:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2827:x1830967310333824:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147210.322186:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147210.322200:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942506277c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ecdb expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.322226:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32e00/0x3139939425062713 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecb1 expref: 17 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.322231:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.322232:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.322234:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942506277c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecdb expref: 17 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.322255:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32e00/0x3139939425062713 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecb1 expref: 17 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.322262:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32e00/0x3139939425062713 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecb1 expref: 17 pid: 1853 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746147210.322270:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311453824:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147210.322340:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147210.326399:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311453824:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147210.326426:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942506277c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecdb expref: 17 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.326441:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091e31800, rc 0) 00000100:00100000:1.0:1746147210.326484:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2827:x1830967310333824:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4310us (4448us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.326498:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19791 00000100:00100000:0.0:1746147210.328251:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.328339:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310333952 00000100:00100000:1.0:1746147210.328348:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310333952 00010000:00010000:1.0:1746147210.328379:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32e00/0x3139939425062713 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecb1 expref: 17 pid: 1853 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746147210.328418:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8993 00000100:00100000:1.0:1746147210.328425:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310333952:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147210.328440:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147210.328459:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32e00/0x3139939425062713 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecb1 expref: 17 pid: 1853 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746147210.328469:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32e00/0x3139939425062713 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecb1 expref: 17 pid: 1853 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746147210.328487:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32e00/0x3139939425062713 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecb1 expref: 17 pid: 1853 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746147210.328517:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.328519:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.328525:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942506277c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecdb expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.328532:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942506277c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecdb expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.328557:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942506277c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecdb expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147210.328568:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311453952:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147210.328640:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.334194:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.334288:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310334080 00000100:00100000:2.0:1746147210.334295:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310334080 00000100:00100000:2.0:1746147210.334348:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19792 00000100:00100000:2.0:1746147210.334356:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2827:x1830967310334080:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147210.334374:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.334391:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009844b200/0x3139939425062783 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ece2 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.334417:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f03d800/0x313993942506271a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecb8 expref: 12 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147210.334424:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.334426:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.334430:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009844b200/0x3139939425062783 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece2 expref: 12 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.334459:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f03d800/0x313993942506271a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecb8 expref: 12 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147210.334470:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f03d800/0x313993942506271a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecb8 expref: 12 pid: 12225 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746147210.334481:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e484a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311454080:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.334555:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147210.334930:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311453952:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147210.334943:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147210.335928:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310333952:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7499us (7681us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.335937:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8993 00000100:00100000:2.0:1746147210.340725:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e484a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311454080:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.340759:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009844b200/0x3139939425062783 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece2 expref: 12 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.340775:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844b200, rc 0) 00000100:00100000:2.0:1746147210.340822:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2827:x1830967310334080:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 6466us (6635us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.340831:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19792 00000100:00100000:1.0:1746147210.341107:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.341298:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310334208 00000100:00100000:2.0:1746147210.341304:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310334208 00010000:00010000:2.0:1746147210.341326:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03d800/0x313993942506271a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecb8 expref: 12 pid: 12225 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746147210.341359:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8994 00000100:00100000:2.0:1746147210.341366:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310334208:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147210.341377:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147210.341392:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f03d800/0x313993942506271a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecb8 expref: 12 pid: 12225 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.341401:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f03d800/0x313993942506271a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecb8 expref: 12 pid: 12225 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.341419:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f03d800/0x313993942506271a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecb8 expref: 12 pid: 12225 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.341442:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.341443:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.341449:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009844b200/0x3139939425062783 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece2 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.341455:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009844b200/0x3139939425062783 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece2 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.341477:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009844b200/0x3139939425062783 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece2 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147210.341487:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e484a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311454208:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147210.341550:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.344254:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.344546:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e484a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311454208:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147210.344562:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147210.344599:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310334208:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3234us (3493us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.344609:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8994 00000100:00100000:3.0:1746147210.344691:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310334336 00000100:00100000:3.0:1746147210.344697:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310334336 00000100:00100000:3.0:1746147210.344727:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19793 00000100:00100000:3.0:1746147210.344734:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2827:x1830967310334336:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147210.344748:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147210.344763:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x313993942506278a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ece9 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.344790:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a20800/0x313993942506272f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecbf expref: 12 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147210.344799:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.344801:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.344805:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x313993942506278a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece9 expref: 12 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.344832:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a20800/0x313993942506272f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecbf expref: 12 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147210.344842:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a20800/0x313993942506272f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecbf expref: 12 pid: 12225 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746147210.344853:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311454336:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147210.344912:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147210.350142:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311454336:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147210.350168:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x313993942506278a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece9 expref: 12 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.350182:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a21200, rc 0) 00000100:00100000:0.0:1746147210.350756:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.350853:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2827:x1830967310334336:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 6118us (6606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.350862:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19793 00000100:00100000:2.0:1746147210.350976:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310334464 00000100:00100000:2.0:1746147210.350982:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310334464 00010000:00010000:2.0:1746147210.351298:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a20800/0x313993942506272f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecbf expref: 12 pid: 12225 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746147210.351611:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8995 00000100:00100000:2.0:1746147210.351711:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310334464:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147210.351725:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147210.351842:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a20800/0x313993942506272f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecbf expref: 12 pid: 12225 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.351955:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a20800/0x313993942506272f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecbf expref: 12 pid: 12225 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.352044:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a20800/0x313993942506272f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecbf expref: 12 pid: 12225 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.353287:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.353289:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.353299:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x313993942506278a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece9 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.353307:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x313993942506278a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece9 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.353344:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x313993942506278a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece9 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147210.353356:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e484a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311454464:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147210.353432:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147210.356965:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e484a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311454464:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147210.356982:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147210.357035:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310334464:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5415us (6281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.357044:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8995 00000100:00100000:0.0:1746147210.357993:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.358367:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310334592 00000100:00100000:3.0:1746147210.358374:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310334592 00000100:00100000:3.0:1746147210.358629:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19794 00000100:00100000:3.0:1746147210.358638:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2827:x1830967310334592:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147210.358656:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147210.358681:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a21600/0x3139939425062791 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ecf0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.358714:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800936b7600/0x3139939425062728 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecc6 expref: 17 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147210.358721:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.358722:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.358726:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a21600/0x3139939425062791 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf0 expref: 17 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.358752:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800936b7600/0x3139939425062728 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecc6 expref: 17 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147210.358762:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800936b7600/0x3139939425062728 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecc6 expref: 17 pid: 1398 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746147210.358774:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311454592:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147210.358841:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147210.360756:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311454592:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147210.360785:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a21600/0x3139939425062791 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf0 expref: 17 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.360805:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a21600, rc 0) 00000100:00100000:3.0:1746147210.360859:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2827:x1830967310334592:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2223us (2867us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.360867:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19794 00000100:00100000:0.0:1746147210.360992:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.361610:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310334720 00000100:00100000:2.0:1746147210.361616:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310334720 00010000:00010000:2.0:1746147210.361644:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800936b7600/0x3139939425062728 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecc6 expref: 17 pid: 1398 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746147210.361682:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8996 00000100:00100000:2.0:1746147210.361688:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310334720:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147210.361700:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147210.361715:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800936b7600/0x3139939425062728 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecc6 expref: 17 pid: 1398 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.361725:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800936b7600/0x3139939425062728 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecc6 expref: 17 pid: 1398 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.361742:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936b7600/0x3139939425062728 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecc6 expref: 17 pid: 1398 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.361757:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.361758:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.361764:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a21600/0x3139939425062791 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf0 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.361770:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a21600/0x3139939425062791 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf0 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.361793:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095a21600/0x3139939425062791 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf0 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147210.361803:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e484a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311454720:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147210.361865:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.367951:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.368577:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310334848 00000100:00100000:3.0:1746147210.368584:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310334848 00000100:00100000:3.0:1746147210.368622:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19795 00000100:00100000:3.0:1746147210.368629:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2827:x1830967310334848:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147210.368644:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147210.368658:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a20e00/0x3139939425062798 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ecf7 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.368693:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062736 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eccd expref: 18 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147210.368700:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.368702:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.368705:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a20e00/0x3139939425062798 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf7 expref: 18 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.368731:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062736 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eccd expref: 18 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147210.368741:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062736 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eccd expref: 18 pid: 1398 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746147210.368756:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311454848:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.368893:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e484a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311454720:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147210.368906:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147210.369960:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147210.370061:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310334720:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8370us (9066us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.370070:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8996 00000100:00100000:3.0:1746147210.377667:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311454848:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147210.377694:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a20e00/0x3139939425062798 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf7 expref: 17 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.377709:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a20e00, rc 0) 00000100:00100000:3.0:1746147210.377749:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2827:x1830967310334848:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 9121us (9808us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.377756:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19795 00000100:00100000:0.0:1746147210.379475:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.380312:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310334976 00000100:00100000:2.0:1746147210.380319:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310334976 00010000:00010000:2.0:1746147210.380350:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062736 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eccd expref: 17 pid: 1398 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746147210.380380:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8997 00000100:00100000:2.0:1746147210.380386:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310334976:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147210.380397:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147210.380413:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062736 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eccd expref: 17 pid: 1398 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.380424:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062736 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eccd expref: 17 pid: 1398 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.380443:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062736 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eccd expref: 17 pid: 1398 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.380469:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.380472:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.380477:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a20e00/0x3139939425062798 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf7 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.380485:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a20e00/0x3139939425062798 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf7 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.380510:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095a20e00/0x3139939425062798 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf7 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147210.380521:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e484a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311454976:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147210.380594:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147210.382272:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e484a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311454976:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147210.382288:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147210.382632:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310334976:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2244us (3159us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.382680:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8997 00000100:00100000:0.0:1746147210.383318:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.383529:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310335104 00000100:00100000:3.0:1746147210.383535:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310335104 00000100:00100000:3.0:1746147210.383579:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19796 00000100:00100000:3.0:1746147210.383585:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2827:x1830967310335104:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147210.383599:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147210.383613:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x313993942506279f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ecfe expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.383639:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33c00/0x3139939425062721 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecd4 expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147210.383646:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.383648:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.383651:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x313993942506279f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecfe expref: 12 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.383692:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33c00/0x3139939425062721 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecd4 expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147210.383702:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33c00/0x3139939425062721 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecd4 expref: 12 pid: 12201 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746147210.383712:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311455104:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147210.383778:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147210.388717:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311455104:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147210.388743:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x313993942506279f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecfe expref: 12 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.388752:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147210.388759:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a21400, rc 0) 00000100:00100000:2.0:1746147210.388837:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310335232 00000100:00100000:2.0:1746147210.388843:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310335232 00010000:00010000:2.0:1746147210.388868:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33c00/0x3139939425062721 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecd4 expref: 13 pid: 12201 timeout: 848 lvb_type: 1 00000100:00100000:2.0:1746147210.388899:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8998 00000100:00100000:2.0:1746147210.388905:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2002:x1830967310335232:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147210.388917:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147210.388933:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33c00/0x3139939425062721 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecd4 expref: 13 pid: 12201 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.388944:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33c00/0x3139939425062721 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecd4 expref: 13 pid: 12201 timeout: 848 lvb_type: 1 00010000:00010000:2.0:1746147210.388962:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c33c00/0x3139939425062721 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecd4 expref: 13 pid: 12201 timeout: 848 lvb_type: 1 00000100:00100000:3.0:1746147210.389000:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2827:x1830967310335104:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5414us (5683us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.389007:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19796 00010000:00010000:2.0:1746147210.389467:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.389469:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.389475:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x313993942506279f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecfe expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.389483:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x313993942506279f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecfe expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.389511:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x313993942506279f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecfe expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147210.389522:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e484a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311455232:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147210.389588:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147210.390679:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e484a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311455232:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147210.390691:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147210.390792:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2002:x1830967310335232:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1885us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.390800:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8998 00000100:00100000:0.0:1746147210.391821:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.393318:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310335360 00000100:00100000:3.0:1746147210.393327:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310335360 00000100:00100000:3.0:1746147210.393378:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19797 00000100:00100000:3.0:1746147210.393386:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310335360:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:3.0:1746147210.393512:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147210.393515:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147207 -> 1746147209 00002000:00010000:3.0:1746147210.393516:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147206 -> 1746147209 00002000:00010000:3.0:1746147210.393518:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147207 -> 1746147210 00002000:00010000:3.0:1746147210.393520:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:3.0:1746147210.393562:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310335360:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 176us (1741us total) trans 21474842596 rc 0/0 00000100:00100000:3.0:1746147210.393567:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19797 00000100:00100000:0.0:1746147210.394252:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.394294:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310335488 00000100:00100000:3.0:1746147210.394298:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310335488 00000100:00100000:3.0:1746147210.394330:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19798 00000100:00100000:3.0:1746147210.394339:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310335488:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:3.0:1746147210.394403:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147210.394405:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:3.0:1746147210.394407:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147209 -> 1746147209 00002000:00010000:3.0:1746147210.394409:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147209 -> 1746147210 00002000:00010000:3.0:1746147210.394410:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147210.394442:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310335488:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 105us (190us total) trans 17179875215 rc 0/0 00000100:00100000:3.0:1746147210.394447:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19798 00000100:00100000:0.0:1746147210.395253:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.395280:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.395305:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.395325:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310335616 00000100:00100000:3.0:1746147210.395330:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310335616 00000100:00100000:0.0:1746147210.395341:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.395450:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310335872 00000100:00100000:3.0:1746147210.395453:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310335872 00000100:00100000:3.0:1746147210.395470:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310335744 00000100:00100000:3.0:1746147210.395472:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310335744 00000100:00100000:1.0:1746147210.395473:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310336000 00000100:00100000:1.0:1746147210.395477:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310336000 00000100:00100000:3.0:1746147210.395485:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19799 00000100:00100000:3.0:1746147210.395491:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310335872:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:1.0:1746147210.395499:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19800 00000100:00100000:1.0:1746147210.395505:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310335744:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:3.0:1746147210.395551:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:1.0:1746147210.395553:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147210.395554:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:3.0:1746147210.395556:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147209 -> 1746147209 00002000:00010000:1.0:1746147210.395556:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:3.0:1746147210.395558:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147209 -> 1746147210 00002000:00010000:1.0:1746147210.395558:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147209 -> 1746147209 00002000:00010000:3.0:1746147210.395559:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00002000:00010000:1.0:1746147210.395560:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147209 -> 1746147210 00002000:00010000:1.0:1746147210.395562:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147210.395585:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967310335872:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 94us (304us total) trans 21474842597 rc 0/0 00000100:00100000:3.0:1746147210.395591:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19799 00000100:00100000:3.0:1746147210.395602:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19801 00000100:00100000:3.0:1746147210.395607:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310336000:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:3.0:1746147210.395649:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147210.395651:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:3.0:1746147210.395653:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147208 -> 1746147209 00002000:00010000:3.0:1746147210.395655:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147209 -> 1746147210 00002000:00010000:3.0:1746147210.395656:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746147210.396304:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310335744:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 797us (995us total) trans 21474842598 rc 0/0 00000100:00100000:1.0:1746147210.396310:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19800 00000100:00100000:3.0:1746147210.396445:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310336000:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 836us (1102us total) trans 17179875216 rc 0/0 00000100:00100000:3.0:1746147210.396455:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19801 00000100:00100000:3.0:1746147210.396485:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19802 00000100:00100000:3.0:1746147210.396490:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310335616:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:3.0:1746147210.396542:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147210.396545:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:3.0:1746147210.396546:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147209 -> 1746147209 00002000:00010000:3.0:1746147210.396548:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147209 -> 1746147210 00002000:00010000:3.0:1746147210.396549:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746147210.396568:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310335616:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 78us (1316us total) trans 17179875217 rc 0/0 00000100:00100000:3.0:1746147210.396574:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19802 00000100:00100000:0.0:1746147210.400257:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.400367:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310336256 00000100:00100000:1.0:1746147210.400375:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310336256 00000100:00100000:1.0:1746147210.400544:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6139 00000100:00100000:1.0:1746147210.400552:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2827:x1830967310336256:12345-192.168.204.25@tcp:35:lfs.0 00000004:00010000:1.0:1746147210.400601:0:16750:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x30:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x31399394250626bf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec9c expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.400641:0:16750:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x31399394250627a6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16750 initiator: MDT0 00010000:00010000:1.0:1746147210.400650:0:16750:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x31399394250626fe lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eca3 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.400656:0:16750:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x31399394250627a6 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16750 initiator: MDT0 00010000:00010000:1.0:1746147210.401021:0:16750:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x31399394250626fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eca3 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.401032:0:16750:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x31399394250626fe lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eca3 expref: 10 pid: 7237 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746147210.401044:0:16750:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16750:1830967311455360:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147210.401831:0:16750:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147210.404339:0:16750:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16750:1830967311455360:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147210.404358:0:16750:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x31399394250627a6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16750 initiator: MDT0 00000100:00100000:0.0:1746147210.404462:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.404882:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310336384 00000100:00100000:2.0:1746147210.404889:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310336384 00010000:00010000:2.0:1746147210.404913:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x31399394250626fe lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eca3 expref: 11 pid: 7237 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.404933:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 8999 00000100:00100000:2.0:1746147210.404939:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310336384:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147210.404951:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147210.404956:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x31399394250626fe lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eca3 expref: 11 pid: 7237 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.404963:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x31399394250626fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eca3 expref: 11 pid: 7237 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.404979:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e05a00/0x31399394250626fe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eca3 expref: 11 pid: 7237 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.405002:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147210.405006:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x31399394250627a6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16750 initiator: MDT0 00010000:00010000:2.0:1746147210.405013:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x31399394250627a6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16750 initiator: MDT0 00010000:00010000:2.0:1746147210.405018:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x31399394250627a6 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16750 initiator: MDT0 00010000:00010000:2.0:1746147210.405031:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147210.405064:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310336384:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 125us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.405075:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 8999 00010000:00010000:1.0:1746147210.405340:0:16750:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x31399394250627a6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16750 initiator: MDT0 00010000:00010000:1.0:1746147210.405351:0:16750:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x31399394250627a6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16750 initiator: MDT0 00000040:00080000:1.0:1746147210.406384:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1245, 88 off117416 00000004:00080000:1.0:1746147210.406395:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748396304955ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147210.406433:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1246, 88 off117504 00000004:00080000:1.0:1746147210.406436:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748396346765ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147210.406448:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1247, 88 off117592 00000004:00080000:1.0:1746147210.406451:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748396362044ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147210.406460:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1246, 88 off117504 00000004:00080000:1.0:1746147210.406462:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748396372949ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147210.406470:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1247, 88 off117592 00000004:00080000:1.0:1746147210.406472:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748396382949ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147210.406479:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1248, 88 off117680 00000004:00080000:1.0:1746147210.406482:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748396392573ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147210.406489:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1249, 88 off117768 00000004:00080000:1.0:1746147210.406491:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748396401179ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147210.406497:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1250, 88 off117856 00000004:00080000:1.0:1746147210.406499:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748396409407ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147210.406505:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1248, 88 off117680 00000004:00080000:1.0:1746147210.406507:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748396417484ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147210.406512:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1251, 88 off117944 00000004:00080000:1.0:1746147210.406514:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748396424695ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147210.406519:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1249, 88 off117768 00000004:00080000:1.0:1746147210.406521:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748396431890ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147210.406527:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1252, 88 off118032 00000004:00080000:1.0:1746147210.406530:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748396440387ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147210.406537:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1250, 88 off117856 00000004:00080000:1.0:1746147210.406540:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748396450355ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147210.406547:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1251, 88 off117944 00000004:00080000:1.0:1746147210.406550:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748396460130ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147210.406556:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1252, 88 off118032 00000004:00080000:1.0:1746147210.406559:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748396469814ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147210.406566:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1253, 88 off118120 00000004:00080000:1.0:1746147210.406568:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748396478787ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147210.406575:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1253, 88 off118120 00000004:00080000:1.0:1746147210.406577:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748396487993ns, next at 694367916532ns, rc = 0 00000001:00080000:2.0:1746147210.408482:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937334 is committed 00000004:00080000:2.0:1746147210.408491:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1230 committed 00000004:00080000:2.0:1746147210.408498:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1233 committed 00000004:00080000:2.0:1746147210.408501:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1232 committed 00000004:00080000:2.0:1746147210.408503:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1231 committed 00000004:00080000:2.0:1746147210.408504:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1230 committed 00000004:00080000:2.0:1746147210.408506:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1229 committed 00000004:00080000:2.0:1746147210.408508:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1229 committed 00000004:00080000:2.0:1746147210.408510:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1228 committed 00000004:00080000:2.0:1746147210.408511:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1228 committed 00000004:00080000:2.0:1746147210.408512:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1227 committed 00000004:00080000:2.0:1746147210.408514:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1226 committed 00000004:00080000:2.0:1746147210.408515:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1225 committed 00000004:00080000:2.0:1746147210.408517:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1227 committed 00000004:00080000:2.0:1746147210.408518:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1226 committed 00000004:00080000:2.0:1746147210.408519:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1224 committed 00000004:00080000:2.0:1746147210.408520:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1223 committed 00000004:00080000:2.0:1746147210.408522:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1225 committed 00010000:00010000:3.0:1746147210.408616:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425062775 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147210.408627:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425062775 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147210.408632:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425062775 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147210.408637:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844b600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147210.408640:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425062775 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147210.408645:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425062775 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147210.408667:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147210.408669:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147210.408672:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425062775 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147210.408676:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x3139939425062775 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00000100:00100000:2.0:1746147210.408943:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311455616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.408991:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.409015:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746147210.409019:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311455488:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.409031:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.409046:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311455872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.409060:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147210.409124:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311455744:0@lo:2:osp-syn-0-0.0 00000004:00010000:1.0:1746147210.409174:0:16750:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012ca13b80 reply state ffff880098d13000 transno 8589937334 ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x31399394250627a6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16750 initiator: MDT0 00010000:00010000:1.0:1746147210.409185:0:16750:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x31399394250627a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16750 initiator: MDT0 00010000:00010000:1.0:1746147210.409191:0:16750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147210.409193:0:16750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746147210.409196:0:16750:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746147210.409200:0:16750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147210.409202:0:16750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746147210.409207:0:16750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x31399394250626bf lrc: 0/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ec9c expref: 7 pid: 7237 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1746147210.409275:0:16750:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746147210.409284:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2827:x1830967310336256:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 8732us (9033us total) trans 8589937334 rc 0/0 00000100:00100000:1.0:1746147210.409293:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6139 00010000:00010000:1.0:1746147210.409315:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x31399394250627a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16750 initiator: MDT0 00010000:00010000:1.0:1746147210.409322:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x31399394250627a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16750 initiator: MDT0 00010000:00010000:1.0:1746147210.409326:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x31399394250627a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16750 initiator: MDT0 00010000:00010000:1.0:1746147210.409331:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091e31c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147210.409334:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x31399394250627a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16750 initiator: MDT0 00010000:00010000:1.0:1746147210.409339:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x31399394250627a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16750 initiator: MDT0 00010000:00010000:1.0:1746147210.409345:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147210.409348:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147210.409350:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x31399394250627a6 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16750 initiator: MDT0 00010000:00010000:1.0:1746147210.409354:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091e31c00/0x31399394250627a6 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16750 initiator: MDT0 00000100:00100000:2.0:1746147210.410113:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746147210.410123:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311456256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.410144:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.410164:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311456128:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.410178:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.410187:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746147210.410191:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311456000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147210.410278:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311456512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147210.410292:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311455616 00000100:00100000:0.0:1746147210.410297:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311455616 00000100:00100000:3.0:1746147210.410300:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147210.410320:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311457024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147210.410321:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19803 00000100:00100000:0.0:1746147210.410327:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+66:3767:x1830967311455616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147210.410333:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147210.410346:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746147210.410350:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311456640:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147210.410361:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147210.410372:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311457152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147210.410384:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147210.410402:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311455488 00000100:00100000:3.0:1746147210.410405:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311455488 00000100:00100000:3.0:1746147210.410421:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311455872 00000100:00100000:3.0:1746147210.410423:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311455872 00002000:00010000:0.0:1746147210.410426:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147210.410429:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147210.410432:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147209 -> 1746147209 00000100:00100000:3.0:1746147210.410434:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311456256 00002000:00010000:0.0:1746147210.410434:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147210.410435:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147210.410436:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311456256 00000100:00100000:3.0:1746147210.410443:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311456128 00000100:00100000:3.0:1746147210.410445:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311456128 00000100:00100000:3.0:1746147210.410450:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311456512 00000100:00100000:3.0:1746147210.410451:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311456512 00000100:00100000:3.0:1746147210.410456:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311457024 00000100:00100000:3.0:1746147210.410457:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311457024 00000100:00100000:0.0:1746147210.410457:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+71:3767:x1830967311455616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 131us (1466us total) trans 21474842599 rc 0/0 00000100:00100000:3.0:1746147210.410462:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311456640 00000100:00100000:0.0:1746147210.410462:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19803 00000100:00100000:3.0:1746147210.410463:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311456640 00000100:00100000:3.0:1746147210.410469:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311457152 00000100:00100000:3.0:1746147210.410470:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311457152 00000100:00100000:0.0:1746147210.410472:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19804 00000100:00100000:0.0:1746147210.410476:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+70:3767:x1830967311455488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147210.410478:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19805 00000100:00100000:3.0:1746147210.410482:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+16:3765:x1830967311455872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147210.410506:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147210.410509:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147210.410511:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147210.410513:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147210.410515:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:0.0:1746147210.410529:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+71:3767:x1830967311455488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (1496us total) trans 21474842600 rc 0/0 00000100:00100000:0.0:1746147210.410533:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19804 00000100:00100000:0.0:1746147210.410542:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19806 00002000:00010000:3.0:1746147210.410546:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746147210.410546:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+70:3765:x1830967311456256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147210.410549:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:3.0:1746147210.410551:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147209 -> 1746147209 00002000:00010000:3.0:1746147210.410552:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147210 -> 1746147210 00002000:00010000:3.0:1746147210.410554:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147210.410574:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+17:3765:x1830967311455872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (1512us total) trans 17179875218 rc 0/0 00000100:00100000:3.0:1746147210.410579:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19805 00000100:00100000:0.0:1746147210.410583:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+71:3765:x1830967311456256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 37us (441us total) trans 21474842601 rc 0/0 00000100:00100000:0.0:1746147210.410588:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19806 00000100:00100000:3.0:1746147210.410591:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19807 00000100:00100000:3.0:1746147210.410595:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+70:3767:x1830967311456128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147210.410596:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19808 00000100:00100000:0.0:1746147210.410600:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+70:3766:x1830967311456512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147210.410624:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147210.410626:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147210.410628:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147210.410629:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147210.410631:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:0.0:1746147210.410649:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+72:3766:x1830967311456512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (348us total) trans 21474842602 rc 0/0 00000100:00100000:0.0:1746147210.410653:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19808 00000100:00100000:3.0:1746147210.410657:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+72:3767:x1830967311456128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (476us total) trans 21474842603 rc 0/0 00000100:00100000:3.0:1746147210.410673:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19807 00000100:00100000:0.0:1746147210.410676:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19809 00000100:00100000:0.0:1746147210.410680:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3766:x1830967311457024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147210.410683:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19810 00000100:00100000:3.0:1746147210.410686:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+16:3766:x1830967311456640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147210.410725:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3766:x1830967311457024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (391us total) trans 17179875219 rc 0/0 00000100:00100000:0.0:1746147210.410733:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19809 00000100:00100000:0.0:1746147210.410740:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19811 00000100:00100000:0.0:1746147210.410744:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3766:x1830967311457152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147210.410773:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:0.0:1746147210.410775:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:0.0:1746147210.410777:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147210.410779:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:0.0:1746147210.410781:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:0.0:1746147210.410793:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3766:x1830967311457152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (409us total) trans 17179875220 rc 0/0 00000100:00100000:0.0:1746147210.410797:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19811 00002000:00010000:3.0:1746147210.410835:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147210.410837:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:3.0:1746147210.410839:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147209 -> 1746147209 00002000:00010000:3.0:1746147210.410841:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147210 -> 1746147210 00002000:00010000:3.0:1746147210.410843:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746147210.410862:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+17:3766:x1830967311456640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 174us (498us total) trans 17179875221 rc 0/0 00000100:00100000:3.0:1746147210.410867:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19810 00000004:00080000:3.0:1746147210.410899:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca10e00/2, rc 0, transno 17179875221 00000100:00100000:3.0:1746147210.410903:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311456640:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147210.410917:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca13100/2, rc 0, transno 17179875220 00000100:00100000:3.0:1746147210.410920:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311457152:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147210.410928:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ed500/2, rc 0, transno 21474842602 00000100:00100000:3.0:1746147210.410934:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311456512:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147210.410940:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca13800/2, rc 0, transno 17179875219 00000100:00100000:3.0:1746147210.410942:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311457024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.411146:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746147210.411164:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ed880/2, rc 0, transno 21474842603 00000100:00100000:2.0:1746147210.411167:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311456128:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147210.411174:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ec700/2, rc 0, transno 21474842600 00000100:00100000:2.0:1746147210.411176:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311455488:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147210.411180:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311456000 00000004:00080000:2.0:1746147210.411181:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ef800/2, rc 0, transno 21474842599 00000100:00100000:3.0:1746147210.411183:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311456000 00000100:00100000:2.0:1746147210.411183:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311455616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.411186:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746147210.411191:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311457536:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147210.411198:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19812 00000100:00100000:2.0:1746147210.411202:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147210.411203:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+71:3767:x1830967311456000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.411216:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311457536 00000100:00100000:2.0:1746147210.411218:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311457536 00000100:00100000:2.0:1746147210.411232:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19813 00000100:00100000:2.0:1746147210.411236:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+73:3767:x1830967311457536:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147210.411244:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746147210.411247:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147210.411248:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147210.411249:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147210.411251:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:3.0:1746147210.411274:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+74:3767:x1830967311456000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (128us total) trans 21474842604 rc 0/0 00000100:00100000:3.0:1746147210.411278:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19812 00000100:00100000:2.0:1746147210.411282:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+74:3767:x1830967311457536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (79us total) trans 21474842605 rc 0/0 00000100:00100000:2.0:1746147210.411287:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19813 00000004:00080000:2.0:1746147210.411312:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d4380/2, rc 0, transno 21474842605 00000100:00100000:3.0:1746147210.411313:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311456384:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.411315:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311457536:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147210.411320:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ee300/2, rc 0, transno 21474842604 00000100:00100000:2.0:1746147210.411322:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311456000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147210.411330:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147210.411341:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311456896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.411350:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311456384 00000100:00100000:2.0:1746147210.411353:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311456384 00000100:00100000:3.0:1746147210.411355:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.411364:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311456896 00000100:00100000:3.0:1746147210.411365:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311457408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.411365:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311456896 00000100:00100000:2.0:1746147210.411375:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19814 00000100:00100000:3.0:1746147210.411379:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.411380:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3765:x1830967311456384:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147210.411394:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ef480/2, rc 0, transno 21474842601 00000100:00100000:3.0:1746147210.411397:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311456256:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147210.411404:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca10700/2, rc 0, transno 17179875218 00000100:00100000:3.0:1746147210.411406:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311455872:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147210.411412:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746147210.411416:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311456768:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147210.411420:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147210.411423:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:2.0:1746147210.411424:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147209 -> 1746147209 00002000:00010000:2.0:1746147210.411426:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147210 -> 1746147210 00002000:00010000:2.0:1746147210.411428:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746147210.411431:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147210.411443:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311457280:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.411446:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3765:x1830967311456384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (115us total) trans 17179875222 rc 0/0 00000100:00100000:2.0:1746147210.411451:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19814 00000100:00100000:3.0:1746147210.411457:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.411458:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311457408 00000100:00100000:2.0:1746147210.411460:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311457408 00000100:00100000:2.0:1746147210.411470:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311456768 00000004:00080000:3.0:1746147210.411471:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca12a00/2, rc 0, transno 17179875222 00000100:00100000:2.0:1746147210.411472:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311456768 00000100:00100000:3.0:1746147210.411474:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311456384:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.411479:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311457280 00000100:00100000:2.0:1746147210.411481:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311457280 00000100:00100000:3.0:1746147210.411487:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19815 00000100:00100000:3.0:1746147210.411492:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3765:x1830967311456896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.411494:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19816 00000100:00100000:2.0:1746147210.411498:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3765:x1830967311457408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.411533:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19817 00000100:00100000:2.0:1746147210.411537:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+73:3765:x1830967311456768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147210.411539:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147210.411541:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147210.411543:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147210.411544:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147210.411546:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746147210.411567:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3765:x1830967311456896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (211us total) trans 17179875223 rc 0/0 00002000:00010000:2.0:1746147210.411569:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:2.0:1746147210.411571:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00000100:00100000:3.0:1746147210.411572:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19815 00002000:00010000:2.0:1746147210.411573:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147210.411574:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147210.411576:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:3.0:1746147210.411581:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19818 00000100:00100000:3.0:1746147210.411585:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3765:x1830967311457280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.411593:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+74:3765:x1830967311456768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (162us total) trans 21474842606 rc 0/0 00000100:00100000:2.0:1746147210.411598:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19817 00000004:00080000:3.0:1746147210.411627:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d5f80/2, rc 0, transno 21474842606 00000100:00100000:3.0:1746147210.411631:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311456768:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.412463:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3765:x1830967311457408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 962us (1081us total) trans 17179875224 rc 0/0 00000100:00100000:1.0:1746147210.412465:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147210.412466:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca11500/2, rc 0, transno 17179875223 00000100:00100000:3.0:1746147210.412469:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311456896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.412470:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19816 00000004:00080000:3.0:1746147210.412476:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca13480/2, rc 0, transno 17179875224 00000100:00100000:3.0:1746147210.412478:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311457408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.412481:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311455744 00000100:00100000:2.0:1746147210.412484:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311455744 00000100:00100000:2.0:1746147210.412501:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19819 00000100:00100000:2.0:1746147210.412506:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+74:3764:x1830967311455744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147210.412550:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:2.0:1746147210.412552:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:2.0:1746147210.412554:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147209 -> 1746147209 00002000:00010000:2.0:1746147210.412556:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147210 -> 1746147210 00002000:00010000:2.0:1746147210.412558:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:2.0:1746147210.412594:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+75:3764:x1830967311455744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (129us total) trans 21474842607 rc 0/0 00000100:00100000:2.0:1746147210.412599:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19819 00000100:00100000:2.0:1746147210.412736:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3765:x1830967311457280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1150us (1278us total) trans 17179875225 rc 0/0 00000100:00100000:2.0:1746147210.412741:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19818 00000004:00080000:3.0:1746147210.412758:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca10000/2, rc 0, transno 17179875225 00000100:00100000:3.0:1746147210.412762:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311457280:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147210.412806:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ece00/2, rc 0, transno 21474842607 00000100:00100000:1.0:1746147210.412811:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311455744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147210.414258:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.414342:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310336512 00000100:00100000:2.0:1746147210.414347:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310336512 00000100:00100000:2.0:1746147210.414384:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16433 00000100:00100000:2.0:1746147210.414389:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+6:2827:x1830967310336512:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147210.414401:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.414414:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a200/0x31399394250627ad lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed05 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.414452:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a200/0x31399394250627ad lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed05 expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.414462:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a200/0x31399394250627ad lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed05 expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.414474:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147210.414476:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147210.414478:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844a200, rc 0) 00000100:00100000:2.0:1746147210.414503:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2827:x1830967310336512:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 114us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.414507:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16433 00000100:00100000:0.0:1746147210.419203:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.419261:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310336768 00000100:00100000:1.0:1746147210.419269:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310336768 00000100:00100000:1.0:1746147210.419582:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6140 00000100:00100000:1.0:1746147210.419589:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2827:x1830967310336768:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:1.0:1746147210.421135:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2827:x1830967310336768:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 1541us (1933us total) trans 8589937335 rc 0/0 00000100:00100000:1.0:1746147210.421145:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6140 00000100:00100000:0.0:1746147210.445935:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.446033:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310337024 00000100:00100000:3.0:1746147210.446043:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310337024 00000100:00100000:2.0:1746147210.446220:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16434 00000100:00100000:2.0:1746147210.446230:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2834:x1830967310337024:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147210.446250:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.446267:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x31399394250627b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed0c expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.446329:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446341:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446350:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446362:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250627c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446367:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250627c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446372:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250627c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446459:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250627c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446466:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250627c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446472:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250627c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147210.446480:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147210.446534:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446540:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627bb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446546:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446550:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844bc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147210.446553:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446557:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446565:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147210.446568:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147210.446571:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446579:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446734:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250627c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446740:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250627c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446744:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250627c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446748:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844ac00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147210.446751:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250627c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446756:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250627c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446762:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096e23700) 00010000:00010000:2.0:1746147210.446765:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147210.446767:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250627c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446772:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250627c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.446802:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844b600/0x31399394250627b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed0c expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.446812:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250627c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed0c expref: 28 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.446823:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147210.446826:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147210.446828:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844a800, rc 0) 00000100:00100000:2.0:1746147210.447819:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2834:x1830967310337024:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1587us (1889us total) trans 8589937336 rc 0/0 00000100:00100000:2.0:1746147210.447827:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16434 00000100:00100000:2.0:1746147210.457303:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311457664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746147210.457372:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147210.457477:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311457664 00000100:00100000:1.0:1746147210.457484:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311457664 00000100:00100000:1.0:1746147210.457532:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:1.0:1746147210.457539:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311457664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1746147210.457558:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1143731264 pending 2879488 free 3911233536 avail 3679711232 00000100:00100000:1.0:1746147210.457589:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311457664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.457595:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00080000:2.0:1746147210.457642:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147210.457676:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311457664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746147210.467965:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.468062:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310337280 00000100:00100000:2.0:1746147210.468071:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310337280 00000100:00100000:2.0:1746147210.468274:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16435 00000100:00100000:2.0:1746147210.468282:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2835:x1830967310337280:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147210.468300:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.468316:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250627d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed13 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.468378:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.468389:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.468398:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.468412:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250627e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.468417:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250627e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.468422:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250627e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.468497:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844be00/0x31399394250627ec lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.468505:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844be00/0x31399394250627ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.468510:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844be00/0x31399394250627ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147210.468517:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147210.468573:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.468579:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.468584:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.468589:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844bc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147210.468593:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.468598:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.468607:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147210.468610:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147210.468613:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.468618:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x31399394250627de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.469412:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250627e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.469419:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250627e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.469423:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250627e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.469427:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844a600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147210.469430:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250627e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.469434:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250627e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.469501:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096e23700) 00010000:00010000:2.0:1746147210.469504:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147210.469507:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250627e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.469511:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a600/0x31399394250627e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147210.469548:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844ac00/0x31399394250627d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed13 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.469559:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844be00/0x31399394250627ec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed13 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.469565:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147210.469567:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147210.469569:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844be00, rc 0) 00000100:00100000:2.0:1746147210.470359:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2835:x1830967310337280:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2076us (2400us total) trans 8589937337 rc 0/0 00000100:00100000:2.0:1746147210.470366:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16435 00000100:00100000:2.0:1746147210.479868:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.480367:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310337536 00000100:00100000:0.0:1746147210.480375:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310337536 00000100:00100000:1.0:1746147210.480497:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.481053:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.481129:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310337792 00000100:00100000:0.0:1746147210.481133:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310337792 00000100:00100000:0.0:1746147210.481156:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16436 00000100:00100000:0.0:1746147210.481162:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2840:x1830967310337536:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147210.481181:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147210.481195:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x31399394250627fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed1a expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.481279:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425062801 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147210.481291:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425062801 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147210.481300:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425062801 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:0.0:1746147210.481309:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147210.481387:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x31399394250627fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed1a expref: 31 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.481403:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425062801 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed1a expref: 30 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.481409:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147210.481411:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746147210.481414:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33800, rc 0) 00000100:00100000:0.0:1746147210.481450:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2840:x1830967310337536:12345-192.168.204.25@tcp:101:cat.0 Request processed in 288us (1593us total) trans 8589937338 rc 0/0 00000100:00100000:0.0:1746147210.481456:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16436 00000100:00100000:0.0:1746147210.481470:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16437 00000100:00100000:0.0:1746147210.481474:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2835:x1830967310337792:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147210.481483:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147210.481484:0:6215:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746147210.481495:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844be00/0x31399394250627ec lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed13 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.481502:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147210.481504:0:6215:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147210.481509:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009371da00/0x313993942506280f lrc: 2/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed21 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.481527:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147210.481533:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250627c9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed0c expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.481539:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a200/0x31399394250627ad lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed05 expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.481544:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425062801 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed1a expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.481548:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147210.481568:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425062801 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed1a expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.481579:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425062801 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed1a expref: 29 pid: 6215 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746147210.481588:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311457792:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147210.481647:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a200/0x31399394250627ad lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed05 expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.481655:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a200/0x31399394250627ad lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed05 expref: 7 pid: 6215 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746147210.481675:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca11880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311457920:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147210.481697:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250627c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed0c expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.481703:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250627c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed0c expref: 29 pid: 6215 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746147210.481709:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099157100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311458048:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147210.481722:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095affd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147210.482607:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310338048 00000100:00100000:3.0:1746147210.482612:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310338048 00000100:00100000:3.0:1746147210.482639:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16438 00000100:00100000:3.0:1746147210.482645:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2839:x1830967310338048:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147210.482652:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147210.482669:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38de00/0x313993942506281d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed28 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.482708:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425062824 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482715:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425062824 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482720:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425062824 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482730:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932e2a00/0x313993942506282b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482735:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932e2a00/0x313993942506282b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482740:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932e2a00/0x313993942506282b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482806:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b537ac00/0x3139939425062832 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482814:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b537ac00/0x3139939425062832 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482819:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b537ac00/0x3139939425062832 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:3.0:1746147210.482830:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147210.482871:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b537ac00/0x3139939425062832 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482877:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b537ac00/0x3139939425062832 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482882:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b537ac00/0x3139939425062832 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482886:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b537ac00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147210.482889:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b537ac00/0x3139939425062832 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482894:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b537ac00/0x3139939425062832 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482901:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147210.482903:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1746147210.482905:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b537ac00/0x3139939425062832 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482910:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b537ac00/0x3139939425062832 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482925:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425062824 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482930:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425062824 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482934:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425062824 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482942:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425062824 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482946:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38d800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147210.482948:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425062824 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482953:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425062824 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482959:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147210.482961:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147210.482964:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425062824 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482967:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425062824 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482973:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932e2a00/0x313993942506282b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482977:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932e2a00/0x313993942506282b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482981:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932e2a00/0x313993942506282b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482985:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932e2a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147210.482987:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932e2a00/0x313993942506282b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.482991:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932e2a00/0x313993942506282b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.483000:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800930f4000) 00010000:00010000:3.0:1746147210.483001:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147210.483003:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932e2a00/0x313993942506282b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.483007:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932e2a00/0x313993942506282b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147210.483032:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38de00/0x313993942506281d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed28 expref: 12 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.483039:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38de00/0x313993942506281d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed28 expref: 12 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.483045:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38de00, rc 0) 00000100:00100000:3.0:1746147210.483073:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2839:x1830967310338048:12345-192.168.204.25@tcp:101:cat.0 Request processed in 428us (2020us total) trans 8589937339 rc 301/301 00000100:00100000:3.0:1746147210.483078:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16438 00000100:00100000:2.0:1746147210.484881:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311457792:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.484891:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca11880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311457920:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.484897:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099157100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311458048:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.484925:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147210.485304:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.485456:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.485848:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.485942:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.485961:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310338560 00000100:00100000:0.0:1746147210.485966:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310338560 00000100:00100000:0.0:1746147210.486000:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16439 00000100:00100000:0.0:1746147210.486006:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2840:x1830967310338560:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147210.486026:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147210.486070:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310338176 00000100:00100000:2.0:1746147210.486070:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310338304 00000100:00100000:3.0:1746147210.486073:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310338176 00000100:00100000:2.0:1746147210.486073:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310338304 00010000:00010000:2.0:1746147210.486104:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a200/0x31399394250627ad lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed05 expref: 8 pid: 6215 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.486106:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425062801 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed1a expref: 31 pid: 6215 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746147210.486143:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310338432 00000100:00100000:1.0:1746147210.486147:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310338432 00010000:00010000:1.0:1746147210.486158:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250627c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed0c expref: 32 pid: 6215 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746147210.486172:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9000 00000100:00100000:1.0:1746147210.486176:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310338176:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147210.486186:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147210.486189:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425062801 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed1a expref: 32 pid: 6215 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.486199:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425062801 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed1a expref: 32 pid: 6215 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.486214:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c33800/0x3139939425062801 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed1a expref: 32 pid: 6215 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.486226:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147210.486230:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147210.486236:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147210.486240:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147210.486266:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967310338176:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 89us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.486271:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9000 00000100:00100000:1.0:1746147210.486283:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9001 00000100:00100000:1.0:1746147210.486286:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2001:x1830967310338304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147210.486292:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147210.486295:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a200/0x31399394250627ad lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed05 expref: 8 pid: 6215 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.486301:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a200/0x31399394250627ad lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed05 expref: 8 pid: 6215 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.486310:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a200/0x31399394250627ad lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed05 expref: 8 pid: 6215 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.486316:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147210.486318:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147210.486322:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147210.486326:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147210.486335:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2001:x1830967310338304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 48us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.486339:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9001 00000100:00100000:1.0:1746147210.486347:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9002 00000100:00100000:1.0:1746147210.486351:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310338432:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147210.486355:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147210.486358:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250627c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed0c expref: 30 pid: 6215 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.486364:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250627c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed0c expref: 30 pid: 6215 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.486371:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844a800/0x31399394250627c9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed0c expref: 30 pid: 6215 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.486376:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147210.486378:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147210.486384:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147210.486388:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147210.486401:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147210.486412:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310338432:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 60us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.486416:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9002 00010000:00010000:0.0:1746147210.486603:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425062840 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed2f expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.486642:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147210.486649:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425062840 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed2f expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.486676:0:9138:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147210.486686:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425062840 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed2f expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.486696:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147210.486697:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147210.486700:0:9138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425062840 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed2f expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.486705:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256f600, rc 0) 00000100:00100000:0.0:1746147210.486724:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2840:x1830967310338560:12345-192.168.204.25@tcp:101:cat.0 Request processed in 718us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.486729:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16439 00000100:00100000:0.0:1746147210.486761:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.486773:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310338688 00000100:00100000:0.0:1746147210.486775:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310338688 00000100:00100000:0.0:1746147210.486792:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16440 00000100:00100000:0.0:1746147210.486796:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2839:x1830967310338688:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147210.486804:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147210.486810:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x3139939425062847 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed36 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.486860:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x313993942506284e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.486867:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x313993942506284e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.486872:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x313993942506284e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147210.487246:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147210.487252:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00000040:00080000:3.0:1746147210.487460:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1254, 88 off118208 00000004:00080000:3.0:1746147210.487466:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748477376050ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147210.487500:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1254, 88 off118208 00000004:00080000:3.0:1746147210.487503:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748477413692ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147210.487514:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1255, 88 off118296 00000004:00080000:3.0:1746147210.487517:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748477427194ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147210.487525:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1255, 88 off118296 00000004:00080000:3.0:1746147210.487527:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748477437732ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147210.487535:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1256, 88 off118384 00000004:00080000:3.0:1746147210.487538:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748477448102ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147210.487546:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1256, 88 off118384 00000004:00080000:3.0:1746147210.487548:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748477458910ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147210.487555:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1257, 88 off118472 00000004:00080000:3.0:1746147210.487558:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748477468304ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147210.487564:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1258, 88 off118560 00000004:00080000:3.0:1746147210.487566:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748477476802ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147210.487572:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1257, 88 off118472 00000004:00080000:3.0:1746147210.487574:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748477484730ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147210.487582:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1259, 88 off118648 00000004:00080000:3.0:1746147210.487584:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748477494537ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147210.487591:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1258, 88 off118560 00000004:00080000:3.0:1746147210.487593:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748477503840ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147210.487601:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1260, 88 off118736 00000004:00080000:3.0:1746147210.487603:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748477513629ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147210.487609:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1259, 88 off118648 00000004:00080000:3.0:1746147210.487612:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748477522344ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147210.487620:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1260, 88 off118736 00000004:00080000:3.0:1746147210.487623:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748477533659ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147210.487716:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1261, 88 off118824 00000004:00080000:3.0:1746147210.487721:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748477631084ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147210.487744:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1262, 88 off118912 00000004:00080000:3.0:1746147210.487747:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748477657559ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147210.487785:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1261, 88 off118824 00000004:00080000:3.0:1746147210.487788:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748477698687ns, next at 694367916532ns, rc = 0 00000001:00080000:2.0:1746147210.489382:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937340 is committed 00000004:00080000:2.0:1746147210.489392:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1238 committed 00000004:00080000:2.0:1746147210.489398:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1242 committed 00000004:00080000:2.0:1746147210.489422:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1241 committed 00000004:00080000:2.0:1746147210.489424:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1240 committed 00000004:00080000:2.0:1746147210.489427:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1239 committed 00000004:00080000:2.0:1746147210.489429:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1237 committed 00000004:00080000:2.0:1746147210.489430:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1238 committed 00000004:00080000:2.0:1746147210.489432:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1236 committed 00000004:00080000:2.0:1746147210.489434:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1237 committed 00000004:00080000:2.0:1746147210.489436:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1235 committed 00000004:00080000:2.0:1746147210.489437:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1234 committed 00000004:00080000:2.0:1746147210.489439:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1233 committed 00000004:00080000:2.0:1746147210.489440:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1236 committed 00000004:00080000:2.0:1746147210.489441:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1235 committed 00000004:00080000:2.0:1746147210.489443:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1232 committed 00000004:00080000:2.0:1746147210.489444:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1231 committed 00000004:00080000:2.0:1746147210.489446:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1234 committed 00000001:00080000:2.0:1746147210.489454:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937338 is committed 00000001:00080000:2.0:1746147210.489466:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937335 is committed 00000100:00100000:2.0:1746147210.489838:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311458560:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.489901:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.489936:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311459072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.489960:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.489984:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746147210.489991:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311458432:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.490023:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.490043:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311458944:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.490064:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.490133:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311458560 00000100:00100000:2.0:1746147210.490140:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311458560 00000100:00100000:2.0:1746147210.490177:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311459072 00000100:00100000:2.0:1746147210.490181:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311459072 00000100:00100000:2.0:1746147210.490197:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311458432 00000100:00100000:2.0:1746147210.490201:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311458432 00000100:00100000:2.0:1746147210.490214:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311458944 00000100:00100000:2.0:1746147210.490217:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311458944 00000100:00100000:2.0:1746147210.490235:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19820 00000100:00100000:2.0:1746147210.490243:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3767:x1830967311458560:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147210.490356:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147210.490359:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147210.490361:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147210.490363:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147210.490364:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:2.0:1746147210.490389:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3767:x1830967311458560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 148us (489us total) trans 17179875226 rc 0/0 00000100:00100000:2.0:1746147210.490394:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19820 00000100:00100000:2.0:1746147210.490405:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19821 00000100:00100000:2.0:1746147210.490409:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3767:x1830967311459072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.490457:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3767:x1830967311459072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (498us total) trans 17179875227 rc 0/0 00000100:00100000:2.0:1746147210.490461:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19821 00000100:00100000:2.0:1746147210.490469:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19822 00000100:00100000:2.0:1746147210.490474:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3767:x1830967311458432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147210.490507:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147210.490509:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:2.0:1746147210.490511:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147209 -> 1746147209 00002000:00010000:2.0:1746147210.490513:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147210 -> 1746147210 00002000:00010000:2.0:1746147210.490514:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746147210.490528:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3767:x1830967311458432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (505us total) trans 17179875228 rc 0/0 00000100:00100000:2.0:1746147210.490533:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19822 00000100:00100000:2.0:1746147210.490541:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19823 00000100:00100000:2.0:1746147210.490545:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3767:x1830967311458944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.490586:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3767:x1830967311458944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (521us total) trans 17179875229 rc 0/0 00000100:00100000:2.0:1746147210.490591:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19823 00000004:00080000:2.0:1746147210.490620:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099155880/2, rc 0, transno 17179875228 00000100:00100000:2.0:1746147210.490624:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311458432:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147210.490630:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099156d80/2, rc 0, transno 17179875229 00000100:00100000:2.0:1746147210.490632:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311458944:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147210.490638:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099156a00/2, rc 0, transno 17179875226 00000100:00100000:2.0:1746147210.490641:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311458560:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147210.490645:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099154a80/2, rc 0, transno 17179875227 00000100:00100000:2.0:1746147210.490647:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311459072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.490668:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311458304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.490686:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.490698:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311458816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.490710:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.490720:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746147210.490724:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311458176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.490734:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.490743:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311458688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.490754:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.490768:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311458304 00000100:00100000:2.0:1746147210.490771:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311458304 00000100:00100000:2.0:1746147210.490784:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311458816 00000100:00100000:2.0:1746147210.490786:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311458816 00000100:00100000:2.0:1746147210.490793:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311458176 00000100:00100000:2.0:1746147210.490794:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311458176 00000100:00100000:2.0:1746147210.490802:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311458688 00000100:00100000:2.0:1746147210.490804:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311458688 00000100:00100000:2.0:1746147210.490810:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19824 00000100:00100000:2.0:1746147210.490815:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3765:x1830967311458304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147210.490853:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147210.490856:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:2.0:1746147210.490858:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147209 -> 1746147209 00002000:00010000:2.0:1746147210.490859:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147210 -> 1746147210 00002000:00010000:2.0:1746147210.490861:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746147210.490880:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3765:x1830967311458304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (193us total) trans 17179875230 rc 0/0 00000100:00100000:2.0:1746147210.490884:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19824 00000100:00100000:2.0:1746147210.490892:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19825 00000100:00100000:2.0:1746147210.490895:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3765:x1830967311458816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147210.490926:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:2.0:1746147210.490929:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:2.0:1746147210.490931:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147210.490932:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:2.0:1746147210.490934:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:2.0:1746147210.490948:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3765:x1830967311458816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (237us total) trans 17179875231 rc 0/0 00000100:00100000:2.0:1746147210.490953:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19825 00000100:00100000:2.0:1746147210.490961:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19826 00000100:00100000:2.0:1746147210.490965:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3765:x1830967311458176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147210.490995:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147210.490998:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:2.0:1746147210.490999:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147209 -> 1746147209 00002000:00010000:2.0:1746147210.491001:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147210 -> 1746147210 00002000:00010000:2.0:1746147210.491003:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746147210.491017:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3765:x1830967311458176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (282us total) trans 17179875232 rc 0/0 00000100:00100000:2.0:1746147210.491022:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19826 00000100:00100000:2.0:1746147210.491029:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19827 00000100:00100000:2.0:1746147210.491033:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3765:x1830967311458688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147210.491071:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3765:x1830967311458688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 38us (316us total) trans 17179875233 rc 0/0 00000100:00100000:2.0:1746147210.491076:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19827 00000004:00080000:2.0:1746147210.491123:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099155c00/2, rc 0, transno 17179875232 00000100:00100000:2.0:1746147210.491126:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311458176:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147210.491132:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099156680/2, rc 0, transno 17179875233 00000100:00100000:2.0:1746147210.491135:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311458688:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147210.491140:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099155f80/2, rc 0, transno 17179875230 00000100:00100000:2.0:1746147210.491142:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311458304:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147210.491147:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099154e00/2, rc 0, transno 17179875231 00000100:00100000:2.0:1746147210.491149:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311458816:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147210.491497:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311459200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147210.491522:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147210.491540:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311459200 00000100:00100000:0.0:1746147210.491544:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311459200 00000100:00100000:0.0:1746147210.491568:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19828 00000100:00100000:0.0:1746147210.491573:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+75:3764:x1830967311459200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147210.491628:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147210.491630:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147210.491632:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147210.491634:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147210.491635:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:0.0:1746147210.491667:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+76:3764:x1830967311459200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (135us total) trans 21474842608 rc 0/0 00000100:00100000:0.0:1746147210.491672:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19828 00000004:00080000:1.0:1746147210.491676:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d7b80/2, rc 0, transno 21474842608 00000100:00100000:1.0:1746147210.491681:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311459200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147210.491836:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746147210.491841:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311459328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147210.491857:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.492248:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311459584:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.492270:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.492284:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746147210.492287:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311459456:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.492300:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.492316:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311459328 00000100:00100000:2.0:1746147210.492319:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311459328 00000100:00100000:3.0:1746147210.492397:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311459968:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147210.492419:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147210.492431:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746147210.492435:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311460096:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147210.492446:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147210.492473:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311459712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147210.495734:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311459584 00000100:00100000:0.0:1746147210.495746:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311459584 00000100:00100000:0.0:1746147210.495794:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311459456 00000100:00100000:0.0:1746147210.495797:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311459456 00000100:00100000:0.0:1746147210.495807:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311459968 00000100:00100000:0.0:1746147210.495809:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311459968 00000100:00100000:0.0:1746147210.495819:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311460096 00000100:00100000:0.0:1746147210.495821:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311460096 00000100:00100000:0.0:1746147210.495835:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19829 00000100:00100000:0.0:1746147210.495841:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+80:3764:x1830967311459328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147210.495973:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147210.495977:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147210.495978:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147210.495982:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147210.495983:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147210.496046:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+81:3764:x1830967311459328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 203us (4185us total) trans 21474842609 rc 0/0 00000100:00100000:0.0:1746147210.496052:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19829 00000100:00100000:0.0:1746147210.496070:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19830 00000100:00100000:0.0:1746147210.496077:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+80:3767:x1830967311459584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147210.496161:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147210.496164:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147210.496166:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147210.496167:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147210.496169:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:0.0:1746147210.496200:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+81:3767:x1830967311459584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 123us (3927us total) trans 21474842610 rc 0/0 00000100:00100000:0.0:1746147210.496205:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19830 00000100:00100000:0.0:1746147210.496219:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19831 00000100:00100000:0.0:1746147210.496225:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+80:3767:x1830967311459456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147210.496281:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:0.0:1746147210.496284:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147210.496286:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147209 -> 1746147209 00002000:00010000:0.0:1746147210.496287:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147210.496289:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:0.0:1746147210.496317:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+81:3767:x1830967311459456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (4014us total) trans 21474842611 rc 0/0 00000100:00100000:0.0:1746147210.496322:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19831 00000100:00100000:0.0:1746147210.496336:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19832 00000100:00100000:0.0:1746147210.496342:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+80:3766:x1830967311459968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147210.496376:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147210.496379:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147210.496380:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147210.496382:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147210.496383:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:0.0:1746147210.496407:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+81:3766:x1830967311459968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (3987us total) trans 21474842612 rc 0/0 00000100:00100000:0.0:1746147210.496412:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19832 00000100:00100000:0.0:1746147210.496420:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19833 00000100:00100000:0.0:1746147210.496424:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+80:3766:x1830967311460096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147210.496461:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:0.0:1746147210.496463:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147210.496465:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147210.496466:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147210.496468:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:0.0:1746147210.496483:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+81:3766:x1830967311460096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (4035us total) trans 21474842613 rc 0/0 00000100:00100000:0.0:1746147210.496487:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19833 00000004:00080000:3.0:1746147210.496597:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d7100/2, rc 0, transno 21474842613 00000100:00100000:3.0:1746147210.496603:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311460096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147210.496634:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746147210.496680:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d4700/2, rc 0, transno 21474842611 00000100:00100000:2.0:1746147210.496684:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311459456:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147210.496694:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d7480/2, rc 0, transno 21474842610 00000100:00100000:2.0:1746147210.496697:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311459584:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.496712:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311459840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.496738:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147210.496759:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311459712 00000100:00100000:2.0:1746147210.496762:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311459712 00000100:00100000:2.0:1746147210.496776:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311459840 00000100:00100000:2.0:1746147210.496778:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311459840 00000100:00100000:2.0:1746147210.496786:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19834 00000100:00100000:2.0:1746147210.496790:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+82:3764:x1830967311459712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.496842:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+83:3764:x1830967311459712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (208us total) trans 21474842614 rc 0/0 00000100:00100000:2.0:1746147210.496847:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19834 00000100:00100000:2.0:1746147210.496856:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19835 00000100:00100000:2.0:1746147210.496860:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+82:3765:x1830967311459840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147210.496906:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+83:3765:x1830967311459840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (167us total) trans 21474842615 rc 0/0 00000100:00100000:2.0:1746147210.496910:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19835 00000004:00080000:2.0:1746147210.496929:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d5180/2, rc 0, transno 21474842615 00000100:00100000:2.0:1746147210.496932:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311459840:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147210.497137:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d6d80/2, rc 0, transno 21474842612 00000100:00100000:3.0:1746147210.497141:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311459968:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746147210.497183:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed21 expref: 11 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.497193:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147210.497195:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:1.0:1746147210.497196:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311460224:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746147210.497199:0:6215:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x313993942506284e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147210.497206:0:6215:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x313993942506284e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147210.497211:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x313993942506284e lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00000100:00100000:1.0:1746147210.497215:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746147210.497221:0:6215:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425062840 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed2f expref: 26 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.497227:0:6215:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425062840 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed2f expref: 26 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.497233:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425062840 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed2f expref: 26 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.497259:0:6215:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425062840 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed2f expref: 26 pid: 9138 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147210.497269:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311460352:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147210.497320:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962f00 going to sleep for 11 seconds 00000004:00080000:1.0:1746147210.497409:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d7800/2, rc 0, transno 21474842609 00000100:00100000:3.0:1746147210.497410:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311460224 00000100:00100000:3.0:1746147210.497412:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311460224 00000100:00100000:1.0:1746147210.497413:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311459328:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147210.497422:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d6300/2, rc 0, transno 21474842614 00000100:00100000:1.0:1746147210.497424:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311459712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147210.497436:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19836 00000100:00100000:3.0:1746147210.497441:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+83:3764:x1830967311460224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147210.497502:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+84:3764:x1830967311460224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (285us total) trans 21474842616 rc 0/0 00000100:00100000:3.0:1746147210.497506:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19836 00010000:00010000:3.0:1746147210.497529:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x313993942506284e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147210.497534:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x313993942506284e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147210.497569:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147210.497573:0:9138:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147210.497586:0:9138:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x313993942506284e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147210.497611:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f400/0x3139939425062847 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed36 expref: 12 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.497624:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x313993942506284e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed36 expref: 11 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.497630:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147210.497632:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746147210.497634:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256e600, rc 0) 00000100:00100000:3.0:1746147210.497655:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2839:x1830967310338688:12345-192.168.204.25@tcp:101:cat.0 Request processed in 10858us (10893us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.497670:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16440 00000004:00080000:1.0:1746147210.499076:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d4000/2, rc 0, transno 21474842616 00000100:00100000:1.0:1746147210.499085:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311460224:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147210.508215:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311460352:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147210.508258:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009371da00/0x313993942506280f lrc: 0/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed21 expref: 10 pid: 6215 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746147210.508291:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed21 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.508318:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371d800, rc 0) 00000100:00100000:3.0:1746147210.508355:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2835:x1830967310337792:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 26879us (27858us total) trans 8589937340 rc 0/0 00000100:00100000:3.0:1746147210.508362:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16437 00000100:00100000:0.0:1746147210.508773:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.508813:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.509061:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310338816 00000100:00100000:2.0:1746147210.509067:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310338816 00000100:00100000:2.0:1746147210.509125:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6141 00000100:00100000:2.0:1746147210.509131:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079238c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2840:x1830967310338816:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:2.0:1746147210.509195:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079238c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2840:x1830967310338816:12345-192.168.204.25@tcp:49:cat.0 Request processed in 63us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.509199:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6141 00000100:00100000:3.0:1746147210.509629:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310338944 00000100:00100000:3.0:1746147210.509636:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310338944 00000100:00100000:3.0:1746147210.509679:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16441 00000100:00100000:3.0:1746147210.509687:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2839:x1830967310338944:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147210.509698:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147210.509713:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3800/0x3139939425062855 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed3d expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.509753:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3800/0x3139939425062855 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed3d expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.509765:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3800/0x3139939425062855 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed3d expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.509780:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147210.509783:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147210.509786:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cd3800, rc 0) 00000100:00100000:3.0:1746147210.509818:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2839:x1830967310338944:12345-192.168.204.25@tcp:101:cat.0 Request processed in 132us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.509824:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16441 00000100:00100000:0.0:1746147210.515255:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.515637:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.515678:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.515994:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310339072 00000100:00100000:2.0:1746147210.516002:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310339072 00000100:00100000:2.0:1746147210.516044:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310339328 00000100:00100000:2.0:1746147210.516046:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310339328 00000100:00100000:2.0:1746147210.516719:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310339200 00000100:00100000:2.0:1746147210.516723:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310339200 00000100:00100000:0.0:1746147210.525352:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19837 00000100:00100000:0.0:1746147210.525368:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310339072:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147210.525386:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147210.525403:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x313993942506285c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed44 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.525452:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099155500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311460480:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147210.525523:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095affd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.525621:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.525640:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310339456 00000100:00100000:0.0:1746147210.525646:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310339456 00000100:00100000:0.0:1746147210.525687:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19838 00000100:00100000:0.0:1746147210.525693:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2835:x1830967310339328:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147210.525700:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147210.525707:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x3139939425062863 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed52 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.525722:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a20e00/0x3139939425062798 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf7 expref: 18 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.525729:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147210.525731:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147210.525734:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x3139939425062863 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2482176->2580479] (req 2482176->2580479) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed52 expref: 20 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.525752:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a20e00/0x3139939425062798 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf7 expref: 18 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.525766:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a20e00/0x3139939425062798 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf7 expref: 18 pid: 1853 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746147210.525774:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311460608:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147210.525793:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ec10b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.525811:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19839 00000100:00100000:0.0:1746147210.525817:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2840:x1830967310339200:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147210.525824:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147210.525829:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091f28800/0x313993942506286a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed4b expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.525840:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942506277c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecdb expref: 18 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.525845:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147210.525846:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147210.525848:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091f28800/0x313993942506286a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed4b expref: 34 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.525861:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942506277c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecdb expref: 18 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.525868:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942506277c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecdb expref: 18 pid: 1853 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746147210.525880:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311460736:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147210.525897:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.525931:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.525958:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.525968:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310339712 00000100:00100000:0.0:1746147210.525971:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310339712 00000100:00100000:0.0:1746147210.525983:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310339968 00000100:00100000:0.0:1746147210.525984:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310339968 00000100:00100000:0.0:1746147210.525992:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19840 00000100:00100000:0.0:1746147210.525997:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310339456:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147210.526003:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147210.526010:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425062871 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed59 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.526028:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311460864:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147210.526042:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.526053:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19841 00000100:00100000:0.0:1746147210.526057:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310339712:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147210.526061:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147210.526065:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425062878 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed67 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.526079:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311460992:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147210.526111:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.526123:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19842 00000100:00100000:0.0:1746147210.526128:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2000:x1830967310339968:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147210.526132:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147210.526138:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x313993942506287f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed75 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.526152:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311461120:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147210.526164:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984899c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.526186:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.526198:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310339584 00000100:00100000:0.0:1746147210.526201:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310339584 00000100:00100000:0.0:1746147210.526216:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19843 00000100:00100000:0.0:1746147210.526220:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310339584:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147210.526225:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147210.526231:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f400/0x3139939425062886 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed60 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.526248:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311461248:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147210.526263:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.526300:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.526310:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310339840 00000100:00100000:0.0:1746147210.526313:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310339840 00000100:00100000:0.0:1746147210.526325:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19844 00000100:00100000:0.0:1746147210.526329:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310339840:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147210.526334:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147210.526339:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ea00/0x313993942506288d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed6e expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.526357:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311461376:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147210.526371:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1c4e40 going to sleep for 11 seconds 00010000:00010000:0.0:1746147210.530979:0:10340:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942506277c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecdb expref: 18 pid: 1853 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746147210.531008:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099155500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311460480:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147210.531037:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x313993942506285c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed44 expref: 24 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147210.531049:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x313993942506285c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed44 expref: 24 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147210.531059:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098226400, rc 0) 00000100:00100000:0.0:1746147210.531138:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310339072:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5775us (15889us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147210.531146:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19837 00000100:00100000:0.0:1746147210.531214:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311460608:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147210.531229:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x3139939425062863 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2482176->2580479] (req 2482176->2580479) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed52 expref: 22 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.531240:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098227000, rc 0) 00000100:00100000:0.0:1746147210.531254:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2835:x1830967310339328:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5561us (15617us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.531259:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19838 00000100:00100000:2.0:1746147210.532368:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.532431:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310340096 00000100:00100000:3.0:1746147210.532437:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310340096 00010000:00010000:3.0:1746147210.532462:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a20e00/0x3139939425062798 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf7 expref: 19 pid: 1853 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.532483:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9003 00000100:00100000:3.0:1746147210.532489:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310340096:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147210.532501:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147210.532514:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a20e00/0x3139939425062798 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf7 expref: 19 pid: 1853 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.532523:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a20e00/0x3139939425062798 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf7 expref: 19 pid: 1853 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.532540:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.532542:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.532547:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x3139939425062863 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2482176->2580479) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed52 expref: 21 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.532553:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x3139939425062863 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2482176->2580479) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed52 expref: 21 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.532577:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x3139939425062863 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2482176->2580479) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed52 expref: 21 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147210.532586:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311461504:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147210.532891:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.534419:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311460736:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147210.534455:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091f28800/0x313993942506286a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed4b expref: 34 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.534473:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f28800, rc 0) 00000100:00100000:0.0:1746147210.534526:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2840:x1830967310339200:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8707us (18844us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.534534:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19839 00000100:00100000:2.0:1746147210.536069:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.536174:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310340224 00000100:00100000:3.0:1746147210.536181:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310340224 00010000:00010000:3.0:1746147210.536214:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942506277c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecdb expref: 20 pid: 1853 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.536526:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9004 00000100:00100000:3.0:1746147210.536533:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967310340224:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147210.536548:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147210.536570:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942506277c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecdb expref: 20 pid: 1853 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.536584:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942506277c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecdb expref: 20 pid: 1853 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.536609:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091e31800/0x313993942506277c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecdb expref: 20 pid: 1853 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.537263:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.537266:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.537276:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091f28800/0x313993942506286a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed4b expref: 33 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.537284:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091f28800/0x313993942506286a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed4b expref: 33 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.537323:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091f28800/0x313993942506286a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed4b expref: 33 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147210.537335:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311461632:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147210.537413:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20000 going to sleep for 11 seconds 00010000:00010000:1.0:1746147210.538636:0:13712:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88009844b200/0x3139939425062783 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece2 expref: 13 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147210.538678:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311460864:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147210.538707:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425062871 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed59 expref: 22 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.538719:0:13712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1c00/0x3139939425062871 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed59 expref: 22 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.538742:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1c00, rc 0) 00000100:00100000:1.0:1746147210.538790:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310339456:12345-192.168.204.25@tcp:101:cat.0 Request processed in 12791us (13169us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147210.538797:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19840 00010000:00010000:2.0:1746147210.555199:0:1854:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff880095a21600/0x3139939425062791 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf0 expref: 19 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147210.555235:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311460992:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147210.555272:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425062878 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed67 expref: 21 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147210.555286:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425062878 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed67 expref: 21 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147210.555309:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1200, rc 0) 00000100:00100000:2.0:1746147210.555358:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310339712:12345-192.168.204.25@tcp:101:cat.0 Request processed in 29298us (29424us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147210.555367:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19841 00000100:00100000:2.0:1746147210.555477:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311461632:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147210.555491:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147210.555512:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310340224:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 18980us (19449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.555520:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9004 00000100:00100000:3.0:1746147210.555782:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311461504:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147210.555795:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147210.555822:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310340096:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 23334us (23458us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.555828:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9003 00010000:00010000:0.0:1746147210.557864:0:13695:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x313993942506279f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecfe expref: 13 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.557897:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311461120:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147210.557924:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x313993942506287f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed75 expref: 20 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147210.557936:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x313993942506287f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed75 expref: 20 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147210.557952:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8fc00, rc 0) 00000100:00100000:0.0:1746147210.558027:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2000:x1830967310339968:12345-192.168.204.25@tcp:101:cat.0 Request processed in 31897us (32066us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147210.558034:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19842 00010000:00010000:0.0:1746147210.558068:0:12225:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x313993942506278a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece9 expref: 13 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.558141:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311461248:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147210.558423:0:1136:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff8801349a1500 x1830967311461376) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880095a20e00/0x3139939425062798 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf7 expref: 17 pid: 1853 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.558449:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a20e00/0x3139939425062798 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf7 expref: 17 pid: 1853 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746147210.558475:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311461376:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147210.558495:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ea00/0x313993942506288d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed6e expref: 19 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.558504:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ea00/0x313993942506288d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed6e expref: 19 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.558511:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8ea00, rc 0) 00000100:00100000:1.0:1746147210.558532:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310339840:12345-192.168.204.25@tcp:101:cat.0 Request processed in 32202us (32231us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147210.558538:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19844 00010000:00010000:0.0:1746147210.558695:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f400/0x3139939425062886 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed60 expref: 18 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147210.558704:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8f400/0x3139939425062886 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed60 expref: 18 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147210.558712:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8f400, rc 0) 00000100:00100000:0.0:1746147210.558729:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310339584:12345-192.168.204.25@tcp:101:cat.0 Request processed in 32508us (32543us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147210.558735:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19843 00000100:00100000:3.0:1746147210.559137:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.559180:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.559182:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310340480 00000100:00100000:2.0:1746147210.559189:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310340480 00002000:00100000:2.0:1746147210.559226:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2482176->2486271) req@ffff88009258f800 x1830967310340480/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.559235:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258f800 with x1830967310340480 ext(2482176->2486271) 00002000:00010000:2.0:1746147210.559239:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258f800 00000100:00100000:2.0:1746147210.559253:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310340736 00000100:00100000:2.0:1746147210.559255:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310340736 00002000:00100000:2.0:1746147210.559267:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88009258df80 x1830967310340736/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.559273:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258df80 with x1830967310340736 ext(0->1048575) 00002000:00010000:2.0:1746147210.559276:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258df80 00000100:00100000:2.0:1746147210.559288:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7282 00000100:00100000:2.0:1746147210.559294:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310340480:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147210.559336:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7283 00000100:00100000:3.0:1746147210.559342:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310340736:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147210.559415:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310340480:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 121us (279us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147210.559420:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7282 00002000:00100000:2.0:1746147210.559425:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2482176->2486271) req@ffff88009258f800 x1830967310340480/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/4536 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.559431:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258f800 with x1830967310340480 ext(2482176->2486271) 00002000:00010000:2.0:1746147210.559434:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258f800 00000100:00100000:0.0:1746147210.564466:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.564571:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310340992 00000100:00100000:1.0:1746147210.564582:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310340992 00002000:00100000:1.0:1746147210.564630:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2576384->2580479) req@ffff8801349a2d80 x1830967310340992/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147210.564641:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2d80 with x1830967310340992 ext(2576384->2580479) 00002000:00010000:1.0:1746147210.564647:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a2d80 00000100:00100000:0.0:1746147210.564868:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.564885:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310341120 00000100:00100000:0.0:1746147210.564888:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310341120 00000100:00100000:0.0:1746147210.564910:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19845 00000100:00100000:0.0:1746147210.564917:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2839:x1830967310341120:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147210.564932:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147210.564949:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e000/0x3139939425062894 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed7c expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.564971:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147210.564972:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147210.564979:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e000/0x3139939425062894 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed7c expref: 20 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.564993:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e000/0x3139939425062894 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed7c expref: 20 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.565007:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8e000, rc 0) 00000100:00100000:0.0:1746147210.565045:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2839:x1830967310341120:12345-192.168.204.25@tcp:101:cat.0 Request processed in 129us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.565051:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19845 00000100:00100000:1.0:1746147210.565154:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7284 00000100:00100000:1.0:1746147210.565160:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310340992:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147210.565258:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310340992:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 98us (804us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147210.565263:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7284 00002000:00100000:1.0:1746147210.565267:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2576384->2580479) req@ffff8801349a2d80 x1830967310340992/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/4536 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147210.565273:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2d80 with x1830967310340992 ext(2576384->2580479) 00002000:00010000:1.0:1746147210.565276:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a2d80 00000100:00100000:3.0:1746147210.567185:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310340736:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7836us (7997us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147210.567194:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7283 00002000:00100000:3.0:1746147210.567202:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88009258df80 x1830967310340736/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/440 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.567210:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258df80 with x1830967310340736 ext(0->1048575) 00002000:00010000:3.0:1746147210.567214:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258df80 00000100:00100000:0.0:1746147210.575339:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.575400:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.575465:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310341632 00000100:00100000:1.0:1746147210.575475:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310341632 00000100:00100000:1.0:1746147210.575538:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6142 00000100:00100000:1.0:1746147210.575546:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2835:x1830967310341632:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147210.575784:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2835:x1830967310341632:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 238us (383us total) trans 8589937341 rc 0/0 00000100:00100000:1.0:1746147210.575792:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6142 00000100:00100000:3.0:1746147210.576825:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310341376 00000100:00100000:3.0:1746147210.576831:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310341376 00002000:00100000:3.0:1746147210.576863:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff8801349a0e00 x1830967310341376/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.576873:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a0e00 with x1830967310341376 ext(0->1048575) 00002000:00010000:3.0:1746147210.576878:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a0e00 00000100:00100000:3.0:1746147210.576902:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7285 00000100:00100000:3.0:1746147210.576906:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310341376:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147210.585836:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.585902:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310341760 00000100:00100000:1.0:1746147210.585912:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310341760 00000100:00100000:1.0:1746147210.585972:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19846 00000100:00100000:1.0:1746147210.585980:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2840:x1830967310341760:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147210.585997:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147210.586441:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942506289b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed83 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.586481:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009844b200/0x3139939425062783 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece2 expref: 13 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.586489:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147210.586491:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147210.586494:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942506289b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed83 expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.586527:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009844b200/0x3139939425062783 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece2 expref: 13 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.586548:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009844b200/0x3139939425062783 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece2 expref: 13 pid: 1853 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746147210.586561:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311461760:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147210.586670:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147210.588632:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.588698:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310341888 00000100:00100000:2.0:1746147210.588705:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310341888 00010000:00010000:2.0:1746147210.588740:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009844b200/0x3139939425062783 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece2 expref: 14 pid: 1853 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.588777:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9005 00000100:00100000:2.0:1746147210.588784:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310341888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147210.588797:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147210.588817:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009844b200/0x3139939425062783 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece2 expref: 14 pid: 1853 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.588829:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009844b200/0x3139939425062783 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece2 expref: 14 pid: 1853 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.588852:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.588854:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.588860:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942506289b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed83 expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.588872:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942506289b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed83 expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.588901:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942506289b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed83 expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147210.588911:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311461888:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147210.588987:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009844b200/0x3139939425062783 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece2 expref: 14 pid: 1853 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746147210.589018:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311461760:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147210.589046:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942506289b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed83 expref: 27 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.589059:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05a00, rc 0) 00000100:00100000:3.0:1746147210.589167:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310341376:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12258us (13838us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147210.589173:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147210.589176:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7285 00002000:00100000:3.0:1746147210.589183:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff8801349a0e00 x1830967310341376/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/440 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.589192:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a0e00 with x1830967310341376 ext(0->1048575) 00002000:00010000:3.0:1746147210.589197:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801349a0e00 00000100:00100000:0.0:1746147210.589830:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2840:x1830967310341760:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3849us (4005us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.589837:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19846 00000100:00100000:2.0:1746147210.595834:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311461888:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147210.595860:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147210.595928:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310341888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7142us (7303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.595940:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9005 00000100:00100000:0.0:1746147210.600246:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.600522:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310342144 00000100:00100000:3.0:1746147210.600532:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310342144 00002000:00100000:3.0:1746147210.600583:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8801349a1f80 x1830967310342144/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.600593:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a1f80 with x1830967310342144 ext(1048576->2097151) 00002000:00010000:3.0:1746147210.600599:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a1f80 00000100:00100000:0.0:1746147210.600801:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.600822:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310342272 00000100:00100000:0.0:1746147210.600825:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310342272 00000100:00100000:0.0:1746147210.600850:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19847 00000100:00100000:0.0:1746147210.600856:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2839:x1830967310342272:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147210.600875:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147210.600893:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009844a200/0x31399394250628a2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed8a expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.600918:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147210.600920:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147210.600927:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009844a200/0x31399394250628a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed8a expref: 18 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.600940:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009844a200/0x31399394250628a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed8a expref: 18 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.600950:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844a200, rc 0) 00000100:00100000:0.0:1746147210.600994:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2839:x1830967310342272:12345-192.168.204.25@tcp:101:cat.0 Request processed in 138us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.601000:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19847 00000100:00100000:3.0:1746147210.601148:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7286 00000100:00100000:3.0:1746147210.601154:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310342144:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147210.606363:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.606470:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310342528 00000100:00100000:1.0:1746147210.606479:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310342528 00002000:00100000:1.0:1746147210.606523:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8801349a2300 x1830967310342528/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147210.606533:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2300 with x1830967310342528 ext(1048576->2097151) 00002000:00010000:1.0:1746147210.606539:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a2300 00000100:00100000:1.0:1746147210.606575:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7287 00000100:00100000:1.0:1746147210.606583:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310342528:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147210.615633:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310342144:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14465us (15386us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147210.615647:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7286 00002000:00100000:3.0:1746147210.616076:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8801349a1f80 x1830967310342144/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/440 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.616087:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a1f80 with x1830967310342144 ext(1048576->2097151) 00002000:00010000:3.0:1746147210.616127:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a1f80 00000100:00100000:1.0:1746147210.621961:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310342528:12345-192.168.204.25@tcp:3:cat.0 Request processed in 15362us (15701us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147210.621975:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7287 00002000:00100000:1.0:1746147210.621988:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8801349a2300 x1830967310342528/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/440 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147210.621996:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2300 with x1830967310342528 ext(1048576->2097151) 00002000:00010000:1.0:1746147210.622002:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a2300 00000100:00100000:0.0:1746147210.622137:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.623332:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310342656 00000100:00100000:1.0:1746147210.623341:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310342656 00000100:00100000:1.0:1746147210.623398:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19848 00000100:00100000:1.0:1746147210.623406:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2840:x1830967310342656:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147210.623422:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147210.623442:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a73600/0x31399394250628a9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed91 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.623471:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x313993942506278a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece9 expref: 12 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.623479:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147210.623481:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147210.623485:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a73600/0x31399394250628a9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed91 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.623569:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x313993942506278a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece9 expref: 12 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.623587:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x313993942506278a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece9 expref: 12 pid: 1853 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746147210.623599:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311462016:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147210.623701:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.629222:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.629311:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310342784 00000100:00100000:2.0:1746147210.629322:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310342784 00000100:00100000:2.0:1746147210.629795:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19849 00000100:00100000:2.0:1746147210.629803:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2839:x1830967310342784:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147210.629823:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.629843:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f03cc00/0x31399394250628b0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed98 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.629872:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147210.629877:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03cc00/0x31399394250628b0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed98 expref: 19 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.629894:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f03cc00/0x31399394250628b0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed98 expref: 19 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.629904:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03cc00, rc 0) 00000100:00100000:2.0:1746147210.629982:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2839:x1830967310342784:12345-192.168.204.25@tcp:101:cat.0 Request processed in 179us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.629988:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19849 00000100:00100000:3.0:1746147210.630789:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.630845:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310342912 00000100:00100000:2.0:1746147210.630850:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310342912 00000100:00100000:1.0:1746147210.630922:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311462016:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147210.630944:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a73600/0x31399394250628a9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed91 expref: 28 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.630954:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a73600, rc 0) 00000100:00100000:1.0:1746147210.630980:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2840:x1830967310342656:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7575us (8843us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.630986:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19848 00010000:00010000:2.0:1746147210.631310:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x313993942506278a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece9 expref: 13 pid: 1853 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.631343:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9006 00000100:00100000:2.0:1746147210.631349:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310342912:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147210.631361:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147210.631381:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x313993942506278a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece9 expref: 13 pid: 1853 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.631391:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x313993942506278a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece9 expref: 13 pid: 1853 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.631412:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a21200/0x313993942506278a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ece9 expref: 13 pid: 1853 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.631427:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.631430:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.631436:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a73600/0x31399394250628a9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed91 expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.631442:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a73600/0x31399394250628a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed91 expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.631449:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.631450:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.631452:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f03cc00/0x31399394250628b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed98 expref: 18 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.631458:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03cc00/0x31399394250628b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed98 expref: 18 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.631483:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f03cc00/0x31399394250628b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed98 expref: 18 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147210.631494:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311462144:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147210.631549:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098a73600/0x31399394250628a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed91 expref: 27 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147210.631557:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311462272:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147210.631572:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147210.637919:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311462144:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147210.637934:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311462272:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147210.637956:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147210.638017:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310342912:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6666us (7226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.638028:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9006 00000100:00100000:0.0:1746147210.640381:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.640510:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310343168 00000100:00100000:1.0:1746147210.640520:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310343168 00002000:00100000:1.0:1746147210.640573:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff8801349a0a80 x1830967310343168/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147210.640582:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a0a80 with x1830967310343168 ext(1048576->2097151) 00002000:00010000:1.0:1746147210.640588:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a0a80 00000100:00100000:1.0:1746147210.640622:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7288 00000100:00100000:1.0:1746147210.640630:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310343168:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147210.647941:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.648340:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310343424 00000100:00100000:3.0:1746147210.648352:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310343424 00002000:00100000:3.0:1746147210.648401:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff8801349a3800 x1830967310343424/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.648412:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a3800 with x1830967310343424 ext(1048576->2097151) 00002000:00010000:3.0:1746147210.648419:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a3800 00000100:00100000:3.0:1746147210.648459:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7289 00000100:00100000:3.0:1746147210.648468:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2000:x1830967310343424:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147210.652186:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310343168:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11544us (11803us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147210.652206:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7288 00002000:00100000:1.0:1746147210.652219:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff8801349a0a80 x1830967310343168/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/440 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147210.652229:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a0a80 with x1830967310343168 ext(1048576->2097151) 00002000:00010000:1.0:1746147210.652236:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a0a80 00000100:00100000:3.0:1746147210.664700:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2000:x1830967310343424:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16221us (16761us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147210.664712:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7289 00002000:00100000:3.0:1746147210.664724:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff8801349a3800 x1830967310343424/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/440 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.664734:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a3800 with x1830967310343424 ext(1048576->2097151) 00002000:00010000:3.0:1746147210.664739:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a3800 00000100:00100000:0.0:1746147210.666031:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.666103:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.666121:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310343552 00000100:00100000:0.0:1746147210.666121:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310343680 00000100:00100000:2.0:1746147210.666128:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310343552 00000100:00100000:0.0:1746147210.666128:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310343680 00000100:00100000:2.0:1746147210.666185:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19850 00000100:00100000:2.0:1746147210.666193:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2834:x1830967310343552:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147210.666210:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.666231:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ed9f expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.666262:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x3139939425062863 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2580479) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed52 expref: 18 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.666270:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147210.666272:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147210.666275:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3026944->3145727] (req 3026944->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.666307:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x3139939425062863 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2580479) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed52 expref: 18 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.666319:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x3139939425062863 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2580479) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed52 expref: 18 pid: 17600 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.666330:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311462400:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.666401:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.666901:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19851 00000100:00100000:0.0:1746147210.666908:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2840:x1830967310343680:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147210.666918:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147210.666927:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098447e00/0x31399394250628be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eda6 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.666942:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a21600/0x3139939425062791 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf0 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.666948:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147210.666949:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147210.666952:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098447e00/0x31399394250628be lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eda6 expref: 37 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.666967:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a21600/0x3139939425062791 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf0 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.666975:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a21600/0x3139939425062791 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf0 expref: 16 pid: 1853 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746147210.666983:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095063800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311462528:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147210.667019:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1c4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147210.669022:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095063800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311462528:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.669053:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098447e00/0x31399394250628be lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eda6 expref: 37 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.669071:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098447e00, rc 0) 00000100:00100000:3.0:1746147210.669270:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311462400:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147210.669292:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3026944->3145727] (req 3026944->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 37 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.669305:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504fa00, rc 0) 00000100:00100000:2.0:1746147210.669421:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2840:x1830967310343680:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2512us (3329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.669429:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19851 00000100:00100000:3.0:1746147210.669537:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2834:x1830967310343552:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3344us (3507us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.669542:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19850 00000100:00100000:1.0:1746147210.669574:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.669597:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310343936 00000100:00100000:3.0:1746147210.669604:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310343936 00002000:00100000:3.0:1746147210.669640:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2482176->2580479) req@ffff88012bab4000 x1830967310343936/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.669649:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab4000 with x1830967310343936 ext(2482176->2580479) 00010000:00010000:3.0:1746147210.669668:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x3139939425062863 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed52 expref: 19 pid: 17600 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.669679:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x3139939425062863 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed52 expref: 19 pid: 17600 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746147210.669687:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bab4000 00000100:00100000:3.0:1746147210.669703:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1709 00000100:00100000:3.0:1746147210.669710:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2002:x1830967310343936:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147210.669794:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.669810:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310343808 00000100:00100000:2.0:1746147210.669813:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310343808 00010000:00010000:2.0:1746147210.669829:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a21600/0x3139939425062791 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf0 expref: 17 pid: 1853 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.669847:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9007 00000100:00100000:2.0:1746147210.669851:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310343808:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147210.669860:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147210.669874:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a21600/0x3139939425062791 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf0 expref: 17 pid: 1853 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.669883:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a21600/0x3139939425062791 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf0 expref: 17 pid: 1853 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.669901:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a21600/0x3139939425062791 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecf0 expref: 17 pid: 1853 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.669923:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.669926:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.669932:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098447e00/0x31399394250628be lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eda6 expref: 35 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.669939:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098447e00/0x31399394250628be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eda6 expref: 35 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.669963:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098447e00/0x31399394250628be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eda6 expref: 35 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147210.669973:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311462656:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147210.670014:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147210.671942:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.672222:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311462656:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147210.672241:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147210.672410:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310343808:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2556us (2614us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.672421:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9007 00000100:00100000:0.0:1746147210.672696:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310344064 00000100:00100000:0.0:1746147210.672703:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310344064 00000100:00100000:0.0:1746147210.672742:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19852 00000100:00100000:0.0:1746147210.672750:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2839:x1830967310344064:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147210.672846:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2002:x1830967310343936:12345-192.168.204.25@tcp:4:cat.0 Request processed in 3136us (3273us total) trans 21474842617 rc 0/0 00000100:00100000:2.0:1746147210.672854:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1709 00002000:00100000:2.0:1746147210.672864:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2482176->2580479) req@ffff88012bab4000 x1830967310343936/t21474842617(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/448 e 0 to 0 dl 1746147221 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.672873:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab4000 with x1830967310343936 ext(2482176->2580479) 00010000:00010000:2.0:1746147210.672882:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x3139939425062863 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed52 expref: 22 pid: 17600 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.672895:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x3139939425062863 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed52 expref: 22 pid: 17600 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746147210.672902:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bab4000 00010000:00010000:0.0:1746147210.672931:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147210.672950:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x31399394250628c5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7edad expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.672976:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147210.672978:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147210.672985:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x31399394250628c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edad expref: 22 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.672999:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x31399394250628c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edad expref: 22 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.673009:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098447a00, rc 0) 00000100:00100000:0.0:1746147210.673029:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2839:x1830967310344064:12345-192.168.204.25@tcp:101:cat.0 Request processed in 280us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.673034:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19852 00000100:00100000:0.0:1746147210.674288:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.674389:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.674564:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310344448 00000100:00100000:3.0:1746147210.674569:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310344448 00010000:00010000:3.0:1746147210.674593:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x3139939425062863 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed52 expref: 22 pid: 17600 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.674616:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9008 00000100:00100000:3.0:1746147210.674621:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2002:x1830967310344448:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147210.674630:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147210.674646:0:13715:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147209 -> 1746147210 00010000:00010000:3.0:1746147210.674652:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x3139939425062863 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed52 expref: 22 pid: 17600 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.674673:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x3139939425062863 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2580479) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed52 expref: 22 pid: 17600 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.674692:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098227000/0x3139939425062863 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2580479) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed52 expref: 22 pid: 17600 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.674719:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.674720:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.674726:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.674734:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.674763:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147210.674775:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311462784:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147210.674841:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f203c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147210.674903:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310344320 00000100:00100000:2.0:1746147210.674908:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310344320 00002000:00100000:2.0:1746147210.674935:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880095061180 x1830967310344320/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.674944:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095061180 with x1830967310344320 ext(1048576->2097151) 00002000:00010000:2.0:1746147210.674948:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095061180 00000100:00100000:2.0:1746147210.674962:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7290 00000100:00100000:2.0:1746147210.674968:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310344320:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147210.676766:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.676909:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310344704 00000100:00100000:3.0:1746147210.676915:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310344704 00002000:00100000:3.0:1746147210.676950:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880095060700 x1830967310344704/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.676960:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095060700 with x1830967310344704 ext(1048576->2097151) 00002000:00010000:3.0:1746147210.676965:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095060700 00000100:00100000:3.0:1746147210.676983:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7291 00000100:00100000:3.0:1746147210.676988:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310344704:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147210.679260:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.679318:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310344960 00000100:00100000:0.0:1746147210.679325:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310344960 00002000:00100000:0.0:1746147210.679367:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3026944->3031039) req@ffff88009514e680 x1830967310344960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147210.679378:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514e680 with x1830967310344960 ext(3026944->3031039) 00002000:00010000:0.0:1746147210.679384:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514e680 00000100:00100000:0.0:1746147210.679403:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7292 00000100:00100000:0.0:1746147210.679412:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310344960:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147210.679545:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310344960:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 134us (294us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147210.679556:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7292 00002000:00100000:0.0:1746147210.679563:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3026944->3031039) req@ffff88009514e680 x1830967310344960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/4536 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147210.679570:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514e680 with x1830967310344960 ext(3026944->3031039) 00002000:00010000:0.0:1746147210.679573:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514e680 00000100:00100000:3.0:1746147210.679731:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311462784:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147210.679750:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147210.679965:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2002:x1830967310344448:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5342us (5575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.679975:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9008 00000100:00100000:3.0:1746147210.687806:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967310344704:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10802us (11035us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147210.687820:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7291 00002000:00100000:3.0:1746147210.687831:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880095060700 x1830967310344704/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/440 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.687841:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095060700 with x1830967310344704 ext(1048576->2097151) 00002000:00010000:3.0:1746147210.687848:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095060700 00000100:00100000:0.0:1746147210.695077:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.695114:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.695467:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310345216 00000100:00100000:1.0:1746147210.695467:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310345088 00000100:00100000:3.0:1746147210.695474:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310345216 00000100:00100000:1.0:1746147210.695474:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310345088 00000100:00100000:1.0:1746147210.695521:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19853 00000100:00100000:1.0:1746147210.695528:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310345088:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147210.695545:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147210.695565:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x31399394250628cc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7edb4 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147210.695616:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311462912:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147210.695675:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.696140:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.696372:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310345344 00000100:00100000:3.0:1746147210.696376:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310345344 00000100:00100000:3.0:1746147210.696395:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19854 00000100:00100000:3.0:1746147210.696400:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2834:x1830967310345216:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147210.696410:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147210.696421:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x31399394250628d3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7edbb expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147210.696436:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310344320:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 20298us (20981us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746147210.696440:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x313993942506279f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecfe expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.696446:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1746147210.696447:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7290 00010000:00010000:3.0:1746147210.696448:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147210.696452:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x31399394250628d3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3010559] (req 2097152->3010559) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edbb expref: 29 pid: 13695 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147210.696457:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880095061180 x1830967310344320/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/440 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.696466:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095061180 with x1830967310344320 ext(1048576->2097151) 00002000:00010000:2.0:1746147210.696470:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095061180 00010000:00010000:3.0:1746147210.696478:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x313993942506279f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecfe expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.696490:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x313993942506279f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecfe expref: 11 pid: 1853 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.696494:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19855 00000100:00100000:3.0:1746147210.696500:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311463040:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.696500:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2000:x1830967310345344:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147210.696506:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.696511:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x31399394250628da lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7edc2 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147210.696533:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311463168:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147210.696535:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f203c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147210.696550:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.700586:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.701266:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311463040:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147210.701308:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x31399394250628d3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3010559] (req 2097152->3010559) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edbb expref: 29 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.701328:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2b800, rc 0) 00000100:00100000:3.0:1746147210.701386:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2834:x1830967310345216:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4983us (6317us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.701396:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19854 00000100:00100000:3.0:1746147210.701442:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310345472 00000100:00100000:3.0:1746147210.701448:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310345472 00010000:00010000:3.0:1746147210.701474:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x313993942506279f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecfe expref: 12 pid: 1853 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.701498:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9009 00000100:00100000:3.0:1746147210.701505:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310345472:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147210.701518:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147210.701540:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x313993942506279f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecfe expref: 12 pid: 1853 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.701552:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x313993942506279f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecfe expref: 12 pid: 1853 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.701575:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.701577:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.701584:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x31399394250628d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3010559) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edbb expref: 28 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.701593:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x31399394250628d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3010559) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edbb expref: 28 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.701621:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x31399394250628d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3010559) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edbb expref: 28 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147210.701633:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311463296:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147210.701699:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f203c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746147210.701791:0:12225:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746147209 -> 1746147210 00000100:00100000:1.0:1746147210.701804:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311462912:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147210.701823:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x31399394250628cc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edb4 expref: 22 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.701832:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x31399394250628cc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edb4 expref: 22 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.701853:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57c00, rc 0) 00000100:00100000:1.0:1746147210.701871:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310345088:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6344us (6756us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147210.701877:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19853 00010000:00010000:2.0:1746147210.703145:0:1854:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x313993942506279f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecfe expref: 12 pid: 1853 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.703172:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x313993942506279f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ecfe expref: 12 pid: 1853 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.703205:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311463168:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147210.703230:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x31399394250628da lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edc2 expref: 20 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147210.703241:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009504f000/0x31399394250628da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edc2 expref: 20 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147210.703248:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504f000, rc 0) 00000100:00100000:2.0:1746147210.703552:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2000:x1830967310345344:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6808us (7168us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147210.703561:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19855 00000100:00100000:3.0:1746147210.705722:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311463296:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147210.705746:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147210.705804:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310345472:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4298us (5227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.705815:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9009 00000100:00100000:0.0:1746147210.711171:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.711215:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.711343:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310345856 00000100:00100000:3.0:1746147210.711353:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310345856 00002000:00100000:3.0:1746147210.711399:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3026943) req@ffff880095061c00 x1830967310345856/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.711411:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095061c00 with x1830967310345856 ext(2097152->3026943) 00002000:00010000:3.0:1746147210.711415:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095061c00 00000100:00100000:3.0:1746147210.711444:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7293 00000100:00100000:3.0:1746147210.711452:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310345856:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147210.712216:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310345600 00000100:00100000:2.0:1746147210.712228:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310345600 00000100:00100000:2.0:1746147210.712293:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19856 00000100:00100000:2.0:1746147210.712301:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2839:x1830967310345600:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147210.712317:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.712333:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009504e400/0x31399394250628e1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7edc9 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.712359:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 37 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.712371:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147210.712373:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147210.712376:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009504e400/0x31399394250628e1 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edc9 expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.712403:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 37 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.712414:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 37 pid: 12225 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.712424:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311463424:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.712511:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147210.716204:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.716376:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310346112 00000100:00100000:0.0:1746147210.716385:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310346112 00002000:00100000:0.0:1746147210.716430:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (3006464->3010559) req@ffff88012bab5f80 x1830967310346112/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147210.716441:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab5f80 with x1830967310346112 ext(3006464->3010559) 00002000:00010000:0.0:1746147210.716446:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bab5f80 00000100:00100000:0.0:1746147210.716505:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7294 00000100:00100000:0.0:1746147210.716513:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967310346112:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147210.716518:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311463424:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.716545:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009504e400/0x31399394250628e1 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edc9 expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.716560:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504e400, rc 0) 00000100:00100000:2.0:1746147210.716600:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2839:x1830967310345600:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4300us (5438us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.716607:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19856 00000100:00100000:0.0:1746147210.716622:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967310346112:12345-192.168.204.25@tcp:3:cat.0 Request processed in 111us (429us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147210.716627:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7294 00002000:00100000:0.0:1746147210.716632:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (3006464->3010559) req@ffff88012bab5f80 x1830967310346112/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/4536 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147210.716643:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab5f80 with x1830967310346112 ext(3006464->3010559) 00002000:00010000:0.0:1746147210.716646:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bab5f80 00000100:00100000:0.0:1746147210.721212:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.721347:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310346240 00000100:00100000:3.0:1746147210.721357:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310346240 00002000:00100000:3.0:1746147210.721402:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3026944->3145727) req@ffff880095062300 x1830967310346240/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.721412:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095062300 with x1830967310346240 ext(3026944->3145727) 00010000:00010000:3.0:1746147210.721422:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 38 pid: 12225 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.721436:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 38 pid: 12225 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746147210.721442:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095062300 00000100:00100000:3.0:1746147210.721464:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1710 00000100:00100000:3.0:1746147210.721471:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310346240:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147210.721806:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310345856:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10354us (10588us total) trans 0 rc 929792/929792 00000100:00100000:2.0:1746147210.721813:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7293 00002000:00100000:2.0:1746147210.721820:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3026943) req@ffff880095061c00 x1830967310345856/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/440 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 929792/929792 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.721827:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095061c00 with x1830967310345856 ext(2097152->3026943) 00010000:00010000:2.0:1746147210.721831:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 38 pid: 12225 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.721839:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 38 pid: 12225 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746147210.721844:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095061c00 00000100:00100000:3.0:1746147210.726199:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310346240:12345-192.168.204.25@tcp:4:cat.0 Request processed in 4717us (4985us total) trans 21474842618 rc 0/0 00000100:00100000:3.0:1746147210.726213:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1710 00002000:00100000:3.0:1746147210.726226:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3026944->3145727) req@ffff880095062300 x1830967310346240/t21474842618(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/448 e 0 to 0 dl 1746147221 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.726243:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095062300 with x1830967310346240 ext(3026944->3145727) 00010000:00010000:3.0:1746147210.726253:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 38 pid: 12225 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.726271:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 38 pid: 12225 timeout: 848 lvb_type: 0 00002000:00010000:3.0:1746147210.726279:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095062300 00000100:00100000:1.0:1746147210.728904:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.728948:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.728975:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.729033:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.730034:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310346496 00000100:00100000:2.0:1746147210.730044:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310346496 00000100:00100000:2.0:1746147210.730123:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6143 00000100:00100000:2.0:1746147210.730131:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2834:x1830967310346496:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147210.730351:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2834:x1830967310346496:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 219us (1455us total) trans 8589937342 rc 0/0 00000100:00100000:2.0:1746147210.730358:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6143 00000100:00100000:2.0:1746147210.730392:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310346752 00000100:00100000:2.0:1746147210.730395:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310346752 00002000:00100000:2.0:1746147210.730420:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (3010560->3145727) req@ffff88012bab4a80 x1830967310346752/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.730430:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab4a80 with x1830967310346752 ext(3010560->3145727) 00002000:00010000:2.0:1746147210.730436:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bab4a80 00000100:00100000:2.0:1746147210.730456:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310347008 00000100:00100000:2.0:1746147210.730459:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310347008 00002000:00100000:2.0:1746147210.730477:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88012bab6d80 x1830967310347008/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.730486:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab6d80 with x1830967310347008 ext(3145728->4194303) 00010000:00010000:2.0:1746147210.730493:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 38 pid: 12225 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.730508:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 38 pid: 12225 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746147210.730514:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bab6d80 00000100:00100000:2.0:1746147210.730526:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310347264 00000100:00100000:2.0:1746147210.730529:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310347264 00002000:00100000:2.0:1746147210.730545:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff88012bab4700 x1830967310347264/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.730551:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab4700 with x1830967310347264 ext(3145728->4194303) 00002000:00010000:2.0:1746147210.730554:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bab4700 00000100:00100000:2.0:1746147210.730564:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1711 00000100:00100000:2.0:1746147210.730569:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310347008:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147210.732776:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7295 00000100:00100000:0.0:1746147210.732799:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310346752:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147210.733013:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7296 00000100:00100000:3.0:1746147210.733022:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967310347264:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147210.746925:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967310346752:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14121us (17962us total) trans 0 rc 135168/135168 00000100:00100000:1.0:1746147210.746938:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7295 00002000:00100000:1.0:1746147210.746952:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (3010560->3145727) req@ffff88012bab4a80 x1830967310346752/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/440 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 135168/135168 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147210.746961:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab4a80 with x1830967310346752 ext(3010560->3145727) 00002000:00010000:1.0:1746147210.746967:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bab4a80 00000100:00100000:2.0:1746147210.747855:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310347008:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17282us (18875us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147210.747863:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1711 00002000:00100000:2.0:1746147210.747870:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88012bab6d80 x1830967310347008/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/440 e 0 to 0 dl 1746147221 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.747877:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab6d80 with x1830967310347008 ext(3145728->4194303) 00010000:00010000:2.0:1746147210.747886:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 38 pid: 12225 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.747906:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 38 pid: 12225 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746147210.747912:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bab6d80 00000100:00100000:3.0:1746147210.753483:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310347264:12345-192.168.204.25@tcp:3:cat.0 Request processed in 20451us (24438us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147210.753497:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7296 00002000:00100000:3.0:1746147210.753509:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff88012bab4700 x1830967310347264/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/440 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.753519:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab4700 with x1830967310347264 ext(3145728->4194303) 00002000:00010000:3.0:1746147210.753525:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bab4700 00000100:00100000:0.0:1746147210.758574:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.758678:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310347392 00000100:00100000:3.0:1746147210.758688:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310347392 00010000:00010000:3.0:1746147210.758734:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 38 pid: 12225 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.758768:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9010 00000100:00100000:3.0:1746147210.758777:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967310347392:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147210.758793:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147210.758815:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 38 pid: 12225 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.758830:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 38 pid: 12225 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.758856:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009504fa00/0x31399394250628b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed9f expref: 38 pid: 12225 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.758893:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.758896:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.758905:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009504e400/0x31399394250628e1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edc9 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.758913:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009504e400/0x31399394250628e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edc9 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.758950:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009504e400/0x31399394250628e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edc9 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147210.758965:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311463552:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147210.759067:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147210.759974:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.760280:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310347520 00000100:00100000:2.0:1746147210.760285:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310347520 00000100:00100000:0.0:1746147210.760304:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311463552:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147210.760319:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147210.760333:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19857 00000100:00100000:2.0:1746147210.760340:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2840:x1830967310347520:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147210.760355:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.760371:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x31399394250628e8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7edd0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.760389:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.760391:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.760395:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x31399394250628e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd0 expref: 39 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.760407:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x31399394250628e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd0 expref: 39 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.760408:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2002:x1830967310347392:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1633us (1847us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147210.760415:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009372d000, rc 0) 00000100:00100000:0.0:1746147210.760416:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9010 00000100:00100000:2.0:1746147210.760434:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2840:x1830967310347520:12345-192.168.204.25@tcp:101:cat.0 Request processed in 95us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.760439:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19857 00000100:00100000:0.0:1746147210.764751:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.764950:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.765014:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310347776 00000100:00100000:2.0:1746147210.765024:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310347776 00000100:00100000:3.0:1746147210.765046:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310348032 00000100:00100000:3.0:1746147210.765051:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310348032 00002000:00100000:3.0:1746147210.765073:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880095060380 x1830967310348032/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.765074:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880095062a00 x1830967310347776/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.765083:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095060380 with x1830967310348032 ext(2097152->3145727) 00002000:00100000:2.0:1746147210.765083:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095062a00 with x1830967310347776 ext(3145728->4194303) 00002000:00010000:3.0:1746147210.765114:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095060380 00002000:00010000:2.0:1746147210.765120:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095062a00 00000100:00100000:3.0:1746147210.765149:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7297 00000100:00100000:3.0:1746147210.765158:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310348032:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147210.766217:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7298 00000100:00100000:2.0:1746147210.766227:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310347776:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147210.774876:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310348032:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9706us (9913us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147210.774890:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7297 00002000:00100000:3.0:1746147210.774904:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880095060380 x1830967310348032/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/440 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.774914:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095060380 with x1830967310348032 ext(2097152->3145727) 00002000:00010000:3.0:1746147210.774921:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095060380 00000100:00100000:2.0:1746147210.775858:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310347776:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9628us (11112us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147210.775866:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7298 00002000:00100000:2.0:1746147210.775871:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880095062a00 x1830967310347776/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/440 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.775879:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095062a00 with x1830967310347776 ext(3145728->4194303) 00002000:00010000:2.0:1746147210.775882:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095062a00 00000100:00100000:0.0:1746147210.784386:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.784541:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.784629:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310348416 00000100:00100000:3.0:1746147210.784638:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310348416 00002000:00100000:3.0:1746147210.784691:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880095063480 x1830967310348416/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.784702:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095063480 with x1830967310348416 ext(4194304->4890623) 00002000:00010000:3.0:1746147210.784707:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095063480 00000100:00100000:3.0:1746147210.784727:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7299 00000100:00100000:3.0:1746147210.784734:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967310348416:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147210.785385:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310348288 00000100:00100000:2.0:1746147210.785390:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310348288 00000100:00100000:2.0:1746147210.785422:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19858 00000100:00100000:2.0:1746147210.785428:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2839:x1830967310348288:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147210.785438:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.785455:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009372c800/0x31399394250628ef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7edd7 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.785480:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x31399394250628d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3010559) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edbb expref: 28 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.785488:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147210.785490:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147210.785494:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009372c800/0x31399394250628ef lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd7 expref: 20 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.785523:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x31399394250628d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3010559) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edbb expref: 28 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.785535:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x31399394250628d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3010559) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edbb expref: 28 pid: 13695 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.785546:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311463680:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.785612:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caad80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147210.792845:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311463680:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.792878:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009372c800/0x31399394250628ef lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd7 expref: 20 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.792895:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009372c800, rc 0) 00000100:00100000:2.0:1746147210.792949:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2839:x1830967310348288:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7519us (8572us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.792958:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19858 00000100:00100000:0.0:1746147210.795625:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.796050:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310348544 00000100:00100000:2.0:1746147210.796061:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310348544 00000100:00100000:3.0:1746147210.796238:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967310348416:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11502us (11694us total) trans 0 rc 696320/696320 00000100:00100000:3.0:1746147210.796249:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7299 00002000:00100000:3.0:1746147210.796261:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880095063480 x1830967310348416/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/440 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.796271:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095063480 with x1830967310348416 ext(4194304->4890623) 00002000:00010000:3.0:1746147210.796277:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095063480 00002000:00100000:2.0:1746147210.796864:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3010559) req@ffff880095063b80 x1830967310348544/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.796874:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095063b80 with x1830967310348544 ext(2097152->3010559) 00010000:00010000:2.0:1746147210.796883:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x31399394250628d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edbb expref: 29 pid: 13695 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.796899:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x31399394250628d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edbb expref: 29 pid: 13695 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746147210.796906:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095063b80 00000100:00100000:2.0:1746147210.796939:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1712 00000100:00100000:2.0:1746147210.796946:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310348544:12345-192.168.204.25@tcp:4:cat.0 00010000:00010000:1.0:1746147210.812643:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147210.816023:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.816058:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310348800 00000100:00100000:0.0:1746147210.816066:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310348800 00000100:00100000:0.0:1746147210.816146:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16442 00000100:00100000:0.0:1746147210.816153:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2845:x1830967310348800:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147210.816172:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147210.816187:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43e00/0x31399394250628f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7edde expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.816251:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43200/0x31399394250628fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816268:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43200/0x31399394250628fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816276:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43200/0x31399394250628fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816287:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x3139939425062904 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816294:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x3139939425062904 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816299:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x3139939425062904 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816378:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942506290b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816386:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942506290b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816391:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942506290b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:0.0:1746147210.816399:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147210.816457:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43200/0x31399394250628fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816462:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43200/0x31399394250628fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816469:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43200/0x31399394250628fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816474:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43200/0x31399394250628fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816478:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d43200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147210.816481:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43200/0x31399394250628fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816487:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43200/0x31399394250628fd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816496:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147210.816498:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147210.816502:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43200/0x31399394250628fd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816507:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43200/0x31399394250628fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816520:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x3139939425062904 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816525:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x3139939425062904 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816529:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x3139939425062904 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816532:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d42600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147210.816535:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x3139939425062904 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816542:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x3139939425062904 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816547:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f2c4e00) 00010000:00010000:0.0:1746147210.816549:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147210.816550:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x3139939425062904 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816555:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x3139939425062904 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.816582:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43e00/0x31399394250628f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edde expref: 14 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.816592:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942506290b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edde expref: 13 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.816597:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147210.816599:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147210.816601:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d42000, rc 0) 00000100:00100000:1.0:1746147210.816817:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.816839:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310348928 00000100:00100000:1.0:1746147210.816843:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310348928 00000100:00100000:1.0:1746147210.816865:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19859 00000100:00100000:1.0:1746147210.816869:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967310348928:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147210.816877:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147210.816887:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x3139939425062919 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ede5 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147210.816923:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311463808:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147210.816972:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967310348544:12345-192.168.204.25@tcp:4:cat.0 Request processed in 20025us (21356us total) trans 17179875234 rc 0/0 00000100:00100000:2.0:1746147210.816982:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1712 00000100:00100000:1.0:1746147210.816988:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b600 going to sleep for 11 seconds 00002000:00100000:2.0:1746147210.816994:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3010559) req@ffff880095063b80 x1830967310348544/t17179875234(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/448 e 0 to 0 dl 1746147221 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.817003:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095063b80 with x1830967310348544 ext(2097152->3010559) 00010000:00010000:2.0:1746147210.817009:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x31399394250628d3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edbb expref: 33 pid: 13695 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.817020:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x31399394250628d3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edbb expref: 33 pid: 13695 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746147210.817026:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095063b80 00000100:00100000:0.0:1746147210.817927:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2845:x1830967310348800:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1772us (1909us total) trans 8589937343 rc 0/0 00000100:00100000:0.0:1746147210.817933:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16442 00000100:00100000:0.0:1746147210.826693:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00010000:1.0:1746147210.827594:0:1854:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime: 1746147209 -> 1746147210 00002000:00010000:1.0:1746147210.827598:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime: 1746147209 -> 1746147210 00000100:00100000:1.0:1746147210.827616:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311463808:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147210.827641:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x3139939425062919 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ede5 expref: 32 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.827663:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1000/0x3139939425062919 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ede5 expref: 32 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.827681:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe1000, rc 0) 00000100:00100000:1.0:1746147210.827720:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967310348928:12345-192.168.204.25@tcp:101:cat.0 Request processed in 10850us (10902us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147210.827728:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19859 00000100:00100000:0.0:1746147210.828041:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.828061:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310349184 00000100:00100000:0.0:1746147210.828066:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310349184 00010000:00010000:0.0:1746147210.828100:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x31399394250628d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edbb expref: 31 pid: 13695 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746147210.828125:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9011 00000100:00100000:0.0:1746147210.828130:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967310349184:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147210.828141:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147210.828149:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x31399394250628d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edbb expref: 31 pid: 13695 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746147210.828158:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x31399394250628d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3010559) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edbb expref: 31 pid: 13695 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746147210.828173:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b800/0x31399394250628d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3010559) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edbb expref: 31 pid: 13695 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746147210.828186:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147210.828187:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147210.828193:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009372c800/0x31399394250628ef lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd7 expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.828200:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009372c800/0x31399394250628ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd7 expref: 19 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147210.828740:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310349056 00000100:00100000:2.0:1746147210.828744:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310349056 00000100:00100000:2.0:1746147210.828767:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19860 00000100:00100000:2.0:1746147210.828772:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2845:x1830967310349056:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147210.828786:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.828796:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7edec expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.828811:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009372c800/0x31399394250628ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd7 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.828817:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.828818:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.828821:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [4149248->4194303] (req 4149248->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.828842:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009372c800/0x31399394250628ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd7 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.828852:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009372c800/0x31399394250628ef lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70080400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd7 expref: 21 pid: 1854 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.828861:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311463936:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147210.828889:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009372c800/0x31399394250628ef lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd7 expref: 21 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.828897:0:13715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009372c800/0x31399394250628ef lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd7 expref: 21 pid: 1854 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.828905:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311464064:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147210.828927:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caad80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147210.829724:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147210.835755:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.835862:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311464064:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147210.835880:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147210.835917:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310349184:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7786us (7875us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.835926:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9011 00000100:00100000:1.0:1746147210.836071:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310349312 00000100:00100000:1.0:1746147210.836078:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310349312 00000100:00100000:1.0:1746147210.836127:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19861 00000100:00100000:1.0:1746147210.836133:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967310349312:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147210.836147:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147210.836161:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425062927 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7edf3 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.836181:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.836189:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425062927 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edf3 expref: 31 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.836199:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0c00/0x3139939425062927 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edf3 expref: 31 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147210.836211:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0c00, rc 0) 00000100:00100000:1.0:1746147210.836232:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967310349312:12345-192.168.204.25@tcp:101:cat.0 Request processed in 100us (486us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147210.836237:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19861 00000100:00100000:2.0:1746147210.836341:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311463936:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.836355:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [4149248->4194303] (req 4149248->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.836365:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009372c600, rc 0) 00000100:00100000:2.0:1746147210.836384:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2845:x1830967310349056:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7612us (9698us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.836390:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19860 00000100:00100000:1.0:1746147210.849240:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.849275:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.849360:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310349568 00000100:00100000:2.0:1746147210.849368:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310349568 00002000:00100000:2.0:1746147210.849403:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88012bab4380 x1830967310349568/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.849413:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab4380 with x1830967310349568 ext(2097152->4194303) 00010000:00010000:2.0:1746147210.849421:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009372c800/0x31399394250628ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd7 expref: 21 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.849433:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009372c800/0x31399394250628ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd7 expref: 21 pid: 1854 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746147210.849439:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bab4380 00000100:00100000:2.0:1746147210.849454:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310349824 00000100:00100000:2.0:1746147210.849456:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310349824 00002000:00100000:2.0:1746147210.849467:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88012bab5880 x1830967310349824/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.849474:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab5880 with x1830967310349824 ext(3145728->4194303) 00002000:00010000:2.0:1746147210.849477:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bab5880 00000100:00100000:2.0:1746147210.849496:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1713 00000100:00100000:2.0:1746147210.849508:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967310349568:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147210.849893:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7300 00000100:00100000:3.0:1746147210.849900:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310349824:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147210.852857:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.854435:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310350080 00000100:00100000:1.0:1746147210.854443:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310350080 00000100:00100000:1.0:1746147210.854481:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6144 00000100:00100000:1.0:1746147210.854487:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2840:x1830967310350080:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147210.854664:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2840:x1830967310350080:12345-192.168.204.25@tcp:35:cat.0 Request processed in 175us (1813us total) trans 8589937344 rc 0/0 00000100:00100000:1.0:1746147210.854670:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6144 00000100:00100000:3.0:1746147210.871382:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310349824:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 21473us (22097us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147210.871394:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7300 00002000:00100000:3.0:1746147210.871403:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88012bab5880 x1830967310349824/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/440 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.871413:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab5880 with x1830967310349824 ext(3145728->4194303) 00002000:00010000:3.0:1746147210.871417:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bab5880 00000100:00100000:0.0:1746147210.889045:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.889068:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310350336 00000100:00100000:0.0:1746147210.889076:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310350336 00000100:00100000:0.0:1746147210.889140:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16443 00000100:00100000:0.0:1746147210.889148:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2847:x1830967310350336:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147210.889168:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147210.889185:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43e00/0x313993942506292e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7edfa expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.889245:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x3139939425062935 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889255:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x3139939425062935 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889263:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x3139939425062935 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889273:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942506293c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889278:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942506293c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889282:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942506293c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889358:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33a00/0x3139939425062943 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889366:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33a00/0x3139939425062943 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889371:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33a00/0x3139939425062943 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:0.0:1746147210.889379:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147210.889431:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x3139939425062935 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889440:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x3139939425062935 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889444:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x3139939425062935 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889448:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x3139939425062935 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889452:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d43400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147210.889455:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x3139939425062935 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889461:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x3139939425062935 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889469:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147210.889471:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147210.889474:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x3139939425062935 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889478:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x3139939425062935 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889490:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942506293c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889494:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942506293c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889498:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942506293c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889501:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d42600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147210.889503:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942506293c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889507:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942506293c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889512:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f2c4200) 00010000:00010000:0.0:1746147210.889513:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147210.889515:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942506293c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889518:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x313993942506293c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147210.889543:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43e00/0x313993942506292e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edfa expref: 32 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.889552:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33a00/0x3139939425062943 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edfa expref: 31 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.889556:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147210.889558:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147210.889560:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33a00, rc 0) 00000100:00100000:0.0:1746147210.889593:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2847:x1830967310350336:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 447us (557us total) trans 8589937345 rc 0/0 00000100:00100000:0.0:1746147210.889599:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16443 00000100:00100000:2.0:1746147210.891608:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967310349568:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 42098us (42368us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147210.891618:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1713 00002000:00100000:2.0:1746147210.891628:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88012bab4380 x1830967310349568/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/440 e 0 to 0 dl 1746147221 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.891635:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab4380 with x1830967310349568 ext(2097152->4194303) 00010000:00010000:2.0:1746147210.891643:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009372c800/0x31399394250628ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd7 expref: 21 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.891664:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009372c800/0x31399394250628ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd7 expref: 21 pid: 1854 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746147210.891670:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bab4380 00000100:00100000:0.0:1746147210.919725:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.920752:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310350464 00000100:00100000:2.0:1746147210.920762:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310350464 00000100:00100000:2.0:1746147210.920815:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19862 00000100:00100000:2.0:1746147210.920823:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2839:x1830967310350464:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147210.920839:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.920855:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009372ca00/0x3139939425062951 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee01 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.920876:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.920882:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [4149248->4194303] (req 4149248->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 22 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.920888:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147210.920891:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009372ca00/0x3139939425062951 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee01 expref: 22 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.920922:0:13695:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [4149248->4194303] (req 4149248->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 22 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.920932:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009372ca00/0x3139939425062951 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee01 expref: 22 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.920941:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009372ca00, rc 0) 00000100:00100000:2.0:1746147210.920992:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2839:x1830967310350464:12345-192.168.204.25@tcp:101:cat.0 Request processed in 170us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.920997:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19862 00000100:00100000:0.0:1746147210.921481:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.922412:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310350592 00000100:00100000:3.0:1746147210.922417:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310350592 00010000:00010000:3.0:1746147210.922443:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009372c800/0x31399394250628ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd7 expref: 22 pid: 1854 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.922474:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9012 00000100:00100000:3.0:1746147210.922480:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310350592:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147210.922490:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147210.922506:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009372c800/0x31399394250628ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd7 expref: 22 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.922516:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009372c800/0x31399394250628ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd7 expref: 22 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.922535:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009372c800/0x31399394250628ef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd7 expref: 22 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.922682:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.922684:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.922690:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.922698:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.923072:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.923083:0:13715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 21 pid: 12225 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.923108:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311464320:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147210.924508:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147210.928356:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311464320:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147210.928374:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147210.928417:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310350592:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5935us (6935us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.928427:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9012 00000100:00100000:1.0:1746147210.931308:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.931510:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310350848 00000100:00100000:2.0:1746147210.931518:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310350848 00002000:00100000:2.0:1746147210.931563:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (4149248->4153343) req@ffff88012bab5180 x1830967310350848/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.931571:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab5180 with x1830967310350848 ext(4149248->4153343) 00010000:00010000:2.0:1746147210.931579:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 21 pid: 12225 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.931591:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 21 pid: 12225 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746147210.931596:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bab5180 00000100:00100000:2.0:1746147210.931625:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1714 00000100:00100000:2.0:1746147210.931632:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310350848:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147210.931765:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310350848:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 132us (464us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147210.931771:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1714 00002000:00100000:2.0:1746147210.931777:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (4149248->4153343) req@ffff88012bab5180 x1830967310350848/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/4536 e 0 to 0 dl 1746147221 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.931783:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab5180 with x1830967310350848 ext(4149248->4153343) 00010000:00010000:2.0:1746147210.931788:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 21 pid: 12225 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.931796:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 21 pid: 12225 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746147210.931802:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bab5180 00000100:00100000:0.0:1746147210.935861:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.938599:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310351104 00000100:00100000:2.0:1746147210.938610:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310351104 00000100:00100000:2.0:1746147210.938675:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19863 00000100:00100000:2.0:1746147210.938683:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2845:x1830967310351104:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147210.938699:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.938716:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x3139939425062958 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee08 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.938742:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009504e400/0x31399394250628e1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edc9 expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.938750:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x31399394250628e8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd0 expref: 37 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.938756:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.938758:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147210.938761:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x3139939425062958 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4194304->4268031] (req 4194304->4268031) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee08 expref: 23 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.938788:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x31399394250628e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd0 expref: 37 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.938798:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x31399394250628e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd0 expref: 37 pid: 1854 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.938808:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311464448:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.939929:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009504e400/0x31399394250628e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edc9 expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.939939:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009504e400/0x31399394250628e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edc9 expref: 23 pid: 1854 timeout: 848 lvb_type: 0 00000100:00100000:2.0:1746147210.939948:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311464576:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.939974:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caad80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.940177:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.940594:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310351232 00000100:00100000:2.0:1746147210.940599:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310351232 00002000:00100000:2.0:1746147210.940628:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (4149248->4194303) req@ffff88012dbc3100 x1830967310351232/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.940636:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc3100 with x1830967310351232 ext(4149248->4194303) 00010000:00010000:2.0:1746147210.940642:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 21 pid: 12225 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.940662:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 21 pid: 12225 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746147210.940669:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dbc3100 00000100:00100000:2.0:1746147210.940694:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1715 00000100:00100000:2.0:1746147210.940700:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310351232:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147210.947515:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.947539:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.947561:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310351360 00000100:00100000:0.0:1746147210.947568:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310351360 00010000:00010000:0.0:1746147210.947597:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x31399394250628e8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd0 expref: 38 pid: 1854 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746147210.947619:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310351488 00000100:00100000:0.0:1746147210.947621:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310351488 00010000:00010000:0.0:1746147210.947631:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009504e400/0x31399394250628e1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edc9 expref: 24 pid: 1854 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746147210.947644:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9013 00000100:00100000:0.0:1746147210.947661:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310351360:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147210.947671:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147210.947688:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x31399394250628e8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd0 expref: 38 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746147210.947699:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x31399394250628e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd0 expref: 38 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746147210.947718:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147210.947752:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310351360:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 101us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147210.947758:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9013 00000100:00100000:0.0:1746147210.947771:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9014 00000100:00100000:0.0:1746147210.947775:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2002:x1830967310351488:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147210.947781:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147210.947788:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009504e400/0x31399394250628e1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edc9 expref: 24 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746147210.947795:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009504e400/0x31399394250628e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edc9 expref: 24 pid: 1854 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746147210.947805:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147210.947806:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147210.947812:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x3139939425062958 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee08 expref: 24 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.947819:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x3139939425062958 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee08 expref: 24 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147210.947844:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x3139939425062958 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee08 expref: 24 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147210.947856:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311464704:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147210.947908:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984899c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746147210.948152:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009372d000/0x31399394250628e8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edd0 expref: 37 pid: 1854 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.948167:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311464448:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147210.948175:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009504e400/0x31399394250628e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edc9 expref: 24 pid: 1854 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.948183:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311464576:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147210.948200:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x3139939425062958 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee08 expref: 23 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.948212:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a4a00, rc 0) 00000100:00100000:3.0:1746147210.948234:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2845:x1830967310351104:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 9552us (12380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.948240:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19863 00000100:00100000:2.0:1746147210.949332:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2002:x1830967310351232:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 8629us (9154us total) trans 17179875235 rc 0/0 00000100:00100000:2.0:1746147210.949340:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1715 00002000:00100000:2.0:1746147210.949347:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (4149248->4194303) req@ffff88012dbc3100 x1830967310351232/t17179875235(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/448 e 0 to 0 dl 1746147221 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.949356:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc3100 with x1830967310351232 ext(4149248->4194303) 00010000:00010000:2.0:1746147210.949362:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 23 pid: 12225 timeout: 848 lvb_type: 0 00010000:00010000:2.0:1746147210.949373:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 23 pid: 12225 timeout: 848 lvb_type: 0 00002000:00010000:2.0:1746147210.949380:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dbc3100 00000100:00100000:0.0:1746147210.953605:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.953703:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310351616 00000100:00100000:1.0:1746147210.953713:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310351616 00010000:00010000:1.0:1746147210.953742:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 23 pid: 12225 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746147210.953781:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9015 00000100:00100000:1.0:1746147210.953788:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310351616:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147210.953803:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147210.953822:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 23 pid: 12225 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.953833:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 23 pid: 12225 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.953855:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x3139939425062920 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edec expref: 23 pid: 12225 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746147210.953878:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.953880:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147210.953886:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009372ca00/0x3139939425062951 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee01 expref: 22 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.953893:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009372ca00/0x3139939425062951 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee01 expref: 22 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147210.953920:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009372ca00/0x3139939425062951 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee01 expref: 22 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147210.953931:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311464832:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147210.954003:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147210.956901:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.956994:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311464704:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147210.957009:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147210.957047:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2002:x1830967310351488:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 9266us (9502us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.957056:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9014 00000100:00100000:3.0:1746147210.957119:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310351872 00000100:00100000:3.0:1746147210.957124:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310351872 00002000:00100000:3.0:1746147210.957153:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (4263936->4268031) req@ffff88012dbc3800 x1830967310351872/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.957162:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc3800 with x1830967310351872 ext(4263936->4268031) 00002000:00010000:3.0:1746147210.957166:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbc3800 00000100:00100000:3.0:1746147210.957190:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7301 00000100:00100000:3.0:1746147210.957196:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2002:x1830967310351872:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147210.957291:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2002:x1830967310351872:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 95us (397us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147210.957296:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7301 00002000:00100000:3.0:1746147210.957300:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (4263936->4268031) req@ffff88012dbc3800 x1830967310351872/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/4536 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.957306:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc3800 with x1830967310351872 ext(4263936->4268031) 00002000:00010000:3.0:1746147210.957308:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbc3800 00000100:00100000:2.0:1746147210.965737:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147210.965951:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311464832:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147210.965968:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147210.966022:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310351616:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 12230us (12420us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147210.966034:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9015 00000100:00100000:3.0:1746147210.966308:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310352128 00000100:00100000:3.0:1746147210.966314:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310352128 00000100:00100000:3.0:1746147210.966343:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6145 00000100:00100000:3.0:1746147210.966348:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2845:x1830967310352128:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147210.966497:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2845:x1830967310352128:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 148us (770us total) trans 8589937346 rc 0/0 00000100:00100000:3.0:1746147210.966503:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6145 00000100:00100000:0.0:1746147210.968037:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147210.968143:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.968211:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310352384 00000100:00100000:2.0:1746147210.968219:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310352384 00002000:00100000:2.0:1746147210.968253:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff88012dbc2d80 x1830967310352384/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.968263:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc2d80 with x1830967310352384 ext(3145728->4194303) 00002000:00010000:2.0:1746147210.968267:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbc2d80 00000100:00100000:2.0:1746147210.968715:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7302 00000100:00100000:3.0:1746147210.968717:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310352512 00000100:00100000:3.0:1746147210.968721:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310352512 00000100:00100000:2.0:1746147210.968722:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2003:x1830967310352384:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147210.968743:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19864 00000100:00100000:3.0:1746147210.968747:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2847:x1830967310352512:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147210.968755:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147210.968769:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x313993942506295f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee0f expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.968790:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098447e00/0x31399394250628be lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eda6 expref: 38 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.968798:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x31399394250628c5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edad expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.968803:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.968804:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.968807:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x313993942506295f lrc: 5/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1290240->1822719] (req 1290240->1822719) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee0f expref: 38 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.968829:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x31399394250628c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edad expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.968838:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x31399394250628c5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edad expref: 21 pid: 12225 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.968851:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311464960:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147210.968929:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098447e00/0x31399394250628be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eda6 expref: 38 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.968936:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098447e00/0x31399394250628be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eda6 expref: 38 pid: 13695 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.968943:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311465088:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147210.968959:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147210.975157:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311464960:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147210.975168:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311465088:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147210.975191:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x313993942506295f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1290240->1822719] (req 1290240->1822719) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee0f expref: 38 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147210.975207:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092562400, rc 0) 00000100:00100000:2.0:1746147210.975257:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2847:x1830967310352512:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6508us (7113us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147210.975264:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19864 00000100:00100000:2.0:1746147210.977763:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.978527:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147210.978589:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310352640 00000100:00100000:3.0:1746147210.978597:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310352640 00010000:00010000:3.0:1746147210.978627:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098447e00/0x31399394250628be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eda6 expref: 38 pid: 13695 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.978657:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310352768 00000100:00100000:3.0:1746147210.978660:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310352768 00010000:00010000:3.0:1746147210.978670:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x31399394250628c5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edad expref: 22 pid: 12225 timeout: 848 lvb_type: 0 00000100:00100000:3.0:1746147210.978684:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9016 00000100:00100000:3.0:1746147210.978690:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310352640:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147210.978700:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147210.978715:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098447e00/0x31399394250628be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eda6 expref: 38 pid: 13695 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.978728:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098447e00/0x31399394250628be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eda6 expref: 38 pid: 13695 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.978745:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098447e00/0x31399394250628be lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eda6 expref: 38 pid: 13695 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.978763:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147210.978793:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310352640:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 103us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.978798:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9016 00000100:00100000:3.0:1746147210.978831:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9017 00000100:00100000:3.0:1746147210.978835:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2003:x1830967310352768:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147210.978840:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147210.978845:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x31399394250628c5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edad expref: 22 pid: 12225 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.978852:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x31399394250628c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edad expref: 22 pid: 12225 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.978861:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098447a00/0x31399394250628c5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edad expref: 22 pid: 12225 timeout: 848 lvb_type: 0 00010000:00010000:3.0:1746147210.978867:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.978869:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147210.978875:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x313993942506295f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1822719) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee0f expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.978881:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x313993942506295f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1822719) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee0f expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147210.978902:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x313993942506295f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1822719) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee0f expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147210.978911:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311465216:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147210.978947:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147210.989109:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311465216:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147210.989129:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147210.989194:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2003:x1830967310352768:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 10356us (10666us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147210.989204:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9017 00000100:00100000:0.0:1746147210.989468:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.989673:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310353024 00000100:00100000:2.0:1746147210.989680:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310353024 00002000:00100000:2.0:1746147210.989713:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (1290240->1294335) req@ffff88012dbc3480 x1830967310353024/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/0 e 0 to 0 dl 1746147221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.989723:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc3480 with x1830967310353024 ext(1290240->1294335) 00002000:00010000:2.0:1746147210.989727:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbc3480 00000100:00100000:2.0:1746147210.989759:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7303 00000100:00100000:2.0:1746147210.989766:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310353024:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147210.989863:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310353024:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 98us (397us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147210.989868:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7303 00002000:00100000:2.0:1746147210.989872:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (1290240->1294335) req@ffff88012dbc3480 x1830967310353024/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:586/0 lens 488/4536 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147210.989878:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc3480 with x1830967310353024 ext(1290240->1294335) 00002000:00010000:2.0:1746147210.989881:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbc3480 00000100:00100000:3.0:1746147210.990961:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2003:x1830967310352384:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 22236us (22926us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147210.990969:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7302 00002000:00100000:3.0:1746147210.990974:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff88012dbc2d80 x1830967310352384/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:586/0 lens 488/440 e 0 to 0 dl 1746147221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147210.990981:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc2d80 with x1830967310352384 ext(3145728->4194303) 00002000:00010000:3.0:1746147210.990984:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbc2d80 00000100:00100000:0.0:1746147210.998631:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147210.998724:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310353152 00000100:00100000:2.0:1746147210.998734:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310353152 00000100:00100000:2.0:1746147210.998897:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19865 00000100:00100000:2.0:1746147210.998906:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310353152:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147210.998924:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147210.998944:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd200/0x3139939425062966 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee16 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147210.999002:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311465344:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147211.000046:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.003079:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.003343:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310353408 00000100:00100000:3.0:1746147211.003354:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310353408 00002000:00100000:3.0:1746147211.003404:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1818624->1822719) req@ffff88012dbc1180 x1830967310353408/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.003420:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc1180 with x1830967310353408 ext(1818624->1822719) 00002000:00010000:3.0:1746147211.003426:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbc1180 00000100:00100000:3.0:1746147211.003455:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7304 00000100:00100000:3.0:1746147211.003463:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310353408:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147211.003607:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310353408:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 144us (538us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147211.003613:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7304 00002000:00100000:3.0:1746147211.003619:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1818624->1822719) req@ffff88012dbc1180 x1830967310353408/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/4536 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.003626:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc1180 with x1830967310353408 ext(1818624->1822719) 00002000:00010000:3.0:1746147211.003629:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbc1180 00002000:00010000:2.0:1746147211.003734:0:12225:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746147209 -> 1746147210 00002000:00010000:2.0:1746147211.003738:0:12225:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746147209 -> 1746147210 00000100:00100000:2.0:1746147211.003749:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311465344:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147211.003779:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd200/0x3139939425062966 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee16 expref: 22 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.003791:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd200/0x3139939425062966 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee16 expref: 22 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.003808:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fd200, rc 0) 00000100:00100000:2.0:1746147211.003833:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310353152:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4929us (5213us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147211.003840:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19865 00000100:00100000:0.0:1746147211.010735:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.010879:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.010971:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310353664 00000100:00100000:1.0:1746147211.010980:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310353664 00000100:00100000:1.0:1746147211.011056:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6146 00000100:00100000:1.0:1746147211.011065:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2847:x1830967310353664:12345-192.168.204.25@tcp:35:multiop.0 00000100:00080000:3.0:1746147211.011080:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147211.011253:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310353920 00000100:00100000:2.0:1746147211.011258:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310353920 00002000:00100000:2.0:1746147211.011287:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (4268032->4890623) req@ffff88012dbc0a80 x1830967310353920/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.011298:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc0a80 with x1830967310353920 ext(4268032->4890623) 00002000:00010000:2.0:1746147211.011305:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbc0a80 00000100:00100000:2.0:1746147211.011324:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7305 00000100:00100000:2.0:1746147211.011330:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310353920:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147211.012231:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2847:x1830967310353664:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 1163us (1503us total) trans 8589937347 rc 0/0 00000100:00100000:1.0:1746147211.012240:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6146 00000100:00100000:2.0:1746147211.023787:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310353920:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12444us (12895us total) trans 0 rc 622592/622592 00000100:00100000:2.0:1746147211.023801:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7305 00002000:00100000:2.0:1746147211.023813:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (4268032->4890623) req@ffff88012dbc0a80 x1830967310353920/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 622592/622592 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.023824:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc0a80 with x1830967310353920 ext(4268032->4890623) 00002000:00010000:2.0:1746147211.023830:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbc0a80 00000100:00100000:0.0:1746147211.027188:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.027293:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310354048 00000100:00100000:2.0:1746147211.027302:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310354048 00000100:00100000:2.0:1746147211.027362:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19866 00000100:00100000:2.0:1746147211.027368:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967310354048:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147211.027387:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.027402:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9fc800/0x313993942506296d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee1d expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147211.027451:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311465472:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147211.027539:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147211.028841:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311465472:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147211.028869:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fc800/0x313993942506296d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee1d expref: 22 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.028882:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fc800/0x313993942506296d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee1d expref: 22 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.028907:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fc800, rc 0) 00000100:00100000:2.0:1746147211.028943:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967310354048:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1574us (1765us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147211.028951:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19866 00000100:00100000:0.0:1746147211.032357:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.032473:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310354176 00000100:00100000:2.0:1746147211.032482:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310354176 00000100:00100000:2.0:1746147211.033015:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19867 00000100:00100000:2.0:1746147211.033024:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967310354176:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147211.033043:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.033061:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd600/0x3139939425062974 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee24 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147211.033131:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311465600:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147211.034596:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147211.035983:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311465600:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147211.036022:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd600/0x3139939425062974 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee24 expref: 22 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.036039:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fd600/0x3139939425062974 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee24 expref: 22 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.036052:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fd600, rc 0) 00000100:00100000:2.0:1746147211.036185:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967310354176:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3160us (3836us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147211.036194:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19867 00000100:00100000:0.0:1746147211.041518:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.041955:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310354432 00000100:00100000:1.0:1746147211.041966:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310354432 00000100:00100000:1.0:1746147211.042065:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6147 00000100:00100000:1.0:1746147211.042073:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079238850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2839:x1830967310354432:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147211.042444:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079238850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2839:x1830967310354432:12345-192.168.204.25@tcp:35:cat.0 Request processed in 370us (936us total) trans 8589937348 rc 0/0 00000100:00100000:1.0:1746147211.042452:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6147 00000100:00100000:0.0:1746147211.050561:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3765:1830967311465728:0@lo:400:kworker.0 00000100:00100000:0.0:1746147211.050642:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147211.050754:0:8099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311465728 00000100:00100000:1.0:1746147211.050762:0:8099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311465728 00000100:00100000:1.0:1746147211.050809:0:8099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1746147211.050817:0:8099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3765:x1830967311465728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.051204:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967311466112:0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.051233:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147211.051261:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967311465856:0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.051278:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147211.051289:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746147211.051292:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3766:1830967311465984:0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.051310:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147211.051327:0:9510:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311465856 00000100:00100000:3.0:1746147211.051329:0:9510:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311465856 00000100:00100000:3.0:1746147211.051351:0:9510:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:3.0:1746147211.051355:0:9510:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3766:x1830967311465856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.051382:0:9510:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3766:x1830967311465856:12345-0@lo:400:kworker.0 Request processed in 26us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.051387:0:9510:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:3.0:1746147211.051405:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311465984 00000100:00100000:3.0:1746147211.051406:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311465984 00000100:00100000:3.0:1746147211.051424:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:3.0:1746147211.051427:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3766:x1830967311465984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.051443:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3766:x1830967311465984:12345-0@lo:400:kworker.0 Request processed in 16us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.051447:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:3.0:1746147211.051473:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3766:1830967311465984:0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.051480:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967311465856:0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.051512:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311466112 00000100:00100000:3.0:1746147211.051515:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311466112 00000100:00080000:3.0:1746147211.051533:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147211.051557:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1746147211.051561:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3764:x1830967311466112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.051592:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3764:x1830967311466112:12345-0@lo:400:kworker.0 Request processed in 31us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.051597:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1746147211.051614:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967311466112:0@lo:400:kworker.0 00000100:00100000:1.0:1746147211.051683:0:8099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3765:x1830967311465728:12345-0@lo:400:kworker.0 Request processed in 866us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.051689:0:8099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1746147211.051741:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3765:1830967311465728:0@lo:400:kworker.0 00000100:00100000:2.0:1746147211.051929:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3767:1830967311466496:0@lo:400:kworker.0 00000100:00100000:2.0:1746147211.051954:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147211.051978:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311467008:0@lo:400:kworker.0 00000100:00100000:2.0:1746147211.051993:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147211.052006:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746147211.052010:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3767:1830967311466368:0@lo:400:kworker.0 00000100:00100000:2.0:1746147211.052026:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147211.052035:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311466880:0@lo:400:kworker.0 00000100:00100000:2.0:1746147211.052050:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147211.052066:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311466880 00000100:00100000:2.0:1746147211.052069:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311466880 00000100:00100000:2.0:1746147211.052102:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:2.0:1746147211.052107:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3767:x1830967311466880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147211.052137:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3767:x1830967311466880:12345-0@lo:400:kworker.0 Request processed in 30us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.052141:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:2.0:1746147211.052160:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311466880:0@lo:400:kworker.0 00000100:00100000:2.0:1746147211.052169:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311467008 00000100:00100000:2.0:1746147211.052172:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311467008 00000100:00100000:2.0:1746147211.052186:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:2.0:1746147211.052191:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+84:3767:x1830967311467008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147211.052213:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+84:3767:x1830967311467008:12345-0@lo:400:kworker.0 Request processed in 22us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.052230:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:2.0:1746147211.052248:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311467008:0@lo:400:kworker.0 00000100:00100000:1.0:1746147211.052303:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311466496 00000100:00100000:1.0:1746147211.052306:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311466496 00000100:00100000:1.0:1746147211.052330:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311466368 00000100:00100000:1.0:1746147211.052332:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311466368 00000100:00100000:1.0:1746147211.052356:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:1.0:1746147211.052362:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3767:x1830967311466496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147211.052389:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3767:x1830967311466496:12345-0@lo:400:kworker.0 Request processed in 27us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.052394:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:1.0:1746147211.052402:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:1.0:1746147211.052406:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3767:x1830967311466368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147211.052424:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3767:x1830967311466368:12345-0@lo:400:kworker.0 Request processed in 18us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.052428:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00080000:1.0:1746147211.052441:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1746147211.052444:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746147211.054247:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3767:1830967311466368:0@lo:400:kworker.0 00000100:00100000:2.0:1746147211.054261:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3767:1830967311466496:0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.054354:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3764:1830967311466624:0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.054403:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147211.054440:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311467136:0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.054461:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147211.054474:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1746147211.054479:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967311466240:0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.054491:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147211.054502:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3764:1830967311466752:0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.054515:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147211.054523:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3764:1830967311467264:0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.054535:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147211.054564:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311467136 00000100:00100000:3.0:1746147211.054568:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311467136 00000100:00100000:3.0:1746147211.054594:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311466240 00000100:00100000:3.0:1746147211.054595:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311466240 00000100:00100000:3.0:1746147211.054607:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:3.0:1746147211.054612:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3764:x1830967311467136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.054641:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3764:x1830967311467136:12345-0@lo:400:kworker.0 Request processed in 28us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.054645:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:3.0:1746147211.054665:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1746147211.054669:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3764:x1830967311466240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.054684:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3764:x1830967311466240:12345-0@lo:400:kworker.0 Request processed in 15us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.054688:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1746147211.054703:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967311466240:0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.054710:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311467136:0@lo:400:kworker.0 00000100:00100000:2.0:1746147211.054762:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311466624 00000100:00100000:2.0:1746147211.054765:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311466624 00000100:00100000:2.0:1746147211.054789:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311466752 00000100:00100000:2.0:1746147211.054791:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311466752 00000100:00100000:2.0:1746147211.055127:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311467264 00000100:00100000:2.0:1746147211.055133:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311467264 00000100:00100000:1.0:1746147211.055172:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:1.0:1746147211.055178:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3764:x1830967311466624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147211.055213:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3764:x1830967311466624:12345-0@lo:400:kworker.0 Request processed in 34us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.055218:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00100000:1.0:1746147211.055229:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:1.0:1746147211.055232:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3764:x1830967311466752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147211.055251:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3764:x1830967311466752:12345-0@lo:400:kworker.0 Request processed in 18us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.055255:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:1.0:1746147211.055262:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:1.0:1746147211.055266:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3764:x1830967311467264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147211.055281:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3764:x1830967311467264:12345-0@lo:400:kworker.0 Request processed in 15us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.055286:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00080000:1.0:1746147211.055298:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1746147211.055301:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746147211.055724:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.055822:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310354560 00000100:00100000:1.0:1746147211.055825:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310354560 00000100:00100000:3.0:1746147211.055900:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3764:1830967311466752:0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.055909:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3764:1830967311467264:0@lo:400:kworker.0 00000100:00100000:3.0:1746147211.055918:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3764:1830967311466624:0@lo:400:kworker.0 00000100:00100000:1.0:1746147211.056273:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16444 00000100:00100000:1.0:1746147211.056279:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+6:2853:x1830967310354560:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147211.056294:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147211.056310:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x313993942506297b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee2b expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.056369:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x3139939425062982 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.056381:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x3139939425062982 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.056393:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x3139939425062982 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.056404:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1800/0x3139939425062989 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.056409:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1800/0x3139939425062989 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.056414:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1800/0x3139939425062989 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.056488:0:7239:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1400/0x3139939425062990 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.056501:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1400/0x3139939425062990 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.056506:0:7239:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1400/0x3139939425062990 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00000004:00200000:1.0:1746147211.056541:0:7239:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:1.0:1746147211.056544:0:7239:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746147211.056560:0:7239:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1400/0x3139939425062990 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.056568:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1400/0x3139939425062990 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.056575:0:7239:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x3139939425062982 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.056580:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x3139939425062982 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.056585:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x3139939425062982 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.056590:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x3139939425062982 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.056595:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbe0c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147211.056598:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x3139939425062982 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.056603:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x3139939425062982 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.056611:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147211.056615:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147211.056618:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x3139939425062982 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.056623:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0c00/0x3139939425062982 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.058251:0:7239:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1800/0x3139939425062989 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.058259:0:7239:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1800/0x3139939425062989 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.058263:0:7239:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1800/0x3139939425062989 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.058268:0:7239:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbe1800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147211.058270:0:7239:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1800/0x3139939425062989 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.058275:0:7239:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1800/0x3139939425062989 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.058285:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f2c5d00) 00010000:00010000:1.0:1746147211.058287:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147211.058290:0:7239:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1800/0x3139939425062989 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.058293:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1800/0x3139939425062989 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7239 initiator: MDT0 00010000:00010000:1.0:1746147211.058330:0:7239:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x313993942506297b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee2b expref: 8 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.058346:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1400/0x3139939425062990 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee2b expref: 7 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.058351:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147211.058352:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147211.058355:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe1400, rc 0) 00000100:00100000:1.0:1746147211.058413:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2853:x1830967310354560:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2133us (2690us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.058421:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16444 00000100:00100000:3.0:1746147211.063140:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.063183:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.063203:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310354688 00000100:00100000:3.0:1746147211.063211:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310354688 00000100:00100000:3.0:1746147211.063253:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310354944 00000100:00100000:3.0:1746147211.063256:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310354944 00000100:00100000:3.0:1746147211.063272:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19868 00000100:00100000:3.0:1746147211.063279:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310354688:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147211.063298:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.063317:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092563000/0x3139939425062997 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee32 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.063338:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.063340:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.063349:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092563000/0x3139939425062997 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee32 expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.063364:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092563000/0x3139939425062997 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee32 expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.063376:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563000, rc 0) 00000100:00100000:2.0:1746147211.063377:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19869 00000100:00100000:2.0:1746147211.063385:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310354944:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147211.063395:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.063407:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x313993942506299e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee40 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.063414:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310354688:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 136us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.063420:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19868 00010000:00010000:2.0:1746147211.063424:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.063426:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.063431:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x313993942506299e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee40 expref: 12 pid: 13712 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147211.063452:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.063465:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310355200 00000100:00100000:3.0:1746147211.063468:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310355200 00000100:00100000:3.0:1746147211.063480:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19870 00000100:00100000:3.0:1746147211.063484:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310355200:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147211.063490:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.063497:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x31399394250629a5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee4e expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.063534:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095061880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311467392:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147211.063540:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x313993942506299e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee40 expref: 12 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.063549:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fd000, rc 0) 00000100:00100000:2.0:1746147211.063571:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310354944:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 187us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.063576:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19869 00000100:00100000:3.0:1746147211.063584:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.064469:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.064492:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.064527:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310354816 00000100:00100000:0.0:1746147211.064530:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.064532:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310354816 00000100:00100000:3.0:1746147211.064558:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310355072 00000100:00100000:3.0:1746147211.064561:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310355072 00000100:00100000:1.0:1746147211.064564:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310355328 00000100:00100000:1.0:1746147211.064568:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310355328 00000100:00100000:3.0:1746147211.064581:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19871 00000100:00100000:3.0:1746147211.064587:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310354816:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147211.064596:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147211.064600:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19872 00010000:00010000:3.0:1746147211.064606:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x31399394250629ac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee39 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.064606:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310355072:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147211.064612:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.064617:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.064618:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.064620:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0000/0x31399394250629b3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee47 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.064624:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x31399394250629ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee39 expref: 14 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.064634:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x31399394250629ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee39 expref: 14 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.064658:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009372c600, rc 0) 00000100:00100000:3.0:1746147211.064681:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310354816:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 93us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.064686:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19871 00000100:00100000:3.0:1746147211.064699:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19873 00000100:00100000:3.0:1746147211.064703:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310355328:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147211.064709:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.064716:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250629ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee55 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.064726:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.064728:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147211.064728:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311467520:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147211.064731:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250629ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee55 expref: 14 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.064738:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250629ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee55 expref: 14 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.064744:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009372d000, rc 0) 00000100:00100000:3.0:1746147211.064759:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310355328:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 55us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.064761:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147211.064764:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19873 00000100:00100000:3.0:1746147211.066764:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095061880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311467392:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147211.066879:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x31399394250629a5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee4e expref: 20 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.066893:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x31399394250629a5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee4e expref: 20 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.066985:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563a00, rc 0) 00000100:00100000:3.0:1746147211.067173:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310355200:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3547us (3580us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147211.067182:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19870 00000100:00100000:2.0:1746147211.067697:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311467520:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147211.067718:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0000/0x31399394250629b3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee47 expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.067729:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0000/0x31399394250629b3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee47 expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.067751:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0000, rc 0) 00000100:00100000:2.0:1746147211.067782:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310355072:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3175us (3288us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147211.067788:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19872 00000100:00100000:0.0:1746147211.070587:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.070788:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310355584 00000100:00100000:2.0:1746147211.070797:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310355584 00000100:00100000:2.0:1746147211.070862:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16445 00000100:00100000:2.0:1746147211.070870:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2853:x1830967310355584:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147211.070891:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.070911:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x31399394250629c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee5c expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.071018:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.071033:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x313993942506284e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed36 expref: 14 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.071041:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942506290b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edde expref: 14 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.071047:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33a00/0x3139939425062943 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edfa expref: 31 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.071053:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1400/0x3139939425062990 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee2b expref: 8 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.071060:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 7/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.071121:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1400/0x3139939425062990 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee2b expref: 8 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.071133:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1400/0x3139939425062990 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee2b expref: 8 pid: 7239 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.071149:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311467648:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147211.071248:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33a00/0x3139939425062943 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edfa expref: 31 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.071256:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33a00/0x3139939425062943 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edfa expref: 31 pid: 9138 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.071263:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311467776:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147211.071289:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942506290b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edde expref: 14 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.071296:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942506290b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edde expref: 14 pid: 9138 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.071304:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311467904:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147211.074942:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x313993942506284e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed36 expref: 14 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.074961:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x313993942506284e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed36 expref: 14 pid: 9138 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.074977:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311468032:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147211.075038:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147211.078476:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311467648:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147211.079270:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311467904:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147211.079279:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311468032:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147211.080736:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.081012:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.081231:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310355840 00000100:00100000:3.0:1746147211.081238:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310355840 00010000:00010000:3.0:1746147211.081275:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942506290b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edde expref: 15 pid: 9138 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147211.081307:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310355712 00000100:00100000:3.0:1746147211.081309:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310355712 00010000:00010000:3.0:1746147211.081318:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1400/0x3139939425062990 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee2b expref: 9 pid: 7239 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.081332:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9018 00000100:00100000:1.0:1746147211.081342:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2001:x1830967310355840:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.081355:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.081362:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942506290b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edde expref: 15 pid: 9138 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.081386:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942506290b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edde expref: 15 pid: 9138 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.081407:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x313993942506290b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edde expref: 15 pid: 9138 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.081438:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147211.081444:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.081453:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.081458:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.081500:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310355840:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 160us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.081829:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9019 00000100:00100000:3.0:1746147211.081836:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310355712:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147211.081845:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147211.081849:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1400/0x3139939425062990 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee2b expref: 9 pid: 7239 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.081858:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1400/0x3139939425062990 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee2b expref: 9 pid: 7239 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.081871:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe1400/0x3139939425062990 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee2b expref: 9 pid: 7239 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.081884:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147211.081887:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.081893:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.081897:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147211.081915:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2001:x1830967310355712:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 81us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.081921:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9019 00000100:00100000:3.0:1746147211.081946:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311468160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746147211.081979:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147211.082007:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746147211.082010:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967311468288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746147211.082024:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147211.082048:0:9510:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311468160 00000100:00100000:3.0:1746147211.082050:0:9510:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311468160 00000100:00100000:3.0:1746147211.082066:0:9510:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311468288 00000100:00100000:3.0:1746147211.082068:0:9510:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311468288 00000100:00100000:3.0:1746147211.082077:0:9510:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:3.0:1746147211.082081:0:9510:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3766:x1830967311468160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1746147211.082124:0:9510:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445597184 avail 1316134912 00000100:00100000:3.0:1746147211.082151:0:9510:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3766:x1830967311468160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.082156:0:9510:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:3.0:1746147211.082164:0:9510:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:3.0:1746147211.082168:0:9510:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3766:x1830967311468288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1746147211.082181:0:9510:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445527552 avail 1316065280 00000100:00100000:3.0:1746147211.082198:0:9510:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3766:x1830967311468288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 30us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.082203:0:9510:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:3.0:1746147211.082231:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3766:1830967311468288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746147211.082239:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311468160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746147211.082429:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9018 00000100:00100000:1.0:1746147211.082462:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.082497:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310355968 00000100:00100000:2.0:1746147211.082501:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310355968 00010000:00010000:2.0:1746147211.082515:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x313993942506284e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed36 expref: 14 pid: 9138 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.082543:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9020 00000100:00100000:2.0:1746147211.082548:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310355968:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147211.082554:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147211.082557:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147211.082558:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x313993942506284e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed36 expref: 14 pid: 9138 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.082566:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x313993942506284e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed36 expref: 14 pid: 9138 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.082568:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310356096 00000100:00100000:1.0:1746147211.082571:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310356096 00010000:00010000:2.0:1746147211.082577:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256e600/0x313993942506284e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed36 expref: 14 pid: 9138 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.082584:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33a00/0x3139939425062943 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edfa expref: 32 pid: 9138 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.082589:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147211.082593:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.082599:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00000100:00100000:1.0:1746147211.082600:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9021 00010000:00010000:2.0:1746147211.082603:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.082604:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967310356096:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.082611:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.082615:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33a00/0x3139939425062943 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edfa expref: 32 pid: 9138 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.082622:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310355968:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 74us (159us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147211.082624:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33a00/0x3139939425062943 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edfa expref: 32 pid: 9138 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.082627:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9020 00010000:00010000:1.0:1746147211.082634:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147211.082637:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.082643:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.082661:0:13715:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.082675:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147211.082761:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33a00/0x3139939425062943 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7edfa expref: 32 pid: 9138 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147211.082769:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311467776:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147211.083334:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.083343:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.083347:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147211.083366:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147211.083499:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fc800/0x31399394250629c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee5c expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.083511:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee5c expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.083517:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147211.083519:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147211.083521:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fce00, rc 0) 00000100:00100000:3.0:1746147211.083545:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2853:x1830967310355584:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 12677us (12969us total) trans 8589937349 rc 0/0 00000100:00100000:3.0:1746147211.083552:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16445 00000100:00100000:1.0:1746147211.083654:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967310356096:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1040us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.083661:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9021 00000100:00100000:0.0:1746147211.087398:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.087571:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310356224 00000100:00100000:3.0:1746147211.087579:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310356224 00000100:00100000:3.0:1746147211.087629:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16446 00000100:00100000:3.0:1746147211.087637:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2853:x1830967310356224:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147211.087675:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.087696:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x31399394250629d6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee63 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.087796:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092562c00/0x31399394250629dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.087812:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee5c expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.087819:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092562c00/0x31399394250629dd lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.087853:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee5c expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.087869:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee5c expref: 9 pid: 6215 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147211.087881:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311468416:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147211.088460:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147211.095032:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311468416:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147211.095060:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092562c00/0x31399394250629dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147211.095272:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.095354:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310356352 00000100:00100000:1.0:1746147211.095362:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310356352 00010000:00010000:1.0:1746147211.095399:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee5c expref: 10 pid: 6215 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.095485:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9022 00000100:00100000:1.0:1746147211.095493:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310356352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.095510:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.095516:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee5c expref: 10 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.095531:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee5c expref: 10 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.095607:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fce00/0x31399394250629c8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee5c expref: 10 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.095840:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147211.095846:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092562c00/0x31399394250629dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.095856:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092562c00/0x31399394250629dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.095862:0:13715:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092562c00/0x31399394250629dd lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.097234:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147211.097468:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092562c00/0x31399394250629dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.097476:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092562c00/0x31399394250629dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147211.097527:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147211.097531:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147211.097548:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092562c00/0x31399394250629dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.097581:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092563600/0x31399394250629d6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee63 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.097866:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310356352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2371us (2593us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.097875:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9022 00010000:00010000:3.0:1746147211.098925:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092562c00/0x31399394250629dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee63 expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.098935:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147211.098938:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147211.098941:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092562c00, rc 0) 00000100:00100000:3.0:1746147211.098997:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2853:x1830967310356224:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 11360us (11608us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.099004:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16446 00000100:00100000:0.0:1746147211.102480:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.102535:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.102720:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310356480 00000100:00100000:2.0:1746147211.102730:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310356480 00000100:00100000:2.0:1746147211.102770:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310356608 00000100:00100000:2.0:1746147211.102772:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310356608 00000100:00100000:2.0:1746147211.102789:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19874 00000100:00100000:2.0:1746147211.102797:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310356480:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147211.102817:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.102835:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x31399394250629e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee6a expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147211.102891:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311468544:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147211.102974:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147211.102996:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19875 00000100:00100000:2.0:1746147211.103001:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310356608:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147211.103007:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.103014:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e261800/0x31399394250629eb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee71 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147211.103036:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311468672:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147211.103057:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147211.107629:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311468672:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147211.107676:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e261800/0x31399394250629eb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee71 expref: 20 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.107690:0:13712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e261800/0x31399394250629eb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee71 expref: 20 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.107717:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261800, rc 0) 00000100:00100000:3.0:1746147211.107766:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310356608:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4763us (5229us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147211.107775:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19875 00000100:00100000:2.0:1746147211.108816:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311468544:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147211.108838:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x31399394250629e4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee6a expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.108848:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e260a00/0x31399394250629e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee6a expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.108872:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260a00, rc 0) 00000100:00100000:2.0:1746147211.108902:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310356480:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 6104us (6432us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147211.108910:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19874 00000100:00100000:0.0:1746147211.112014:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.112146:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310356864 00000100:00100000:2.0:1746147211.112156:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310356864 00000100:00100000:2.0:1746147211.112219:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16447 00000100:00100000:2.0:1746147211.112227:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2853:x1830967310356864:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147211.112246:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.112271:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0a00/0x31399394250629f2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee78 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.112385:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x31399394250629f9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.112399:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x31399394250629f9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.112410:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x31399394250629f9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147211.112420:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147211.112516:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0a00/0x31399394250629f2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee78 expref: 11 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.112531:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x31399394250629f9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee78 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.112539:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147211.112541:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147211.112544:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261800, rc 0) 00000100:00100000:2.0:1746147211.112601:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2853:x1830967310356864:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 374us (598us total) trans 8589937350 rc 0/0 00000100:00100000:2.0:1746147211.112608:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16447 00000100:00100000:0.0:1746147211.115738:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.115778:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.115808:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.115836:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.115849:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.115870:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310356992 00000100:00100000:0.0:1746147211.115874:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.115880:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310356992 00000100:00100000:1.0:1746147211.115920:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310357120 00000100:00100000:1.0:1746147211.115922:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310357120 00000100:00100000:1.0:1746147211.115937:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310357248 00000100:00100000:1.0:1746147211.115943:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310357248 00000100:00100000:1.0:1746147211.115953:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310357376 00000100:00100000:1.0:1746147211.115955:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310357376 00000100:00100000:1.0:1746147211.115963:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310357504 00000100:00100000:1.0:1746147211.115965:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310357504 00000100:00100000:1.0:1746147211.115972:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310357632 00000100:00100000:1.0:1746147211.115973:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310357632 00000100:00100000:2.0:1746147211.115980:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19876 00000100:00100000:2.0:1746147211.115989:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2002:x1830967310356992:12345-192.168.204.25@tcp:1:lfs.0 00000100:00100000:1.0:1746147211.115994:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19877 00000100:00100000:1.0:1746147211.115998:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2002:x1830967310357120:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147211.116030:0:1398:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e261000/0x3139939425062a0e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.116030:0:9584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425062a07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.116047:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942506289b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed83 expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.116048:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091f28800/0x313993942506286a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed4b expref: 36 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.116055:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x31399394250629ac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee39 expref: 16 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.116056:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092563000/0x3139939425062997 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee32 expref: 19 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.116063:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e000/0x3139939425062894 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed7c expref: 20 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.116063:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009844a200/0x31399394250628a2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed8a expref: 21 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.116068:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.116068:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.116070:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.116070:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.116072:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e261000/0x3139939425062a0e lrc: 6/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.116072:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425062a07 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.116120:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e000/0x3139939425062894 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed7c expref: 20 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.116120:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009844a200/0x31399394250628a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed8a expref: 21 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.116131:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e000/0x3139939425062894 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed7c expref: 20 pid: 12225 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.116131:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009844a200/0x31399394250628a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed8a expref: 21 pid: 1136 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.116144:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311468800:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147211.116144:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311468928:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147211.116192:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19878 00000100:00100000:0.0:1746147211.116198:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2002:x1830967310357248:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147211.116217:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x3139939425062a15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.116227:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a73600/0x31399394250628a9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed91 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.116234:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x313993942506299e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee40 expref: 16 pid: 13712 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147211.116239:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19879 00010000:00010000:0.0:1746147211.116240:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f03cc00/0x31399394250628b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed98 expref: 21 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.116245:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2002:x1830967310357376:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147211.116245:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147211.116246:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147211.116248:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x3139939425062a15 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.116260:0:1136:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092562e00/0x3139939425062a1c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.116261:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f03cc00/0x31399394250628b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed98 expref: 21 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.116268:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x313993942506295f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1822719) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee0f expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.116269:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f03cc00/0x31399394250628b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed98 expref: 21 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.116274:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147211.116275:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746147211.116276:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311469056:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147211.116277:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092562e00/0x3139939425062a1c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.116295:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x313993942506295f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1822719) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee0f expref: 36 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.116302:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x313993942506295f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1822719) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee0f expref: 36 pid: 12225 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147211.116308:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311469184:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147211.116340:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19880 00000100:00100000:3.0:1746147211.116345:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2002:x1830967310357504:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147211.116351:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092563000/0x3139939425062997 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee32 expref: 19 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.116358:0:13712:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x3139939425062a23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.116358:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092563000/0x3139939425062997 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee32 expref: 19 pid: 12225 timeout: 849 lvb_type: 1 00000100:00100000:2.0:1746147211.116366:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311469312:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147211.116367:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x3139939425062958 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee08 expref: 20 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.116372:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147211.116373:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147211.116375:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x3139939425062a23 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.116387:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x3139939425062958 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee08 expref: 20 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.116387:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091f28800/0x313993942506286a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed4b expref: 36 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.116394:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x3139939425062958 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee08 expref: 20 pid: 12225 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.116394:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091f28800/0x313993942506286a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed4b expref: 36 pid: 9584 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.116400:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311469440:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147211.116405:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311469568:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147211.116414:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caad80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147211.116433:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19881 00000100:00100000:3.0:1746147211.116434:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147211.116437:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2002:x1830967310357632:12345-192.168.204.25@tcp:1:lfs.0 00000100:00100000:3.0:1746147211.116441:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20600 going to sleep for 11 seconds 00010000:00010000:2.0:1746147211.116452:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f09fc00/0x3139939425062a2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.116461:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009372ca00/0x3139939425062951 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee01 expref: 21 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.116467:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250629ba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee55 expref: 16 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.116475:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.116476:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.116478:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f09fc00/0x3139939425062a2a lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.116492:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250629ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee55 expref: 16 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.116499:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250629ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee55 expref: 16 pid: 1136 timeout: 849 lvb_type: 1 00000100:00100000:2.0:1746147211.116507:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311469696:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147211.116530:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009372ca00/0x3139939425062951 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee01 expref: 21 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.116537:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009372ca00/0x3139939425062951 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee01 expref: 21 pid: 13695 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.116543:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311469824:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147211.116932:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00010000:00010000:1.0:1746147211.117753:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x31399394250629ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee39 expref: 16 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147211.117763:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x31399394250629ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee39 expref: 16 pid: 1136 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746147211.117772:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311469952:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147211.117801:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942506289b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed83 expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.117809:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942506289b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed83 expref: 29 pid: 1136 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.117817:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311470080:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147211.117835:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550bb40 going to sleep for 11 seconds 00010000:00010000:0.0:1746147211.119066:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x313993942506299e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee40 expref: 16 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147211.119080:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x313993942506299e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee40 expref: 16 pid: 13712 timeout: 849 lvb_type: 1 00000100:00100000:0.0:1746147211.119104:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311470208:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147211.119537:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a73600/0x31399394250628a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed91 expref: 29 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.119546:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a73600/0x31399394250628a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed91 expref: 29 pid: 12225 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746147211.119554:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095120000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311470336:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147211.119577:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147211.123440:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.123555:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311469184:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147211.123555:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311469568:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147211.123576:0:1136:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092562e00/0x3139939425062a1c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.123576:0:13712:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x3139939425062a23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147211.123699:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311468800:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147211.123710:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311469312:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147211.123717:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311469440:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147211.123730:0:1398:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012e261000/0x3139939425062a0e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.123797:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310357760 00000100:00100000:1.0:1746147211.123805:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310357760 00010000:00010000:1.0:1746147211.123838:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092563000/0x3139939425062997 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee32 expref: 20 pid: 12225 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746147211.123877:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9023 00000100:00100000:1.0:1746147211.123883:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967310357760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.123896:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.123915:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092563000/0x3139939425062997 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee32 expref: 20 pid: 12225 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.123929:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092563000/0x3139939425062997 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee32 expref: 20 pid: 12225 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.123950:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092563000/0x3139939425062997 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee32 expref: 20 pid: 12225 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.123968:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.124002:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310357760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 120us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.124008:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9023 00000100:00100000:0.0:1746147211.124342:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311469056:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147211.124352:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311470208:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147211.124608:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311469696:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147211.124616:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311469824:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147211.124629:0:1854:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f09fc00/0x3139939425062a2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147211.124683:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.125832:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311468928:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147211.125843:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311469952:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147211.125851:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311470080:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147211.125871:0:9584:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425062a07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.125937:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310358656 00000100:00100000:3.0:1746147211.125943:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310358656 00010000:00010000:3.0:1746147211.125987:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009844a200/0x31399394250628a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed8a expref: 22 pid: 1136 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147211.126009:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9024 00000100:00100000:3.0:1746147211.126016:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2003:x1830967310358656:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147211.126026:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147211.126043:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009844a200/0x31399394250628a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed8a expref: 22 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.126052:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009844a200/0x31399394250628a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed8a expref: 22 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.126068:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009844a200/0x31399394250628a2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed8a expref: 22 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.126086:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147211.126143:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2003:x1830967310358656:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 127us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.126149:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9024 00000100:00080000:1.0:1746147211.126268:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147211.126835:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.126944:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095120000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311470336:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147211.126967:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x3139939425062a15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.127069:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.129101:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.129128:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.129145:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310358400 00000100:00100000:3.0:1746147211.129151:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310358400 00010000:00010000:3.0:1746147211.129183:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009372ca00/0x3139939425062951 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee01 expref: 21 pid: 13695 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147211.129206:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310358784 00000100:00100000:3.0:1746147211.129208:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310358784 00010000:00010000:3.0:1746147211.129217:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091f28800/0x313993942506286a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed4b expref: 37 pid: 9584 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147211.129230:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9025 00000100:00100000:3.0:1746147211.129237:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310358400:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147211.129250:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147211.129269:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009372ca00/0x3139939425062951 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee01 expref: 21 pid: 13695 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.129278:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009372ca00/0x3139939425062951 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee01 expref: 21 pid: 13695 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.129303:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009372ca00/0x3139939425062951 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee01 expref: 21 pid: 13695 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.129318:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147211.129351:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310358400:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 115us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.129357:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9025 00000100:00100000:3.0:1746147211.129371:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9026 00000100:00100000:3.0:1746147211.129375:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310358784:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147211.129382:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147211.129393:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091f28800/0x313993942506286a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed4b expref: 37 pid: 9584 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.129401:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091f28800/0x313993942506286a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed4b expref: 37 pid: 9584 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.129412:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091f28800/0x313993942506286a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed4b expref: 37 pid: 9584 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.129421:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147211.129435:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310358784:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 59us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.129440:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9026 00000100:00100000:3.0:1746147211.129467:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.129482:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310358016 00000100:00100000:3.0:1746147211.129485:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310358016 00010000:00010000:3.0:1746147211.129497:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e000/0x3139939425062894 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed7c expref: 21 pid: 12225 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147211.129511:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9027 00000100:00100000:3.0:1746147211.129516:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310358016:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147211.129522:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147211.129529:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e000/0x3139939425062894 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed7c expref: 21 pid: 12225 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.129538:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e000/0x3139939425062894 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed7c expref: 21 pid: 12225 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.129549:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e000/0x3139939425062894 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed7c expref: 21 pid: 12225 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.129558:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.129560:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.129565:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e261000/0x3139939425062a0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.129574:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e261000/0x3139939425062a0e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.129595:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147211.129607:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310358016:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 92us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.129612:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9027 00000100:00100000:3.0:1746147211.129687:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.129698:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310358272 00000100:00100000:3.0:1746147211.129702:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310358272 00010000:00010000:3.0:1746147211.129714:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250629ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee55 expref: 17 pid: 1136 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746147211.129725:0:1398:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012e261000/0x3139939425062a0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.129727:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9028 00000100:00100000:3.0:1746147211.129731:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310358272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147211.129736:0:1398:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e261000/0x3139939425062a0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.129737:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147211.129744:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250629ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee55 expref: 17 pid: 1136 timeout: 849 lvb_type: 1 00010000:00010000:3.0:1746147211.129751:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250629ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee55 expref: 17 pid: 1136 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746147211.129754:0:1398:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e261000/0x3139939425062a0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.129762:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009372d000/0x31399394250629ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee55 expref: 17 pid: 1136 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746147211.129762:0:1398:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e261000/0x3139939425062a0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.129769:0:1398:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e261000/0x3139939425062a0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.129770:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.129771:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.129773:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f09fc00/0x3139939425062a2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.129776:0:1398:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e261000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147211.129779:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f09fc00/0x3139939425062a2a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.129779:0:1398:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e261000/0x3139939425062a0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.129788:0:1398:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e261000/0x3139939425062a0e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.129793:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147211.129805:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310358272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 74us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.129811:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9028 00000100:00100000:3.0:1746147211.129837:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.129845:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310358528 00000100:00100000:3.0:1746147211.129847:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310358528 00010000:00010000:3.0:1746147211.129856:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x31399394250629ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee39 expref: 16 pid: 1136 timeout: 849 lvb_type: 1 00000100:00100000:3.0:1746147211.129868:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9029 00000100:00100000:3.0:1746147211.129872:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310358528:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147211.129877:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147211.129885:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x31399394250629ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee39 expref: 16 pid: 1136 timeout: 849 lvb_type: 1 00010000:00010000:3.0:1746147211.129892:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x31399394250629ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee39 expref: 16 pid: 1136 timeout: 849 lvb_type: 1 00010000:00010000:3.0:1746147211.129902:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009372c600/0x31399394250629ac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee39 expref: 16 pid: 1136 timeout: 849 lvb_type: 1 00010000:00010000:3.0:1746147211.129909:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147211.129922:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310358528:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 50us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.129927:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9029 00010000:00010000:0.0:1746147211.129958:0:1398:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e261000/0x3139939425062a0e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.129961:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.129970:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310358912 00010000:00010000:0.0:1746147211.129971:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e261000/0x3139939425062a0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.129972:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310358912 00010000:00010000:3.0:1746147211.129981:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x313993942506299e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee40 expref: 15 pid: 13712 timeout: 849 lvb_type: 1 00000100:00100000:3.0:1746147211.129993:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9030 00000100:00100000:3.0:1746147211.129997:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310358912:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147211.130003:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147211.130010:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x313993942506299e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee40 expref: 15 pid: 13712 timeout: 849 lvb_type: 1 00010000:00010000:3.0:1746147211.130018:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x313993942506299e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee40 expref: 15 pid: 13712 timeout: 849 lvb_type: 1 00010000:00010000:3.0:1746147211.130027:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x313993942506299e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee40 expref: 15 pid: 13712 timeout: 849 lvb_type: 1 00000100:00100000:0.0:1746147211.130028:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2002:x1830967310356992:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 14039us (14300us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147211.130035:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147211.130047:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310358912:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 50us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.130052:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9030 00000100:00100000:3.0:1746147211.130107:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.130118:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310359040 00000100:00100000:3.0:1746147211.130120:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310359040 00010000:00010000:3.0:1746147211.130130:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942506289b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed83 expref: 30 pid: 1136 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147211.130140:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9031 00000100:00100000:3.0:1746147211.130144:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310359040:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147211.130149:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147211.130155:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942506289b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed83 expref: 30 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.130162:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942506289b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed83 expref: 30 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.130171:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e05a00/0x313993942506289b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed83 expref: 30 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.130179:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.130180:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.130183:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425062a07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.130189:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425062a07 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.130203:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147211.130219:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310359040:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 75us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.130224:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9031 00000100:00100000:3.0:1746147211.130256:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.130265:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310359168 00000100:00100000:3.0:1746147211.130267:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310359168 00010000:00010000:3.0:1746147211.130275:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03cc00/0x31399394250628b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed98 expref: 20 pid: 1136 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147211.130291:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9032 00000100:00100000:3.0:1746147211.130295:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2002:x1830967310359168:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147211.130300:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147211.130301:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19876 00010000:00010000:3.0:1746147211.130306:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f03cc00/0x31399394250628b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed98 expref: 20 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.130313:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f03cc00/0x31399394250628b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed98 expref: 20 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.130322:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f03cc00/0x31399394250628b0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed98 expref: 20 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.130329:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147211.130387:0:9584:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425062a07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.130395:0:9584:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425062a07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.130408:0:9584:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425062a07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.130414:0:9584:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425062a07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.130419:0:9584:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425062a07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.130424:0:9584:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbe1400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147211.130427:0:9584:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425062a07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.130432:0:9584:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425062a07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.130440:0:9584:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425062a07 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.130445:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1400/0x3139939425062a07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147211.130944:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310357888 00000100:00100000:0.0:1746147211.130945:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310358144 00000100:00100000:2.0:1746147211.130949:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310357888 00000100:00100000:0.0:1746147211.130949:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310358144 00000100:00100000:3.0:1746147211.130977:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2002:x1830967310359168:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 679us (719us total) trans 0 rc 0/0 00002000:00100000:2.0:1746147211.130978:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1290240->1822719) req@ffff880098c70380 x1830967310357888/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147211.130978:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4268031) req@ffff880098c71c00 x1830967310358144/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147211.130984:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9032 00002000:00100000:2.0:1746147211.130987:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c70380 with x1830967310357888 ext(1290240->1822719) 00002000:00100000:0.0:1746147211.130987:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c71c00 with x1830967310358144 ext(4194304->4268031) 00010000:00010000:2.0:1746147211.130993:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x313993942506295f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee0f expref: 36 pid: 12225 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746147211.130993:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x3139939425062958 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee08 expref: 20 pid: 12225 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.131002:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x313993942506295f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee0f expref: 36 pid: 12225 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746147211.131002:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x3139939425062958 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee08 expref: 20 pid: 12225 timeout: 849 lvb_type: 0 00002000:00010000:2.0:1746147211.131008:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098c70380 00002000:00010000:0.0:1746147211.131008:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098c71c00 00000100:00100000:2.0:1746147211.131021:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1716 00000100:00100000:2.0:1746147211.131029:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310357888:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147211.131032:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1717 00000100:00100000:0.0:1746147211.131036:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310358144:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147211.131080:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2002:x1830967310357120:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 15081us (15301us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.131086:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19877 00010000:00010000:2.0:1746147211.131246:0:1854:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f09fc00/0x3139939425062a2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.131254:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f09fc00/0x3139939425062a2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.131267:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f09fc00/0x3139939425062a2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.131273:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f09fc00/0x3139939425062a2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.131278:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f09fc00/0x3139939425062a2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.131282:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f09fc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147211.131285:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f09fc00/0x3139939425062a2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.131289:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f09fc00/0x3139939425062a2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.131297:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f09fc00/0x3139939425062a2a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.131302:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f09fc00/0x3139939425062a2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147211.131346:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2002:x1830967310357632:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 14908us (15470us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.131352:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19881 00000100:00100000:3.0:1746147211.131417:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.131587:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310359296 00000100:00100000:2.0:1746147211.131591:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310359296 00010000:00010000:2.0:1746147211.131604:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a73600/0x31399394250628a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed91 expref: 29 pid: 12225 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.131618:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9033 00000100:00100000:2.0:1746147211.131622:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310359296:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147211.131629:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147211.131636:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a73600/0x31399394250628a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed91 expref: 29 pid: 12225 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.131643:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a73600/0x31399394250628a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed91 expref: 29 pid: 12225 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.131664:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a73600/0x31399394250628a9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed91 expref: 29 pid: 12225 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.131671:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.131672:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.131675:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x3139939425062a15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.131681:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x3139939425062a15 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.131695:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147211.131799:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x3139939425062a15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.131808:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x3139939425062a15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.131825:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x3139939425062a15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.131832:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x3139939425062a15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.131837:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x3139939425062a15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.131843:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a31e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147211.131845:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x3139939425062a15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.131850:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x3139939425062a15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.131860:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x3139939425062a15 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.131866:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x3139939425062a15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147211.131907:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310359296:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 283us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147211.131909:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2002:x1830967310357248:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 15710us (16099us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.131913:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9033 00000100:00100000:0.0:1746147211.131915:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19878 00000100:00100000:1.0:1746147211.137867:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310358144:12345-192.168.204.25@tcp:4:cat.0 Request processed in 6815us (10782us total) trans 21474842619 rc 0/0 00000100:00100000:1.0:1746147211.137881:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1717 00002000:00100000:1.0:1746147211.137894:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4268031) req@ffff880098c71c00 x1830967310358144/t21474842619(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/448 e 0 to 0 dl 1746147222 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147211.137905:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c71c00 with x1830967310358144 ext(4194304->4268031) 00010000:00010000:1.0:1746147211.137915:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x3139939425062958 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee08 expref: 22 pid: 12225 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.137929:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x3139939425062958 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee08 expref: 22 pid: 12225 timeout: 849 lvb_type: 0 00002000:00010000:1.0:1746147211.137936:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098c71c00 00000001:00080000:0.0:1746147211.140336:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842619 is committed 00000001:00080000:0.0:1746147211.140349:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842618 is committed 00000001:00080000:0.0:1746147211.140358:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842616 is committed 00000001:00080000:0.0:1746147211.140384:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842598 is committed 00000100:00100000:2.0:1746147211.141654:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2000:x1830967310357888:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 10606us (14803us total) trans 21474842620 rc 0/0 00000100:00100000:2.0:1746147211.141666:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1716 00002000:00100000:2.0:1746147211.141678:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1290240->1822719) req@ffff880098c70380 x1830967310357888/t21474842620(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/448 e 0 to 0 dl 1746147222 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.141688:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c70380 with x1830967310357888 ext(1290240->1822719) 00010000:00010000:2.0:1746147211.141698:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x313993942506295f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee0f expref: 22 pid: 12225 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.141711:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x313993942506295f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee0f expref: 22 pid: 12225 timeout: 849 lvb_type: 0 00002000:00010000:2.0:1746147211.141717:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098c70380 00000100:00100000:0.0:1746147211.142960:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.143010:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310359424 00000100:00100000:2.0:1746147211.143018:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310359424 00010000:00010000:2.0:1746147211.143312:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x3139939425062958 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee08 expref: 6 pid: 12225 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.143351:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9034 00000100:00100000:2.0:1746147211.143359:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+6:2001:x1830967310359424:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147211.143372:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147211.143388:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x3139939425062958 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee08 expref: 6 pid: 12225 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.143399:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x3139939425062958 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee08 expref: 6 pid: 12225 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.143425:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x3139939425062958 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4268031) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee08 expref: 6 pid: 12225 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.143439:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.143441:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.143446:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x3139939425062a23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.143455:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x3139939425062a23 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.143485:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147211.143516:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+5:2001:x1830967310359424:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 159us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.143522:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9034 00010000:00010000:3.0:1746147211.143663:0:13712:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x3139939425062a23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.143671:0:13712:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x3139939425062a23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.143688:0:13712:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x3139939425062a23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.143700:0:13712:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x3139939425062a23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.143707:0:13712:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x3139939425062a23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.143714:0:13712:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092563600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147211.143718:0:13712:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x3139939425062a23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.143725:0:13712:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x3139939425062a23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.143736:0:13712:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x3139939425062a23 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.143742:0:13712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092563600/0x3139939425062a23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.143785:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2002:x1830967310357504:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 27438us (27934us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.143792:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19880 00000100:00100000:0.0:1746147211.145343:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311470464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147211.145398:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147211.145448:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746147211.145453:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311470592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746147211.145473:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147211.146025:0:12153:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311470464 00000100:00100000:0.0:1746147211.146032:0:12153:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311470464 00000100:00100000:0.0:1746147211.146149:0:12153:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311470592 00000100:00100000:0.0:1746147211.146151:0:12153:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311470592 00000100:00100000:0.0:1746147211.146167:0:12153:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:0.0:1746147211.146173:0:12153:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3764:x1830967311470464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746147211.146195:0:12153:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1312187456 pending 557056 free 3905277952 avail 3668594688 00000100:00100000:2.0:1746147211.146210:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.146259:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:1.0:1746147211.146267:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3764:x1830967311470592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746147211.146286:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1144738880 pending 3887104 free 3911233536 avail 3679711232 00000100:00100000:0.0:1746147211.146962:0:12153:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3764:x1830967311470464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 787us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147211.146968:0:12153:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1746147211.147034:0:3764:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474842616 gen 2 00000004:00080000:2.0:1746147211.147041:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e58a80, transno 21474842517 00000004:00080000:2.0:1746147211.148206:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e5a680, transno 21474842518 00000004:00080000:2.0:1746147211.148211:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e5b100, transno 21474842519 00000004:00080000:2.0:1746147211.148214:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8b2300, transno 21474842520 00000004:00080000:2.0:1746147211.148216:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e59880, transno 21474842521 00000004:00080000:2.0:1746147211.148218:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e5b800, transno 21474842522 00000004:00080000:2.0:1746147211.148221:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e58e00, transno 21474842523 00000004:00080000:2.0:1746147211.148223:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093147480, transno 21474842529 00000004:00080000:2.0:1746147211.148225:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093145f80, transno 21474842530 00000004:00080000:2.0:1746147211.148228:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3ced80, transno 21474842531 00000004:00080000:2.0:1746147211.148231:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093144700, transno 21474842532 00000004:00080000:2.0:1746147211.148233:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093144e00, transno 21474842533 00000004:00080000:2.0:1746147211.148235:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093145c00, transno 21474842534 00000004:00080000:2.0:1746147211.148237:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3ce300, transno 21474842535 00000004:00080000:2.0:1746147211.148240:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258c000, transno 21474842536 00000004:00080000:2.0:1746147211.148242:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c71f80, transno 21474842537 00000004:00080000:2.0:1746147211.148245:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f8a80, transno 21474842542 00000004:00080000:2.0:1746147211.148248:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095062d80, transno 21474842543 00000004:00080000:2.0:1746147211.148250:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fa300, transno 21474842544 00000004:00080000:2.0:1746147211.148253:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095060000, transno 21474842545 00000004:00080000:2.0:1746147211.148255:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fbb80, transno 21474842546 00000004:00080000:2.0:1746147211.148257:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909f8380, transno 21474842547 00000004:00080000:2.0:1746147211.148260:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800769d9f80, transno 21474842548 00000004:00080000:2.0:1746147211.148262:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fb100, transno 21474842549 00000004:00080000:2.0:1746147211.148264:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800909fb480, transno 21474842550 00000004:00080000:2.0:1746147211.148266:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f56a00, transno 21474842551 00000004:00080000:2.0:1746147211.148269:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258ea00, transno 21474842552 00000004:00080000:2.0:1746147211.148271:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095149f80, transno 21474842553 00000004:00080000:2.0:1746147211.148273:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258f100, transno 21474842554 00000004:00080000:2.0:1746147211.148275:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009514a300, transno 21474842555 00000004:00080000:2.0:1746147211.148278:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258d880, transno 21474842556 00000004:00080000:2.0:1746147211.148280:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258ce00, transno 21474842557 00000004:00080000:2.0:1746147211.148283:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbc3b80, transno 21474842558 00000004:00080000:2.0:1746147211.148285:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258f480, transno 21474842559 00000004:00080000:2.0:1746147211.148287:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800933f5880, transno 21474842561 00000004:00080000:2.0:1746147211.148289:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800933f6300, transno 21474842562 00000004:00080000:2.0:1746147211.148291:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800933f5500, transno 21474842563 00000004:00080000:2.0:1746147211.148294:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800933f5c00, transno 21474842564 00000004:00080000:2.0:1746147211.148296:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800933f6d80, transno 21474842565 00000004:00080000:2.0:1746147211.148298:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800933f4e00, transno 21474842566 00000004:00080000:2.0:1746147211.148301:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800933f6a00, transno 21474842567 00000004:00080000:2.0:1746147211.148303:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800933f6680, transno 21474842568 00000004:00080000:2.0:1746147211.148304:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800933f7100, transno 21474842569 00000004:00080000:2.0:1746147211.148307:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800769dad80, transno 21474842570 00000004:00080000:2.0:1746147211.148309:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099010380, transno 21474842571 00000004:00080000:2.0:1746147211.148312:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099012a00, transno 21474842572 00000004:00080000:2.0:1746147211.148314:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009514dc00, transno 21474842573 00000004:00080000:2.0:1746147211.148316:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800769daa00, transno 21474842574 00000100:00100000:1.0:1746147211.148316:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3764:x1830967311470592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2049us (2840us total) trans 0 rc 0/0 00000004:00080000:2.0:1746147211.148318:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009514fb80, transno 21474842575 00000004:00080000:2.0:1746147211.148321:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800769d9880, transno 21474842576 00000004:00080000:2.0:1746147211.148323:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099010000, transno 21474842577 00000004:00080000:2.0:1746147211.148325:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009988bb80, transno 21474842578 00000100:00100000:1.0:1746147211.148325:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000004:00080000:2.0:1746147211.148328:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097eb9500, transno 21474842586 00000004:00080000:2.0:1746147211.148330:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097ebad80, transno 21474842587 00000004:00080000:2.0:1746147211.148332:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097ebaa00, transno 21474842588 00000004:00080000:2.0:1746147211.148334:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097ebb480, transno 21474842589 00000004:00080000:2.0:1746147211.148336:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097eb9c00, transno 21474842590 00000004:00080000:2.0:1746147211.148338:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097eba300, transno 21474842591 00000004:00080000:2.0:1746147211.148341:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097eb9f80, transno 21474842592 00000004:00080000:2.0:1746147211.148343:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097eb9880, transno 21474842593 00000004:00080000:2.0:1746147211.148345:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097eb8a80, transno 21474842594 00000004:00080000:2.0:1746147211.148348:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ef800, transno 21474842599 00000004:00080000:2.0:1746147211.148350:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ec700, transno 21474842600 00000004:00080000:2.0:1746147211.148352:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ef480, transno 21474842601 00000004:00080000:2.0:1746147211.148354:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ed500, transno 21474842602 00000004:00080000:2.0:1746147211.148356:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ed880, transno 21474842603 00000100:00100000:1.0:1746147211.148357:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310359552 00000004:00080000:2.0:1746147211.148358:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ee300, transno 21474842604 00000004:00080000:2.0:1746147211.148361:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d4380, transno 21474842605 00000100:00100000:1.0:1746147211.148361:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310359552 00000004:00080000:2.0:1746147211.148363:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d5f80, transno 21474842606 00000004:00080000:2.0:1746147211.148365:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ece00, transno 21474842607 00000004:00080000:2.0:1746147211.148368:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d7b80, transno 21474842608 00000004:00080000:2.0:1746147211.148370:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d7800, transno 21474842609 00000004:00080000:2.0:1746147211.148373:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d7480, transno 21474842610 00000004:00080000:2.0:1746147211.148375:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d4700, transno 21474842611 00000004:00080000:2.0:1746147211.148377:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d6d80, transno 21474842612 00000004:00080000:2.0:1746147211.148384:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d7100, transno 21474842613 00000004:00080000:2.0:1746147211.148387:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d6300, transno 21474842614 00000004:00080000:2.0:1746147211.148389:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d5180, transno 21474842615 00010000:00010000:1.0:1746147211.148389:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x313993942506295f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1290240->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee0f expref: 22 pid: 12225 timeout: 849 lvb_type: 0 00000004:00080000:2.0:1746147211.148392:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d4000, transno 21474842616 00000100:00100000:2.0:1746147211.148405:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311470464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746147211.148413:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9035 00000100:00100000:1.0:1746147211.148419:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2003:x1830967310359552:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.148432:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147211.148436:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311470592:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1746147211.148452:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x313993942506295f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1290240->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee0f expref: 22 pid: 12225 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.148470:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x313993942506295f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1290240->1822719) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee0f expref: 22 pid: 12225 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.148494:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x313993942506295f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1290240->1822719) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee0f expref: 22 pid: 12225 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.148512:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.148514:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.148518:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092562e00/0x3139939425062a1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.148526:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092562e00/0x3139939425062a1c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746147211.149057:0:8110:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 79 done 00010000:00010000:1.0:1746147211.149138:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.149177:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2003:x1830967310359552:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 757us (2968us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.149184:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9035 00010000:00010000:2.0:1746147211.150424:0:1136:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092562e00/0x3139939425062a1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.150435:0:1136:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092562e00/0x3139939425062a1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.150457:0:1136:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092562e00/0x3139939425062a1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.150464:0:1136:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092562e00/0x3139939425062a1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.150472:0:1136:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092562e00/0x3139939425062a1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.150479:0:1136:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092562e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147211.150483:0:1136:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092562e00/0x3139939425062a1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.150490:0:1136:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092562e00/0x3139939425062a1c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.150504:0:1136:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092562e00/0x3139939425062a1c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.150510:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092562e00/0x3139939425062a1c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147211.150568:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2002:x1830967310357376:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 34321us (34729us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.150576:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19879 00000100:00100000:2.0:1746147211.156467:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.156545:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310359808 00000100:00100000:0.0:1746147211.156554:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310359808 00000100:00100000:0.0:1746147211.156598:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16448 00000100:00100000:0.0:1746147211.156604:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2853:x1830967310359808:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:0.0:1746147211.156668:0:6215:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147211.156701:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092562c00/0x31399394250629dd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee63 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.156720:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147211.156725:0:6215:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147211.156754:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425062a31 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.156767:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed21 expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.156774:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425062840 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed2f expref: 30 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.156780:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3800/0x3139939425062855 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed3d expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.156785:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425062a31 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.156817:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3800/0x3139939425062855 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed3d expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.156828:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3800/0x3139939425062855 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed3d expref: 12 pid: 6215 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746147211.156842:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095123800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311470720:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147211.156947:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425062840 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed2f expref: 30 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.156955:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425062840 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed2f expref: 30 pid: 9138 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746147211.156961:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095121180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311470848:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147211.156985:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed21 expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.156991:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed21 expref: 12 pid: 6215 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746147211.156998:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095122300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311470976:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147211.157011:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147211.158767:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095123800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311470720:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147211.158775:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095121180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311470848:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147211.158782:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095122300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311470976:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147211.158806:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425062a31 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147211.160495:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.160539:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.160572:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310359936 00000100:00100000:2.0:1746147211.160579:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310359936 00010000:00010000:2.0:1746147211.160613:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425062840 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed2f expref: 31 pid: 9138 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746147211.160626:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.160770:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310360064 00000100:00100000:1.0:1746147211.160775:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310360064 00010000:00010000:1.0:1746147211.160792:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed21 expref: 13 pid: 6215 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.160815:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310360192 00000100:00100000:1.0:1746147211.160817:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310360192 00010000:00010000:1.0:1746147211.160825:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3800/0x3139939425062855 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed3d expref: 14 pid: 6215 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.160846:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9036 00000100:00100000:1.0:1746147211.160852:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310360064:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.160864:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.160869:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed21 expref: 14 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.160877:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed21 expref: 14 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.160899:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009371d800/0x3139939425062816 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed21 expref: 14 pid: 6215 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147211.160904:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9037 00000100:00100000:3.0:1746147211.160911:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310360192:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.160918:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147211.160921:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.160923:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425062a31 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.160924:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3800/0x3139939425062855 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed3d expref: 13 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.160931:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147211.160932:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3800/0x3139939425062855 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed3d expref: 13 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.160941:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cd3800/0x3139939425062855 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed3d expref: 13 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.160951:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147211.160954:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425062a31 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.160958:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147211.160970:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967310360192:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 61us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.160970:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310360064:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 118us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.160976:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9037 00000100:00100000:1.0:1746147211.161595:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9036 00000100:00100000:1.0:1746147211.161609:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9038 00000100:00100000:1.0:1746147211.161615:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967310359936:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.161623:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.161628:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425062840 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed2f expref: 31 pid: 9138 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.161643:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425062840 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed2f expref: 31 pid: 9138 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.161669:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009256f600/0x3139939425062840 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ed2f expref: 31 pid: 9138 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.161678:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147211.161681:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425062a31 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.161688:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425062a31 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.161697:0:13715:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425062a31 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.161725:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.161749:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310359936:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 134us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.161755:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9038 00010000:00010000:2.0:1746147211.161933:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425062a31 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.161941:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425062a31 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000040:00080000:2.0:1746147211.162265:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1263, 88 off119000 00000004:00080000:2.0:1746147211.162271:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749152181195ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147211.162301:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1262, 88 off118912 00000004:00080000:2.0:1746147211.162306:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749152216125ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147211.162317:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1263, 88 off119000 00000004:00080000:2.0:1746147211.162320:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749152230440ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147211.162328:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1264, 88 off119088 00000004:00080000:2.0:1746147211.162330:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749152240699ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147211.162338:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1265, 88 off119176 00000004:00080000:2.0:1746147211.162340:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749152251072ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147211.162349:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1264, 88 off119088 00000004:00080000:2.0:1746147211.162351:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749152261259ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147211.162357:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1265, 88 off119176 00000004:00080000:2.0:1746147211.162360:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749152270900ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147211.162367:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1266, 88 off119264 00000004:00080000:2.0:1746147211.162369:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749152279874ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147211.162751:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1266, 88 off119264 00000004:00080000:2.0:1746147211.162756:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749152667004ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147211.163116:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1267, 88 off119352 00000004:00080000:2.0:1746147211.163121:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749153031294ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147211.163134:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1267, 88 off119352 00000004:00080000:2.0:1746147211.163137:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749153047212ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147211.163144:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1268, 88 off119440 00000004:00080000:2.0:1746147211.163147:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749153057522ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147211.163154:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1268, 88 off119440 00000004:00080000:2.0:1746147211.163156:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749153067082ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147211.163164:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1269, 88 off119528 00000004:00080000:2.0:1746147211.163167:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749153077289ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147211.163174:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1270, 88 off119616 00000004:00080000:2.0:1746147211.163177:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749153087559ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147211.163185:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1271, 88 off119704 00000004:00080000:2.0:1746147211.163187:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749153097790ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147211.163195:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1269, 88 off119528 00000004:00080000:2.0:1746147211.163198:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749153108715ns, next at 694367916532ns, rc = 0 00000001:00080000:3.0:1746147211.168168:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937351 is committed 00000004:00080000:3.0:1746147211.168179:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1246 committed 00000004:00080000:3.0:1746147211.168195:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1251 committed 00000100:00100000:0.0:1746147211.168382:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746147211.168422:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311471232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147211.168479:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147211.168499:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1250 committed 00000004:00080000:3.0:1746147211.168501:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1249 committed 00000004:00080000:3.0:1746147211.168503:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1248 committed 00000004:00080000:3.0:1746147211.168505:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1245 committed 00000004:00080000:3.0:1746147211.168507:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1247 committed 00000004:00080000:3.0:1746147211.168508:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1244 committed 00000004:00080000:3.0:1746147211.168510:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1246 committed 00000004:00080000:3.0:1746147211.168511:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1243 committed 00000004:00080000:3.0:1746147211.168513:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1242 committed 00000004:00080000:3.0:1746147211.168515:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1241 committed 00000004:00080000:3.0:1746147211.168518:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1245 committed 00000004:00080000:3.0:1746147211.168519:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1244 committed 00000004:00080000:3.0:1746147211.168521:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1240 committed 00000004:00080000:3.0:1746147211.168522:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1239 committed 00000004:00080000:3.0:1746147211.168523:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1243 committed 00000001:00080000:3.0:1746147211.168533:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937348 is committed 00000001:00080000:3.0:1746147211.168537:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937347 is committed 00000100:00100000:2.0:1746147211.168579:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311471360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147211.168670:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311471488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147211.168770:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147211.168771:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311471104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147211.168792:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147211.168799:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311472000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147211.168809:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311471744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147211.168821:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147211.168836:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311471232 00000100:00100000:0.0:1746147211.168842:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311471232 00000100:00100000:1.0:1746147211.168851:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311472512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147211.168866:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147211.168904:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311471616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147211.168959:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311471488 00000100:00100000:0.0:1746147211.168961:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311471488 00000100:00100000:1.0:1746147211.168973:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311473024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147211.168975:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311471104 00000100:00100000:0.0:1746147211.168976:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311471104 00000100:00100000:0.0:1746147211.168984:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311472000 00000100:00100000:0.0:1746147211.168986:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311472000 00000100:00100000:1.0:1746147211.168991:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147211.169002:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311472512 00000100:00100000:0.0:1746147211.169004:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311472512 00000100:00100000:1.0:1746147211.169008:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1746147211.169012:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311471872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147211.169014:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311473024 00000100:00100000:0.0:1746147211.169016:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311473024 00000100:00100000:0.0:1746147211.169027:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19882 00000100:00100000:1.0:1746147211.169028:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147211.169033:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3767:x1830967311471232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147211.169039:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311472384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147211.169050:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147211.169056:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311472896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147211.169067:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147211.169108:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311471872 00000100:00100000:1.0:1746147211.169113:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311471872 00000100:00100000:1.0:1746147211.169135:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311472384 00000100:00100000:1.0:1746147211.169137:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311472384 00000100:00100000:1.0:1746147211.169143:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311472896 00000100:00100000:1.0:1746147211.169145:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311472896 00000100:00100000:1.0:1746147211.169155:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19883 00000100:00100000:1.0:1746147211.169161:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3765:x1830967311471488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147211.169172:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3767:x1830967311471232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 138us (693us total) trans 17179875236 rc 0/0 00000100:00100000:0.0:1746147211.169178:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19882 00000100:00100000:0.0:1746147211.169190:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19884 00000100:00100000:0.0:1746147211.169195:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3767:x1830967311471104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147211.169243:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3767:x1830967311471104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (451us total) trans 17179875237 rc 0/0 00000100:00100000:0.0:1746147211.169247:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19884 00000100:00100000:0.0:1746147211.169255:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19885 00002000:00010000:1.0:1746147211.169257:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746147211.169259:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3765:x1830967311472000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147211.169260:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147211.169262:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147211.169264:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147211.169266:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746147211.169290:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3765:x1830967311471488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 129us (521us total) trans 17179875238 rc 0/0 00000100:00100000:1.0:1746147211.169296:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19883 00000100:00100000:1.0:1746147211.169316:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19886 00000100:00100000:0.0:1746147211.169316:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3765:x1830967311472000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (494us total) trans 21474842621 rc 0/0 00000100:00100000:1.0:1746147211.169322:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3765:x1830967311472512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147211.169322:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19885 00000100:00100000:0.0:1746147211.169331:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19887 00000100:00100000:0.0:1746147211.169335:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3765:x1830967311473024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147211.169377:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19888 00002000:00010000:0.0:1746147211.169380:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00000100:00100000:1.0:1746147211.169383:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3765:x1830967311471872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147211.169383:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147211.169385:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147211.169387:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147211.169388:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:0.0:1746147211.169405:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3765:x1830967311473024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (413us total) trans 21474842623 rc 0/0 00000100:00100000:0.0:1746147211.169412:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19887 00000100:00100000:0.0:1746147211.169421:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19889 00000100:00100000:0.0:1746147211.169425:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3765:x1830967311472384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147211.169426:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:1.0:1746147211.169429:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:1.0:1746147211.169430:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147211.169432:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:1.0:1746147211.169434:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:1.0:1746147211.169454:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3765:x1830967311471872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (426us total) trans 17179875239 rc 0/0 00000100:00100000:1.0:1746147211.169459:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19888 00000100:00100000:1.0:1746147211.169470:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19890 00000100:00100000:1.0:1746147211.169475:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3765:x1830967311472896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147211.169562:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147211.169566:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147211.169567:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147211.169569:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147211.169571:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:1.0:1746147211.169590:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3765:x1830967311472896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (521us total) trans 21474842624 rc 0/0 00000100:00100000:1.0:1746147211.169595:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19890 00002000:00010000:1.0:1746147211.169623:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746147211.169625:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147211.169627:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147211.169629:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147211.169631:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:1.0:1746147211.169659:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3765:x1830967311472512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 338us (791us total) trans 21474842622 rc 0/0 00000100:00100000:1.0:1746147211.169664:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19886 00000004:00080000:1.0:1746147211.169696:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800933f4a80/2, rc 0, transno 17179875239 00000100:00100000:1.0:1746147211.169701:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311471872:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147211.169710:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801349a1880/2, rc 0, transno 21474842624 00000100:00100000:1.0:1746147211.169717:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311472896:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147211.169724:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801349a3100/2, rc 0, transno 21474842622 00000100:00100000:1.0:1746147211.169727:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311472512:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147211.169735:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801349a1180/2, rc 0, transno 21474842623 00000100:00100000:1.0:1746147211.169737:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311473024:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147211.169742:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800933f5180/2, rc 0, transno 17179875238 00000100:00100000:1.0:1746147211.169745:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311471488:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147211.169752:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801349a2a00/2, rc 0, transno 21474842621 00000100:00100000:1.0:1746147211.169754:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311472000:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147211.169853:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147211.169886:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311471360 00000100:00100000:2.0:1746147211.169890:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311471360 00000100:00100000:2.0:1746147211.169910:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19891 00000100:00100000:2.0:1746147211.169915:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3764:x1830967311471360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.169983:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3764:x1830967311471360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (130us total) trans 17179875241 rc 0/0 00000100:00100000:2.0:1746147211.169988:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19891 00000004:00080000:2.0:1746147211.170019:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800933f7b80/2, rc 0, transno 17179875241 00000100:00100000:2.0:1746147211.170023:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311471360:0@lo:2:osp-syn-1-0.0 00000004:00010000:2.0:1746147211.170057:0:6215:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8801349a3b80 reply state ffff88009522ec00 transno 8589937351 ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425062a31 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.170069:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425062a31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.170078:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147211.170079:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746147211.170081:0:6215:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746147211.170155:0:6215:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746147211.170182:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2853:x1830967310359808:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 13575us (13724us total) trans 8589937351 rc 0/0 00000100:00100000:2.0:1746147211.170187:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16448 00010000:00010000:1.0:1746147211.170393:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425062a31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.170403:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425062a31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.170409:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425062a31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.170414:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a31400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147211.170417:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425062a31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.170427:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425062a31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.170436:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147211.170438:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147211.170441:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425062a31 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.170446:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31400/0x3139939425062a31 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00000100:00100000:3.0:1746147211.171377:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147211.171421:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311472128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147211.171448:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147211.171461:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311472640:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147211.171475:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147211.171490:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311473152:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147211.171507:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147211.171528:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311471616 00000100:00100000:3.0:1746147211.171532:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311471616 00000100:00100000:3.0:1746147211.171551:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19892 00000100:00100000:3.0:1746147211.171557:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3766:x1830967311471616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147211.171642:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3766:x1830967311471616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (265us total) trans 17179875242 rc 0/0 00000100:00100000:3.0:1746147211.171659:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19892 00000100:00100000:3.0:1746147211.171670:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311472128 00000100:00100000:3.0:1746147211.171673:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311472128 00000100:00100000:3.0:1746147211.171696:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311472640 00000100:00100000:3.0:1746147211.171699:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311472640 00000100:00100000:3.0:1746147211.171712:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311473152 00000100:00100000:3.0:1746147211.171713:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311473152 00000100:00100000:3.0:1746147211.171724:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19893 00000100:00100000:3.0:1746147211.171727:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3766:x1830967311472128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147211.171729:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19894 00000100:00100000:1.0:1746147211.171737:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3766:x1830967311472640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147211.171779:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3766:x1830967311472128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (329us total) trans 17179875243 rc 0/0 00000100:00100000:3.0:1746147211.171784:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19893 00000100:00100000:3.0:1746147211.171793:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19895 00000100:00100000:3.0:1746147211.171798:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3766:x1830967311473152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147211.171810:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3766:x1830967311472640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (333us total) trans 21474842625 rc 0/0 00000100:00100000:1.0:1746147211.171815:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19894 00000100:00100000:3.0:1746147211.171856:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3766:x1830967311473152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (341us total) trans 21474842626 rc 0/0 00000100:00100000:3.0:1746147211.171860:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19895 00000004:00080000:3.0:1746147211.171887:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800933f6a00/2, rc 0, transno 21474842626 00000100:00100000:3.0:1746147211.171892:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311473152:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147211.171900:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800933f4700/2, rc 0, transno 17179875242 00000100:00100000:3.0:1746147211.171902:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311471616:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147211.171907:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800933f7480/2, rc 0, transno 17179875243 00000100:00100000:3.0:1746147211.171909:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311472128:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147211.171915:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801349a2680/2, rc 0, transno 21474842625 00000100:00100000:3.0:1746147211.171917:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311472640:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147211.172109:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147211.172134:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311472256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147211.172153:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147211.172176:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311472768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147211.172190:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147211.172199:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311471744 00000100:00100000:2.0:1746147211.172202:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311471744 00000004:00080000:1.0:1746147211.172208:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800933f4000/2, rc 0, transno 17179875236 00000100:00100000:1.0:1746147211.172211:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311471232:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147211.172219:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800933f4380/2, rc 0, transno 17179875237 00000100:00100000:1.0:1746147211.172221:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311471104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147211.172407:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3765:x1830967311472384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2981us (3355us total) trans 17179875240 rc 0/0 00000100:00100000:0.0:1746147211.172412:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19889 00000100:00100000:0.0:1746147211.172420:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311472256 00000100:00100000:0.0:1746147211.172422:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311472256 00000100:00100000:2.0:1746147211.172463:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311472768 00000100:00100000:2.0:1746147211.172465:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311472768 00000100:00100000:1.0:1746147211.172467:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19896 00000100:00100000:1.0:1746147211.172473:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e219050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3767:x1830967311471744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147211.172475:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19897 00000100:00100000:2.0:1746147211.172479:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3767:x1830967311472256:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147211.172521:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800933f5f80/2, rc 0, transno 17179875240 00000100:00100000:1.0:1746147211.172525:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311472384:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.172532:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3767:x1830967311472256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (378us total) trans 21474842627 rc 0/0 00000100:00100000:2.0:1746147211.172536:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19897 00000004:00080000:1.0:1746147211.172537:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801349a3480/2, rc 0, transno 21474842627 00000100:00100000:1.0:1746147211.172540:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311472256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147211.172543:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19898 00000100:00100000:2.0:1746147211.172546:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3767:x1830967311472768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147211.172577:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e219050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3767:x1830967311471744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (467us total) trans 21474842628 rc 0/0 00000100:00100000:1.0:1746147211.172582:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19896 00000100:00100000:3.0:1746147211.172695:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000004:00080000:1.0:1746147211.172700:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801349a0380/2, rc 0, transno 21474842628 00000100:00100000:1.0:1746147211.172703:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311471744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147211.172757:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310360320 00000100:00100000:2.0:1746147211.172760:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310360320 00000100:00100000:1.0:1746147211.172772:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3767:x1830967311472768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 223us (579us total) trans 21474842629 rc 0/0 00000100:00100000:1.0:1746147211.172777:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19898 00000004:00080000:0.0:1746147211.172791:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801349a1500/2, rc 0, transno 21474842629 00000100:00100000:0.0:1746147211.172794:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311472768:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147211.173001:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16449 00000100:00100000:2.0:1746147211.173006:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2853:x1830967310360320:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147211.173018:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.173029:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062a38 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee7f expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.173064:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062a38 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee7f expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.173075:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062a38 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee7f expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.173104:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147211.173107:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147211.173109:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c42a00, rc 0) 00000100:00100000:2.0:1746147211.173141:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2853:x1830967310360320:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 135us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.173146:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16449 00000100:00100000:3.0:1746147211.180052:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.180248:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310360448 00000100:00100000:0.0:1746147211.180257:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310360448 00000100:00100000:0.0:1746147211.180295:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16450 00000100:00100000:0.0:1746147211.180302:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2853:x1830967310360448:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147211.180317:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147211.180333:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425062a3f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee86 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.180403:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425062a46 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147211.180413:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425062a46 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147211.180422:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425062a46 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:0.0:1746147211.180440:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:0.0:1746147211.180443:0:7237:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746147211.180456:0:7237:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425062a46 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147211.180474:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31a00/0x3139939425062a3f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee86 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.180498:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425062a46 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee86 expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.180507:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147211.180510:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147211.180512:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a31000, rc 0) 00000100:00100000:0.0:1746147211.180548:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2853:x1830967310360448:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 247us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147211.180553:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16450 00000100:00100000:0.0:1746147211.182286:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.182437:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310360576 00000100:00100000:1.0:1746147211.182443:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310360576 00000100:00100000:1.0:1746147211.182487:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19899 00000100:00100000:1.0:1746147211.182493:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2001:x1830967310360576:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147211.182504:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147211.182519:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0c00/0x3139939425062a4d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee8d expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147211.182536:0:1136:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x93:0x0] initial LVB size: 1048576, mtime: 0x68141789, atime: 0x68141789, ctime: 0x6814178a, blocks: 0x7e8 00010000:00010000:1.0:1746147211.182549:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.182551:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.182558:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0c00/0x3139939425062a4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee8d expref: 9 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147211.182572:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0c00/0x3139939425062a4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee8d expref: 9 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147211.182579:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0c00, rc 0) 00000100:00100000:1.0:1746147211.183610:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310360576:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1111us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.183617:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19899 00000100:00100000:3.0:1746147211.183631:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.183664:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310360704 00000100:00100000:1.0:1746147211.183668:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310360704 00000100:00100000:1.0:1746147211.183698:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19900 00000100:00100000:1.0:1746147211.183704:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310360704:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147211.183713:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147211.183726:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0600/0x3139939425062a54 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee94 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.183736:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00010000:1.0:1746147211.183740:0:1136:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x96:0x0] initial LVB size: 2097152, mtime: 0x68141789, atime: 0x68141789, ctime: 0x6814178a, blocks: 0x808 00010000:00010000:1.0:1746147211.183751:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.183752:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.183757:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0600/0x3139939425062a54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee94 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147211.183763:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147211.183768:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0600/0x3139939425062a54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee94 expref: 12 pid: 1136 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147211.183775:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310360832 00010000:00010000:1.0:1746147211.183776:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0600, rc 0) 00000100:00100000:3.0:1746147211.183778:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310360832 00000100:00100000:3.0:1746147211.183793:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310360960 00000100:00100000:3.0:1746147211.183794:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310360960 00000100:00100000:1.0:1746147211.183795:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310360704:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 92us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.183800:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19900 00000100:00100000:3.0:1746147211.183808:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19901 00000100:00100000:3.0:1746147211.183812:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310360832:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147211.183818:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.183825:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x3139939425062a5b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ee9b expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147211.183834:0:12225:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x97:0x0] initial LVB size: 2097152, mtime: 0x68141789, atime: 0x68141789, ctime: 0x6814178a, blocks: 0x800 00010000:00010000:3.0:1746147211.183841:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.183843:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.183847:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x3139939425062a5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee9b expref: 13 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.183855:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x3139939425062a5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee9b expref: 13 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.183862:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fd000, rc 0) 00000100:00100000:3.0:1746147211.183875:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310360832:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 62us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.183981:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19902 00000100:00100000:1.0:1746147211.183989:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310360960:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147211.183999:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147211.184009:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425062a62 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eea2 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147211.184020:0:1136:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6814178a, atime: 0x68141789, ctime: 0x6814178a, blocks: 0x808 00010000:00010000:1.0:1746147211.184028:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.184029:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.184033:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425062a62 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eea2 expref: 10 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147211.184042:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425062a62 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eea2 expref: 10 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147211.184048:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe1000, rc 0) 00000100:00100000:1.0:1746147211.184063:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310360960:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 76us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.184068:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19902 00000100:00100000:3.0:1746147211.184211:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19901 00000100:00100000:0.0:1746147211.184258:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.184346:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.184366:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310361088 00000100:00100000:3.0:1746147211.184369:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310361088 00000100:00100000:3.0:1746147211.184383:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310361216 00000100:00100000:3.0:1746147211.184384:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310361216 00000100:00100000:2.0:1746147211.184393:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19903 00000100:00100000:2.0:1746147211.184400:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310361088:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147211.184407:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147211.184408:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19904 00000100:00100000:3.0:1746147211.184412:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310361216:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147211.184417:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42c00/0x3139939425062a69 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eea9 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.184419:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.184426:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425062a70 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eeb0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147211.184430:0:13695:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4886560, mtime: 0x6814178a, atime: 0x6814178a, ctime: 0x6814178a, blocks: 0x1558 00002000:00010000:3.0:1746147211.184436:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x98:0x0] initial LVB size: 4194304, mtime: 0x6814178a, atime: 0x6814178a, ctime: 0x6814178a, blocks: 0x1008 00010000:00010000:2.0:1746147211.184439:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.184440:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.184443:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.184444:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.184445:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42c00/0x3139939425062a69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eea9 expref: 11 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.184448:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425062a70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb0 expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.184455:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42c00/0x3139939425062a69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eea9 expref: 11 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.184457:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425062a70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb0 expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.184462:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c42c00, rc 0) 00010000:00010000:3.0:1746147211.184463:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fca00, rc 0) 00000100:00100000:3.0:1746147211.184483:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310361216:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 70us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.184487:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19904 00000100:00100000:2.0:1746147211.184788:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310361088:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 388us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.184794:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19903 00000100:00100000:0.0:1746147211.188358:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.188398:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.188427:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.188556:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.188606:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.188830:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310361344 00000100:00100000:2.0:1746147211.188838:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310361344 00000100:00100000:0.0:1746147211.188861:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.188888:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310361600 00000100:00100000:2.0:1746147211.188891:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310361600 00000100:00100000:3.0:1746147211.188896:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310361856 00000100:00100000:3.0:1746147211.188899:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310361856 00000100:00100000:0.0:1746147211.188902:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310361472 00000100:00100000:0.0:1746147211.188906:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310361472 00000100:00100000:2.0:1746147211.188910:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310361728 00000100:00100000:3.0:1746147211.188912:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310361984 00000100:00100000:2.0:1746147211.188912:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310361728 00000100:00100000:3.0:1746147211.188913:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310361984 00000100:00100000:0.0:1746147211.188927:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19905 00000100:00100000:0.0:1746147211.188934:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310361344:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147211.189015:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19906 00000100:00100000:2.0:1746147211.189022:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310361600:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147211.189023:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310361344:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 89us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.189029:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19907 00000100:00100000:0.0:1746147211.189032:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19905 00000100:00100000:3.0:1746147211.189034:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310361856:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147211.189047:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19908 00000100:00100000:0.0:1746147211.189051:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310361472:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147211.189065:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310361856:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 31us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.189071:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19907 00000100:00100000:1.0:1746147211.189076:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19909 00000100:00100000:3.0:1746147211.189081:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19910 00000100:00100000:1.0:1746147211.189083:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310361728:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147211.189085:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310361984:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147211.189203:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310361600:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 181us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147211.189205:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310361472:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 153us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147211.189211:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19908 00000100:00100000:2.0:1746147211.189215:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19906 00000100:00100000:3.0:1746147211.189516:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310361984:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 429us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.189521:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19910 00000100:00100000:1.0:1746147211.189609:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310361728:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 526us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.189617:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19909 00000100:00100000:0.0:1746147211.194710:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.194753:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.194781:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.194793:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.194806:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.194917:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310362112 00000100:00100000:1.0:1746147211.194927:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310362112 00000100:00100000:1.0:1746147211.194962:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310362368 00000100:00100000:1.0:1746147211.194964:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310362368 00000100:00100000:1.0:1746147211.194972:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310362624 00000100:00100000:1.0:1746147211.194974:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310362624 00000100:00100000:1.0:1746147211.194986:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310362240 00000100:00100000:1.0:1746147211.194987:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310362240 00000100:00100000:1.0:1746147211.194994:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310362496 00000100:00100000:1.0:1746147211.194995:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310362496 00000100:00100000:1.0:1746147211.195006:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19911 00000100:00100000:1.0:1746147211.195013:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310362112:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147211.195019:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19912 00000100:00100000:2.0:1746147211.195028:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310362368:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147211.195118:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19913 00000100:00100000:1.0:1746147211.195123:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310362112:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 110us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.195128:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19911 00000100:00100000:2.0:1746147211.195130:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310362368:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 103us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.195136:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19912 00000100:00100000:1.0:1746147211.195139:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19914 00000100:00100000:1.0:1746147211.195142:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310362240:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147211.195147:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19915 00000100:00100000:2.0:1746147211.195151:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310362496:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147211.195162:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310362240:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 20us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.195166:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19914 00000100:00100000:2.0:1746147211.195179:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310362496:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 28us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.195185:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19915 00000100:00100000:3.0:1746147211.195216:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310362624:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147211.195263:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310362624:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 52us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.195269:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19913 00000100:00100000:0.0:1746147211.195364:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.195380:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310362752 00000100:00100000:0.0:1746147211.195383:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310362752 00000100:00100000:0.0:1746147211.195402:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19916 00000100:00100000:0.0:1746147211.195407:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310362752:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147211.195448:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310362752:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 41us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147211.195453:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19916 00000100:00100000:2.0:1746147211.199145:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.199217:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310362880 00000100:00100000:0.0:1746147211.199227:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310362880 00000100:00100000:0.0:1746147211.199478:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19917 00000100:00100000:0.0:1746147211.199487:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310362880:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:0.0:1746147211.199681:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147211.199684:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147211.199686:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147211.199688:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147211.199690:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746147211.199740:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310362880:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 254us (605us total) trans 17179875244 rc 0/0 00000100:00100000:0.0:1746147211.199746:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19917 00000100:00100000:0.0:1746147211.203456:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.203545:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310363008 00000100:00100000:3.0:1746147211.203553:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310363008 00000100:00100000:3.0:1746147211.203597:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19918 00000100:00100000:3.0:1746147211.203606:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310363008:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:3.0:1746147211.203818:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147211.203821:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147211.203823:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147211.203825:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147211.203828:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:3.0:1746147211.204261:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310363008:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 655us (815us total) trans 21474842630 rc 0/0 00000100:00100000:3.0:1746147211.204269:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19918 00000100:00100000:0.0:1746147211.211749:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.211836:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.211865:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.211889:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.211916:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.212087:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310363392 00000100:00100000:3.0:1746147211.212117:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310363392 00000100:00100000:3.0:1746147211.212173:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310363648 00000100:00100000:3.0:1746147211.212175:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310363648 00000100:00100000:3.0:1746147211.212187:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310363520 00000100:00100000:3.0:1746147211.212190:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310363520 00000100:00100000:3.0:1746147211.212200:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310363904 00000100:00100000:3.0:1746147211.212202:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310363904 00000100:00100000:3.0:1746147211.212215:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310364032 00000100:00100000:3.0:1746147211.212217:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310364032 00000100:00100000:3.0:1746147211.212231:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7306 00000100:00100000:3.0:1746147211.212239:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310363392:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147211.212276:0:29478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88007923ee00/0x3139939425062a77 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.212290:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.212292:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.212297:0:29478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007923ee00/0x3139939425062a77 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.212310:0:29478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007923ee00/0x3139939425062a77 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.213038:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7307 00000100:00100000:3.0:1746147211.213045:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310363648:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147211.213062:0:29476:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8801304bcc00/0x3139939425062a7e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.213070:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.213071:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.213074:0:29476:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801304bcc00/0x3139939425062a7e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.213082:0:29476:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801304bcc00/0x3139939425062a7e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.213757:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7308 00000100:00100000:3.0:1746147211.213764:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310363520:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147211.213786:0:29479:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800909c0600/0x3139939425062a85 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.213794:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.213795:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.213798:0:29479:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909c0600/0x3139939425062a85 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.213807:0:29479:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909c0600/0x3139939425062a85 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.214484:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7309 00000100:00100000:3.0:1746147211.214492:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310363904:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147211.214515:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880098e6c000/0x3139939425062a8c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.214523:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.214524:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.214526:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098e6c000/0x3139939425062a8c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.214534:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098e6c000/0x3139939425062a8c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.215557:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7310 00000100:00100000:1.0:1746147211.215570:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310364032:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147211.215593:0:9589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1800/0x3139939425062a93 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.215604:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.215606:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.215608:0:9589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1800/0x3139939425062a93 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.215616:0:9589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1800/0x3139939425062a93 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147211.216557:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.217460:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.218691:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310364416 00000100:00100000:2.0:1746147211.218702:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310364416 00000100:00100000:2.0:1746147211.218750:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310364672 00000100:00100000:2.0:1746147211.218753:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310364672 00000100:00100000:2.0:1746147211.218771:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7311 00000100:00100000:2.0:1746147211.218778:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310364416:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147211.218813:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d5bb600/0x3139939425062a9a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.218827:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.218828:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.218832:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d5bb600/0x3139939425062a9a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.218845:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d5bb600/0x3139939425062a9a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147211.219609:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7312 00000100:00100000:2.0:1746147211.219617:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310364672:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147211.219638:0:13334:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f0e0600/0x3139939425062aa1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.219657:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.219658:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.219662:0:13334:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0e0600/0x3139939425062aa1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.219671:0:13334:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0e0600/0x3139939425062aa1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147211.224666:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.224867:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310364928 00000100:00100000:3.0:1746147211.224878:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310364928 00000100:00100000:3.0:1746147211.224949:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7313 00000100:00100000:3.0:1746147211.224958:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2000:x1830967310364928:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147211.224995:0:29474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094ffc600/0x3139939425062aa8 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.225010:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.225011:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.225018:0:29474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ffc600/0x3139939425062aa8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.225031:0:29474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094ffc600/0x3139939425062aa8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.231478:0:29478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88007923ee00/0x3139939425062a77 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.231496:0:29478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007923ee00/0x3139939425062a77 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.231504:0:29478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007923ee00/0x3139939425062a77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.231509:0:29478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007923ee00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147211.231513:0:29478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007923ee00/0x3139939425062a77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.231520:0:29478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007923ee00/0x3139939425062a77 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.231543:0:29478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007923ee00/0x3139939425062a77 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.231549:0:29478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007923ee00/0x3139939425062a77 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.232744:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310363392:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 19638us (20139us total) trans 0 rc 1032192/1032192 00000100:00100000:3.0:1746147211.232758:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7306 00010000:00010000:3.0:1746147211.236744:0:29476:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8801304bcc00/0x3139939425062a7e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.236762:0:29476:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801304bcc00/0x3139939425062a7e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.236770:0:29476:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801304bcc00/0x3139939425062a7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.236775:0:29476:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801304bcc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147211.236779:0:29476:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801304bcc00/0x3139939425062a7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.236786:0:29476:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801304bcc00/0x3139939425062a7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.236808:0:29476:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801304bcc00/0x3139939425062a7e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.236818:0:29476:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801304bcc00/0x3139939425062a7e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.236909:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310363648:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 23860us (25068us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147211.236920:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7307 00010000:00010000:3.0:1746147211.240508:0:29479:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800909c0600/0x3139939425062a85 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.240523:0:29479:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800909c0600/0x3139939425062a85 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.240529:0:29479:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800909c0600/0x3139939425062a85 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.240535:0:29479:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800909c0600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147211.240539:0:29479:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800909c0600/0x3139939425062a85 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.240547:0:29479:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800909c0600/0x3139939425062a85 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.240567:0:29479:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800909c0600/0x3139939425062a85 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.240573:0:29479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909c0600/0x3139939425062a85 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.240641:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310363520:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 26873us (28770us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147211.240660:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7308 00010000:00010000:1.0:1746147211.248707:0:9589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1800/0x3139939425062a93 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.248722:0:9589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1800/0x3139939425062a93 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.248729:0:9589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1800/0x3139939425062a93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.248735:0:9589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbe1800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147211.248738:0:9589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1800/0x3139939425062a93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.248744:0:9589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1800/0x3139939425062a93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.248758:0:9589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1800/0x3139939425062a93 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.248764:0:9589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe1800/0x3139939425062a93 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.248832:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2000:x1830967310364032:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 33264us (36911us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147211.248842:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7310 00010000:00010000:3.0:1746147211.250015:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d5bb600/0x3139939425062a9a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.250029:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d5bb600/0x3139939425062a9a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.250035:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d5bb600/0x3139939425062a9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.250041:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d5bb600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147211.250045:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d5bb600/0x3139939425062a9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.250052:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d5bb600/0x3139939425062a9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.250067:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d5bb600/0x3139939425062a9a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.250072:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d5bb600/0x3139939425062a9a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.250160:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310364416:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 31378us (33601us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147211.250173:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7311 00010000:00010000:3.0:1746147211.255176:0:29477:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880098e6c000/0x3139939425062a8c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.255197:0:29477:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098e6c000/0x3139939425062a8c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.255206:0:29477:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098e6c000/0x3139939425062a8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.255213:0:29477:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098e6c000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147211.255217:0:29477:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098e6c000/0x3139939425062a8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.255349:0:29477:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098e6c000/0x3139939425062a8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.255371:0:29477:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098e6c000/0x3139939425062a8c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.255378:0:29477:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098e6c000/0x3139939425062a8c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.257855:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310363904:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 43350us (45950us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147211.257869:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7309 00010000:00010000:2.0:1746147211.264461:0:13334:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f0e0600/0x3139939425062aa1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.264482:0:13334:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0e0600/0x3139939425062aa1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.264491:0:13334:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f0e0600/0x3139939425062aa1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.264499:0:13334:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0e0600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147211.264503:0:13334:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f0e0600/0x3139939425062aa1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.264512:0:13334:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f0e0600/0x3139939425062aa1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.264532:0:13334:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f0e0600/0x3139939425062aa1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.264538:0:13334:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0e0600/0x3139939425062aa1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147211.264667:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310364672:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 45045us (47201us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147211.264678:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7312 00010000:00010000:3.0:1746147211.267627:0:29474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094ffc600/0x3139939425062aa8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.267654:0:29474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094ffc600/0x3139939425062aa8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.267662:0:29474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094ffc600/0x3139939425062aa8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.267670:0:29474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094ffc600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147211.267674:0:29474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094ffc600/0x3139939425062aa8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.267681:0:29474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094ffc600/0x3139939425062aa8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.267699:0:29474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094ffc600/0x3139939425062aa8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.267705:0:29474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094ffc600/0x3139939425062aa8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.267804:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310364928:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 42842us (43159us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147211.267815:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7313 00000100:00100000:0.0:1746147211.272817:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.272940:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310365184 00000100:00100000:3.0:1746147211.272950:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310365184 00000100:00100000:0.0:1746147211.273282:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16451 00000100:00100000:0.0:1746147211.273292:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2853:x1830967310365184:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:0.0:1746147211.273347:0:7237:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147211.273375:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a31000/0x3139939425062a46 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee86 expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.273408:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147211.273413:0:7237:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147211.273457:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425062aaf lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147211.273470:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425062aaf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147211.273478:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425062aaf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00010000:0.0:1746147211.273581:0:7237:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880096899500 reply state ffff880098948000 transno 8589937352 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425062aaf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147211.273590:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425062aaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147211.273595:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147211.273598:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746147211.273600:0:7237:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746147211.273693:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2853:x1830967310365184:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 402us (886us total) trans 8589937352 rc 0/0 00000100:00100000:0.0:1746147211.273700:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16451 00000100:00100000:0.0:1746147211.277400:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.277465:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310365312 00000100:00100000:3.0:1746147211.277477:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310365312 00000100:00100000:3.0:1746147211.277540:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19919 00000100:00100000:3.0:1746147211.277549:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2853:x1830967310365312:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147211.277569:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.277588:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425062ab6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eeb7 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.277618:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0c00/0x3139939425062a4d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee8d expref: 13 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.277627:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.277629:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.277632:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425062ab6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb7 expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.277677:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0c00/0x3139939425062a4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee8d expref: 13 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.277689:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0c00/0x3139939425062a4d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee8d expref: 13 pid: 1136 timeout: 849 lvb_type: 1 00000100:00100000:3.0:1746147211.277700:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311473280:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147211.277841:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.281478:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.281627:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311473280:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147211.281671:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425062ab6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb7 expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.281690:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ffc600, rc 0) 00000100:00100000:3.0:1746147211.281746:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2853:x1830967310365312:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4197us (4353us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.281756:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19919 00000100:00100000:1.0:1746147211.281876:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310365440 00000100:00100000:1.0:1746147211.281884:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310365440 00010000:00010000:1.0:1746147211.281912:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0c00/0x3139939425062a4d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee8d expref: 13 pid: 1136 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746147211.281944:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9039 00000100:00100000:1.0:1746147211.281950:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310365440:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.281962:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.281976:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0c00/0x3139939425062a4d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee8d expref: 13 pid: 1136 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.281986:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0c00/0x3139939425062a4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee8d expref: 13 pid: 1136 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.282003:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0c00/0x3139939425062a4d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee8d expref: 13 pid: 1136 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.282018:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.282020:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.282025:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425062ab6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb7 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.282032:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425062ab6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb7 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.282057:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425062ab6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb7 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.282066:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311473408:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147211.282147:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1c4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147211.284327:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311473408:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147211.284343:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.284381:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310365440:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2430us (2910us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.284390:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9039 00000100:00100000:0.0:1746147211.284397:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.284498:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310365568 00000100:00100000:2.0:1746147211.284504:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310365568 00000100:00100000:2.0:1746147211.284531:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19920 00000100:00100000:2.0:1746147211.284536:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2853:x1830967310365568:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147211.284550:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.284562:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x3139939425062abd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eebe expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.284582:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0600/0x3139939425062a54 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee94 expref: 16 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.284589:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.284590:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.284593:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x3139939425062abd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eebe expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.284614:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0600/0x3139939425062a54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee94 expref: 16 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.284624:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0600/0x3139939425062a54 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee94 expref: 16 pid: 1136 timeout: 849 lvb_type: 1 00000100:00100000:2.0:1746147211.284634:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311473536:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147211.284694:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.287231:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.287296:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311473536:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147211.287319:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310365696 00000100:00100000:1.0:1746147211.287325:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310365696 00010000:00010000:3.0:1746147211.287328:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x3139939425062abd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eebe expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.287346:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3fa00, rc 0) 00010000:00010000:1.0:1746147211.287356:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0600/0x3139939425062a54 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee94 expref: 17 pid: 1136 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746147211.287381:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9040 00000100:00100000:1.0:1746147211.287387:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967310365696:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.287398:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147211.287399:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2853:x1830967310365568:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2862us (3003us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.287407:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19920 00010000:00010000:1.0:1746147211.287415:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0600/0x3139939425062a54 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee94 expref: 17 pid: 1136 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.287428:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0600/0x3139939425062a54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee94 expref: 16 pid: 1136 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.287451:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0600/0x3139939425062a54 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee94 expref: 16 pid: 1136 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.287463:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.287465:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.287653:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x3139939425062abd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eebe expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.287662:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x3139939425062abd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eebe expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.287690:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x3139939425062abd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eebe expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.287701:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311473664:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147211.288183:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1c4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.290639:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.290724:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310365824 00000100:00100000:2.0:1746147211.290730:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310365824 00000100:00100000:2.0:1746147211.290767:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19921 00000100:00100000:2.0:1746147211.290774:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2853:x1830967310365824:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147211.290788:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.290802:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e3f000/0x3139939425062ac4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eec5 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.290836:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x3139939425062a5b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee9b expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.290843:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.290845:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.290848:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3f000/0x3139939425062ac4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eec5 expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.290851:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311473664:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147211.290866:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147211.290871:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x3139939425062a5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee9b expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.290881:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x3139939425062a5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee9b expref: 17 pid: 12225 timeout: 849 lvb_type: 1 00000100:00100000:2.0:1746147211.290891:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311473792:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147211.290905:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967310365696:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3518us (3682us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.290913:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9040 00000100:00100000:2.0:1746147211.290935:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147211.292752:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311473792:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147211.292776:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e3f000/0x3139939425062ac4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eec5 expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.292791:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3f000, rc 0) 00000100:00100000:2.0:1746147211.292840:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2853:x1830967310365824:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2066us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.292848:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19921 00000100:00100000:0.0:1746147211.294827:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.295286:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310365952 00000100:00100000:1.0:1746147211.295293:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310365952 00010000:00010000:1.0:1746147211.295322:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x3139939425062a5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee9b expref: 16 pid: 12225 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746147211.295364:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9041 00000100:00100000:1.0:1746147211.295371:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310365952:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.295382:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.295399:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x3139939425062a5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee9b expref: 16 pid: 12225 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.295411:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x3139939425062a5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee9b expref: 16 pid: 12225 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.295430:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fd000/0x3139939425062a5b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee9b expref: 16 pid: 12225 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.295446:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.295448:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.295455:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e3f000/0x3139939425062ac4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eec5 expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.295462:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3f000/0x3139939425062ac4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eec5 expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.295489:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096e3f000/0x3139939425062ac4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eec5 expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.295501:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311473920:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147211.295707:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1c4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.297232:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.298544:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310366080 00000100:00100000:2.0:1746147211.298553:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310366080 00000100:00100000:1.0:1746147211.298622:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311473920:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147211.298639:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147211.299041:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19922 00000100:00100000:2.0:1746147211.299048:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2853:x1830967310366080:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147211.299065:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.299079:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062acb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eecc expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.299116:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425062a62 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eea2 expref: 13 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.299123:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.299124:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.299127:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062acb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eecc expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.299147:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425062a62 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eea2 expref: 13 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.299156:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425062a62 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eea2 expref: 13 pid: 1136 timeout: 849 lvb_type: 1 00000100:00100000:2.0:1746147211.299165:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311474048:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147211.299244:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310365952:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3872us (4421us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.299253:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9041 00000100:00100000:2.0:1746147211.300794:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.303978:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.304181:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311474048:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147211.304203:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062acb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eecc expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.304224:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3ee00, rc 0) 00000100:00100000:2.0:1746147211.304272:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2853:x1830967310366080:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5224us (7045us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.304280:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19922 00000100:00100000:1.0:1746147211.304285:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310366208 00000100:00100000:1.0:1746147211.304291:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310366208 00010000:00010000:1.0:1746147211.304312:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425062a62 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eea2 expref: 13 pid: 1136 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746147211.304340:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9042 00000100:00100000:1.0:1746147211.304346:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310366208:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.304356:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.304371:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425062a62 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eea2 expref: 13 pid: 1136 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.304381:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425062a62 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eea2 expref: 13 pid: 1136 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.304399:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe1000/0x3139939425062a62 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eea2 expref: 13 pid: 1136 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.304555:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.304558:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.304564:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062acb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eecc expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.304577:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062acb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eecc expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.304599:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062acb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eecc expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.304608:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311474176:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147211.304668:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1c4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147211.306744:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311474176:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147211.306758:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.306797:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310366208:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2450us (2826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.306805:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9042 00000100:00100000:0.0:1746147211.308220:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.308479:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310366336 00000100:00100000:2.0:1746147211.308490:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310366336 00000100:00100000:2.0:1746147211.308719:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19923 00000100:00100000:2.0:1746147211.308728:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2853:x1830967310366336:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147211.308746:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.308766:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e3e000/0x3139939425062ad2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eed3 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.308795:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42c00/0x3139939425062a69 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eea9 expref: 13 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.308803:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.308806:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.308809:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e3e000/0x3139939425062ad2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eed3 expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.308840:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42c00/0x3139939425062a69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eea9 expref: 13 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.308852:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42c00/0x3139939425062a69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eea9 expref: 13 pid: 13695 timeout: 849 lvb_type: 1 00000100:00100000:2.0:1746147211.308871:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311474304:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147211.309440:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147211.312952:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311474304:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147211.312985:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e3e000/0x3139939425062ad2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eed3 expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.312989:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147211.313004:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3e000, rc 0) 00000100:00100000:0.0:1746147211.313043:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310366464 00000100:00100000:2.0:1746147211.313050:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2853:x1830967310366336:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4323us (4835us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147211.313050:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310366464 00000100:00100000:2.0:1746147211.313059:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19923 00010000:00010000:0.0:1746147211.313077:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42c00/0x3139939425062a69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eea9 expref: 13 pid: 13695 timeout: 849 lvb_type: 1 00000100:00100000:0.0:1746147211.313130:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9043 00000100:00100000:0.0:1746147211.313140:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310366464:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147211.313152:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147211.313172:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42c00/0x3139939425062a69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eea9 expref: 13 pid: 13695 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746147211.313183:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42c00/0x3139939425062a69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eea9 expref: 13 pid: 13695 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746147211.313206:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c42c00/0x3139939425062a69 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eea9 expref: 13 pid: 13695 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746147211.313229:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147211.313231:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147211.313238:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e3e000/0x3139939425062ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eed3 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.313247:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e3e000/0x3139939425062ad2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eed3 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.313274:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096e3e000/0x3139939425062ad2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eed3 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147211.313290:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8b0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311474432:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147211.313352:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.317311:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.317599:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310366592 00000100:00100000:3.0:1746147211.317608:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310366592 00000100:00100000:3.0:1746147211.317660:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19924 00000100:00100000:3.0:1746147211.317669:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2853:x1830967310366592:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147211.317690:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.317710:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425062ad9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eeda expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.317739:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425062a70 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb0 expref: 16 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.317751:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.317752:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.317755:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425062ad9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeda expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.317787:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425062a70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb0 expref: 16 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.317803:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425062a70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb0 expref: 16 pid: 1854 timeout: 849 lvb_type: 1 00000100:00100000:3.0:1746147211.317815:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311474560:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147211.317904:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147211.317984:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8b0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311474432:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147211.318003:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147211.318030:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310366464:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4893us (5042us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.318038:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9043 00000100:00100000:0.0:1746147211.321194:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.321212:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311474560:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147211.321424:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310366720 00000100:00100000:2.0:1746147211.321432:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310366720 00010000:00010000:2.0:1746147211.321472:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425062a70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb0 expref: 17 pid: 1854 timeout: 849 lvb_type: 1 00000100:00100000:2.0:1746147211.321515:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9044 00000100:00100000:2.0:1746147211.321523:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310366720:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147211.321539:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147211.321617:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425062ad9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeda expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.321633:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425062a70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb0 expref: 17 pid: 1854 timeout: 849 lvb_type: 1 00010000:00010000:3.0:1746147211.321635:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ffd800, rc 0) 00010000:00010000:2.0:1746147211.321652:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425062a70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb0 expref: 17 pid: 1854 timeout: 849 lvb_type: 1 00010000:00010000:2.0:1746147211.321676:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fca00/0x3139939425062a70 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb0 expref: 17 pid: 1854 timeout: 849 lvb_type: 1 00000100:00100000:3.0:1746147211.321697:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2853:x1830967310366592:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4028us (4398us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147211.321701:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.321703:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147211.321704:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19924 00010000:00010000:2.0:1746147211.321710:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425062ad9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeda expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.321719:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425062ad9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeda expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.321749:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425062ad9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeda expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147211.321761:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311474688:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147211.321819:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.323640:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.323673:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.323696:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.323707:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.323708:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310366848 00000100:00100000:3.0:1746147211.323715:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310366848 00000100:00100000:0.0:1746147211.323720:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.323740:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310366976 00000100:00100000:3.0:1746147211.323742:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310366976 00000100:00100000:0.0:1746147211.323750:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.323768:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310367104 00000100:00100000:3.0:1746147211.323770:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310367104 00000100:00100000:3.0:1746147211.323780:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310367232 00000100:00100000:3.0:1746147211.323781:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310367232 00000100:00100000:3.0:1746147211.323793:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310367360 00000100:00100000:3.0:1746147211.323795:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310367360 00000100:00100000:3.0:1746147211.323802:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310367488 00000100:00100000:3.0:1746147211.323804:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310367488 00000100:00100000:2.0:1746147211.323810:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19925 00000100:00100000:1.0:1746147211.323817:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19926 00000100:00100000:2.0:1746147211.323823:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310366976:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:1.0:1746147211.323824:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310367104:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:0.0:1746147211.323959:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19927 00000100:00100000:0.0:1746147211.323965:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310367232:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147211.324061:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147211.324064:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147211.324067:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147209 -> 1746147210 00002000:00010000:0.0:1746147211.324069:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147210 -> 1746147211 00002000:00010000:0.0:1746147211.324070:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147211.324124:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310367232:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 158us (415us total) trans 21474842631 rc 0/0 00000100:00100000:0.0:1746147211.324129:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19927 00000100:00100000:0.0:1746147211.324142:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19928 00000100:00100000:0.0:1746147211.324145:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310367360:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147211.324180:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:0.0:1746147211.324183:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147211.324184:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147211.324186:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147210 -> 1746147211 00002000:00010000:0.0:1746147211.324187:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:0.0:1746147211.324203:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310367360:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 57us (481us total) trans 21474842632 rc 0/0 00000100:00100000:0.0:1746147211.324207:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19928 00000100:00100000:3.0:1746147211.324392:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19929 00000100:00100000:3.0:1746147211.324399:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967310367488:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:2.0:1746147211.324420:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147211.324422:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147211.324423:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147209 -> 1746147210 00002000:00010000:1.0:1746147211.324424:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147209 -> 1746147210 00002000:00010000:2.0:1746147211.324425:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147209 -> 1746147210 00002000:00010000:1.0:1746147211.324426:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147209 -> 1746147210 00002000:00010000:2.0:1746147211.324428:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147210 -> 1746147211 00002000:00010000:1.0:1746147211.324428:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147210 -> 1746147211 00002000:00010000:2.0:1746147211.324429:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:1.0:1746147211.324430:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:3.0:1746147211.324447:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147211.324450:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147210 -> 1746147210 00002000:00010000:3.0:1746147211.324452:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:3.0:1746147211.324454:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147210 -> 1746147211 00002000:00010000:3.0:1746147211.324455:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746147211.324455:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967310366976:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 637us (780us total) trans 17179875245 rc 0/0 00000100:00100000:1.0:1746147211.324455:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967310367104:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 631us (757us total) trans 17179875246 rc 0/0 00000100:00100000:2.0:1746147211.324460:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19925 00000100:00100000:1.0:1746147211.324462:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19926 00000100:00100000:3.0:1746147211.324474:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310367488:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 76us (723us total) trans 17179875247 rc 0/0 00000100:00100000:3.0:1746147211.324479:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19929 00000100:00100000:2.0:1746147211.324502:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311474688:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147211.324509:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19930 00000100:00100000:3.0:1746147211.324514:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310366848:12345-192.168.204.25@tcp:2:lfs.0 00010000:00010000:2.0:1746147211.324517:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147211.324535:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310366720:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3014us (3353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.324543:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9044 00002000:00010000:3.0:1746147211.324553:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147211.324556:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147209 -> 1746147210 00002000:00010000:3.0:1746147211.324558:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147209 -> 1746147210 00002000:00010000:3.0:1746147211.324560:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147210 -> 1746147211 00002000:00010000:3.0:1746147211.324562:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:3.0:1746147211.324576:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310366848:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 63us (943us total) trans 21474842633 rc 0/0 00000100:00100000:3.0:1746147211.324581:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19930 00000100:00100000:0.0:1746147211.326861:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.326922:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310367744 00000100:00100000:1.0:1746147211.326929:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310367744 00000100:00100000:1.0:1746147211.326984:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6148 00000100:00100000:1.0:1746147211.326992:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2853:x1830967310367744:12345-192.168.204.25@tcp:35:lfs.0 00000004:00010000:1.0:1746147211.327047:0:16750:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x30:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x31399394250629f9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee78 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.327126:0:16750:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425062ae0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16750 initiator: MDT0 00010000:00010000:1.0:1746147211.327139:0:16750:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062a38 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee7f expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.327147:0:16750:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425062ae0 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16750 initiator: MDT0 00010000:00010000:1.0:1746147211.327177:0:16750:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062a38 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee7f expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.327190:0:16750:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062a38 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee7f expref: 10 pid: 6215 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.327204:0:16750:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16750:1830967311474816:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147211.328018:0:16750:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1c4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147211.329590:0:16750:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16750:1830967311474816:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147211.329613:0:16750:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425062ae0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16750 initiator: MDT0 00000100:00100000:0.0:1746147211.329619:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.329684:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310367872 00000100:00100000:2.0:1746147211.329691:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310367872 00010000:00010000:2.0:1746147211.329717:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062a38 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee7f expref: 11 pid: 6215 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.329751:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9045 00000100:00100000:2.0:1746147211.329758:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310367872:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147211.329770:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147211.329774:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062a38 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee7f expref: 11 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.329786:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062a38 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee7f expref: 11 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.329804:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062a38 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee7f expref: 11 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.329835:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147211.329839:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425062ae0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16750 initiator: MDT0 00010000:00010000:2.0:1746147211.329847:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425062ae0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16750 initiator: MDT0 00010000:00010000:2.0:1746147211.329853:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425062ae0 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16750 initiator: MDT0 00010000:00010000:2.0:1746147211.329867:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147211.329898:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310367872:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 139us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.329904:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9045 00010000:00010000:1.0:1746147211.330127:0:16750:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425062ae0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16750 initiator: MDT0 00010000:00010000:1.0:1746147211.330133:0:16750:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425062ae0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16750 initiator: MDT0 00000040:00080000:1.0:1746147211.330770:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1272, 88 off119792 00000004:00080000:1.0:1746147211.330776:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749320685817ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147211.331163:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1270, 88 off119616 00000004:00080000:1.0:1746147211.331167:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749321078077ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147211.331180:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1271, 88 off119704 00000004:00080000:1.0:1746147211.331183:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749321093645ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147211.331191:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1273, 88 off119880 00000004:00080000:1.0:1746147211.331194:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749321104165ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147211.331200:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1274, 88 off119968 00000004:00080000:1.0:1746147211.331203:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749321113472ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147211.331210:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1272, 88 off119792 00000004:00080000:1.0:1746147211.331212:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749321122967ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147211.331220:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1273, 88 off119880 00000004:00080000:1.0:1746147211.331223:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749321133059ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147211.331230:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1274, 88 off119968 00000004:00080000:1.0:1746147211.331232:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749321142572ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147211.331239:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1275, 88 off120056 00000004:00080000:1.0:1746147211.331241:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749321152090ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147211.331248:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1275, 88 off120056 00000004:00080000:1.0:1746147211.331250:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749321160849ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147211.331256:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1276, 88 off120144 00000004:00080000:1.0:1746147211.331259:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749321170149ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147211.331267:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1276, 88 off120144 00000004:00080000:1.0:1746147211.331270:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749321181014ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147211.331277:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1277, 88 off120232 00000004:00080000:1.0:1746147211.331280:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749321190217ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147211.331286:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1278, 88 off120320 00000004:00080000:1.0:1746147211.331289:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749321199444ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147211.331295:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1279, 88 off120408 00000004:00080000:1.0:1746147211.331298:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749321208222ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147211.331305:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1280, 88 off120496 00000004:00080000:1.0:1746147211.331308:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749321219012ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147211.331316:0:16750:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1277, 88 off120232 00000004:00080000:1.0:1746147211.331318:0:16750:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749321229030ns, next at 694367916532ns, rc = 0 00000001:00080000:3.0:1746147211.334608:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937353 is committed 00000004:00080000:3.0:1746147211.334621:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1254 committed 00000004:00080000:3.0:1746147211.334628:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1260 committed 00000004:00080000:3.0:1746147211.334634:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1259 committed 00000004:00080000:3.0:1746147211.334636:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1258 committed 00000004:00080000:3.0:1746147211.334637:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1257 committed 00000004:00080000:3.0:1746147211.334639:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1253 committed 00000004:00080000:3.0:1746147211.334650:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1256 committed 00000004:00080000:3.0:1746147211.334653:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1252 committed 00000004:00080000:3.0:1746147211.334655:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1255 committed 00000004:00080000:3.0:1746147211.334656:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1251 committed 00000004:00080000:3.0:1746147211.334658:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1250 committed 00000004:00080000:3.0:1746147211.334659:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1249 committed 00000004:00080000:3.0:1746147211.334661:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1254 committed 00000004:00080000:3.0:1746147211.334662:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1253 committed 00000004:00080000:3.0:1746147211.334663:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1248 committed 00000004:00080000:3.0:1746147211.334665:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1247 committed 00000004:00080000:3.0:1746147211.334666:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1252 committed 00010000:00010000:1.0:1746147211.334726:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425062aaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147211.334737:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425062aaf lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147211.334745:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425062aaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147211.334751:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbe0800 already unused, calling callback (ffffffffa0efd690) 00000100:00100000:2.0:1746147211.334754:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311474944:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746147211.334755:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425062aaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147211.334762:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425062aaf lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147211.334778:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147211.334781:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147211.334786:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425062aaf lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147211.334791:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbe0800/0x3139939425062aaf lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00000100:00100000:1.0:1746147211.334813:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311475200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.334824:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147211.334837:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147211.334852:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311474944 00000100:00100000:0.0:1746147211.334859:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311474944 00000100:00100000:2.0:1746147211.334860:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311475456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.334876:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:1.0:1746147211.334882:0:16750:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012b8b2300 reply state ffff88008f388c00 transno 8589937353 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425062ae0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16750 initiator: MDT0 00000100:00100000:0.0:1746147211.334889:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311475200 00000100:00100000:0.0:1746147211.334890:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311475200 00000100:00100000:2.0:1746147211.334891:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311475968:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746147211.334892:0:16750:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425062ae0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16750 initiator: MDT0 00010000:00010000:1.0:1746147211.334899:0:16750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00000100:00100000:0.0:1746147211.334899:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311475456 00010000:00010000:1.0:1746147211.334901:0:16750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746147211.334901:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311475456 00000100:00100000:1.0:1746147211.334904:0:16750:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746147211.334905:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746147211.334909:0:16750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147211.334911:0:16750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:0.0:1746147211.334911:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311475968 00000100:00100000:0.0:1746147211.334913:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311475968 00000100:00100000:2.0:1746147211.334916:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311476480:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746147211.334916:0:16750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261800/0x31399394250629f9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ee78 expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147211.334927:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19931 00000100:00100000:2.0:1746147211.334928:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147211.334934:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3767:x1830967311474944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.334939:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1746147211.334943:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311475328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.334956:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147211.334967:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311475840:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.334990:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1746147211.334994:0:16750:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746147211.335002:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311476352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147211.335003:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2853:x1830967310367744:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 8012us (8151us total) trans 8589937353 rc 0/0 00000100:00100000:1.0:1746147211.335011:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6148 00000100:00100000:2.0:1746147211.335014:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147211.335024:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311476864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147211.335031:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311476480 00000100:00100000:1.0:1746147211.335033:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311476480 00000100:00100000:2.0:1746147211.335036:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147211.335054:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311475072:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147211.335058:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147211.335061:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147211.335063:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147211.335065:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147211 -> 1746147211 00002000:00010000:0.0:1746147211.335067:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746147211.335070:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147211.335113:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3767:x1830967311474944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (290us total) trans 17179875248 rc 0/0 00000100:00100000:0.0:1746147211.335118:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19931 00000100:00100000:0.0:1746147211.336451:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311475328 00000100:00100000:2.0:1746147211.336454:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311475584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147211.336462:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311475328 00000100:00100000:3.0:1746147211.336474:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311476352 00000100:00100000:3.0:1746147211.336478:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311476352 00000100:00100000:2.0:1746147211.336481:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147211.336490:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311476096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147211.336493:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311476864 00000100:00100000:3.0:1746147211.336496:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311475072 00000100:00100000:0.0:1746147211.336496:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311476864 00000100:00100000:3.0:1746147211.336497:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311475072 00000100:00100000:3.0:1746147211.336503:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311475584 00000100:00100000:2.0:1746147211.336503:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147211.336505:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311475584 00000100:00100000:0.0:1746147211.336506:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311476096 00000100:00100000:0.0:1746147211.336508:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311476096 00000100:00100000:2.0:1746147211.336510:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311476608:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147211.336511:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19932 00000100:00100000:3.0:1746147211.336516:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3765:x1830967311475200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.336521:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147211.336522:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19933 00000100:00100000:0.0:1746147211.336531:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3767:x1830967311475456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.336547:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311476608 00000100:00100000:2.0:1746147211.336550:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311476608 00000100:00100000:2.0:1746147211.336567:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19934 00000100:00100000:2.0:1746147211.336571:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3767:x1830967311475968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147211.336594:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147211.336596:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147210 -> 1746147210 00002000:00010000:3.0:1746147211.336597:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:3.0:1746147211.336598:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147211 -> 1746147211 00002000:00010000:3.0:1746147211.336600:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746147211.336621:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3765:x1830967311475200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (1784us total) trans 17179875249 rc 0/0 00000100:00100000:3.0:1746147211.336624:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19932 00000100:00100000:3.0:1746147211.336634:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19935 00000100:00100000:3.0:1746147211.336637:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e218c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3767:x1830967311476480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147211.336659:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746147211.336662:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147210 -> 1746147210 00002000:00010000:2.0:1746147211.336664:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:2.0:1746147211.336666:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147211 -> 1746147211 00002000:00010000:2.0:1746147211.336667:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:1.0:1746147211.336694:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311475840 00000100:00100000:1.0:1746147211.336698:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311475840 00000100:00100000:1.0:1746147211.336713:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19936 00000100:00100000:1.0:1746147211.336721:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3767:x1830967311475328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147211.336768:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147211.336770:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147211.336772:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147211.336773:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147211.336775:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:2.0:1746147211.338187:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3767:x1830967311475968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1611us (3277us total) trans 21474842634 rc 0/0 00000100:00100000:2.0:1746147211.338195:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19934 00000100:00100000:2.0:1746147211.338214:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19937 00000100:00100000:2.0:1746147211.338220:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3767:x1830967311476352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147211.338288:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746147211.338290:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00000100:00100000:0.0:1746147211.338291:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3767:x1830967311475456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1756us (3408us total) trans 17179875250 rc 0/0 00002000:00010000:2.0:1746147211.338293:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147211.338294:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147211.338296:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:0.0:1746147211.338300:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19933 00000100:00100000:2.0:1746147211.338319:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3767:x1830967311476352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (3304us total) trans 21474842636 rc 0/0 00000100:00100000:0.0:1746147211.338323:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19938 00000100:00100000:2.0:1746147211.338327:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19937 00000100:00100000:0.0:1746147211.338330:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3764:x1830967311475072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.338340:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19939 00000100:00100000:2.0:1746147211.338345:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3767:x1830967311476864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147211.338392:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:2.0:1746147211.338395:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147211.338396:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147211.338398:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147211.338399:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00002000:00010000:0.0:1746147211.338404:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147211.338406:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147211.338409:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147211.338410:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147211 -> 1746147211 00002000:00010000:0.0:1746147211.338412:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746147211.338424:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3767:x1830967311476864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (3387us total) trans 21474842637 rc 0/0 00000100:00100000:2.0:1746147211.338429:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19939 00000100:00100000:2.0:1746147211.338441:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19940 00000100:00100000:3.0:1746147211.338446:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e218c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3767:x1830967311476480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1806us (3515us total) trans 21474842635 rc 0/0 00000100:00100000:2.0:1746147211.338447:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3764:x1830967311475584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147211.338451:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3767:x1830967311475328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1730us (3494us total) trans 17179875251 rc 0/0 00000100:00100000:3.0:1746147211.338454:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19935 00000100:00100000:0.0:1746147211.338454:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3764:x1830967311475072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 126us (3382us total) trans 17179875252 rc 0/0 00000100:00100000:1.0:1746147211.338457:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19936 00000100:00100000:0.0:1746147211.338460:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19938 00000100:00100000:0.0:1746147211.338477:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19941 00000100:00100000:1.0:1746147211.338482:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19942 00000100:00100000:0.0:1746147211.338487:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3764:x1830967311476096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147211.338489:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3764:x1830967311476608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147211.338548:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3764:x1830967311476608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (2025us total) trans 21474842638 rc 0/0 00000100:00100000:1.0:1746147211.338552:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19942 00000100:00100000:1.0:1746147211.338562:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19943 00000100:00100000:1.0:1746147211.338566:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3767:x1830967311475840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147211.338807:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147211.338810:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147211.338812:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147211.338814:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147211 -> 1746147211 00002000:00010000:0.0:1746147211.338816:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147211.338838:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3764:x1830967311476096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 356us (2333us total) trans 21474842639 rc 0/0 00000100:00100000:0.0:1746147211.338844:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19941 00010000:00010000:0.0:1746147211.339251:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425062ae0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16750 initiator: MDT0 00010000:00010000:0.0:1746147211.339261:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425062ae0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16750 initiator: MDT0 00010000:00010000:0.0:1746147211.339267:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425062ae0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16750 initiator: MDT0 00010000:00010000:0.0:1746147211.339272:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2e8600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147211.339276:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425062ae0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16750 initiator: MDT0 00010000:00010000:0.0:1746147211.339282:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425062ae0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16750 initiator: MDT0 00010000:00010000:0.0:1746147211.339298:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147211.339301:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147211.339304:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425062ae0 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16750 initiator: MDT0 00010000:00010000:0.0:1746147211.339309:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e8600/0x3139939425062ae0 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16750 initiator: MDT0 00000004:00080000:3.0:1746147211.339534:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3ce300/2, rc 0, transno 17179875251 00000100:00100000:3.0:1746147211.339541:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311475328:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147211.339555:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cf100/2, rc 0, transno 21474842636 00000100:00100000:3.0:1746147211.339563:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311476352:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147211.339572:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cca80/2, rc 0, transno 21474842637 00000100:00100000:3.0:1746147211.339575:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311476864:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147211.339582:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cd880/2, rc 0, transno 21474842634 00000100:00100000:3.0:1746147211.339584:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311475968:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147211.339590:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cdc00/2, rc 0, transno 21474842635 00000100:00100000:3.0:1746147211.339592:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311476480:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147211.339600:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8b2d80/2, rc 0, transno 17179875248 00000100:00100000:3.0:1746147211.339603:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311474944:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147211.339611:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cc700/2, rc 0, transno 17179875250 00000100:00100000:3.0:1746147211.339613:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311475456:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147211.339623:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8b1f80/2, rc 0, transno 17179875252 00000100:00100000:2.0:1746147211.339628:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311475072:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147211.339638:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cdf80/2, rc 0, transno 21474842639 00000100:00100000:2.0:1746147211.339651:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311476096:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147211.339659:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cc380/2, rc 0, transno 21474842638 00000100:00100000:2.0:1746147211.339661:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311476608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147211.339722:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3767:x1830967311475840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1154us (4730us total) trans 17179875253 rc 0/0 00000100:00100000:1.0:1746147211.339727:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19943 00000004:00080000:1.0:1746147211.339756:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3ced80/2, rc 0, transno 17179875249 00000100:00100000:1.0:1746147211.339759:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311475200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147211.339766:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311475712:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147211.339772:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3ce680/2, rc 0, transno 17179875253 00000100:00100000:2.0:1746147211.339777:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311475840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147211.339788:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147211.339807:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311476224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147211.339823:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147211.339840:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311476736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147211.339852:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147211.339871:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311475712 00000100:00100000:1.0:1746147211.339876:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311475712 00000100:00100000:1.0:1746147211.339895:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311476224 00000100:00100000:1.0:1746147211.339897:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311476224 00000100:00100000:1.0:1746147211.339906:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311476736 00000100:00100000:1.0:1746147211.339908:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311476736 00000100:00100000:1.0:1746147211.339920:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19944 00000100:00100000:1.0:1746147211.339925:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3765:x1830967311475712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.339962:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19945 00000100:00100000:2.0:1746147211.339969:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+21:3765:x1830967311476224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147211.339983:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3765:x1830967311475712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (194us total) trans 17179875254 rc 0/0 00000100:00100000:1.0:1746147211.339988:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19944 00000100:00100000:1.0:1746147211.339997:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19946 00000100:00100000:1.0:1746147211.340001:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3765:x1830967311476736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147211.340020:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:2.0:1746147211.340023:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147210 -> 1746147210 00002000:00010000:2.0:1746147211.340025:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:2.0:1746147211.340027:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147211 -> 1746147211 00002000:00010000:2.0:1746147211.340029:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00002000:00010000:1.0:1746147211.340038:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147211.340040:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147211.340042:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147211.340044:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147211.340046:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:2.0:1746147211.340051:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+23:3765:x1830967311476224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (227us total) trans 21474842640 rc 0/0 00000100:00100000:2.0:1746147211.340056:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19945 00002000:00010000:3.0:1746147211.340141:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:3.0:1746147211.340143:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147211.340145:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147211.340146:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147211.340148:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:3.0:1746147211.340180:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3764:x1830967311475584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1733us (3697us total) trans 17179875255 rc 0/0 00000100:00100000:3.0:1746147211.340186:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19940 00000004:00080000:2.0:1746147211.340407:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cd180/2, rc 0, transno 17179875255 00000100:00100000:2.0:1746147211.340411:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311475584:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.342129:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.342209:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3765:x1830967311476736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (229us total) trans 21474842641 rc 0/0 00000100:00100000:1.0:1746147211.342222:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19946 00000004:00080000:1.0:1746147211.342269:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cf800/2, rc 0, transno 17179875254 00000100:00100000:1.0:1746147211.342273:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311475712:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147211.342284:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cfb80/2, rc 0, transno 21474842640 00000100:00100000:1.0:1746147211.342287:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311476224:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147211.342294:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cc000/2, rc 0, transno 21474842641 00000100:00100000:1.0:1746147211.342296:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311476736:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147211.342453:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746147211.342464:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311476992:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147211.342498:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147211.342528:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310368000 00000100:00100000:3.0:1746147211.342534:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310368000 00000100:00100000:3.0:1746147211.342562:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16452 00000100:00100000:3.0:1746147211.342568:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+6:2853:x1830967310368000:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147211.342584:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.342603:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd000/0x3139939425062ae7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eee1 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.342660:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd000/0x3139939425062ae7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eee1 expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.342673:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd000/0x3139939425062ae7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eee1 expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.342690:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147211.342693:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147211.342696:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fd000, rc 0) 00000100:00100000:3.0:1746147211.342729:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2853:x1830967310368000:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 161us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.342734:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16452 00000100:00100000:1.0:1746147211.342844:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311476992 00000100:00100000:1.0:1746147211.342847:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311476992 00000100:00100000:1.0:1746147211.342868:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19947 00000100:00100000:1.0:1746147211.342872:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3766:x1830967311476992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147211.342986:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3766:x1830967311476992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (487us total) trans 21474842642 rc 0/0 00000100:00100000:1.0:1746147211.342991:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19947 00000004:00080000:3.0:1746147211.343044:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cce00/2, rc 0, transno 21474842642 00000100:00100000:3.0:1746147211.343047:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311476992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147211.350612:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.350732:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310368256 00000100:00100000:1.0:1746147211.350743:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310368256 00000100:00100000:1.0:1746147211.350804:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6149 00000100:00100000:1.0:1746147211.350812:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2853:x1830967310368256:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:1.0:1746147211.352218:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2853:x1830967310368256:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 1279us (1492us total) trans 8589937354 rc 0/0 00000100:00100000:1.0:1746147211.352231:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6149 00000100:00100000:0.0:1746147211.378365:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.378474:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310368512 00000100:00100000:2.0:1746147211.378482:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310368512 00000100:00100000:2.0:1746147211.378531:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16453 00000100:00100000:2.0:1746147211.378538:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2865:x1830967310368512:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147211.378558:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.378574:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc800/0x3139939425062aee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eee8 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.378636:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeec00/0x3139939425062af5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378658:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeec00/0x3139939425062af5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378668:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeec00/0x3139939425062af5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378679:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425062afc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378684:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425062afc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378689:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425062afc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378778:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062b03 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378786:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062b03 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378791:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062b03 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:2.0:1746147211.378799:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147211.378862:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeec00/0x3139939425062af5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378868:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeec00/0x3139939425062af5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378874:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeec00/0x3139939425062af5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378879:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeec00/0x3139939425062af5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378884:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b1aeec00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147211.378887:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeec00/0x3139939425062af5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378893:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeec00/0x3139939425062af5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378902:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147211.378904:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147211.378907:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeec00/0x3139939425062af5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378911:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeec00/0x3139939425062af5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378938:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425062afc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378942:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425062afc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378946:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425062afc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378950:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b1aeea00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147211.378952:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425062afc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378960:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425062afc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378966:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096bb1c00) 00010000:00010000:2.0:1746147211.378967:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147211.378970:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425062afc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.378974:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425062afc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.379019:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55cc800/0x3139939425062aee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eee8 expref: 29 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.379029:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062b03 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eee8 expref: 28 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.379035:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147211.379036:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147211.379039:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c42a00, rc 0) 00000100:00100000:2.0:1746147211.379086:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2865:x1830967310368512:12345-192.168.204.25@tcp:101:cat.0 Request processed in 548us (729us total) trans 8589937355 rc 0/0 00000100:00100000:2.0:1746147211.379120:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16453 00000100:00100000:0.0:1746147211.385466:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.385732:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310368768 00000100:00100000:2.0:1746147211.385740:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310368768 00000100:00100000:2.0:1746147211.385787:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16454 00000100:00100000:2.0:1746147211.385794:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2864:x1830967310368768:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147211.385812:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.385829:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4200/0x3139939425062b11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eeef expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.385896:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062b18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.385907:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062b18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.385916:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062b18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.385928:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425062b1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.385933:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425062b1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.385937:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425062b1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.386013:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797800/0x3139939425062b26 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.386020:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797800/0x3139939425062b26 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.386026:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797800/0x3139939425062b26 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:2.0:1746147211.386033:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147211.386125:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062b18 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.386132:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062b18 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.386137:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062b18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.386142:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062b18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.386148:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098e6c000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147211.386151:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062b18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.386156:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062b18 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.386165:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147211.386168:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147211.386171:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062b18 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.386175:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098e6c000/0x3139939425062b18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.386213:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425062b1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.386218:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425062b1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.386222:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425062b1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.386226:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d5bb600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147211.386228:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425062b1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.386235:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425062b1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.386241:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096bb1200) 00010000:00010000:2.0:1746147211.386243:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147211.386244:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425062b1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.386248:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5bb600/0x3139939425062b1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.386740:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a4200/0x3139939425062b11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeef expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.386752:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797800/0x3139939425062b26 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeef expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.386757:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147211.386759:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147211.386761:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5797800, rc 0) 00000100:00100000:2.0:1746147211.386815:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2864:x1830967310368768:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1022us (1357us total) trans 8589937356 rc 0/0 00000100:00100000:2.0:1746147211.386822:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16454 00000100:00100000:0.0:1746147211.398623:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.398675:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.398726:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310369152 00000100:00100000:0.0:1746147211.398731:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.398739:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310369152 00000100:00100000:0.0:1746147211.398753:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310368896 00000100:00100000:0.0:1746147211.398766:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310368896 00000100:00100000:0.0:1746147211.398797:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310369280 00000100:00100000:0.0:1746147211.398799:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310369280 00000100:00100000:3.0:1746147211.398801:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16455 00000100:00100000:3.0:1746147211.398810:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2863:x1830967310369152:12345-192.168.204.25@tcp:101:multiop.0 00000100:00100000:0.0:1746147211.398815:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19948 00000100:00100000:0.0:1746147211.398822:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+5:2864:x1830967310368896:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147211.398838:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147211.398838:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147211.398854:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x3139939425062b34 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eef6 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.398858:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x3139939425062b3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eefd expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.398879:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425062ab6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb7 expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.398886:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147211.398888:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147211.398891:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x3139939425062b34 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eef6 expref: 6 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.398917:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425062ab6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb7 expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.398928:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425062ab6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb7 expref: 14 pid: 1854 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746147211.398939:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095124000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311477120:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147211.398972:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425062b42 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147211.398986:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062b03 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eee8 expref: 29 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.398995:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797800/0x3139939425062b26 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeef expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.399001:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425062b42 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147211.399012:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489900 going to sleep for 11 seconds 00010000:00010000:3.0:1746147211.399027:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797800/0x3139939425062b26 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeef expref: 8 pid: 7237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147211.399031:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19949 00010000:00010000:3.0:1746147211.399037:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797800/0x3139939425062b26 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeef expref: 8 pid: 7237 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746147211.399038:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2865:x1830967310369280:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147211.399044:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147211.399047:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311477248:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147211.399049:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b80a00/0x3139939425062b49 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef04 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.399064:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147211.399067:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b80a00/0x3139939425062b49 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef04 expref: 22 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.399075:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b80a00/0x3139939425062b49 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef04 expref: 22 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.399084:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80a00, rc 0) 00000100:00100000:0.0:1746147211.399132:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2865:x1830967310369280:12345-192.168.204.25@tcp:101:cat.0 Request processed in 95us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147211.399138:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19949 00010000:00010000:3.0:1746147211.399155:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062b03 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eee8 expref: 29 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.399162:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062b03 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eee8 expref: 29 pid: 7237 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147211.399174:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311477376:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147211.399196:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.402000:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.404013:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310369536 00000100:00100000:3.0:1746147211.404027:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310369536 00000100:00100000:0.0:1746147211.404476:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095124000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311477120:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147211.404502:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x3139939425062b34 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eef6 expref: 6 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.404517:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81400, rc 0) 00000100:00100000:0.0:1746147211.404569:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+6:2864:x1830967310368896:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5747us (5892us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147211.404577:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19948 00000100:00100000:3.0:1746147211.404720:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16456 00000100:00100000:3.0:1746147211.404729:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2862:x1830967310369536:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147211.404752:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.404772:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b537a600/0x3139939425062b50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef0b expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.404877:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6400/0x3139939425062b57 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.404891:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6400/0x3139939425062b57 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.404901:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6400/0x3139939425062b57 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:3.0:1746147211.406180:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311477248:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147211.409690:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.409730:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.409828:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.409866:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310369664 00000100:00100000:0.0:1746147211.409872:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310369664 00010000:00010000:0.0:1746147211.409905:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425062ab6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb7 expref: 15 pid: 1854 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746147211.409929:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310369792 00000100:00100000:0.0:1746147211.409932:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310369792 00010000:00010000:0.0:1746147211.409944:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797800/0x3139939425062b26 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeef expref: 11 pid: 7237 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746147211.409958:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310369920 00000100:00100000:0.0:1746147211.409960:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310369920 00010000:00010000:0.0:1746147211.409969:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062b03 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eee8 expref: 30 pid: 7237 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746147211.410002:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9046 00000100:00100000:0.0:1746147211.410009:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310369664:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147211.410022:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147211.410039:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425062ab6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb7 expref: 15 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746147211.410049:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425062ab6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb7 expref: 15 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746147211.410070:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425062ab6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeb7 expref: 15 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746147211.410113:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147211.410115:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147211.410122:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x3139939425062b34 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eef6 expref: 5 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.410135:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x3139939425062b34 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eef6 expref: 5 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.410143:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147211.410144:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147211.410147:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b80a00/0x3139939425062b49 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef04 expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.410153:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b80a00/0x3139939425062b49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef04 expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.410180:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096b80a00/0x3139939425062b49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef04 expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147211.410190:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095127100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311477504:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147211.410266:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x3139939425062b34 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eef6 expref: 5 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147211.410273:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095125880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311477632:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147211.410290:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.410367:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9047 00000100:00100000:0.0:1746147211.410373:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310369792:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147211.410381:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147211.410385:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797800/0x3139939425062b26 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeef expref: 11 pid: 7237 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746147211.410393:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797800/0x3139939425062b26 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeef expref: 11 pid: 7237 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746147211.410404:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5797800/0x3139939425062b26 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeef expref: 11 pid: 7237 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746147211.410414:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147211.410419:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425062b42 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147211.410425:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425062b42 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147211.410429:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147211.410446:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310369792:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 74us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147211.410451:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9047 00000100:00100000:0.0:1746147211.410464:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9048 00000100:00100000:0.0:1746147211.410468:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310369920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147211.410474:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147211.410476:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062b03 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eee8 expref: 30 pid: 7237 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746147211.410483:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062b03 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eee8 expref: 30 pid: 7237 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746147211.410491:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147211.410494:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425062b42 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147211.410500:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425062b42 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147211.410504:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425062b42 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147211.410509:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6400/0x3139939425062b57 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.410514:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6400/0x3139939425062b57 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.410518:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6400/0x3139939425062b57 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.410528:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147211.410540:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310369920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 72us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147211.410545:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9048 00010000:00010000:0.0:1746147211.410568:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6400/0x3139939425062b57 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.410574:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6400/0x3139939425062b57 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:0.0:1746147211.410588:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147211.410698:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c42a00/0x3139939425062b03 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eee8 expref: 29 pid: 7237 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.410711:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311477376:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147211.410731:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425062b42 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.410737:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425062b42 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147211.410740:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b537a600/0x3139939425062b50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef0b expref: 11 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.410741:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425062b42 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:2.0:1746147211.410749:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147211.410750:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6400/0x3139939425062b57 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef0b expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.410759:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147211.410762:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147211.410763:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974a6400, rc 0) 00000100:00100000:0.0:1746147211.410784:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2862:x1830967310369536:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6057us (8792us total) trans 8589937357 rc 0/0 00010000:00010000:2.0:1746147211.410789:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fcc00/0x3139939425062b3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eefd expref: 30 pid: 7237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147211.410790:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16456 00010000:00010000:2.0:1746147211.410798:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425062b42 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eefd expref: 29 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.410802:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147211.410804:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147211.410806:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f212a00, rc 0) 00000100:00100000:2.0:1746147211.410819:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2863:x1830967310369152:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 12012us (12206us total) trans 8589937358 rc 0/0 00000100:00100000:2.0:1746147211.410825:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16455 00000100:00100000:2.0:1746147211.414362:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095127100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311477504:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147211.414834:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.415724:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310370048 00000100:00100000:2.0:1746147211.415731:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310370048 00000100:00100000:2.0:1746147211.415783:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16457 00000100:00100000:2.0:1746147211.415790:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2865:x1830967310370048:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147211.415808:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.415823:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425062b6c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef12 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.415872:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425062b6c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef12 expref: 30 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.415882:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425062b6c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef12 expref: 30 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.415895:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147211.415898:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147211.415900:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ffc600, rc 0) 00000100:00100000:2.0:1746147211.415943:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2865:x1830967310370048:12345-192.168.204.25@tcp:101:cat.0 Request processed in 153us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.415949:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16457 00000100:00100000:3.0:1746147211.417684:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095125880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311477632:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147211.417707:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147211.417747:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310369664:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7738us (8065us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.417756:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9046 00000100:00100000:3.0:1746147211.417825:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.418722:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310370176 00000100:00100000:2.0:1746147211.418730:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310370176 00000100:00100000:2.0:1746147211.418985:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16458 00000100:00100000:2.0:1746147211.418994:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2862:x1830967310370176:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147211.419015:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.419032:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fdc00/0x3139939425062b73 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef19 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.419080:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fdc00/0x3139939425062b73 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef19 expref: 11 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.420206:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fdc00/0x3139939425062b73 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef19 expref: 11 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.420227:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147211.420230:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147211.420233:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fdc00, rc 0) 00000100:00100000:2.0:1746147211.420286:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2862:x1830967310370176:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1293us (2460us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.420292:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16458 00000100:00100000:0.0:1746147211.422346:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.422656:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310370432 00000100:00100000:3.0:1746147211.422665:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310370432 00002000:00100000:3.0:1746147211.422703:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880095126a00 x1830967310370432/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.422713:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095126a00 with x1830967310370432 ext(0->1048575) 00002000:00010000:3.0:1746147211.422717:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095126a00 00000100:00100000:3.0:1746147211.422748:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7314 00000100:00100000:3.0:1746147211.422755:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2003:x1830967310370432:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147211.423404:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.423453:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310370688 00000100:00100000:2.0:1746147211.423457:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310370688 00000100:00100000:0.0:1746147211.424404:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.426578:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310370816 00000100:00100000:2.0:1746147211.426588:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310370816 00000100:00100000:2.0:1746147211.426654:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16459 00000100:00100000:2.0:1746147211.426662:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2862:x1830967310370688:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147211.426680:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.426684:0:7237:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147211.426706:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fdc00/0x3139939425062b73 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef19 expref: 12 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.426731:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147211.426734:0:7237:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147211.426744:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x3139939425062b7a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef20 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.426774:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16460 00010000:00010000:2.0:1746147211.426781:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00000100:00100000:3.0:1746147211.426783:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2864:x1830967310370816:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147211.426790:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.426792:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd000/0x3139939425062ae7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eee1 expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.426798:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425062b6c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef12 expref: 29 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.426799:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425062b88 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef27 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.426808:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147211.426824:0:7239:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147211.426831:0:7239:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425062b88 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef27 expref: 13 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.428216:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425062b6c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef12 expref: 29 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.428229:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425062b6c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef12 expref: 29 pid: 7237 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.428240:0:7239:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00000100:00100000:2.0:1746147211.428242:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099157100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311477760:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147211.428254:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425062b88 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef27 expref: 13 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.428264:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147211.428266:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147211.428268:0:7239:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147211.428275:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974a7c00, rc 0) 00000100:00100000:3.0:1746147211.428306:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2864:x1830967310370816:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1524us (3905us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.428311:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16460 00010000:00010000:2.0:1746147211.428334:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd000/0x3139939425062ae7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eee1 expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.428341:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd000/0x3139939425062ae7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eee1 expref: 7 pid: 6215 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.428348:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099155500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311477888:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147211.428365:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147211.431217:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2003:x1830967310370432:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8455us (8870us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147211.431229:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7314 00002000:00100000:3.0:1746147211.431238:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880095126a00 x1830967310370432/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.431246:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095126a00 with x1830967310370432 ext(0->1048575) 00002000:00010000:3.0:1746147211.431251:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095126a00 00000100:00100000:0.0:1746147211.432558:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.432603:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099157100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311477760:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147211.432678:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310370944 00000100:00100000:3.0:1746147211.432684:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310370944 00010000:00010000:3.0:1746147211.432714:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425062b6c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef12 expref: 30 pid: 7237 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147211.432740:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9049 00000100:00100000:3.0:1746147211.432746:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310370944:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147211.432758:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147211.432762:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425062b6c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef12 expref: 30 pid: 7237 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.432772:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425062b6c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef12 expref: 30 pid: 7237 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.432790:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ffc600/0x3139939425062b6c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef12 expref: 30 pid: 7237 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.432925:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147211.432930:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147211.432948:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147211.432953:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147211.432988:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310370944:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 241us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.432994:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9049 00000100:00100000:2.0:1746147211.433382:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.433438:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310371072 00000100:00100000:1.0:1746147211.433442:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310371072 00010000:00010000:1.0:1746147211.433458:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd000/0x3139939425062ae7 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eee1 expref: 8 pid: 6215 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.433474:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9050 00000100:00100000:1.0:1746147211.433479:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967310371072:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.433487:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.433491:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd000/0x3139939425062ae7 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eee1 expref: 8 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.433503:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd000/0x3139939425062ae7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eee1 expref: 8 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.433514:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147211.433518:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147211.433525:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147211.433526:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fd000/0x3139939425062ae7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eee1 expref: 8 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.433530:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147211.433538:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425062b88 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef27 expref: 12 pid: 7239 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147211.433555:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099155500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311477888:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147211.433561:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.433584:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2000:x1830967310371072:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 103us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.433589:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9050 00010000:00010000:0.0:1746147211.434310:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147211.434388:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147211.434396:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00000040:00080000:1.0:1746147211.434627:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1281, 88 off120584 00000004:00080000:1.0:1746147211.434632:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749424541844ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147211.434666:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1278, 88 off120320 00000004:00080000:1.0:1746147211.434669:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749424579974ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147211.434683:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1279, 88 off120408 00000004:00080000:1.0:1746147211.434685:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749424595365ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147211.435568:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1282, 88 off120672 00000004:00080000:1.0:1746147211.435574:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749425484884ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147211.435789:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1283, 88 off120760 00000004:00080000:1.0:1746147211.435793:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749425703822ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147211.435806:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1280, 88 off120496 00000004:00080000:1.0:1746147211.435808:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749425718709ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147211.436371:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1281, 88 off120584 00000004:00080000:1.0:1746147211.436375:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749426285562ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147211.436383:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1282, 88 off120672 00000004:00080000:1.0:1746147211.436385:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749426296040ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147211.436394:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1284, 88 off120848 00000004:00080000:1.0:1746147211.436396:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749426306854ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147211.436405:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1283, 88 off120760 00000004:00080000:1.0:1746147211.436408:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749426318705ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147211.436416:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1285, 88 off120936 00000004:00080000:1.0:1746147211.436418:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749426328504ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147211.436426:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1284, 88 off120848 00000004:00080000:1.0:1746147211.436428:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749426338362ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147211.436436:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1286, 88 off121024 00000004:00080000:1.0:1746147211.436438:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749426348739ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147211.436445:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1287, 88 off121112 00000004:00080000:1.0:1746147211.436447:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749426357657ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147211.436454:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1288, 88 off121200 00000004:00080000:1.0:1746147211.436456:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749426366880ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147211.436463:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1289, 88 off121288 00000004:00080000:1.0:1746147211.436466:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749426376612ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147211.436473:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1285, 88 off120936 00000004:00080000:1.0:1746147211.436476:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749426386130ns, next at 694367916532ns, rc = 0 00000100:00100000:2.0:1746147211.439495:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.439881:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310371200 00000100:00100000:0.0:1746147211.439889:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310371200 00000100:00100000:0.0:1746147211.439940:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19950 00000100:00100000:0.0:1746147211.439947:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2865:x1830967310371200:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147211.439961:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147211.439975:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4e00/0x3139939425062b8f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef2e expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.440006:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x3139939425062abd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eebe expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.440013:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147211.440014:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147211.440017:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4e00/0x3139939425062b8f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef2e expref: 29 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.440043:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x3139939425062abd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eebe expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.440055:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x3139939425062abd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eebe expref: 17 pid: 1854 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746147211.440065:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095126680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311478016:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147211.440147:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489a80 going to sleep for 11 seconds 00000001:00080000:3.0:1746147211.441651:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937359 is committed 00000004:00080000:3.0:1746147211.441660:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1262 committed 00000004:00080000:3.0:1746147211.441679:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1269 committed 00000004:00080000:3.0:1746147211.441689:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1268 committed 00000004:00080000:3.0:1746147211.441690:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1267 committed 00000004:00080000:3.0:1746147211.441692:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1266 committed 00000004:00080000:3.0:1746147211.441693:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1261 committed 00000004:00080000:3.0:1746147211.441694:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1265 committed 00000004:00080000:3.0:1746147211.441695:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1260 committed 00000004:00080000:3.0:1746147211.441697:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1264 committed 00000004:00080000:3.0:1746147211.441698:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1259 committed 00000004:00080000:3.0:1746147211.441700:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1258 committed 00000004:00080000:3.0:1746147211.441701:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1257 committed 00000004:00080000:3.0:1746147211.441702:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1263 committed 00000004:00080000:3.0:1746147211.441703:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1262 committed 00000004:00080000:3.0:1746147211.441705:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1256 committed 00000004:00080000:3.0:1746147211.441706:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1255 committed 00000004:00080000:3.0:1746147211.441707:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1261 committed 00000001:00080000:3.0:1746147211.441712:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937358 is committed 00000001:00080000:3.0:1746147211.441721:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937354 is committed 00000100:00100000:2.0:1746147211.441921:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311478272:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.441963:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147211.441984:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311478784:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.441996:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147211.442010:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746147211.442014:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311478144:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.442028:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147211.442038:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311478656:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.442048:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147211.442066:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311478272 00000100:00100000:2.0:1746147211.442071:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311478272 00000100:00100000:2.0:1746147211.442111:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311478784 00000100:00100000:2.0:1746147211.442113:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311478784 00000100:00100000:2.0:1746147211.442123:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311478144 00000100:00100000:2.0:1746147211.442124:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311478144 00000100:00100000:2.0:1746147211.442144:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311478656 00000100:00100000:2.0:1746147211.442145:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311478656 00000100:00100000:2.0:1746147211.442156:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19951 00000100:00100000:2.0:1746147211.442161:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3765:x1830967311478272:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147211.442253:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147211.442255:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147210 -> 1746147210 00002000:00010000:2.0:1746147211.442257:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:2.0:1746147211.442259:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147211 -> 1746147211 00002000:00010000:2.0:1746147211.442261:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746147211.442284:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3765:x1830967311478272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 123us (322us total) trans 17179875256 rc 0/0 00000100:00100000:2.0:1746147211.442290:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19951 00000100:00100000:2.0:1746147211.442302:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19952 00000100:00100000:2.0:1746147211.442305:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3765:x1830967311478784:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147211.442336:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:2.0:1746147211.442338:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:2.0:1746147211.442339:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147211.442341:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:2.0:1746147211.442343:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:2.0:1746147211.442355:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3765:x1830967311478784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (358us total) trans 17179875257 rc 0/0 00000100:00100000:2.0:1746147211.442359:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19952 00000100:00100000:2.0:1746147211.442366:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19953 00000100:00100000:2.0:1746147211.442369:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3765:x1830967311478144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147211.442394:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147211.442396:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147210 -> 1746147210 00002000:00010000:2.0:1746147211.442397:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:2.0:1746147211.442399:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147211 -> 1746147211 00002000:00010000:2.0:1746147211.442400:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746147211.442416:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3765:x1830967311478144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (386us total) trans 17179875258 rc 0/0 00000100:00100000:2.0:1746147211.442420:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19953 00000100:00100000:2.0:1746147211.442428:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19954 00000100:00100000:2.0:1746147211.442432:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3765:x1830967311478656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.442474:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3765:x1830967311478656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (424us total) trans 17179875259 rc 0/0 00000100:00100000:2.0:1746147211.442478:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19954 00000004:00080000:2.0:1746147211.442507:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e485f80/2, rc 0, transno 17179875258 00000100:00100000:2.0:1746147211.442511:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311478144:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147211.442518:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e486300/2, rc 0, transno 17179875259 00000100:00100000:2.0:1746147211.442520:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311478656:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147211.442525:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e487480/2, rc 0, transno 17179875256 00000100:00100000:2.0:1746147211.442528:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311478272:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147211.442532:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca12300/2, rc 0, transno 17179875257 00000100:00100000:2.0:1746147211.442534:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311478784:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.442560:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311478528:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.442576:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147211.442588:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311479040:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.442599:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147211.442607:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746147211.442610:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311478400:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.442620:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147211.442626:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311478912:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.442635:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147211.442660:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311478528 00000100:00100000:2.0:1746147211.442663:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311478528 00000100:00100000:2.0:1746147211.442687:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311479040 00000100:00100000:2.0:1746147211.442689:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311479040 00000100:00100000:2.0:1746147211.442698:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311478400 00000100:00100000:2.0:1746147211.442700:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311478400 00000100:00100000:2.0:1746147211.442707:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311478912 00000100:00100000:2.0:1746147211.442709:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311478912 00000100:00100000:2.0:1746147211.442717:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19955 00000100:00100000:2.0:1746147211.442721:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+52:3767:x1830967311478528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147211.442760:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147211.442762:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147211.442764:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147211.442766:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147211.442767:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:2.0:1746147211.442789:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+53:3767:x1830967311478528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (211us total) trans 17179875260 rc 0/0 00000100:00100000:2.0:1746147211.442793:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19955 00000100:00100000:2.0:1746147211.442803:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19956 00000100:00100000:2.0:1746147211.442807:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+52:3767:x1830967311479040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.442853:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+53:3767:x1830967311479040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (253us total) trans 17179875261 rc 0/0 00000100:00100000:2.0:1746147211.442858:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19956 00000100:00100000:2.0:1746147211.442867:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19957 00000100:00100000:2.0:1746147211.442870:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+52:3767:x1830967311478400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147211.442914:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147211.442917:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147210 -> 1746147210 00002000:00010000:2.0:1746147211.442918:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:2.0:1746147211.442920:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147211 -> 1746147211 00002000:00010000:2.0:1746147211.442921:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746147211.442939:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+53:3767:x1830967311478400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (317us total) trans 17179875262 rc 0/0 00000100:00100000:2.0:1746147211.442943:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19957 00000100:00100000:2.0:1746147211.442951:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19958 00000100:00100000:2.0:1746147211.442955:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+52:3767:x1830967311478912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147211.442995:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+53:3767:x1830967311478912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (358us total) trans 17179875263 rc 0/0 00000100:00100000:2.0:1746147211.442999:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19958 00000004:00080000:2.0:1746147211.443020:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e484000/2, rc 0, transno 17179875262 00000100:00100000:2.0:1746147211.443023:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311478400:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147211.443029:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca11880/2, rc 0, transno 17179875263 00000100:00100000:2.0:1746147211.443031:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311478912:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147211.443036:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e485180/2, rc 0, transno 17179875260 00000100:00100000:2.0:1746147211.443038:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311478528:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147211.443043:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ca12d80/2, rc 0, transno 17179875261 00000100:00100000:2.0:1746147211.443045:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311479040:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746147211.443176:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef20 expref: 11 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.443186:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147211.443188:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746147211.443192:0:7237:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425062b88 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef27 expref: 11 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.443201:0:7237:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425062b88 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef27 expref: 11 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.443208:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425062b88 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef27 expref: 11 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.443230:0:7237:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425062b88 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef27 expref: 11 pid: 7239 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.443238:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311479168:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147211.443290:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fa55b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.443539:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311479680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147211.443561:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147211.443574:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311480192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147211.443586:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147211.443595:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746147211.443598:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311479552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147211.443611:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147211.443619:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311480064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147211.443630:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147211.443659:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311479680 00000100:00100000:0.0:1746147211.443662:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311479680 00000100:00100000:0.0:1746147211.443679:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311480192 00000100:00100000:0.0:1746147211.443681:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311480192 00000100:00100000:0.0:1746147211.443688:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311479552 00000100:00100000:0.0:1746147211.443690:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311479552 00000100:00100000:0.0:1746147211.443696:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311480064 00000100:00100000:0.0:1746147211.443697:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311480064 00000100:00100000:0.0:1746147211.443705:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19959 00000100:00100000:0.0:1746147211.443710:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3767:x1830967311479680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147211.443764:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147211.443767:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147211.443768:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147211.443770:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147211.443772:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:0.0:1746147211.443792:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3767:x1830967311479680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (231us total) trans 21474842643 rc 0/0 00000100:00100000:0.0:1746147211.443797:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19959 00000100:00100000:0.0:1746147211.443806:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19960 00000100:00100000:0.0:1746147211.443810:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3767:x1830967311480192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147211.443845:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:0.0:1746147211.443847:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147211.443849:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147211.443851:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147211.443852:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:0.0:1746147211.443868:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3767:x1830967311480192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (280us total) trans 21474842644 rc 0/0 00000100:00100000:0.0:1746147211.443872:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19960 00000100:00100000:0.0:1746147211.443881:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19961 00000100:00100000:0.0:1746147211.443884:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3767:x1830967311479552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147211.443916:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:0.0:1746147211.443918:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147211.443920:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147211.443922:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147211 -> 1746147211 00002000:00010000:0.0:1746147211.443923:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:0.0:1746147211.443939:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3767:x1830967311479552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (326us total) trans 21474842645 rc 0/0 00000100:00100000:0.0:1746147211.443944:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19961 00000100:00100000:0.0:1746147211.443952:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19962 00000100:00100000:0.0:1746147211.443955:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3767:x1830967311480064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147211.443987:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147211.443989:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147211.443990:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147211.443992:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147211.443993:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:0.0:1746147211.444008:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3767:x1830967311480064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (377us total) trans 21474842646 rc 0/0 00000100:00100000:0.0:1746147211.444013:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19962 00000004:00080000:0.0:1746147211.444035:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095127100/2, rc 0, transno 21474842645 00000100:00100000:0.0:1746147211.444040:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311479552:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147211.444046:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009455c380/2, rc 0, transno 21474842646 00000100:00100000:0.0:1746147211.444049:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311480064:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147211.444054:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099155500/2, rc 0, transno 21474842643 00000100:00100000:0.0:1746147211.444058:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311479680:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147211.444063:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009455ca80/2, rc 0, transno 21474842644 00000100:00100000:0.0:1746147211.444065:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311480192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147211.444121:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311479424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147211.444139:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147211.444150:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311479936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147211.444162:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147211.444173:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1746147211.444176:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311479296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147211.444188:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147211.444195:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311479808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147211.444205:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147211.444213:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311480320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147211.444224:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147211.444238:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311479424 00000100:00100000:0.0:1746147211.444240:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311479424 00000100:00100000:0.0:1746147211.444252:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311479936 00000100:00100000:0.0:1746147211.444253:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311479936 00000100:00100000:0.0:1746147211.444260:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311479296 00000100:00100000:0.0:1746147211.444261:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311479296 00000100:00100000:0.0:1746147211.444267:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311479808 00000100:00100000:0.0:1746147211.444268:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311479808 00000100:00100000:0.0:1746147211.444275:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311480320 00000100:00100000:0.0:1746147211.444277:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311480320 00000100:00100000:0.0:1746147211.444283:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19963 00000100:00100000:0.0:1746147211.444286:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3765:x1830967311479424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147211.444322:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147211.444325:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147211.444327:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147211.444328:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147211 -> 1746147211 00002000:00010000:0.0:1746147211.444330:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147211.444349:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3765:x1830967311479424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (210us total) trans 21474842647 rc 0/0 00000100:00100000:0.0:1746147211.444354:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19963 00000100:00100000:0.0:1746147211.444362:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19964 00000100:00100000:0.0:1746147211.444366:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3765:x1830967311479936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147211.444409:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3765:x1830967311479936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (246us total) trans 21474842648 rc 0/0 00000100:00100000:0.0:1746147211.444414:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19964 00000100:00100000:0.0:1746147211.444422:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19965 00000100:00100000:0.0:1746147211.444426:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3765:x1830967311479296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147211.444460:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147211.444462:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147211.444464:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:0.0:1746147211.444465:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147211 -> 1746147211 00002000:00010000:0.0:1746147211.444467:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:0.0:1746147211.444483:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3765:x1830967311479296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (294us total) trans 21474842649 rc 0/0 00000100:00100000:0.0:1746147211.444488:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19965 00000100:00100000:0.0:1746147211.444496:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19966 00000100:00100000:0.0:1746147211.444500:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3765:x1830967311479808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147211.444543:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3765:x1830967311479808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (336us total) trans 21474842650 rc 0/0 00000100:00100000:0.0:1746147211.444549:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19966 00000100:00100000:0.0:1746147211.444557:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19967 00000100:00100000:0.0:1746147211.444561:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3765:x1830967311480320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147211.444606:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3765:x1830967311480320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (380us total) trans 21474842651 rc 0/0 00000100:00100000:0.0:1746147211.444611:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19967 00000004:00080000:0.0:1746147211.444629:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095127480/2, rc 0, transno 21474842649 00000100:00100000:0.0:1746147211.444632:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311479296:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147211.444638:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099157100/2, rc 0, transno 21474842650 00000100:00100000:0.0:1746147211.444663:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311479808:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147211.444672:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009455df80/2, rc 0, transno 21474842651 00000100:00100000:0.0:1746147211.444674:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311480320:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147211.444680:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095125880/2, rc 0, transno 21474842647 00000100:00100000:0.0:1746147211.444682:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311479424:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147211.444687:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009455c000/2, rc 0, transno 21474842648 00000100:00100000:0.0:1746147211.444690:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311479936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147211.444753:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095126680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311478016:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147211.444773:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4e00/0x3139939425062b8f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef2e expref: 29 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.444785:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9b4e00, rc 0) 00000100:00100000:0.0:1746147211.444805:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2865:x1830967310371200:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4859us (5317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147211.444813:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19950 00000100:00100000:0.0:1746147211.444923:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.445747:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310371328 00000100:00100000:3.0:1746147211.445752:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310371328 00010000:00010000:3.0:1746147211.445774:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x3139939425062abd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eebe expref: 18 pid: 1854 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147211.445806:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9051 00000100:00100000:3.0:1746147211.445811:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310371328:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147211.445819:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147211.445831:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x3139939425062abd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eebe expref: 18 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.445841:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x3139939425062abd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eebe expref: 18 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.445858:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x3139939425062abd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eebe expref: 18 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.445868:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.445870:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.445875:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4e00/0x3139939425062b8f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef2e expref: 28 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.445882:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4e00/0x3139939425062b8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef2e expref: 28 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.445905:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4e00/0x3139939425062b8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef2e expref: 28 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.445914:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311480448:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147211.445972:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.449057:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.449163:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.449252:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311480448:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147211.449268:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147211.449314:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310371328:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3502us (4390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.449323:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9051 00000100:00100000:3.0:1746147211.449378:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310371584 00000100:00100000:3.0:1746147211.449383:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310371584 00000100:00100000:3.0:1746147211.449408:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16461 00000100:00100000:3.0:1746147211.449414:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2865:x1830967310371584:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147211.449432:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.449446:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6800/0x3139939425062b96 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef35 expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.449491:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6800/0x3139939425062b96 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef35 expref: 28 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.449503:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6800/0x3139939425062b96 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef35 expref: 28 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.449516:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147211.449519:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147211.449522:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974a6800, rc 0) 00000100:00100000:3.0:1746147211.449542:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2865:x1830967310371584:12345-192.168.204.25@tcp:101:cat.0 Request processed in 128us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.449547:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16461 00000100:00100000:1.0:1746147211.449695:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311479168:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147211.449715:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x3139939425062b7a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef20 expref: 11 pid: 7237 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746147211.449729:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef20 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.449745:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f15f800, rc 0) 00000100:00100000:1.0:1746147211.449766:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2862:x1830967310370688:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 23105us (26363us total) trans 8589937359 rc 0/0 00000100:00100000:1.0:1746147211.449771:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16459 00000100:00100000:2.0:1746147211.449858:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310371456 00000100:00100000:2.0:1746147211.449862:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310371456 00000100:00100000:2.0:1746147211.449883:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6150 00000100:00100000:2.0:1746147211.449888:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2864:x1830967310371456:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:2.0:1746147211.449939:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2864:x1830967310371456:12345-192.168.204.25@tcp:49:cat.0 Request processed in 51us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.449945:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6150 00000100:00100000:0.0:1746147211.463548:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.463935:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.465900:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310371968 00000100:00100000:1.0:1746147211.465910:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310371968 00000100:00100000:1.0:1746147211.465949:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16462 00000100:00100000:1.0:1746147211.465956:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2863:x1830967310371968:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147211.465970:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147211.465984:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425062b9d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef3c expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.466031:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425062b9d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef3c expref: 29 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.466041:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425062b9d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef3c expref: 29 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.466055:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147211.466057:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147211.466060:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9200, rc 0) 00000100:00100000:1.0:1746147211.466124:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2863:x1830967310371968:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 168us (2188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.466130:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16462 00000100:00100000:0.0:1746147211.466312:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.466677:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310371712 00000100:00100000:2.0:1746147211.466682:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310371712 00000100:00100000:2.0:1746147211.466703:0:2705:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6151 00000100:00100000:2.0:1746147211.466707:0:2705:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2862:x1830967310371712:12345-192.168.204.25@tcp:49:multiop.0 00000100:00100000:2.0:1746147211.466761:0:2705:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2862:x1830967310371712:12345-192.168.204.25@tcp:49:multiop.0 Request processed in 54us (3221us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.466767:0:2705:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6151 00000100:00100000:0.0:1746147211.467753:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.468125:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310372096 00000100:00100000:3.0:1746147211.468130:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310372096 00002000:00100000:3.0:1746147211.468158:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880095125f80 x1830967310372096/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.468166:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095125f80 with x1830967310372096 ext(1048576->2097151) 00002000:00010000:3.0:1746147211.468171:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095125f80 00000100:00100000:3.0:1746147211.468188:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310372352 00000100:00100000:3.0:1746147211.468190:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310372352 00002000:00100000:3.0:1746147211.468202:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880095124000 x1830967310372352/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.468207:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095124000 with x1830967310372352 ext(0->1048575) 00002000:00010000:3.0:1746147211.468210:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095124000 00000100:00100000:3.0:1746147211.468221:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7315 00000100:00100000:3.0:1746147211.468226:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310372096:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147211.468793:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7316 00000100:00100000:3.0:1746147211.468799:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+6:2000:x1830967310372352:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147211.471284:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.471553:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.471766:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310372608 00000100:00100000:2.0:1746147211.471773:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310372608 00000100:00100000:2.0:1746147211.471815:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19968 00000100:00100000:2.0:1746147211.471834:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2862:x1830967310372608:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147211.471850:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.471865:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef43 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.471888:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e3f000/0x3139939425062ac4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eec5 expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.471895:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147211.471897:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147211.471899:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1662976->1699839] (req 1662976->1699839) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 20 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.471924:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e3f000/0x3139939425062ac4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eec5 expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.471935:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e3f000/0x3139939425062ac4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eec5 expref: 16 pid: 1854 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.471945:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311480576:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147211.472013:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caad80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147211.473431:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310372480 00000100:00100000:3.0:1746147211.473438:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310372480 00000100:00100000:3.0:1746147211.473477:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 997 00000100:00100000:3.0:1746147211.473482:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310372480:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147211.473491:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147211.473509:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9200/0x3139939425062b9d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef3c expref: 29 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.473529:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147211.473532:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147211.473563:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310372480:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 81us (2285us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.473569:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 997 00000100:00100000:2.0:1746147211.479066:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.479223:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310372096:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 10995us (12910us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147211.479233:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7315 00002000:00100000:3.0:1746147211.479243:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880095125f80 x1830967310372096/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.479252:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095125f80 with x1830967310372096 ext(1048576->2097151) 00002000:00010000:3.0:1746147211.479257:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095125f80 00000100:00100000:1.0:1746147211.479316:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310372736 00000100:00100000:1.0:1746147211.479323:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310372736 00010000:00010000:1.0:1746147211.479347:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3f000/0x3139939425062ac4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eec5 expref: 17 pid: 1854 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.479365:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9052 00000100:00100000:1.0:1746147211.479370:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310372736:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.479380:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.479394:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e3f000/0x3139939425062ac4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eec5 expref: 17 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.479403:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e3f000/0x3139939425062ac4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eec5 expref: 17 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.479422:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.479424:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.479430:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1699839) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 20 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.479437:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1699839) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 20 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.479465:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1699839) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 20 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.479475:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311480704:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147211.479513:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fa55b40 going to sleep for 11 seconds 00010000:00010000:0.0:1746147211.479573:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e3f000/0x3139939425062ac4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eec5 expref: 17 pid: 1854 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746147211.479588:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311480576:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147211.479605:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1699839) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 20 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.479613:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011dacf400, rc 0) 00000100:00100000:0.0:1746147211.479630:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2862:x1830967310372608:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7799us (8077us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147211.479636:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19968 00000100:00100000:1.0:1746147211.483083:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311480704:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147211.483154:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.483210:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310372736:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3837us (4149us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.483222:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9052 00000100:00100000:3.0:1746147211.484028:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.484080:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310372992 00000100:00100000:2.0:1746147211.484207:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+6:2000:x1830967310372352:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 15406us (16453us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147211.484216:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7316 00002000:00100000:2.0:1746147211.484225:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880095124000 x1830967310372352/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.484241:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095124000 with x1830967310372352 ext(0->1048575) 00002000:00010000:2.0:1746147211.484246:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095124000 00000100:00100000:0.0:1746147211.484292:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310372992 00002000:00100000:0.0:1746147211.484321:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1662976->1667071) req@ffff880098c73480 x1830967310372992/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147211.484333:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c73480 with x1830967310372992 ext(1662976->1667071) 00002000:00010000:0.0:1746147211.484336:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098c73480 00000100:00100000:0.0:1746147211.484358:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7317 00000100:00100000:0.0:1746147211.484365:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310372992:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147211.484471:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310372992:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 106us (450us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147211.484476:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7317 00002000:00100000:0.0:1746147211.484481:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1662976->1667071) req@ffff880098c73480 x1830967310372992/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/4536 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147211.484487:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c73480 with x1830967310372992 ext(1662976->1667071) 00002000:00010000:0.0:1746147211.484489:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098c73480 00000100:00100000:0.0:1746147211.491543:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.491660:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310373120 00000100:00100000:2.0:1746147211.491670:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310373120 00000100:00100000:2.0:1746147211.491719:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19969 00000100:00100000:2.0:1746147211.491727:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2865:x1830967310373120:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147211.491748:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.491768:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f966000/0x3139939425062bab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef4a expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.491800:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1699839) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 19 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.491807:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147211.491809:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147211.491813:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f966000/0x3139939425062bab lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef4a expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.491851:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1699839) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 19 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.491864:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1699839) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 19 pid: 1136 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.491876:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311480832:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147211.492503:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.492586:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.492636:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310373248 00000100:00100000:0.0:1746147211.492647:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310373248 00000100:00100000:0.0:1746147211.492679:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19970 00000100:00100000:0.0:1746147211.492684:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2863:x1830967310373248:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147211.492692:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147211.492701:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef51 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.492719:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4e00/0x3139939425062b8f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef2e expref: 32 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.492724:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147211.492726:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147211.492728:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1417216->1843199] (req 1417216->1843199) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 32 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.492975:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4e00/0x3139939425062b8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef2e expref: 32 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.492986:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4e00/0x3139939425062b8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef2e expref: 32 pid: 10340 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746147211.492995:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f55c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311480960:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147211.493233:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.499794:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.499879:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.499911:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.499919:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310373632 00000100:00100000:3.0:1746147211.499951:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311480832:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147211.499962:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310373760 00000100:00100000:2.0:1746147211.499968:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310373760 00010000:00010000:3.0:1746147211.499981:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f966000/0x3139939425062bab lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef4a expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.499997:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f966000, rc 0) 00000100:00100000:2.0:1746147211.500014:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19971 00000100:00100000:1.0:1746147211.500285:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310373632 00010000:00010000:1.0:1746147211.500311:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4e00/0x3139939425062b8f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef2e expref: 33 pid: 10340 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746147211.500318:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f55c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311480960:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147211.500335:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9053 00010000:00010000:0.0:1746147211.500338:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1417216->1843199] (req 1417216->1843199) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.500339:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967310373632:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147211.500350:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fdc00, rc 0) 00010000:00010000:1.0:1746147211.500351:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.500369:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4e00/0x3139939425062b8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef2e expref: 33 pid: 10340 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.500378:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4e00/0x3139939425062b8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef2e expref: 33 pid: 10340 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746147211.500384:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2863:x1830967310373248:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7700us (7882us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147211.500389:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19970 00010000:00010000:1.0:1746147211.500400:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4e00/0x3139939425062b8f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef2e expref: 33 pid: 10340 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.500417:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.500419:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.500424:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.500432:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.500471:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.500484:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311481088:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147211.500491:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2864:x1830967310373760:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147211.500506:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.500518:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d90600/0x3139939425062bb9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef58 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.500534:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.500536:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fa55b40 going to sleep for 11 seconds 00010000:00010000:2.0:1746147211.500539:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147211.500540:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147211.500543:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d90600/0x3139939425062bb9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef58 expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.500559:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.500568:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 31 pid: 1854 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.500576:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311481216:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147211.500597:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147211.500614:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310373504 00000100:00100000:2.0:1746147211.500617:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310373504 00002000:00100000:2.0:1746147211.500651:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x97:0x0] (1695744->1699839) req@ffff880129f54380 x1830967310373504/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746147211.500691:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2865:x1830967310373120:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8962us (9156us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.500699:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19969 00002000:00100000:2.0:1746147211.500795:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f54380 with x1830967310373504 ext(1695744->1699839) 00010000:00010000:2.0:1746147211.500802:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 22 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.500811:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 22 pid: 1136 timeout: 849 lvb_type: 0 00002000:00010000:2.0:1746147211.500817:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f54380 00000100:00100000:2.0:1746147211.500899:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1718 00000100:00100000:2.0:1746147211.500905:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310373504:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147211.501017:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310373504:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 111us (1232us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147211.501023:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1718 00002000:00100000:2.0:1746147211.501028:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x97:0x0] (1695744->1699839) req@ffff880129f54380 x1830967310373504/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/4536 e 0 to 0 dl 1746147222 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.501035:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f54380 with x1830967310373504 ext(1695744->1699839) 00010000:00010000:2.0:1746147211.501040:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 22 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.501047:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 22 pid: 1136 timeout: 849 lvb_type: 0 00002000:00010000:2.0:1746147211.501053:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f54380 00000100:00100000:1.0:1746147211.501914:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311481088:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147211.501929:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.501948:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310373632:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1609us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.501955:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9053 00000100:00100000:0.0:1746147211.502969:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.503045:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311481216:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147211.503066:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d90600/0x3139939425062bb9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef58 expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.503079:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d90600, rc 0) 00000100:00100000:2.0:1746147211.503120:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2864:x1830967310373760:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3099us (3207us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.503127:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19971 00000100:00100000:1.0:1746147211.503178:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310374016 00000100:00100000:1.0:1746147211.503183:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310374016 00002000:00100000:1.0:1746147211.503210:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1417216->1421311) req@ffff880129f55c00 x1830967310374016/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147211.503218:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55c00 with x1830967310374016 ext(1417216->1421311) 00010000:00010000:1.0:1746147211.503223:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 30 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.503233:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 30 pid: 1854 timeout: 849 lvb_type: 0 00002000:00010000:1.0:1746147211.503239:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f55c00 00000100:00100000:1.0:1746147211.503263:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1719 00000100:00100000:1.0:1746147211.503269:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967310374016:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147211.503365:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967310374016:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 95us (399us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147211.503371:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1719 00002000:00100000:1.0:1746147211.503376:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1417216->1421311) req@ffff880129f55c00 x1830967310374016/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/4536 e 0 to 0 dl 1746147222 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147211.503382:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55c00 with x1830967310374016 ext(1417216->1421311) 00010000:00010000:1.0:1746147211.503387:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 30 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.503394:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 30 pid: 1854 timeout: 849 lvb_type: 0 00002000:00010000:1.0:1746147211.503399:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f55c00 00000100:00100000:0.0:1746147211.504131:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.504209:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310374272 00000100:00100000:3.0:1746147211.504214:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310374272 00002000:00100000:3.0:1746147211.504234:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x97:0x0] (1662976->1699839) req@ffff880129f57800 x1830967310374272/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.504242:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f57800 with x1830967310374272 ext(1662976->1699839) 00010000:00010000:3.0:1746147211.504248:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 21 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.504257:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 21 pid: 1136 timeout: 849 lvb_type: 0 00002000:00010000:3.0:1746147211.504263:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f57800 00000100:00100000:3.0:1746147211.504363:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1720 00000100:00100000:3.0:1746147211.504369:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310374272:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:1.0:1746147211.510447:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.510522:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310374528 00000100:00100000:0.0:1746147211.510533:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310374528 00002000:00100000:0.0:1746147211.510581:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1839104->1843199) req@ffff8800933f6d80 x1830967310374528/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147211.510591:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f6d80 with x1830967310374528 ext(1839104->1843199) 00010000:00010000:0.0:1746147211.510602:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 30 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746147211.510619:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 30 pid: 1854 timeout: 849 lvb_type: 0 00002000:00010000:0.0:1746147211.510626:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800933f6d80 00000100:00100000:0.0:1746147211.510662:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1721 00000100:00100000:0.0:1746147211.510670:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967310374528:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147211.510915:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967310374528:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 245us (479us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147211.510922:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1721 00002000:00100000:0.0:1746147211.510928:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1839104->1843199) req@ffff8800933f6d80 x1830967310374528/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/4536 e 0 to 0 dl 1746147222 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147211.510939:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f6d80 with x1830967310374528 ext(1839104->1843199) 00010000:00010000:0.0:1746147211.510945:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 30 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746147211.510953:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 30 pid: 1854 timeout: 849 lvb_type: 0 00002000:00010000:0.0:1746147211.510958:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800933f6d80 00000100:00100000:3.0:1746147211.511059:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310374272:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 6689us (6929us total) trans 17179875264 rc 0/0 00000100:00100000:3.0:1746147211.511067:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1720 00002000:00100000:3.0:1746147211.511071:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x97:0x0] (1662976->1699839) req@ffff880129f57800 x1830967310374272/t17179875264(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/448 e 0 to 0 dl 1746147222 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.511077:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f57800 with x1830967310374272 ext(1662976->1699839) 00010000:00010000:3.0:1746147211.511083:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 23 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.511105:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 23 pid: 1136 timeout: 849 lvb_type: 0 00002000:00010000:3.0:1746147211.511110:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f57800 00000100:00100000:0.0:1746147211.513197:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.513755:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.513806:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310374656 00000100:00100000:3.0:1746147211.513809:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310374912 00000100:00100000:3.0:1746147211.513814:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310374912 00000100:00100000:1.0:1746147211.513814:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310374656 00010000:00010000:1.0:1746147211.513848:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 23 pid: 1136 timeout: 849 lvb_type: 0 00002000:00100000:3.0:1746147211.513853:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x96:0x0] (1417216->1843199) req@ffff880129f55500 x1830967310374912/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.513860:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55500 with x1830967310374912 ext(1417216->1843199) 00010000:00010000:3.0:1746147211.513866:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 30 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.513875:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 30 pid: 1854 timeout: 849 lvb_type: 0 00002000:00010000:3.0:1746147211.513881:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f55500 00000100:00100000:1.0:1746147211.513889:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9054 00000100:00100000:1.0:1746147211.513896:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2001:x1830967310374656:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147211.513902:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1722 00000100:00100000:3.0:1746147211.513907:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310374912:12345-192.168.204.25@tcp:4:multiop.0 00010000:00010000:1.0:1746147211.513909:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147211.513923:0:7226:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147210 -> 1746147211 00010000:00010000:1.0:1746147211.513928:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 23 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.513943:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1699839) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 23 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.513968:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011dacf400/0x3139939425062ba4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1699839) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef43 expref: 23 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.513995:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.513997:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.514004:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f966000/0x3139939425062bab lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef4a expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.514011:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f966000/0x3139939425062bab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef4a expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.514043:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f966000/0x3139939425062bab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef4a expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.514055:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311481344:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147211.514649:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fa55b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147211.518746:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311481344:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147211.518772:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.518815:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310374656:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4918us (5623us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.518827:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9054 00000100:00100000:3.0:1746147211.522238:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310374912:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 8318us (8471us total) trans 17179875265 rc 0/0 00000100:00100000:3.0:1746147211.522252:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1722 00002000:00100000:3.0:1746147211.522264:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x96:0x0] (1417216->1843199) req@ffff880129f55500 x1830967310374912/t17179875265(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/448 e 0 to 0 dl 1746147222 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.522273:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55500 with x1830967310374912 ext(1417216->1843199) 00010000:00010000:3.0:1746147211.522284:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 32 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.522298:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 32 pid: 1854 timeout: 849 lvb_type: 0 00002000:00010000:3.0:1746147211.522310:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f55500 00000100:00100000:0.0:1746147211.523190:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.523256:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310375168 00000100:00100000:3.0:1746147211.523264:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310375168 00002000:00100000:3.0:1746147211.523443:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880129f56d80 x1830967310375168/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.523456:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f56d80 with x1830967310375168 ext(1048576->2097151) 00002000:00010000:3.0:1746147211.523460:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f56d80 00000100:00100000:3.0:1746147211.523488:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7318 00000100:00100000:3.0:1746147211.523495:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310375168:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147211.524776:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.525831:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310375296 00000100:00100000:1.0:1746147211.525841:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310375296 00010000:00010000:1.0:1746147211.525872:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 34 pid: 1854 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.525903:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9055 00000100:00100000:1.0:1746147211.525910:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967310375296:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.525922:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147211.525937:0:7226:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147210 -> 1746147211 00010000:00010000:1.0:1746147211.525943:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 34 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.525955:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 34 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.525979:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9fdc00/0x3139939425062bb2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1417216->1843199) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef51 expref: 34 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.526004:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.526006:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.526012:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d90600/0x3139939425062bb9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef58 expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.526019:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d90600/0x3139939425062bb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef58 expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.526047:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d90600/0x3139939425062bb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef58 expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.526067:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311481472:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147211.526169:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fa55b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.534923:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.535010:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310375552 00000100:00100000:2.0:1746147211.535021:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310375552 00002000:00100000:2.0:1746147211.535065:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880129f55f80 x1830967310375552/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.535074:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55f80 with x1830967310375552 ext(1048576->2097151) 00002000:00010000:2.0:1746147211.535080:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f55f80 00000100:00100000:2.0:1746147211.535127:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7319 00000100:00100000:2.0:1746147211.535134:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310375552:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147211.535248:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311481472:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147211.535269:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.535310:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967310375296:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 9400us (10538us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.535319:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9055 00000100:00100000:3.0:1746147211.535488:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967310375168:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 11987us (12293us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147211.535496:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7318 00002000:00100000:3.0:1746147211.535502:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880129f56d80 x1830967310375168/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.535509:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f56d80 with x1830967310375168 ext(1048576->2097151) 00002000:00010000:3.0:1746147211.535512:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f56d80 00000100:00100000:0.0:1746147211.540202:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.540338:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310375680 00000100:00100000:2.0:1746147211.540347:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310375680 00000100:00100000:2.0:1746147211.540857:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19972 00000100:00100000:2.0:1746147211.540867:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e218850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2865:x1830967310375680:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147211.540888:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.540909:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425062bc0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef5f expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.540939:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062acb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eecc expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.540951:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147211.540953:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147211.540956:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425062bc0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef5f expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.540988:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062acb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eecc expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.541000:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062acb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eecc expref: 13 pid: 1854 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.541012:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311481600:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147211.542074:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147211.542929:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310375552:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 7790us (8013us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147211.542939:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7319 00002000:00100000:2.0:1746147211.542948:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880129f55f80 x1830967310375552/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.542957:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55f80 with x1830967310375552 ext(1048576->2097151) 00002000:00010000:2.0:1746147211.542961:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f55f80 00000100:00100000:0.0:1746147211.543536:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.543796:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311481600:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147211.543820:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425062bc0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef5f expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.543840:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0ae800, rc 0) 00000100:00100000:2.0:1746147211.543866:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e218850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2865:x1830967310375680:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3002us (3675us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.543872:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19972 00000100:00100000:1.0:1746147211.544120:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310375808 00000100:00100000:1.0:1746147211.544127:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310375808 00010000:00010000:1.0:1746147211.544153:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062acb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eecc expref: 14 pid: 1854 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.544176:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9056 00000100:00100000:1.0:1746147211.544181:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310375808:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.544192:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.544212:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062acb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eecc expref: 14 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.544222:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062acb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eecc expref: 14 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.544244:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062acb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eecc expref: 14 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.544264:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.544266:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.544273:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425062bc0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef5f expref: 22 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.544281:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425062bc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef5f expref: 22 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.544309:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425062bc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef5f expref: 22 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.544321:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311481728:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147211.544384:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fa55b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147211.546417:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311481728:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147211.546438:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.546476:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310375808:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2293us (2940us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.546486:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9056 00000100:00100000:0.0:1746147211.546934:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.547011:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310375936 00000100:00100000:2.0:1746147211.547022:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310375936 00000100:00100000:2.0:1746147211.547070:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19973 00000100:00100000:2.0:1746147211.547077:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2864:x1830967310375936:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147211.547129:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.547148:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0afa00/0x3139939425062bc7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef66 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.547244:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.547246:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.547253:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0afa00/0x3139939425062bc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef66 expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.547267:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0afa00/0x3139939425062bc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef66 expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.547278:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0afa00, rc 0) 00000100:00100000:2.0:1746147211.547313:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2864:x1830967310375936:12345-192.168.204.25@tcp:101:cat.0 Request processed in 236us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.547319:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19973 00000100:00100000:0.0:1746147211.548254:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.548324:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310376192 00000100:00100000:2.0:1746147211.548329:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310376192 00002000:00100000:2.0:1746147211.548362:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880129f55180 x1830967310376192/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.548372:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55180 with x1830967310376192 ext(1048576->2097151) 00002000:00010000:2.0:1746147211.548377:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f55180 00000100:00100000:2.0:1746147211.548393:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7320 00000100:00100000:2.0:1746147211.548399:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967310376192:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147211.550136:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.550157:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310376448 00000100:00100000:0.0:1746147211.550162:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310376448 00002000:00100000:0.0:1746147211.550192:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880098822680 x1830967310376448/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147211.550201:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098822680 with x1830967310376448 ext(1048576->2097151) 00002000:00010000:0.0:1746147211.550205:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098822680 00000100:00100000:0.0:1746147211.550238:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7321 00000100:00100000:0.0:1746147211.550244:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2001:x1830967310376448:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147211.556668:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967310376192:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 8256us (8403us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147211.556682:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7320 00002000:00100000:2.0:1746147211.556694:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880129f55180 x1830967310376192/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.556703:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f55180 with x1830967310376192 ext(1048576->2097151) 00002000:00010000:2.0:1746147211.556709:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f55180 00000100:00100000:2.0:1746147211.558569:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2001:x1830967310376448:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 8314us (8429us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147211.558579:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7321 00002000:00100000:2.0:1746147211.558590:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880098822680 x1830967310376448/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.558599:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098822680 with x1830967310376448 ext(1048576->2097151) 00002000:00010000:2.0:1746147211.558605:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098822680 00000100:00100000:0.0:1746147211.561818:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.561858:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.562016:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.562797:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310376704 00000100:00100000:2.0:1746147211.562807:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310376704 00000100:00100000:2.0:1746147211.562865:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310376576 00000100:00100000:2.0:1746147211.562869:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310376576 00000100:00100000:2.0:1746147211.562888:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310376832 00000100:00100000:2.0:1746147211.562890:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310376832 00000100:00100000:2.0:1746147211.562906:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19974 00000100:00100000:2.0:1746147211.562914:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2003:x1830967310376704:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147211.562938:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.562961:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x3139939425062bce lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef74 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147211.563041:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311481856:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147211.563173:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147211.563199:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19975 00000100:00100000:2.0:1746147211.563204:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967310376576:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147211.563212:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.563222:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ff5c00/0x3139939425062bd5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef6d expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.563234:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.563236:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.563246:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff5c00/0x3139939425062bd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef6d expref: 33 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.563261:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ff5c00/0x3139939425062bd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef6d expref: 33 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.563271:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff5c00, rc 0) 00000100:00100000:2.0:1746147211.563295:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967310376576:12345-192.168.204.25@tcp:101:cat.0 Request processed in 92us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.563302:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19975 00000100:00100000:2.0:1746147211.563316:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19976 00000100:00100000:2.0:1746147211.563320:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967310376832:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147211.563325:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.563330:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x3139939425062bdc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef7b expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147211.563350:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311481984:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147211.563371:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caad80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.563867:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.563955:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310376960 00000100:00100000:3.0:1746147211.563960:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310376960 00000100:00100000:3.0:1746147211.563997:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19977 00000100:00100000:3.0:1746147211.564003:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+6:2864:x1830967310376960:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147211.564011:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.564020:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062be3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef82 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.564038:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.564039:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.564044:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062be3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef82 expref: 7 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.564055:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062be3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef82 expref: 7 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.564062:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3ee00, rc 0) 00000100:00100000:3.0:1746147211.564084:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2864:x1830967310376960:12345-192.168.204.25@tcp:101:cat.0 Request processed in 82us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.564108:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19977 00010000:00010000:2.0:1746147211.567283:0:13695:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff880096e3e000/0x3139939425062ad2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eed3 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147211.567313:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311481856:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147211.567332:0:13712:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425062ad9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeda expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.567347:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x3139939425062bce lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef74 expref: 24 pid: 13695 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147211.567351:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311481984:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147211.567360:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x3139939425062bce lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef74 expref: 24 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.567368:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x3139939425062bdc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef7b expref: 33 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.567375:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff5800, rc 0) 00010000:00010000:3.0:1746147211.567376:0:13712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ff4000/0x3139939425062bdc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef7b expref: 33 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.567402:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4000, rc 0) 00000100:00100000:2.0:1746147211.567414:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2003:x1830967310376704:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4499us (5607us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147211.567422:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967310376832:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4100us (5406us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147211.567422:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19974 00000100:00100000:3.0:1746147211.567430:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19976 00000100:00100000:0.0:1746147211.568572:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.568620:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310377216 00000100:00100000:2.0:1746147211.568628:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310377216 00002000:00100000:2.0:1746147211.568672:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880098820380 x1830967310377216/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.568681:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820380 with x1830967310377216 ext(1048576->2097151) 00002000:00010000:2.0:1746147211.568686:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098820380 00000100:00100000:2.0:1746147211.568716:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7322 00000100:00100000:2.0:1746147211.568724:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2000:x1830967310377216:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147211.573439:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.573589:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310377344 00000100:00100000:3.0:1746147211.573599:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310377344 00000100:00100000:3.0:1746147211.573661:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19978 00000100:00100000:3.0:1746147211.573670:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2865:x1830967310377344:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147211.573688:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.573707:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800974a6a00/0x3139939425062bea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef89 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.573736:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e3e000/0x3139939425062ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eed3 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.573743:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147211.573745:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147211.573748:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800974a6a00/0x3139939425062bea lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef89 expref: 24 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.573779:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e3e000/0x3139939425062ad2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eed3 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.573791:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e3e000/0x3139939425062ad2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eed3 expref: 12 pid: 1854 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147211.573803:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311482112:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147211.574325:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147211.577180:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2000:x1830967310377216:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 8448us (8603us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147211.577191:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7322 00002000:00100000:2.0:1746147211.577202:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880098820380 x1830967310377216/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.577209:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820380 with x1830967310377216 ext(1048576->2097151) 00002000:00010000:2.0:1746147211.577214:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098820380 00000100:00100000:3.0:1746147211.577387:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311482112:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147211.577415:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800974a6a00/0x3139939425062bea lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef89 expref: 24 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.577432:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974a6a00, rc 0) 00000100:00100000:3.0:1746147211.577451:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2865:x1830967310377344:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3784us (4022us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.577457:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19978 00000100:00100000:0.0:1746147211.579542:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.579621:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310377472 00000100:00100000:1.0:1746147211.579630:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310377472 00010000:00010000:1.0:1746147211.579673:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e3e000/0x3139939425062ad2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eed3 expref: 13 pid: 1854 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.579716:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9057 00000100:00100000:1.0:1746147211.579724:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310377472:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.579740:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.579761:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e3e000/0x3139939425062ad2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eed3 expref: 13 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.579773:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e3e000/0x3139939425062ad2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eed3 expref: 13 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.579798:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e3e000/0x3139939425062ad2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eed3 expref: 13 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.579831:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.579833:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.579841:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800974a6a00/0x3139939425062bea lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef89 expref: 23 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.579849:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800974a6a00/0x3139939425062bea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef89 expref: 23 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.579884:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800974a6a00/0x3139939425062bea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef89 expref: 23 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.579896:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311482240:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147211.579983:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fa55b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.584837:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.584911:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310377600 00000100:00100000:1.0:1746147211.584923:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310377600 00000100:00100000:1.0:1746147211.584994:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16463 00000100:00100000:1.0:1746147211.585003:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+6:2868:x1830967310377600:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147211.585031:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147211.585052:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10e00/0x3139939425062bf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef90 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.585851:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425062bf8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.585868:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425062bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.585883:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425062bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.585895:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11c00/0x3139939425062bff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.585900:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11c00/0x3139939425062bff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.585905:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11c00/0x3139939425062bff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.585985:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.585997:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425062b42 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eefd expref: 27 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.586003:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6400/0x3139939425062b57 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef0b expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.586009:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.586046:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6400/0x3139939425062b57 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef0b expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.586058:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6400/0x3139939425062b57 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef0b expref: 9 pid: 6215 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.586070:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311482368:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147211.586203:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425062b42 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eefd expref: 27 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.586212:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425062b42 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eefd expref: 27 pid: 7237 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.586220:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311482496:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147211.586239:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1c4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.589980:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.590281:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311482240:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147211.590307:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.590357:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310377472:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 10632us (10822us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.590370:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9057 00000100:00100000:0.0:1746147211.590620:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.590662:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.590736:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310378368 00000100:00100000:2.0:1746147211.590736:0:2705:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310378112 00000100:00100000:3.0:1746147211.590743:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310378368 00000100:00100000:2.0:1746147211.590743:0:2705:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310378112 00000100:00100000:1.0:1746147211.590808:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311482368:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147211.590817:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311482496:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147211.590834:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:3.0:1746147211.590891:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6152 00000100:00100000:3.0:1746147211.590898:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:30749:x1830967310378368:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147211.591239:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:30749:x1830967310378368:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 341us (574us total) trans 8589937360 rc 0/0 00000100:00100000:3.0:1746147211.591245:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6152 00000100:00100000:3.0:1746147211.591257:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6153 00000100:00100000:3.0:1746147211.591262:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079238450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:30748:x1830967310378112:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746147211.591322:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079238450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:30748:x1830967310378112:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 60us (701us total) trans 8589937361 rc 0/0 00000100:00100000:3.0:1746147211.591328:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6153 00000100:00100000:2.0:1746147211.591879:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310377856 00000100:00100000:2.0:1746147211.591884:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310377856 00002000:00100000:2.0:1746147211.591912:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880098820700 x1830967310377856/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.591922:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820700 with x1830967310377856 ext(2097152->3145727) 00002000:00010000:2.0:1746147211.591927:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098820700 00000100:00100000:2.0:1746147211.591946:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7323 00000100:00100000:2.0:1746147211.591952:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310377856:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147211.594743:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.595538:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.595625:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.595700:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310378496 00000100:00100000:2.0:1746147211.595710:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310378496 00000100:00100000:2.0:1746147211.595752:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310378624 00000100:00100000:2.0:1746147211.595754:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310378624 00000100:00100000:2.0:1746147211.596978:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19979 00000100:00100000:3.0:1746147211.596987:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19980 00000100:00100000:2.0:1746147211.596992:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2003:x1830967310378496:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:3.0:1746147211.596997:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2003:x1830967310378624:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147211.597011:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.597011:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.597030:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x3139939425062c14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef9e expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.597030:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x3139939425062c0d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7ef97 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.597053:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.597055:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.597063:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x3139939425062c0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef97 expref: 8 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.597078:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x3139939425062c0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef97 expref: 8 pid: 13695 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147211.597083:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311482624:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147211.597101:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff5800, rc 0) 00000100:00100000:1.0:1746147211.597926:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310378752 00000100:00100000:1.0:1746147211.597934:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310378752 00010000:00010000:1.0:1746147211.597964:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425062b42 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eefd expref: 29 pid: 7237 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.597997:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9058 00000100:00100000:1.0:1746147211.598002:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310378752:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.598012:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.598018:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425062b42 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eefd expref: 29 pid: 7237 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.598027:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425062b42 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eefd expref: 29 pid: 7237 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.598047:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425062b42 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eefd expref: 29 pid: 7237 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.598069:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147211.598074:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.598081:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.598086:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.598101:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147211.598238:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2003:x1830967310378496:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1249us (3504us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.598244:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19979 00000100:00100000:3.0:1746147211.598250:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f206c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.598766:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.598835:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310378880 00000100:00100000:2.0:1746147211.598839:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310378880 00010000:00010000:2.0:1746147211.598854:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6400/0x3139939425062b57 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef0b expref: 11 pid: 6215 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.598882:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9059 00000100:00100000:2.0:1746147211.598887:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310378880:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147211.598896:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147211.598896:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310378752:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 892us (3269us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147211.598900:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6400/0x3139939425062b57 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef0b expref: 11 pid: 6215 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.598903:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9058 00010000:00010000:2.0:1746147211.598909:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6400/0x3139939425062b57 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef0b expref: 11 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.598921:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6400/0x3139939425062b57 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef0b expref: 11 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.598938:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147211.598941:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.598948:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.598954:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.598967:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147211.598983:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310378880:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 96us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.598989:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9059 00010000:00010000:0.0:1746147211.599386:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.599395:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:0.0:1746147211.599449:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:0.0:1746147211.599454:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746147211.599608:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.599621:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.599630:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425062bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.599647:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425062bf8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.599653:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425062bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.599659:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c10400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147211.599662:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425062bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.599669:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425062bf8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.599679:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147211.599682:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147211.599686:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425062bf8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.599691:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10400/0x3139939425062bf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.599715:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11c00/0x3139939425062bff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.599720:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11c00/0x3139939425062bff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.599725:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11c00/0x3139939425062bff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.599729:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c11c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147211.599731:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11c00/0x3139939425062bff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.599735:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11c00/0x3139939425062bff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.599742:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f2c5900) 00010000:00010000:0.0:1746147211.599744:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147211.599746:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11c00/0x3139939425062bff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.599750:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11c00/0x3139939425062bff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147211.599783:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c10e00/0x3139939425062bf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef90 expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.599796:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef90 expref: 7 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.599802:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147211.599805:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746147211.599807:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c11800, rc 0) 00000100:00100000:0.0:1746147211.599846:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2868:x1830967310377600:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 14845us (15020us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147211.599853:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16463 00000100:00100000:2.0:1746147211.600798:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310377856:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8846us (10829us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147211.600808:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7323 00002000:00100000:2.0:1746147211.600816:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880098820700 x1830967310377856/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147211.601151:0:13712:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425062ad9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeda expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.601179:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311482624:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147211.601208:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x3139939425062c14 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef9e expref: 24 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.601219:0:13712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x3139939425062c14 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef9e expref: 24 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.601239:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3e000, rc 0) 00000100:00100000:3.0:1746147211.601264:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2003:x1830967310378624:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4270us (5727us total) trans 0 rc 301/301 00002000:00100000:2.0:1746147211.601268:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820700 with x1830967310377856 ext(2097152->3145727) 00000100:00100000:3.0:1746147211.601271:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19980 00002000:00010000:2.0:1746147211.601272:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098820700 00000100:00100000:3.0:1746147211.611276:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.611313:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.611334:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.611347:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.611362:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.611374:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310379264 00000100:00100000:0.0:1746147211.611374:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310379008 00000100:00100000:3.0:1746147211.611375:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.611383:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310379264 00000100:00100000:0.0:1746147211.611383:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310379008 00000100:00100000:3.0:1746147211.611399:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.611427:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310379136 00000100:00100000:2.0:1746147211.611427:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310379520 00000100:00100000:2.0:1746147211.611430:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310379520 00000100:00100000:0.0:1746147211.611430:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310379392 00000100:00100000:3.0:1746147211.611431:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310379136 00000100:00100000:0.0:1746147211.611432:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310379392 00000100:00100000:2.0:1746147211.611442:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310379904 00000100:00100000:2.0:1746147211.611444:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310379904 00000100:00100000:0.0:1746147211.611450:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19981 00000100:00100000:0.0:1746147211.611457:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310379008:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:1.0:1746147211.611458:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19982 00000100:00100000:3.0:1746147211.611464:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19983 00000100:00100000:1.0:1746147211.611467:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310379264:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:3.0:1746147211.611470:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310379520:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147211.611472:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147211.611473:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19984 00010000:00010000:1.0:1746147211.611476:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.611477:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147211.611479:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310379392:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147211.611487:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.611489:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b417d400/0x3139939425062c1b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7efc1 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.611489:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x3139939425062c29 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7efb3 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.611489:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425062c22 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7efa5 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.611494:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ff4400/0x3139939425062c30 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7efba expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.611509:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.611509:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.611509:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147211.611509:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.611510:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.611510:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147211.611510:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.611511:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147211.611518:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425062c22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efa5 expref: 17 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.611519:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b417d400/0x3139939425062c1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc1 expref: 17 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.611519:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff4400/0x3139939425062c30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efba expref: 17 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147211.611519:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x3139939425062c29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efb3 expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.611533:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b417d400/0x3139939425062c1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc1 expref: 17 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147211.611533:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425062c22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efa5 expref: 17 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.611534:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ff4400/0x3139939425062c30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efba expref: 17 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147211.611534:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x3139939425062c29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efb3 expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.611542:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b417d400, rc 0) 00010000:00010000:2.0:1746147211.611542:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4400, rc 0) 00010000:00010000:1.0:1746147211.611542:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e81000, rc 0) 00010000:00010000:0.0:1746147211.611544:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9a00, rc 0) 00000100:00100000:3.0:1746147211.611589:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310379520:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 119us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147211.611589:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310379008:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 133us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.611590:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310379264:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 125us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.611593:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310379392:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 114us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147211.611595:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19981 00000100:00100000:3.0:1746147211.611598:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19983 00000100:00100000:1.0:1746147211.611601:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19982 00000100:00100000:2.0:1746147211.611605:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19984 00000100:00100000:0.0:1746147211.611608:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19985 00000100:00100000:3.0:1746147211.611611:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19986 00000100:00100000:0.0:1746147211.611612:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310379136:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:3.0:1746147211.611616:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2865:x1830967310379904:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147211.611617:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.611622:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147211.611622:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x3139939425062c37 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7efac expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.611629:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x3139939425062c3e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7efc8 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.611631:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147211.611632:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147211.611634:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310379776 00000100:00100000:2.0:1746147211.611646:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310379776 00010000:00010000:0.0:1746147211.611646:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x3139939425062c37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efac expref: 18 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.611652:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425062ad9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeda expref: 18 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147211.611655:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x3139939425062c37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efac expref: 18 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147211.611661:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9e00, rc 0) 00010000:00010000:3.0:1746147211.611662:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147211.611664:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147211.611666:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x3139939425062c3e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc8 expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147211.611672:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880098c73100 x1830967310379776/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147211.611673:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310379136:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 61us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147211.611677:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19985 00002000:00100000:2.0:1746147211.611681:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c73100 with x1830967310379776 ext(2097152->3145727) 00002000:00010000:2.0:1746147211.611685:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098c73100 00010000:00010000:3.0:1746147211.611690:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425062ad9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeda expref: 17 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.611701:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425062ad9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeda expref: 17 pid: 1854 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.611704:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7324 00000100:00100000:2.0:1746147211.611709:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2002:x1830967310379776:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147211.611711:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311482752:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147211.611764:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f206c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.622973:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.623970:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310380160 00000100:00100000:2.0:1746147211.623980:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310380160 00000100:00100000:2.0:1746147211.624042:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16464 00000100:00100000:2.0:1746147211.624050:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2868:x1830967310380160:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147211.624072:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.624108:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4600/0x3139939425062c45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7efcf expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.624213:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x3139939425062c4c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.624227:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef90 expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.624235:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x3139939425062c4c lrc: 4/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.624269:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef90 expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.624279:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef90 expref: 8 pid: 6215 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.624297:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311482880:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147211.625150:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311482752:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147211.625176:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x3139939425062c3e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc8 expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.625190:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3e000, rc 0) 00000100:00100000:3.0:1746147211.625216:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2865:x1830967310379904:12345-192.168.204.25@tcp:101:cat.0 Request processed in 13599us (13815us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.625224:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19986 00000100:00100000:2.0:1746147211.625306:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147211.627518:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.628380:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310380288 00000100:00100000:0.0:1746147211.628392:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310380288 00010000:00010000:0.0:1746147211.628432:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425062ad9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeda expref: 18 pid: 1854 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.628939:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9060 00000100:00100000:2.0:1746147211.628950:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310380288:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147211.628967:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147211.628989:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425062ad9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeda expref: 18 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.629001:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425062ad9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeda expref: 18 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.629025:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425062ad9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eeda expref: 18 pid: 1854 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.629049:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.629051:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147211.629059:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x3139939425062c3e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc8 expref: 32 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.629067:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x3139939425062c3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc8 expref: 32 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.629124:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x3139939425062c3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc8 expref: 32 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147211.629140:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311483008:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147211.629615:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caad80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147211.629841:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.629864:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310380416 00000100:00100000:1.0:1746147211.629868:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310380416 00000100:00100000:2.0:1746147211.629886:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2002:x1830967310379776:12345-192.168.204.25@tcp:3:cat.0 Request processed in 18175us (18521us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147211.629896:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7324 00010000:00010000:1.0:1746147211.629896:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef90 expref: 9 pid: 6215 timeout: 849 lvb_type: 0 00002000:00100000:2.0:1746147211.629904:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880098c73100 x1830967310379776/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.629913:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c73100 with x1830967310379776 ext(2097152->3145727) 00002000:00010000:2.0:1746147211.629917:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098c73100 00000100:00100000:1.0:1746147211.629924:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9061 00000100:00100000:1.0:1746147211.629930:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310380416:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.629939:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.629944:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef90 expref: 9 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.629953:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef90 expref: 9 pid: 6215 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.629957:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311482880:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147211.629967:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c11800/0x3139939425062c06 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef90 expref: 9 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.629978:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x3139939425062c4c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.629982:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147211.629986:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x3139939425062c4c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.629999:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x3139939425062c4c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.630006:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x3139939425062c4c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.632035:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147211.632059:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x3139939425062c4c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.632070:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x3139939425062c4c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147211.632108:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147211.632244:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4600/0x3139939425062c45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efcf expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.632261:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x3139939425062c4c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efcf expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.632272:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147211.632275:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147211.632277:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff5000, rc 0) 00000100:00100000:2.0:1746147211.633673:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2868:x1830967310380160:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 9617us (10704us total) trans 8589937362 rc 0/0 00000100:00100000:2.0:1746147211.633683:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16464 00000100:00100000:1.0:1746147211.633683:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310380416:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3752us (3843us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.633693:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9061 00000100:00100000:0.0:1746147211.638667:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.638800:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310380672 00000100:00100000:2.0:1746147211.638809:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310380672 00000100:00100000:2.0:1746147211.638873:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16465 00000100:00100000:2.0:1746147211.638882:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2870:x1830967310380672:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147211.638911:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.638934:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49800/0x3139939425062c5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7efd6 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.639009:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425062c61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639021:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425062c61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639032:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425062c61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639043:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425062c68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639048:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425062c68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639056:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425062c68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639180:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49200/0x3139939425062c6f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639188:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49200/0x3139939425062c6f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639193:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49200/0x3139939425062c6f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147211.639200:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147211.639271:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425062c61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639278:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425062c61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639284:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425062c61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639289:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d48000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147211.639293:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425062c61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639298:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425062c61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639309:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147211.639311:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147211.639315:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425062c61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639322:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48000/0x3139939425062c61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639348:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425062c68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639353:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425062c68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639357:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425062c68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639361:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d49600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147211.639363:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425062c68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639368:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425062c68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639373:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009823af00) 00010000:00010000:2.0:1746147211.639374:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147211.639376:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425062c68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639380:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425062c68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.639416:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49800/0x3139939425062c5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efd6 expref: 13 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.639425:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49200/0x3139939425062c6f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efd6 expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.639434:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147211.639436:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147211.639438:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49200, rc 0) 00000100:00100000:2.0:1746147211.639488:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2870:x1830967310380672:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 607us (832us total) trans 8589937363 rc 0/0 00000100:00100000:2.0:1746147211.639493:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16465 00000100:00100000:0.0:1746147211.639834:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.640033:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310380800 00000100:00100000:2.0:1746147211.640038:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310380800 00000100:00100000:2.0:1746147211.640137:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16466 00000100:00100000:2.0:1746147211.640144:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2868:x1830967310380800:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147211.640157:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.640165:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49c00/0x3139939425062c7d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7efdd expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.640214:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48e00/0x3139939425062c84 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.640223:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x3139939425062c4c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efcf expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.640230:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48e00/0x3139939425062c84 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.640262:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x3139939425062c4c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efcf expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.640275:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x3139939425062c4c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efcf expref: 9 pid: 6215 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.640297:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311483136:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147211.640476:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147211.640770:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311483008:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147211.640786:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147211.640823:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310380288:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 11874us (13312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.640832:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9060 00000100:00100000:0.0:1746147211.647013:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.647057:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.647073:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310380928 00000100:00100000:3.0:1746147211.647082:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310380928 00000100:00100000:0.0:1746147211.647119:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.647155:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19987 00000100:00100000:3.0:1746147211.647164:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2864:x1830967310380928:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147211.647177:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310381312 00000100:00100000:2.0:1746147211.647180:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310381312 00010000:00010000:3.0:1746147211.647183:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.647201:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974a6400/0x3139939425062c8b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7efe4 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147211.647210:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88009f087100 x1830967310381312/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.647218:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087100 with x1830967310381312 ext(2097152->4194303) 00002000:00010000:2.0:1746147211.647223:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f087100 00010000:00010000:3.0:1746147211.647226:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.647228:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147211.647234:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310381440 00010000:00010000:3.0:1746147211.647235:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974a6400/0x3139939425062c8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efe4 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147211.647236:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310381440 00002000:00100000:2.0:1746147211.647246:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88009f087480 x1830967310381440/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746147211.647251:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974a6400/0x3139939425062c8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efe4 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147211.647252:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087480 with x1830967310381440 ext(3145728->4194303) 00002000:00010000:2.0:1746147211.647255:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f087480 00010000:00010000:3.0:1746147211.647261:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974a6400, rc 0) 00000100:00100000:2.0:1746147211.647271:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7325 00000100:00100000:2.0:1746147211.647276:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967310381312:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147211.647802:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7326 00000100:00100000:1.0:1746147211.647810:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310381440:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147211.648003:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2864:x1830967310380928:12345-192.168.204.25@tcp:101:cat.0 Request processed in 839us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.648009:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19987 00000100:00100000:2.0:1746147211.661545:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311483136:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147211.661583:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48e00/0x3139939425062c84 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:1.0:1746147211.661952:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.665516:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310381568 00000100:00100000:2.0:1746147211.665531:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310381568 00010000:00010000:2.0:1746147211.665574:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x3139939425062c4c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efcf expref: 10 pid: 6215 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147211.665603:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9062 00000100:00100000:2.0:1746147211.665610:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310381568:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147211.665624:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147211.665629:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x3139939425062c4c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efcf expref: 10 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.665651:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x3139939425062c4c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efcf expref: 10 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.665673:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff5000/0x3139939425062c4c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efcf expref: 10 pid: 6215 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.665697:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147211.665702:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48e00/0x3139939425062c84 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.665711:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48e00/0x3139939425062c84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.665718:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48e00/0x3139939425062c84 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.665745:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147211.665780:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48e00/0x3139939425062c84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.665788:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48e00/0x3139939425062c84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:2.0:1746147211.665794:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310381568:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 185us (3845us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147211.665800:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9062 00000004:00200000:3.0:1746147211.665839:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147211.665844:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147211.665868:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48e00/0x3139939425062c84 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.665900:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49c00/0x3139939425062c7d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efdd expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.665925:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48e00/0x3139939425062c84 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efdd expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.665931:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147211.665933:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147211.665935:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d48e00, rc 0) 00000100:00100000:3.0:1746147211.665961:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2868:x1830967310380800:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 25818us (26128us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.665967:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16466 00000100:00100000:0.0:1746147211.671454:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.671498:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.674570:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310381824 00000100:00100000:3.0:1746147211.674585:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310381824 00000100:00100000:3.0:1746147211.674601:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310382080 00000100:00100000:3.0:1746147211.674604:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310382080 00002000:00100000:3.0:1746147211.674661:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88009f085880 x1830967310382080/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.674672:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f085880 with x1830967310382080 ext(3145728->4194303) 00002000:00010000:3.0:1746147211.674678:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f085880 00000100:00100000:3.0:1746147211.675972:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7327 00000100:00100000:3.0:1746147211.675984:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2002:x1830967310382080:12345-192.168.204.25@tcp:3:cat.0 00002000:00100000:2.0:1746147211.676079:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88009f084700 x1830967310381824/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.676103:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f084700 with x1830967310381824 ext(2097152->4194303) 00002000:00010000:2.0:1746147211.676107:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f084700 00000100:00100000:2.0:1746147211.676130:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7328 00000100:00100000:2.0:1746147211.676136:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2002:x1830967310381824:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147211.686486:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2000:x1830967310381312:12345-192.168.204.25@tcp:3:cat.0 Request processed in 39198us (39417us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147211.686504:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7325 00002000:00100000:3.0:1746147211.686516:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88009f087100 x1830967310381312/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.686532:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087100 with x1830967310381312 ext(2097152->4194303) 00002000:00010000:3.0:1746147211.686538:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f087100 00000100:00100000:1.0:1746147211.686682:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310381440:12345-192.168.204.25@tcp:3:cat.0 Request processed in 38872us (39561us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147211.686694:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7326 00002000:00100000:1.0:1746147211.686700:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88009f087480 x1830967310381440/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147211.686708:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f087480 with x1830967310381440 ext(3145728->4194303) 00002000:00010000:1.0:1746147211.686712:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f087480 00000100:00100000:2.0:1746147211.690625:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.690697:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310382208 00000100:00100000:1.0:1746147211.690707:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310382208 00000100:00100000:1.0:1746147211.690764:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19988 00000100:00100000:1.0:1746147211.690772:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310382208:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147211.690789:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147211.690808:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097c7fa00/0x3139939425062c92 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7efeb expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.690829:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.690831:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.690840:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c7fa00/0x3139939425062c92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efeb expref: 18 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147211.690856:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097c7fa00/0x3139939425062c92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efeb expref: 18 pid: 1136 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147211.690864:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2002:x1830967310382080:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14882us (19363us total) trans 0 rc 1048576/1048576 00010000:00010000:1.0:1746147211.690868:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c7fa00, rc 0) 00000100:00100000:2.0:1746147211.690873:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7327 00002000:00100000:2.0:1746147211.690882:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88009f085880 x1830967310382080/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147211.690889:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310382208:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 118us (276us total) trans 0 rc 0/0 00002000:00100000:2.0:1746147211.690890:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f085880 with x1830967310382080 ext(3145728->4194303) 00002000:00010000:2.0:1746147211.690894:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f085880 00000100:00100000:1.0:1746147211.690894:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19988 00000100:00100000:0.0:1746147211.701551:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.701620:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310382464 00000100:00100000:2.0:1746147211.701629:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310382464 00000100:00100000:2.0:1746147211.701680:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16467 00000100:00100000:2.0:1746147211.701687:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2868:x1830967310382464:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147211.701706:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.701726:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062c99 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eff2 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.701820:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062ca0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.701834:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.701845:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.701855:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.701861:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062ca0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.701866:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062ca0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.701871:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d6a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147211.701874:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062ca0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.701880:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062ca0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.701888:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147211.701890:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147211.701893:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062ca0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.701897:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062ca0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.701926:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062c99 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff2 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.701937:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062c99 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff2 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.701942:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7600, rc 0) 00000100:00100000:2.0:1746147211.702004:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2868:x1830967310382464:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 318us (464us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147211.702009:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16467 00000100:00100000:0.0:1746147211.705663:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.705718:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310382720 00000100:00100000:2.0:1746147211.705727:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310382720 00002000:00100000:2.0:1746147211.705771:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88009f085c00 x1830967310382720/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.705780:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f085c00 with x1830967310382720 ext(4194304->4890623) 00002000:00010000:2.0:1746147211.705787:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f085c00 00000100:00100000:1.0:1746147211.705865:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7329 00000100:00100000:1.0:1746147211.706370:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2002:x1830967310382720:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147211.707158:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2002:x1830967310381824:12345-192.168.204.25@tcp:3:cat.0 Request processed in 31019us (35712us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147211.707167:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7328 00002000:00100000:3.0:1746147211.707175:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88009f084700 x1830967310381824/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.707182:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f084700 with x1830967310381824 ext(2097152->4194303) 00002000:00010000:3.0:1746147211.707187:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f084700 00000100:00100000:3.0:1746147211.707256:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.707277:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310382976 00000100:00100000:3.0:1746147211.707281:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310382976 00000100:00100000:3.0:1746147211.707327:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6154 00000100:00100000:3.0:1746147211.707333:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2868:x1830967310382976:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:3.0:1746147211.707494:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2868:x1830967310382976:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 160us (237us total) trans 8589937364 rc 0/0 00000100:00100000:3.0:1746147211.707500:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6154 00000100:00100000:1.0:1746147211.713829:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2002:x1830967310382720:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7944us (8164us total) trans 0 rc 696320/696320 00000100:00100000:1.0:1746147211.713841:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7329 00002000:00100000:1.0:1746147211.713852:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88009f085c00 x1830967310382720/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147211.713861:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f085c00 with x1830967310382720 ext(4194304->4890623) 00002000:00010000:1.0:1746147211.713867:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f085c00 00000100:00100000:0.0:1746147211.716397:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.716948:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310383104 00000100:00100000:1.0:1746147211.716959:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310383104 00000100:00100000:1.0:1746147211.717024:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19989 00000100:00100000:1.0:1746147211.717032:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2870:x1830967310383104:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147211.717051:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147211.717073:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7eff9 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.717146:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x3139939425062c3e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc8 expref: 32 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.717155:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097c7fa00/0x3139939425062c92 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efeb expref: 17 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147211.717163:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800974a6400/0x3139939425062c8b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efe4 expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.717170:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.717174:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.717177:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2686976->3043327] (req 2686976->3043327) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 25 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.717209:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800974a6400/0x3139939425062c8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efe4 expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.717222:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800974a6400/0x3139939425062c8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efe4 expref: 25 pid: 1853 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.717234:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311483264:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147211.717342:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097c7fa00/0x3139939425062c92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efeb expref: 17 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147211.717350:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097c7fa00/0x3139939425062c92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efeb expref: 17 pid: 1136 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746147211.717358:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311483392:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147211.717391:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x3139939425062c3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc8 expref: 32 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.717399:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x3139939425062c3e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc8 expref: 32 pid: 1853 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.717407:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311483520:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147211.717425:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1c4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147211.723025:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311483264:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147211.726027:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.726052:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.726070:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.726116:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.726149:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.726214:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310383488 00000100:00100000:1.0:1746147211.726223:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310383488 00010000:00010000:1.0:1746147211.726263:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097c7fa00/0x3139939425062c92 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efeb expref: 18 pid: 1136 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746147211.726298:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310383616 00000100:00100000:1.0:1746147211.726301:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310383616 00010000:00010000:1.0:1746147211.726313:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800974a6400/0x3139939425062c8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efe4 expref: 26 pid: 1853 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.726326:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310383872 00000100:00100000:1.0:1746147211.726328:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310383872 00010000:00010000:1.0:1746147211.726337:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x3139939425062c3e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc8 expref: 33 pid: 1853 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.726351:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9063 00000100:00100000:1.0:1746147211.726358:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310383488:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.726370:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.726391:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097c7fa00/0x3139939425062c92 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efeb expref: 18 pid: 1136 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.726401:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097c7fa00/0x3139939425062c92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efeb expref: 18 pid: 1136 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.726427:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.726470:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310383488:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 112us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.726480:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9063 00000100:00100000:1.0:1746147211.726494:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9064 00000100:00100000:1.0:1746147211.726498:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2001:x1830967310383616:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.726504:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.726510:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800974a6400/0x3139939425062c8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efe4 expref: 26 pid: 1853 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.726517:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800974a6400/0x3139939425062c8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efe4 expref: 26 pid: 1853 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.726527:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974a6400/0x3139939425062c8b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efe4 expref: 26 pid: 1853 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.726542:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.726557:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2001:x1830967310383616:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 59us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.726562:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9064 00000100:00100000:1.0:1746147211.726605:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9065 00000100:00100000:1.0:1746147211.726609:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967310383872:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.726614:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.726620:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x3139939425062c3e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc8 expref: 33 pid: 1853 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.726628:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x3139939425062c3e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc8 expref: 33 pid: 1853 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.726652:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.726654:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.726660:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 24 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.726667:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 24 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.726692:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 24 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.726702:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311483648:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147211.726745:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a564de40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147211.726781:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097c7fa00/0x3139939425062c92 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efeb expref: 17 pid: 1136 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746147211.726790:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311483392:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147211.726797:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x3139939425062c3e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc8 expref: 33 pid: 1853 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.726804:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311483520:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147211.726826:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 24 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.726834:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c7e600, rc 0) 00000100:00100000:1.0:1746147211.726850:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2870:x1830967310383104:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 9821us (10464us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.726856:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19989 00000100:00100000:1.0:1746147211.726868:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310383744 00000100:00100000:1.0:1746147211.726870:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310383744 00000100:00100000:1.0:1746147211.726890:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19990 00000100:00100000:1.0:1746147211.726894:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+24:2864:x1830967310383744:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147211.726905:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147211.726914:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x3139939425062cae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f000 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.726928:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 25 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.726933:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147211.726935:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147211.726937:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x3139939425062cae lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f000 expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.726949:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 25 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.726957:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 25 pid: 1136 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.726964:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311483776:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147211.726980:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1c4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147211.727315:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310383360 00000100:00100000:2.0:1746147211.727319:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310383360 00000100:00100000:2.0:1746147211.727357:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6155 00000100:00100000:2.0:1746147211.727363:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2865:x1830967310383360:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147211.727521:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2865:x1830967310383360:12345-192.168.204.25@tcp:35:cat.0 Request processed in 157us (1506us total) trans 8589937365 rc 0/0 00000100:00100000:2.0:1746147211.727526:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6155 00000100:00100000:0.0:1746147211.730051:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.730420:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311483648:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147211.730441:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.730481:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310383872:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3870us (4331us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.730490:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9065 00000100:00100000:2.0:1746147211.730940:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310384128 00000100:00100000:2.0:1746147211.730946:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310384128 00002000:00100000:2.0:1746147211.730980:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x98:0x0] (2686976->2691071) req@ffff880091d97480 x1830967310384128/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.730989:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97480 with x1830967310384128 ext(2686976->2691071) 00010000:00010000:2.0:1746147211.730998:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 26 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.731011:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 26 pid: 1136 timeout: 849 lvb_type: 0 00002000:00010000:2.0:1746147211.731017:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091d97480 00000100:00100000:1.0:1746147211.731153:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311483776:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147211.731168:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x3139939425062cae lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f000 expref: 26 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.731182:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822a600, rc 0) 00000100:00100000:1.0:1746147211.731204:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2864:x1830967310383744:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4310us (5088us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.731211:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19990 00000100:00100000:2.0:1746147211.731399:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1723 00000100:00100000:2.0:1746147211.731407:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2000:x1830967310384128:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147211.731522:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2000:x1830967310384128:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 115us (1478us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147211.731527:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1723 00002000:00100000:2.0:1746147211.731532:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x98:0x0] (2686976->2691071) req@ffff880091d97480 x1830967310384128/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/4536 e 0 to 0 dl 1746147222 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.731539:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97480 with x1830967310384128 ext(2686976->2691071) 00010000:00010000:2.0:1746147211.731543:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 25 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.731551:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 25 pid: 1136 timeout: 849 lvb_type: 0 00002000:00010000:2.0:1746147211.731556:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091d97480 00000100:00100000:0.0:1746147211.739983:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.740078:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310384384 00000100:00100000:3.0:1746147211.740119:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310384384 00002000:00100000:3.0:1746147211.740167:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (3039232->3043327) req@ffff880091d94700 x1830967310384384/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.740176:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94700 with x1830967310384384 ext(3039232->3043327) 00010000:00010000:3.0:1746147211.740185:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 25 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.740205:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 25 pid: 1136 timeout: 849 lvb_type: 0 00002000:00010000:3.0:1746147211.740212:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091d94700 00000100:00100000:3.0:1746147211.741115:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1724 00000100:00100000:3.0:1746147211.741127:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2000:x1830967310384384:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147211.741623:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2000:x1830967310384384:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 497us (1648us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147211.741630:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1724 00002000:00100000:3.0:1746147211.741646:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (3039232->3043327) req@ffff880091d94700 x1830967310384384/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/4536 e 0 to 0 dl 1746147222 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.741654:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94700 with x1830967310384384 ext(3039232->3043327) 00010000:00010000:3.0:1746147211.741662:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 25 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.741674:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 25 pid: 1136 timeout: 849 lvb_type: 0 00002000:00010000:3.0:1746147211.741680:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091d94700 00000100:00100000:1.0:1746147211.742746:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.743082:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310384640 00000100:00100000:2.0:1746147211.743113:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310384640 00000100:00100000:2.0:1746147211.743156:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16468 00000100:00100000:2.0:1746147211.743163:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2873:x1830967310384640:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147211.743180:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.743201:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425062cb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f007 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.743270:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425062cbc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743283:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425062cbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743293:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425062cbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743304:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062cc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743310:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743315:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743406:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062cca lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743414:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062cca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743419:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062cca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:2.0:1746147211.743427:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147211.743496:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425062cbc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743505:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425062cbc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743511:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425062cbc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743516:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425062cbc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743521:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147211.743525:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425062cbc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743530:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425062cbc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743540:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147211.743543:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147211.743546:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425062cbc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743551:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x3139939425062cbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743566:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743571:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062cc3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743576:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743579:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147211.743582:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743587:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062cc3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743592:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009823af00) 00010000:00010000:2.0:1746147211.743594:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147211.743596:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062cc3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743600:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062cc3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147211.743631:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425062cb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f007 expref: 32 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.743655:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062cca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f007 expref: 31 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.743662:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147211.743664:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147211.743666:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d6a00, rc 0) 00000100:00100000:2.0:1746147211.743698:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2873:x1830967310384640:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 536us (955us total) trans 8589937366 rc 0/0 00000100:00100000:2.0:1746147211.743704:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16468 00000100:00100000:0.0:1746147211.748842:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.748919:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310384896 00000100:00100000:3.0:1746147211.748929:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310384896 00002000:00100000:3.0:1746147211.748975:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (2686976->3043327) req@ffff880091d96300 x1830967310384896/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.748985:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d96300 with x1830967310384896 ext(2686976->3043327) 00010000:00010000:3.0:1746147211.748996:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 25 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.749011:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 25 pid: 1136 timeout: 849 lvb_type: 0 00002000:00010000:3.0:1746147211.749018:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091d96300 00000100:00100000:3.0:1746147211.750118:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1725 00000100:00100000:3.0:1746147211.750128:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2000:x1830967310384896:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:1.0:1746147211.751121:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.751197:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310385152 00000100:00100000:0.0:1746147211.751203:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310385152 00000100:00100000:3.0:1746147211.751901:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6156 00000100:00100000:3.0:1746147211.751909:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2870:x1830967310385152:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147211.753067:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2870:x1830967310385152:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 1149us (1940us total) trans 8589937367 rc 0/0 00000100:00100000:3.0:1746147211.753077:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6156 00000100:00100000:3.0:1746147211.766811:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2000:x1830967310384896:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 16431us (17729us total) trans 17179875266 rc 0/0 00000100:00100000:3.0:1746147211.766828:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1725 00002000:00100000:3.0:1746147211.766845:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (2686976->3043327) req@ffff880091d96300 x1830967310384896/t17179875266(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/448 e 0 to 0 dl 1746147222 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.766854:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d96300 with x1830967310384896 ext(2686976->3043327) 00010000:00010000:3.0:1746147211.766867:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 27 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147211.766885:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 27 pid: 1136 timeout: 849 lvb_type: 0 00002000:00010000:3.0:1746147211.766894:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091d96300 00000100:00100000:0.0:1746147211.772332:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.772440:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310385280 00000100:00100000:1.0:1746147211.772450:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310385280 00010000:00010000:1.0:1746147211.772489:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 27 pid: 1136 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.772533:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9066 00000100:00100000:1.0:1746147211.772541:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2000:x1830967310385280:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.772554:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746147211.772572:0:7227:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147210 -> 1746147211 00010000:00010000:1.0:1746147211.772578:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 27 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.772597:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 27 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.772620:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097c7e600/0x3139939425062ca7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2686976->3043327) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eff9 expref: 27 pid: 1136 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.772661:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.772663:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.772671:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x3139939425062cae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f000 expref: 26 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.772679:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x3139939425062cae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f000 expref: 26 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.772711:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x3139939425062cae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f000 expref: 26 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.772724:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311483904:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147211.772818:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1c4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147211.779578:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311483904:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147211.779603:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.779670:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2000:x1830967310385280:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7128us (7347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.779682:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9066 00000100:00100000:0.0:1746147211.784028:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.784129:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310385536 00000100:00100000:3.0:1746147211.784140:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310385536 00002000:00100000:3.0:1746147211.784190:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff880091d94a80 x1830967310385536/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.784200:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94a80 with x1830967310385536 ext(3145728->4194303) 00002000:00010000:3.0:1746147211.784206:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d94a80 00000100:00100000:3.0:1746147211.784239:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7330 00000100:00100000:3.0:1746147211.784247:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2001:x1830967310385536:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147211.801691:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2001:x1830967310385536:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 17433us (17666us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147211.801704:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7330 00002000:00100000:3.0:1746147211.801716:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff880091d94a80 x1830967310385536/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.801726:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d94a80 with x1830967310385536 ext(3145728->4194303) 00002000:00010000:3.0:1746147211.801731:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d94a80 00000100:00100000:0.0:1746147211.805851:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.805923:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310385792 00000100:00100000:3.0:1746147211.805933:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310385792 00002000:00100000:3.0:1746147211.805983:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880091d97100 x1830967310385792/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.805993:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97100 with x1830967310385792 ext(4194304->4890623) 00002000:00010000:3.0:1746147211.805998:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d97100 00000100:00100000:3.0:1746147211.806038:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7331 00000100:00100000:3.0:1746147211.806048:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310385792:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:1.0:1746147211.813508:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147211.814574:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310385792:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8517us (8727us total) trans 0 rc 696320/696320 00000100:00100000:3.0:1746147211.814586:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7331 00002000:00100000:3.0:1746147211.814600:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880091d97100 x1830967310385792/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.814609:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d97100 with x1830967310385792 ext(4194304->4890623) 00002000:00010000:3.0:1746147211.814616:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d97100 00000100:00100000:0.0:1746147211.828728:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.828923:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310386048 00000100:00100000:3.0:1746147211.828934:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310386048 00000100:00100000:3.0:1746147211.828993:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6157 00000100:00100000:3.0:1746147211.829001:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2864:x1830967310386048:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147211.829252:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2864:x1830967310386048:12345-192.168.204.25@tcp:35:cat.0 Request processed in 251us (534us total) trans 8589937368 rc 0/0 00000100:00100000:3.0:1746147211.829259:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6157 00000100:00100000:2.0:1746147211.829819:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.831609:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310386176 00000100:00100000:1.0:1746147211.831621:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310386176 00000100:00100000:3.0:1746147211.833223:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19991 00000100:00100000:3.0:1746147211.833239:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2873:x1830967310386176:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147211.833259:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.833279:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f00e expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.833310:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x3139939425062cae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f000 expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.833318:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.833322:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.833326:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3088384->3145727] (req 3088384->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.833358:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x3139939425062cae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f000 expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.833371:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x3139939425062cae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f000 expref: 25 pid: 13712 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147211.833383:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311484032:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147211.833497:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147211.841572:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.841677:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310386304 00000100:00100000:1.0:1746147211.841686:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310386304 00010000:00010000:1.0:1746147211.841725:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x3139939425062cae lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f000 expref: 26 pid: 13712 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.841773:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9067 00000100:00100000:1.0:1746147211.841781:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2000:x1830967310386304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.841796:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.841817:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x3139939425062cae lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f000 expref: 26 pid: 13712 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.841830:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x3139939425062cae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f000 expref: 26 pid: 13712 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.841855:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.841857:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.841865:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.841873:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.841907:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.841920:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311484160:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147211.842003:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1c4e40 going to sleep for 11 seconds 00010000:00010000:3.0:1746147211.842684:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822a600/0x3139939425062cae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f000 expref: 26 pid: 13712 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147211.842702:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311484032:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147211.842726:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.842734:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093730600, rc 0) 00000100:00100000:3.0:1746147211.842772:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2873:x1830967310386176:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 9538us (12953us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.842780:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19991 00000100:00100000:0.0:1746147211.852843:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.852954:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311484160:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147211.852976:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.853029:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2000:x1830967310386304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 11248us (11467us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.853040:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9067 00000100:00100000:3.0:1746147211.853233:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310386560 00000100:00100000:3.0:1746147211.853240:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310386560 00002000:00100000:3.0:1746147211.853278:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (3088384->3092479) req@ffff880091d95180 x1830967310386560/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.853294:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d95180 with x1830967310386560 ext(3088384->3092479) 00002000:00010000:3.0:1746147211.853299:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d95180 00000100:00100000:3.0:1746147211.853312:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7332 00000100:00100000:3.0:1746147211.853317:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967310386560:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147211.853430:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967310386560:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 113us (598us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147211.853436:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7332 00002000:00100000:3.0:1746147211.853441:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (3088384->3092479) req@ffff880091d95180 x1830967310386560/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/4536 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.853447:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d95180 with x1830967310386560 ext(3088384->3092479) 00002000:00010000:3.0:1746147211.853450:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d95180 00000100:00100000:0.0:1746147211.861742:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.862788:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.863251:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310386944 00000100:00100000:3.0:1746147211.863261:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310386944 00000100:00100000:1.0:1746147211.863492:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310386816 00000100:00100000:1.0:1746147211.863497:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310386816 00000100:00100000:1.0:1746147211.863541:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16469 00000100:00100000:1.0:1746147211.863549:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2879:x1830967310386816:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147211.863573:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147211.863591:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425062cdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f015 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.864122:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19992 00000100:00100000:3.0:1746147211.864129:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2873:x1830967310386944:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147211.864137:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.864148:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425062ce6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f01c expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.864169:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800974a6a00/0x3139939425062bea lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef89 expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.864178:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b417d400/0x3139939425062c1b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc1 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.864190:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x3139939425062c0d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef97 expref: 7 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.864196:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.864198:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.864201:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425062ce6 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->3665919] (req 3145728->3665919) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f01c expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.864228:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x3139939425062c0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef97 expref: 7 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.864241:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x3139939425062c0d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef97 expref: 7 pid: 13695 timeout: 849 lvb_type: 1 00000100:00100000:3.0:1746147211.864253:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311484288:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147211.864360:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b417d400/0x3139939425062c1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc1 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.864368:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b417d400/0x3139939425062c1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc1 expref: 14 pid: 1853 timeout: 849 lvb_type: 1 00000100:00100000:3.0:1746147211.864377:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311484416:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147211.864401:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800974a6a00/0x3139939425062bea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef89 expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.864413:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800974a6a00/0x3139939425062bea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef89 expref: 25 pid: 13712 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147211.864420:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311484544:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147211.864436:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20000 going to sleep for 11 seconds 00010000:00010000:1.0:1746147211.864801:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x3139939425062ced lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.864815:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x3139939425062ced lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147211.864827:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x3139939425062ced lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:1.0:1746147211.864836:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147211.864945:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7f000/0x3139939425062cdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f015 expref: 34 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.864967:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x3139939425062ced lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f015 expref: 33 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.864979:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147211.864982:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746147211.864985:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c7fc00, rc 0) 00000100:00100000:1.0:1746147211.865015:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2879:x1830967310386816:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1467us (2228us total) trans 8589937369 rc 0/0 00000100:00100000:1.0:1746147211.865022:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16469 00000100:00100000:0.0:1746147211.869232:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.869388:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310387072 00000100:00100000:1.0:1746147211.869396:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310387072 00010000:00010000:1.0:1746147211.869435:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b417d400/0x3139939425062c1b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc1 expref: 15 pid: 1853 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746147211.869478:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9068 00000100:00100000:1.0:1746147211.869486:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2002:x1830967310387072:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.869501:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.869520:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b417d400/0x3139939425062c1b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc1 expref: 15 pid: 1853 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.869532:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b417d400/0x3139939425062c1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc1 expref: 15 pid: 1853 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.869558:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.869596:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2002:x1830967310387072:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 111us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.869603:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9068 00000100:00100000:3.0:1746147211.869753:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311484288:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147211.869766:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b417d400/0x3139939425062c1b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efc1 expref: 14 pid: 1853 timeout: 849 lvb_type: 1 00000100:00100000:3.0:1746147211.869784:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311484416:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147211.869793:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311484544:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147211.869819:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425062ce6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->3665919] (req 3145728->3665919) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f01c expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.869829:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093731400, rc 0) 00000100:00100000:0.0:1746147211.869841:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.869851:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2873:x1830967310386944:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5722us (8120us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.869857:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19992 00000100:00100000:3.0:1746147211.869873:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310387200 00000100:00100000:3.0:1746147211.869875:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310387200 00000100:00100000:3.0:1746147211.869891:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19993 00000100:00100000:3.0:1746147211.869896:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310387200:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147211.869910:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.869921:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093730800/0x3139939425062cfb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f023 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.869935:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147211.869943:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093730800/0x3139939425062cfb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f023 expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.869951:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093730800/0x3139939425062cfb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f023 expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.869959:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093730800, rc 0) 00000100:00100000:3.0:1746147211.869977:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310387200:12345-192.168.204.25@tcp:101:cat.0 Request processed in 81us (137us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147211.869982:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19993 00000100:00100000:0.0:1746147211.872646:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.872847:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.872931:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310387456 00000100:00100000:1.0:1746147211.872940:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310387456 00010000:00010000:1.0:1746147211.872976:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x3139939425062c0d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef97 expref: 8 pid: 13695 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746147211.873000:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310387328 00000100:00100000:1.0:1746147211.873002:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310387328 00010000:00010000:1.0:1746147211.873014:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800974a6a00/0x3139939425062bea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef89 expref: 25 pid: 13712 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.873030:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9069 00000100:00100000:1.0:1746147211.873037:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2001:x1830967310387456:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.873053:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.873072:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x3139939425062c0d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef97 expref: 8 pid: 13695 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.873082:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x3139939425062c0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef97 expref: 8 pid: 13695 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.873133:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ff5800/0x3139939425062c0d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef97 expref: 8 pid: 13695 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746147211.873152:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.873208:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2001:x1830967310387456:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 170us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.873215:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9069 00000100:00100000:1.0:1746147211.873230:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9070 00000100:00100000:1.0:1746147211.873235:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310387328:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.873245:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.873251:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800974a6a00/0x3139939425062bea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef89 expref: 25 pid: 13712 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.873260:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800974a6a00/0x3139939425062bea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef89 expref: 25 pid: 13712 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.873272:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800974a6a00/0x3139939425062bea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef89 expref: 25 pid: 13712 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.873280:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.873282:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.873289:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425062ce6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f01c expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.873297:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425062ce6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f01c expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.873328:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425062ce6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f01c expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.873341:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311484672:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147211.873395:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a564de40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147211.876835:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311484672:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147211.876863:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.876920:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2002:x1830967310387328:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3683us (4071us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.876932:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9070 00000100:00100000:0.0:1746147211.877811:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.877861:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310387840 00000100:00100000:2.0:1746147211.877868:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310387840 00000100:00100000:0.0:1746147211.877885:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00100000:2.0:1746147211.877908:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880095060000 x1830967310387840/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.877928:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095060000 with x1830967310387840 ext(0->1048575) 00002000:00010000:2.0:1746147211.877933:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095060000 00000100:00100000:2.0:1746147211.877949:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310387968 00000100:00100000:2.0:1746147211.877951:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310387968 00002000:00100000:2.0:1746147211.877964:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88012dbc0000 x1830967310387968/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.877971:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc0000 with x1830967310387968 ext(1048576->2097151) 00002000:00010000:2.0:1746147211.877973:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbc0000 00000100:00100000:2.0:1746147211.877984:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7333 00000100:00100000:2.0:1746147211.877989:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310387840:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147211.878603:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7334 00000100:00100000:0.0:1746147211.878612:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967310387968:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147211.881421:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.882777:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310388224 00000100:00100000:2.0:1746147211.882789:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310388224 00002000:00100000:2.0:1746147211.882838:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3661824->3665919) req@ffff88012dbc1f80 x1830967310388224/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.882848:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc1f80 with x1830967310388224 ext(3661824->3665919) 00002000:00010000:2.0:1746147211.882854:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbc1f80 00000100:00100000:2.0:1746147211.882884:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7335 00000100:00100000:2.0:1746147211.882891:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967310388224:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147211.883046:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967310388224:12345-192.168.204.25@tcp:3:cat.0 Request processed in 154us (1634us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147211.883053:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7335 00002000:00100000:2.0:1746147211.883059:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3661824->3665919) req@ffff88012dbc1f80 x1830967310388224/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/4536 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.883073:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc1f80 with x1830967310388224 ext(3661824->3665919) 00002000:00010000:2.0:1746147211.883076:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbc1f80 00000100:00100000:2.0:1746147211.886658:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310387840:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8653us (8834us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147211.886671:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7333 00002000:00100000:2.0:1746147211.886684:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880095060000 x1830967310387840/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.886694:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095060000 with x1830967310387840 ext(0->1048575) 00002000:00010000:2.0:1746147211.886700:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095060000 00000100:00100000:2.0:1746147211.893408:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967310387968:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14786us (15510us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147211.893423:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7334 00002000:00100000:2.0:1746147211.893436:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88012dbc0000 x1830967310387968/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.893446:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc0000 with x1830967310387968 ext(1048576->2097151) 00002000:00010000:2.0:1746147211.893453:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbc0000 00000100:00100000:0.0:1746147211.893667:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.893783:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310388480 00000100:00100000:2.0:1746147211.893791:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310388480 00000100:00100000:2.0:1746147211.893842:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16470 00000100:00100000:2.0:1746147211.893850:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2882:x1830967310388480:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147211.893870:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147211.893894:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x3139939425062d02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f02a expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147211.893988:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x3139939425062d09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.894001:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x3139939425062d09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.894013:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x3139939425062d09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.894026:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425062d10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.894032:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425062d10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.894037:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425062d10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.894189:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062d17 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.894199:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062d17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147211.894206:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062d17 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147211.894214:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000100:00100000:0.0:1746147211.894221:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147211.894880:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x3139939425062d09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.894888:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x3139939425062d09 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.894893:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x3139939425062d09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.894898:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147211.894902:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x3139939425062d09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.894908:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x3139939425062d09 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.894919:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147211.894922:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147211.894926:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x3139939425062d09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.894930:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x3139939425062d09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.894958:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425062d10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.894962:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425062d10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.894967:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425062d10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.894970:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d6e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147211.894972:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425062d10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.894976:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425062d10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.894982:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009823ae00) 00010000:00010000:3.0:1746147211.894984:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147211.894986:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425062d10 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.894989:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6e00/0x3139939425062d10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.895030:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x3139939425062d02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f02a expref: 17 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.895044:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062d17 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f02a expref: 16 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.895050:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147211.895051:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147211.895053:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7600, rc 0) 00000100:00100000:3.0:1746147211.895113:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2882:x1830967310388480:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1264us (1446us total) trans 8589937370 rc 0/0 00000100:00100000:3.0:1746147211.895119:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16470 00000100:00100000:2.0:1746147211.895227:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310388736 00000100:00100000:2.0:1746147211.895231:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310388736 00000100:00100000:2.0:1746147211.895257:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6158 00000100:00100000:2.0:1746147211.895262:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880079238050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2873:x1830967310388736:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147211.895364:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880079238050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2873:x1830967310388736:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 101us (1141us total) trans 8589937371 rc 0/0 00000100:00100000:2.0:1746147211.895370:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6158 00000100:00100000:0.0:1746147211.903274:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.903382:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310388864 00000100:00100000:3.0:1746147211.903392:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310388864 00000100:00100000:3.0:1746147211.903446:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19994 00000100:00100000:3.0:1746147211.903454:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+25:2882:x1830967310388864:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147211.903477:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.903498:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425062d25 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f031 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.903532:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 32 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.903540:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147211.903541:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147211.903545:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425062d25 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3510272->3649535] (req 3510272->3649535) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f031 expref: 26 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.903577:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 32 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.903594:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 32 pid: 1853 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147211.903606:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311484800:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147211.903893:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147211.907371:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311484800:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147211.907403:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425062d25 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3510272->3649535] (req 3510272->3649535) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f031 expref: 26 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.907422:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542800, rc 0) 00000100:00100000:3.0:1746147211.907471:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2882:x1830967310388864:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4016us (4207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.907480:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19994 00000100:00100000:1.0:1746147211.909845:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.909940:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310388992 00000100:00100000:2.0:1746147211.909948:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310388992 00002000:00100000:2.0:1746147211.909995:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (3088384->3145727) req@ffff8800933f7800 x1830967310388992/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.910004:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f7800 with x1830967310388992 ext(3088384->3145727) 00010000:00010000:2.0:1746147211.910014:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 33 pid: 1853 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.910030:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 33 pid: 1853 timeout: 849 lvb_type: 0 00002000:00010000:2.0:1746147211.910037:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800933f7800 00000100:00100000:2.0:1746147211.910069:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1726 00000100:00100000:2.0:1746147211.910077:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967310388992:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147211.916209:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967310388992:12345-192.168.204.25@tcp:4:cat.0 Request processed in 6121us (6361us total) trans 17179875267 rc 0/0 00000100:00100000:2.0:1746147211.916223:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1726 00002000:00100000:2.0:1746147211.916236:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (3088384->3145727) req@ffff8800933f7800 x1830967310388992/t17179875267(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/448 e 0 to 0 dl 1746147222 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.916246:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f7800 with x1830967310388992 ext(3088384->3145727) 00010000:00010000:2.0:1746147211.916257:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 35 pid: 1853 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.916275:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 35 pid: 1853 timeout: 849 lvb_type: 0 00002000:00010000:2.0:1746147211.916281:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800933f7800 00000100:00100000:0.0:1746147211.925934:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.926379:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310389248 00000100:00100000:2.0:1746147211.926388:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310389248 00002000:00100000:2.0:1746147211.926435:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88012dbc2300 x1830967310389248/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 504/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.926446:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc2300 with x1830967310389248 ext(2097152->4194303) 00002000:00010000:2.0:1746147211.926451:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbc2300 00000100:00100000:2.0:1746147211.926483:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7336 00000100:00100000:2.0:1746147211.926490:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310389248:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147211.927986:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.929659:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310389504 00000100:00100000:2.0:1746147211.929673:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310389504 00002000:00100000:2.0:1746147211.929727:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88012dbc1500 x1830967310389504/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 504/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.929738:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc1500 with x1830967310389504 ext(2097152->4194303) 00010000:00010000:2.0:1746147211.929749:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 35 pid: 1853 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.929765:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 35 pid: 1853 timeout: 849 lvb_type: 0 00002000:00010000:2.0:1746147211.929772:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dbc1500 00000100:00100000:2.0:1746147211.929816:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1727 00000100:00100000:2.0:1746147211.929824:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967310389504:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147211.947306:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310389248:12345-192.168.204.25@tcp:3:cat.0 Request processed in 20802us (21369us total) trans 0 rc 1576960/1576960 00000100:00100000:2.0:1746147211.947321:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7336 00002000:00100000:2.0:1746147211.947334:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88012dbc2300 x1830967310389248/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 504/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 1576960/1576960 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.947342:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc2300 with x1830967310389248 ext(2097152->4194303) 00002000:00010000:2.0:1746147211.947347:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbc2300 00000100:00100000:0.0:1746147211.958382:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.958475:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310389632 00000100:00100000:3.0:1746147211.958485:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310389632 00000100:00100000:3.0:1746147211.958538:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19995 00000100:00100000:3.0:1746147211.958546:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2879:x1830967310389632:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147211.958565:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.958582:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425062d2c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f038 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.958608:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147211.958610:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147211.958614:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425062d2c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f038 expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.958637:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425062d2c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f038 expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.958646:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542600, rc 0) 00000100:00100000:3.0:1746147211.958692:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2879:x1830967310389632:12345-192.168.204.25@tcp:101:cat.0 Request processed in 147us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147211.958698:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19995 00000100:00100000:2.0:1746147211.959030:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310389504:12345-192.168.204.25@tcp:3:cat.0 Request processed in 29206us (31049us total) trans 0 rc 2039808/2039808 00000100:00100000:2.0:1746147211.959039:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1727 00002000:00100000:2.0:1746147211.959048:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88012dbc1500 x1830967310389504/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 504/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:H/200/0 rc 2039808/2039808 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.959057:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc1500 with x1830967310389504 ext(2097152->4194303) 00010000:00010000:2.0:1746147211.959063:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 36 pid: 1853 timeout: 849 lvb_type: 0 00010000:00010000:2.0:1746147211.959074:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 36 pid: 1853 timeout: 849 lvb_type: 0 00002000:00010000:2.0:1746147211.959081:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dbc1500 00000100:00100000:0.0:1746147211.969609:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147211.969781:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310389760 00000100:00100000:1.0:1746147211.969792:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310389760 00010000:00010000:1.0:1746147211.969834:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 36 pid: 1853 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746147211.969878:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9071 00000100:00100000:1.0:1746147211.969886:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310389760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147211.969904:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147211.969926:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 36 pid: 1853 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.969939:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 36 pid: 1853 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.969965:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425062cd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f00e expref: 36 pid: 1853 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746147211.970000:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.970002:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.970011:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425062d25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3510272->3649535) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f031 expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.970020:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425062d25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3510272->3649535) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f031 expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.970035:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.970036:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147211.970040:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425062d2c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f038 expref: 35 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.970046:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425062d2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f038 expref: 35 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147211.970085:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425062d2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f038 expref: 35 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.970127:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311484928:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147211.970231:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425062d25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3510272->3649535) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f031 expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147211.970239:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311485056:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147211.970258:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a564de40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147211.973961:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.975704:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310390016 00000100:00100000:3.0:1746147211.975715:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310390016 00000100:00100000:3.0:1746147211.975791:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16471 00000100:00100000:3.0:1746147211.975800:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2886:x1830967310390016:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147211.975826:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.975850:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f03f expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.975960:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542c00/0x3139939425062d3a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.975975:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092542c00/0x3139939425062d3a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147211.975986:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542c00/0x3139939425062d3a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147211.975997:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147211.976150:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f03f expref: 19 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.976179:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542c00/0x3139939425062d3a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f03f expref: 18 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147211.976188:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147211.976191:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746147211.976194:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542c00, rc 0) 00000100:00100000:3.0:1746147211.976251:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2886:x1830967310390016:12345-192.168.204.25@tcp:101:cat.0 Request processed in 452us (2300us total) trans 8589937372 rc 0/0 00000100:00100000:3.0:1746147211.976257:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16471 00000100:00100000:0.0:1746147211.978087:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.978156:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.978199:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310390272 00000100:00100000:2.0:1746147211.978206:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310390272 00000100:00100000:3.0:1746147211.978223:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310390528 00000100:00100000:3.0:1746147211.978227:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310390528 00002000:00100000:3.0:1746147211.978244:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3145727) req@ffff88012dbc3b80 x1830967310390528/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.978244:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x98:0x0] (3645440->3649535) req@ffff88012dbc0380 x1830967310390272/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/0 e 0 to 0 dl 1746147222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.978254:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc3b80 with x1830967310390528 ext(2097152->3145727) 00002000:00100000:2.0:1746147211.978254:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc0380 with x1830967310390272 ext(3645440->3649535) 00002000:00010000:3.0:1746147211.978258:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbc3b80 00002000:00010000:2.0:1746147211.978258:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbc0380 00000100:00100000:2.0:1746147211.978380:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7337 00000100:00100000:3.0:1746147211.978384:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7338 00000100:00100000:3.0:1746147211.978389:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310390528:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147211.978392:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2002:x1830967310390272:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147211.978930:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2002:x1830967310390272:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 542us (848us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147211.978936:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7337 00002000:00100000:2.0:1746147211.978941:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x98:0x0] (3645440->3649535) req@ffff88012dbc0380 x1830967310390272/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:587/0 lens 488/4536 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147211.978947:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc0380 with x1830967310390272 ext(3645440->3649535) 00002000:00010000:2.0:1746147211.978950:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbc0380 00000100:00100000:1.0:1746147211.979358:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311484928:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147211.979371:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311485056:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147211.979395:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147211.979427:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310389760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 9542us (9832us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147211.979436:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9071 00000100:00100000:0.0:1746147211.986249:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147211.987175:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310390784 00000100:00100000:2.0:1746147211.987185:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310390784 00000100:00100000:2.0:1746147211.987240:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6159 00000100:00100000:2.0:1746147211.987248:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2882:x1830967310390784:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147211.987487:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2882:x1830967310390784:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 238us (1248us total) trans 8589937373 rc 0/0 00000100:00100000:2.0:1746147211.987494:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6159 00000100:00100000:3.0:1746147211.990847:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967310390528:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12446us (12679us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147211.990859:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7338 00002000:00100000:3.0:1746147211.990873:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3145727) req@ffff88012dbc3b80 x1830967310390528/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:587/0 lens 488/440 e 0 to 0 dl 1746147222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147211.990882:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbc3b80 with x1830967310390528 ext(2097152->3145727) 00002000:00010000:3.0:1746147211.990888:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbc3b80 00000100:00100000:2.0:1746147211.992681:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147211.992769:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310390912 00000100:00100000:0.0:1746147211.992777:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310390912 00000100:00100000:0.0:1746147211.992827:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19996 00000100:00100000:0.0:1746147211.992835:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2002:x1830967310390912:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147211.992853:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147211.992875:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062d48 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f046 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147211.993002:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311485184:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147211.993079:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984899c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147211.993245:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147211.993291:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310391040 00000100:00100000:3.0:1746147211.993295:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310391040 00000100:00100000:3.0:1746147211.993314:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19997 00000100:00100000:3.0:1746147211.993319:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2002:x1830967310391040:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147211.993327:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147211.993338:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092542400/0x3139939425062d4f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f04d expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147211.993364:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311485312:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147211.993405:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20540 going to sleep for 11 seconds 00002000:00010000:2.0:1746147211.997742:0:13712:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746147210 -> 1746147211 00002000:00010000:2.0:1746147211.997752:0:13712:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746147210 -> 1746147211 00000100:00100000:2.0:1746147211.997779:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311485184:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147211.997817:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062d48 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f046 expref: 8 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.997833:0:13712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092563a00/0x3139939425062d48 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f046 expref: 8 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147211.997867:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092563a00, rc 0) 00000100:00100000:2.0:1746147211.997916:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2002:x1830967310390912:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5081us (5242us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147211.997925:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19996 00002000:00010000:3.0:1746147211.998165:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime: 1746147210 -> 1746147211 00000100:00100000:3.0:1746147211.998179:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311485312:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147211.998195:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092542400/0x3139939425062d4f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f04d expref: 27 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.998204:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092542400/0x3139939425062d4f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f04d expref: 27 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147211.998748:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542400, rc 0) 00000100:00100000:3.0:1746147211.998780:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2002:x1830967310391040:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5459us (5533us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147211.998785:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19997 00000100:00100000:0.0:1746147212.004933:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.005038:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310391168 00000100:00100000:3.0:1746147212.005048:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310391168 00000100:00080000:1.0:1746147212.005196:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147212.005274:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19998 00000100:00100000:3.0:1746147212.005281:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2879:x1830967310391168:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147212.005304:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147212.005324:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425062d56 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f054 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.005358:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425062d25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3510272->3649535) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f031 expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.005365:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147212.005367:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147212.005370:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425062d56 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f054 expref: 36 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.005399:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425062d25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3510272->3649535) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f031 expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.005410:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425062d25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3510272->3649535) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f031 expref: 25 pid: 1853 timeout: 849 lvb_type: 0 00000100:00100000:3.0:1746147212.005421:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311485440:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147212.006553:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147212.008242:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.008300:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310391296 00000100:00100000:2.0:1746147212.008306:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310391296 00000100:00100000:2.0:1746147212.008354:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 19999 00000100:00100000:2.0:1746147212.008362:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2886:x1830967310391296:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147212.008374:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147212.008391:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d49c00/0x3139939425062d5d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f05b expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.008417:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425062ce6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f01c expref: 23 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.008424:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147212.008426:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147212.008429:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d49c00/0x3139939425062d5d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f05b expref: 8 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.008453:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425062ce6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f01c expref: 23 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.008463:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425062ce6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f01c expref: 23 pid: 1853 timeout: 849 lvb_type: 0 00000100:00100000:2.0:1746147212.008474:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311485568:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147212.008525:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985f00 going to sleep for 11 seconds 00000100:00080000:1.0:1746147212.008566:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147212.009944:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311485440:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147212.009971:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425062d56 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f054 expref: 36 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.009985:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092543c00, rc 0) 00000100:00100000:3.0:1746147212.010018:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2879:x1830967310391168:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4737us (5096us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.010026:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19998 00000100:00100000:0.0:1746147212.010734:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.010791:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310391424 00000100:00100000:3.0:1746147212.010797:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310391424 00002000:00100000:3.0:1746147212.010831:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (3510272->3649535) req@ffff88009258dc00 x1830967310391424/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147212.010841:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258dc00 with x1830967310391424 ext(3510272->3649535) 00010000:00010000:3.0:1746147212.010847:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425062d25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3510272->3649535) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f031 expref: 26 pid: 1853 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147212.010860:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425062d25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3510272->3649535) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f031 expref: 26 pid: 1853 timeout: 850 lvb_type: 0 00002000:00010000:3.0:1746147212.010866:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009258dc00 00000100:00100000:3.0:1746147212.010890:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1728 00000100:00100000:3.0:1746147212.010896:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+26:2001:x1830967310391424:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147212.012661:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311485568:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147212.012695:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d49c00/0x3139939425062d5d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f05b expref: 8 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.012709:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49c00, rc 0) 00000100:00100000:2.0:1746147212.012743:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2886:x1830967310391296:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4382us (4507us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147212.012751:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 19999 00000100:00100000:0.0:1746147212.016326:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.017165:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2001:x1830967310391424:12345-192.168.204.25@tcp:4:cat.0 Request processed in 6267us (6430us total) trans 17179875268 rc 0/0 00000100:00100000:3.0:1746147212.017179:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1728 00002000:00100000:3.0:1746147212.017190:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (3510272->3649535) req@ffff88009258dc00 x1830967310391424/t17179875268(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/448 e 0 to 0 dl 1746147223 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147212.017198:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258dc00 with x1830967310391424 ext(3510272->3649535) 00010000:00010000:3.0:1746147212.017207:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425062d25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3510272->3649535) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f031 expref: 28 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147212.017224:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425062d25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3510272->3649535) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f031 expref: 28 pid: 1853 timeout: 850 lvb_type: 0 00002000:00010000:3.0:1746147212.017231:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009258dc00 00000100:00100000:3.0:1746147212.017254:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310391552 00000100:00100000:3.0:1746147212.017260:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310391552 00002000:00100000:3.0:1746147212.018188:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->3665919) req@ffff88009258c000 x1830967310391552/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147212.018197:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258c000 with x1830967310391552 ext(3145728->3665919) 00010000:00010000:3.0:1746147212.018204:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425062ce6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f01c expref: 24 pid: 1853 timeout: 849 lvb_type: 0 00010000:00010000:3.0:1746147212.018219:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425062ce6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f01c expref: 24 pid: 1853 timeout: 850 lvb_type: 0 00002000:00010000:3.0:1746147212.018225:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258c000 00000100:00100000:3.0:1746147212.018251:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1729 00000100:00100000:3.0:1746147212.018258:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310391552:12345-192.168.204.25@tcp:4:cat.0 00000100:00080000:1.0:1746147212.018720:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147212.024898:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.025026:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310391680 00000100:00100000:2.0:1746147212.025037:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310391680 00010000:00010000:2.0:1746147212.025520:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425062d25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3510272->3649535) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f031 expref: 28 pid: 1853 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746147212.025586:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9072 00000100:00100000:2.0:1746147212.025595:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2001:x1830967310391680:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147212.025609:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147212.025642:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425062d25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3510272->3649535) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f031 expref: 28 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.025662:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425062d25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3510272->3649535) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f031 expref: 28 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.025689:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092542800/0x3139939425062d25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3510272->3649535) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f031 expref: 28 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.025721:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.025723:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.025731:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425062d56 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f054 expref: 35 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.025739:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425062d56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f054 expref: 35 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.026522:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425062d56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f054 expref: 35 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147212.026537:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311485696:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147212.026969:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147212.028687:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310391552:12345-192.168.204.25@tcp:4:cat.0 Request processed in 10420us (12363us total) trans 21474842652 rc 0/0 00000100:00100000:3.0:1746147212.028700:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1729 00002000:00100000:3.0:1746147212.028713:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->3665919) req@ffff88009258c000 x1830967310391552/t21474842652(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/448 e 0 to 0 dl 1746147223 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147212.028722:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258c000 with x1830967310391552 ext(3145728->3665919) 00010000:00010000:3.0:1746147212.028734:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425062ce6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f01c expref: 26 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147212.028749:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425062ce6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f01c expref: 26 pid: 1853 timeout: 850 lvb_type: 0 00002000:00010000:3.0:1746147212.028756:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258c000 00000100:00100000:0.0:1746147212.029585:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311485696:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147212.029613:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147212.029710:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2001:x1830967310391680:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4115us (4821us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147212.029719:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9072 00000100:00100000:0.0:1746147212.031518:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.031614:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310391936 00000100:00100000:3.0:1746147212.031621:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310391936 00002000:00100000:3.0:1746147212.031670:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff88009258ea00 x1830967310391936/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147212.031680:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258ea00 with x1830967310391936 ext(3145728->4194303) 00002000:00010000:3.0:1746147212.031685:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009258ea00 00000100:00100000:3.0:1746147212.031896:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7339 00000100:00100000:3.0:1746147212.031907:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310391936:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147212.035177:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147212.035914:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310392064 00000100:00100000:1.0:1746147212.035924:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310392064 00010000:00010000:1.0:1746147212.035960:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425062ce6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f01c expref: 26 pid: 1853 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746147212.035992:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9073 00000100:00100000:1.0:1746147212.036000:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310392064:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147212.036014:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147212.036033:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425062ce6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f01c expref: 26 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746147212.036045:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425062ce6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f01c expref: 26 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746147212.036071:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425062ce6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3665919) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f01c expref: 26 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746147212.036108:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147212.036110:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147212.036121:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d49c00/0x3139939425062d5d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f05b expref: 7 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.036131:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d49c00/0x3139939425062d5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f05b expref: 7 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.036170:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d49c00/0x3139939425062d5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f05b expref: 7 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147212.036184:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311485824:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147212.036245:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1ccd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147212.039791:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311485824:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147212.039815:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147212.039875:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310392064:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3873us (4706us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147212.039887:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9073 00000100:00100000:3.0:1746147212.040067:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310391936:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8160us (8553us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147212.040077:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7339 00002000:00100000:3.0:1746147212.040127:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff88009258ea00 x1830967310391936/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147212.040138:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258ea00 with x1830967310391936 ext(3145728->4194303) 00002000:00010000:3.0:1746147212.040143:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009258ea00 00000100:00100000:0.0:1746147212.044555:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.044753:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.044849:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310392320 00000100:00100000:3.0:1746147212.044859:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310392320 00002000:00100000:3.0:1746147212.044908:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88009258d880 x1830967310392320/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147212.044924:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258d880 with x1830967310392320 ext(2097152->3145727) 00002000:00010000:3.0:1746147212.044929:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258d880 00000100:00100000:2.0:1746147212.045142:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310392448 00000100:00100000:3.0:1746147212.045144:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7340 00000100:00100000:2.0:1746147212.045146:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310392448 00000100:00100000:3.0:1746147212.045152:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310392320:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147212.045179:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20000 00000100:00100000:2.0:1746147212.045183:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310392448:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147212.045192:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147212.045210:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062d64 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f062 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.045231:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.045232:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.045240:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062d64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f062 expref: 26 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147212.045254:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062d64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f062 expref: 26 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147212.045262:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1a00, rc 0) 00000100:00100000:2.0:1746147212.045778:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310392448:12345-192.168.204.25@tcp:101:cat.0 Request processed in 592us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147212.045784:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20000 00000100:00100000:0.0:1746147212.051439:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.054780:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310392704 00000100:00100000:2.0:1746147212.054794:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310392704 00002000:00100000:2.0:1746147212.054842:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88009258f480 x1830967310392704/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.054852:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258f480 with x1830967310392704 ext(4194304->4890623) 00002000:00010000:2.0:1746147212.054858:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258f480 00000100:00100000:2.0:1746147212.054891:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7341 00000100:00100000:2.0:1746147212.054899:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310392704:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147212.056234:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310392320:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11077us (11690us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147212.056244:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7340 00002000:00100000:3.0:1746147212.056252:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88009258d880 x1830967310392320/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147212.056260:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258d880 with x1830967310392320 ext(2097152->3145727) 00002000:00010000:3.0:1746147212.056265:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258d880 00000100:00100000:2.0:1746147212.063605:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310392704:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8693us (12164us total) trans 0 rc 696320/696320 00000100:00100000:2.0:1746147212.063620:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7341 00002000:00100000:2.0:1746147212.063644:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88009258f480 x1830967310392704/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.063662:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258f480 with x1830967310392704 ext(4194304->4890623) 00002000:00010000:2.0:1746147212.063668:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258f480 00000100:00100000:0.0:1746147212.066388:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.066509:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310392832 00000100:00100000:2.0:1746147212.066518:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310392832 00000100:00100000:2.0:1746147212.066573:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20001 00000100:00100000:2.0:1746147212.066581:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+27:2886:x1830967310392832:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147212.066601:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147212.066624:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098227c00/0x3139939425062d6b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f069 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.066659:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.066661:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.066669:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098227c00/0x3139939425062d6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f069 expref: 28 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.066684:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098227c00/0x3139939425062d6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f069 expref: 28 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.066694:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098227c00, rc 0) 00000100:00100000:2.0:1746147212.067940:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2886:x1830967310392832:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1356us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147212.067947:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20001 00000100:00100000:0.0:1746147212.081427:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.082327:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.082402:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310393088 00000100:00100000:2.0:1746147212.082411:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310393088 00000100:00100000:3.0:1746147212.082418:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310393344 00000100:00100000:3.0:1746147212.082422:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310393344 00002000:00100000:2.0:1746147212.082456:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff8801312ef800 x1830967310393088/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147212.082471:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8801312ec700 x1830967310393344/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.082472:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ef800 with x1830967310393088 ext(2097152->4194303) 00002000:00100000:3.0:1746147212.082477:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ec700 with x1830967310393344 ext(3145728->4194303) 00002000:00010000:2.0:1746147212.082478:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312ef800 00002000:00010000:3.0:1746147212.082480:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312ec700 00000100:00100000:2.0:1746147212.082508:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7342 00000100:00100000:2.0:1746147212.082516:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2002:x1830967310393088:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147212.082827:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7343 00000100:00100000:3.0:1746147212.082834:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2002:x1830967310393344:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147212.096678:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2002:x1830967310393344:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13833us (14340us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147212.096691:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7343 00002000:00100000:3.0:1746147212.096705:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8801312ec700 x1830967310393344/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147212.096715:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ec700 with x1830967310393344 ext(3145728->4194303) 00002000:00010000:3.0:1746147212.096721:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312ec700 00000100:00100000:2.0:1746147212.110590:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2002:x1830967310393088:12345-192.168.204.25@tcp:3:cat.0 Request processed in 28062us (29160us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147212.110603:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7342 00002000:00100000:2.0:1746147212.110617:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff8801312ef800 x1830967310393088/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.110635:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ef800 with x1830967310393088 ext(2097152->4194303) 00002000:00010000:2.0:1746147212.110642:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312ef800 00000100:00100000:0.0:1746147212.123199:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.123258:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310393600 00000100:00100000:2.0:1746147212.123269:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310393600 00002000:00100000:2.0:1746147212.123313:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff8801312ef480 x1830967310393600/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.123321:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ef480 with x1830967310393600 ext(4194304->4890623) 00002000:00010000:2.0:1746147212.123327:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312ef480 00000100:00100000:2.0:1746147212.123357:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7344 00000100:00100000:2.0:1746147212.123364:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2003:x1830967310393600:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147212.138069:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2003:x1830967310393600:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14690us (14868us total) trans 0 rc 696320/696320 00000100:00100000:2.0:1746147212.138083:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7344 00002000:00100000:2.0:1746147212.138120:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff8801312ef480 x1830967310393600/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.138129:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ef480 with x1830967310393600 ext(4194304->4890623) 00002000:00010000:2.0:1746147212.138135:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312ef480 00000100:00100000:0.0:1746147212.153510:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.153594:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310393856 00000100:00100000:3.0:1746147212.153612:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310393856 00000100:00100000:3.0:1746147212.153779:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16472 00000100:00100000:3.0:1746147212.153788:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2890:x1830967310393856:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147212.153816:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147212.153835:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542400/0x3139939425062d72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f070 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.153938:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.153952:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48e00/0x3139939425062c84 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efdd expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.153958:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062cca lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f007 expref: 35 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.153964:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062d17 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f02a expref: 18 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.153969:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.154005:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062d17 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f02a expref: 18 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.154022:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062d17 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f02a expref: 18 pid: 6215 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746147212.154033:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311485952:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147212.154185:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062cca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f007 expref: 35 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.154193:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062cca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f007 expref: 35 pid: 7237 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746147212.154200:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311486080:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147212.154224:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48e00/0x3139939425062c84 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efdd expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.154231:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48e00/0x3139939425062c84 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efdd expref: 8 pid: 6215 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746147212.154237:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311486208:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147212.154254:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147212.157447:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.157464:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311485952:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147212.157477:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311486080:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147212.157485:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311486208:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147212.157511:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147212.159186:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147212.159572:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310394112 00000100:00100000:1.0:1746147212.159581:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310394112 00010000:00010000:1.0:1746147212.159624:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062cca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f007 expref: 36 pid: 7237 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746147212.159654:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147212.159673:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310393984 00000100:00100000:1.0:1746147212.159675:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310393984 00000100:00100000:0.0:1746147212.159693:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310394240 00010000:00010000:1.0:1746147212.159695:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062d17 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f02a expref: 19 pid: 6215 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746147212.159700:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310394240 00000100:00100000:1.0:1746147212.159712:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9074 00000100:00100000:1.0:1746147212.159718:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967310394112:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147212.159733:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147212.159734:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48e00/0x3139939425062c84 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efdd expref: 9 pid: 6215 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746147212.159739:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062cca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f007 expref: 36 pid: 7237 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746147212.159753:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062cca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f007 expref: 36 pid: 7237 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746147212.159763:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9075 00000100:00100000:0.0:1746147212.159770:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2002:x1830967310393984:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147212.159776:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x3139939425062cca lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f007 expref: 36 pid: 7237 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746147212.159784:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147212.159790:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062d17 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f02a expref: 19 pid: 6215 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746147212.159796:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147212.159802:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147212.159810:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147212.159815:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147212.159824:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062d17 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f02a expref: 19 pid: 6215 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746147212.159841:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7600/0x3139939425062d17 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f02a expref: 19 pid: 6215 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746147212.159859:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147212.159863:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147212.159870:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147212.159876:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147212.159912:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310393984:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 143us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147212.159917:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9075 00000100:00100000:0.0:1746147212.159932:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9076 00000100:00100000:0.0:1746147212.159936:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2002:x1830967310394240:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147212.159942:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147212.159946:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48e00/0x3139939425062c84 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efdd expref: 9 pid: 6215 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746147212.159954:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48e00/0x3139939425062c84 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efdd expref: 9 pid: 6215 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746147212.159964:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d48e00/0x3139939425062c84 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efdd expref: 9 pid: 6215 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746147212.159972:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147212.159974:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147212.159980:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147212.159986:0:4349:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147212.160005:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147212.160019:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2002:x1830967310394240:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 82us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147212.160024:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9076 00010000:00010000:0.0:1746147212.160044:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147212.160049:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:0.0:1746147212.160064:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000100:00100000:1.0:1746147212.160913:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967310394112:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1193us (3475us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147212.160920:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9074 00000100:00080000:1.0:1746147212.160937:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1746147212.161080:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542400/0x3139939425062d72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f070 expref: 36 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.161134:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f070 expref: 35 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.161141:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147212.161144:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746147212.161146:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542200, rc 0) 00000100:00100000:0.0:1746147212.161179:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2890:x1830967310393856:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7393us (7675us total) trans 8589937374 rc 0/0 00000100:00100000:0.0:1746147212.161185:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16472 00000100:00100000:0.0:1746147212.218391:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.219899:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310394496 00000100:00100000:2.0:1746147212.219912:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310394496 00000100:00100000:2.0:1746147212.219975:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16473 00000100:00100000:2.0:1746147212.219984:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2893:x1830967310394496:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147212.220009:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147212.220029:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098226200/0x3139939425062d87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f077 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.220147:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098227600/0x3139939425062d8e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147212.220162:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098227600/0x3139939425062d8e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147212.220173:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098227600/0x3139939425062d8e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147212.220182:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147212.220278:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098226200/0x3139939425062d87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f077 expref: 21 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.220942:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098227600/0x3139939425062d8e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f077 expref: 20 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.220951:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147212.220955:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147212.220958:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098227600, rc 0) 00000100:00100000:2.0:1746147212.221023:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2893:x1830967310394496:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1040us (2645us total) trans 8589937375 rc 0/0 00000100:00100000:2.0:1746147212.221030:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16473 00000100:00100000:0.0:1746147212.259357:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.259409:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.259453:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.259970:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310394880 00000100:00100000:3.0:1746147212.259980:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310394880 00000100:00100000:3.0:1746147212.260050:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 988 00000100:00100000:3.0:1746147212.260058:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+375:2003:x1830967310394880:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1746147212.260147:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+375:2003:x1830967310394880:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 90us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.260153:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 988 00000100:00080000:0.0:1746147212.260465:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746147212.261181:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310394624 00000100:00100000:2.0:1746147212.261186:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310394624 00000100:00100000:2.0:1746147212.261220:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20002 00000100:00100000:2.0:1746147212.261226:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2890:x1830967310394624:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147212.261239:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147212.261257:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f07e expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.261283:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d49c00/0x3139939425062d5d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f05b expref: 7 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.261291:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062d64 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f062 expref: 27 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147212.261298:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.261300:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.261304:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2469888->3112959] (req 2469888->3112959) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 27 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.261334:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062d64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f062 expref: 27 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147212.261345:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062d64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f062 expref: 27 pid: 13712 timeout: 850 lvb_type: 1 00000100:00100000:2.0:1746147212.261358:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311486336:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147212.261449:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d49c00/0x3139939425062d5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f05b expref: 7 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.261463:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d49c00/0x3139939425062d5d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f05b expref: 7 pid: 13712 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746147212.261470:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311486464:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147212.261488:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147212.261661:0:8098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310394752 00000100:00100000:1.0:1746147212.261665:0:8098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310394752 00000100:00100000:1.0:1746147212.261700:0:8098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 237 00000100:00100000:1.0:1746147212.261706:0:8098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2002:x1830967310394752:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:1.0:1746147212.261743:0:8098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2002:x1830967310394752:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 37us (2333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147212.261748:0:8098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 237 00000100:00100000:0.0:1746147212.274215:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.276864:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310395008 00000100:00100000:3.0:1746147212.276879:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310395008 00000100:00080000:1.0:1746147212.276945:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746147212.276975:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 989 00000100:00100000:3.0:1746147212.276983:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+5:2002:x1830967310395008:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:3.0:1746147212.277072:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+5:2002:x1830967310395008:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 89us (2869us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.277078:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 989 00000100:00100000:1.0:1746147212.277246:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.278913:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310395136 00000100:00100000:3.0:1746147212.278921:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310395136 00000100:00080000:0.0:1746147212.278985:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746147212.279210:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311486336:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147212.279221:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311486464:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147212.279249:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2469888->3112959] (req 2469888->3112959) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 27 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.279267:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098226400, rc 0) 00000100:00100000:3.0:1746147212.279347:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 990 00000100:00100000:3.0:1746147212.279355:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+5:2003:x1830967310395136:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:2.0:1746147212.279728:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2890:x1830967310394624:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 18501us (20382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147212.279735:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20002 00000100:00100000:3.0:1746147212.279808:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+5:2003:x1830967310395136:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 454us (2563us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.279814:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 990 00000100:00100000:0.0:1746147212.286301:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.286991:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147212.289308:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310395392 00000100:00100000:1.0:1746147212.289321:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310395392 00010000:00010000:1.0:1746147212.289367:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d49c00/0x3139939425062d5d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f05b expref: 8 pid: 13712 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746147212.289387:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310395264 00000100:00100000:3.0:1746147212.289392:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310395264 00000100:00100000:1.0:1746147212.289408:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9077 00010000:00010000:3.0:1746147212.289409:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062d64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f062 expref: 27 pid: 13712 timeout: 850 lvb_type: 1 00000100:00100000:1.0:1746147212.289416:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2003:x1830967310395392:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147212.289434:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9078 00010000:00010000:1.0:1746147212.289434:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147212.289439:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310395264:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147212.289446:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147212.289452:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d49c00/0x3139939425062d5d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f05b expref: 8 pid: 13712 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147212.289454:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062d64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f062 expref: 27 pid: 13712 timeout: 850 lvb_type: 1 00010000:00010000:3.0:1746147212.289464:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062d64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f062 expref: 27 pid: 13712 timeout: 850 lvb_type: 1 00010000:00010000:1.0:1746147212.289483:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d49c00/0x3139939425062d5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f05b expref: 8 pid: 13712 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147212.289593:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1a00/0x3139939425062d64 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f062 expref: 27 pid: 13712 timeout: 850 lvb_type: 1 00010000:00010000:3.0:1746147212.289613:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147212.289668:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310395264:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 228us (2677us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.289674:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9078 00010000:00010000:1.0:1746147212.290610:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d49c00/0x3139939425062d5d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f05b expref: 8 pid: 13712 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746147212.290644:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147212.290646:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147212.290653:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.290662:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.290697:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147212.290714:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311486592:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147212.290809:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147212.291736:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.291880:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310395520 00000100:00100000:2.0:1746147212.291886:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310395520 00000100:00100000:2.0:1746147212.291933:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20003 00000100:00100000:2.0:1746147212.291940:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2896:x1830967310395520:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147212.291953:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147212.291968:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098227e00/0x3139939425062da3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f085 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.291990:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.291997:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147212.291998:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147212.292001:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098227e00/0x3139939425062da3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f085 expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.292022:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.292034:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 25 pid: 1853 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746147212.292044:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311486720:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147212.292118:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147212.292483:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311486592:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147212.292500:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147212.292526:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967310395392:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3110us (6236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147212.292540:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9077 00000100:00100000:0.0:1746147212.293188:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.293240:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310395776 00000100:00100000:2.0:1746147212.293244:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310395776 00002000:00100000:2.0:1746147212.293271:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2469888->2473983) req@ffff8800984d7480 x1830967310395776/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.293280:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d7480 with x1830967310395776 ext(2469888->2473983) 00010000:00010000:2.0:1746147212.293287:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 26 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.293302:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 26 pid: 1853 timeout: 850 lvb_type: 0 00002000:00010000:2.0:1746147212.293309:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800984d7480 00000100:00100000:2.0:1746147212.293333:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1730 00000100:00100000:2.0:1746147212.293338:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310395776:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147212.293447:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310395776:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 109us (259us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147212.293453:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1730 00002000:00100000:2.0:1746147212.293458:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2469888->2473983) req@ffff8800984d7480 x1830967310395776/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/4536 e 0 to 0 dl 1746147223 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.293465:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d7480 with x1830967310395776 ext(2469888->2473983) 00010000:00010000:2.0:1746147212.293469:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 26 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.293478:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 26 pid: 1853 timeout: 850 lvb_type: 0 00002000:00010000:2.0:1746147212.293484:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800984d7480 00000100:00100000:2.0:1746147212.295960:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311486720:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147212.295987:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098227e00/0x3139939425062da3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f085 expref: 8 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.296003:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098227e00, rc 0) 00000100:00100000:2.0:1746147212.296047:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2896:x1830967310395520:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4106us (4314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147212.296059:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20003 00000100:00100000:0.0:1746147212.303142:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.303236:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310396032 00000100:00100000:3.0:1746147212.303246:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310396032 00002000:00100000:3.0:1746147212.303289:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3108864->3112959) req@ffff8800984d4700 x1830967310396032/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147212.303299:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d4700 with x1830967310396032 ext(3108864->3112959) 00010000:00010000:3.0:1746147212.303309:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 26 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147212.303323:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 26 pid: 1853 timeout: 850 lvb_type: 0 00002000:00010000:3.0:1746147212.303331:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800984d4700 00000100:00100000:3.0:1746147212.303364:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1731 00000100:00100000:3.0:1746147212.303372:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310396032:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147212.303505:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310396032:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 133us (415us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147212.303511:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1731 00002000:00100000:3.0:1746147212.303516:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3108864->3112959) req@ffff8800984d4700 x1830967310396032/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/4536 e 0 to 0 dl 1746147223 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147212.303523:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d4700 with x1830967310396032 ext(3108864->3112959) 00010000:00010000:3.0:1746147212.303527:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 26 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147212.303536:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 26 pid: 1853 timeout: 850 lvb_type: 0 00002000:00010000:3.0:1746147212.303542:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800984d4700 00000100:00100000:0.0:1746147212.308273:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.308369:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310396288 00000100:00100000:3.0:1746147212.308378:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310396288 00000100:00100000:3.0:1746147212.308436:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16474 00000100:00100000:3.0:1746147212.308445:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2899:x1830967310396288:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147212.308471:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147212.308492:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73e00/0x3139939425062daa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f08c expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.308573:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425062db1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308587:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425062db1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308596:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425062db1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308608:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72800/0x3139939425062db8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308613:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72800/0x3139939425062db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308619:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72800/0x3139939425062db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308722:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73c00/0x3139939425062dbf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308731:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73c00/0x3139939425062dbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308737:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73c00/0x3139939425062dbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:3.0:1746147212.308745:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147212.308815:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425062db1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308821:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425062db1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308830:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425062db1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308836:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425062db1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308841:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a73600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147212.308845:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425062db1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308851:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425062db1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308861:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147212.308864:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147212.308867:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425062db1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308872:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73600/0x3139939425062db1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308889:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72800/0x3139939425062db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308893:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72800/0x3139939425062db8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308898:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72800/0x3139939425062db8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308902:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a72800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147212.308904:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72800/0x3139939425062db8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308912:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72800/0x3139939425062db8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308917:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098239c00) 00010000:00010000:3.0:1746147212.308919:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147212.308921:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72800/0x3139939425062db8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308925:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a72800/0x3139939425062db8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147212.308957:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73e00/0x3139939425062daa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f08c expref: 38 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.308967:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73c00/0x3139939425062dbf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f08c expref: 37 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.308974:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147212.308975:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147212.308978:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a73c00, rc 0) 00000100:00100000:3.0:1746147212.309035:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2899:x1830967310396288:12345-192.168.204.25@tcp:101:cat.0 Request processed in 590us (771us total) trans 8589937376 rc 0/0 00000100:00100000:3.0:1746147212.309041:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16474 00000100:00100000:2.0:1746147212.309555:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.309691:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310396544 00000100:00100000:0.0:1746147212.309695:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310396544 00000100:00100000:0.0:1746147212.309721:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20004 00000100:00100000:0.0:1746147212.309726:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2893:x1830967310396544:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147212.309736:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147212.309747:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425062dcd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f093 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.309765:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147212.309767:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147212.309771:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425062dcd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3997696->4194303] (req 3997696->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f093 expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.309780:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425062dcd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3997696->4194303] (req 3997696->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f093 expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.309788:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092562400, rc 0) 00000100:00100000:0.0:1746147212.309818:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2893:x1830967310396544:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 91us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147212.309824:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20004 00000100:00100000:0.0:1746147212.311161:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.312127:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310396672 00000100:00100000:2.0:1746147212.312134:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310396672 00002000:00100000:2.0:1746147212.312173:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2469888->3112959) req@ffff8800984d7100 x1830967310396672/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.312183:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d7100 with x1830967310396672 ext(2469888->3112959) 00010000:00010000:2.0:1746147212.312191:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 26 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.312205:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 26 pid: 1853 timeout: 850 lvb_type: 0 00002000:00010000:2.0:1746147212.312212:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800984d7100 00000100:00100000:2.0:1746147212.312229:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1732 00000100:00100000:2.0:1746147212.312235:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310396672:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:1.0:1746147212.313500:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.313653:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310396928 00000100:00100000:0.0:1746147212.313659:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310396928 00000100:00100000:0.0:1746147212.313866:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6160 00000100:00100000:0.0:1746147212.313874:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2899:x1830967310396928:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:0.0:1746147212.316306:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2899:x1830967310396928:12345-192.168.204.25@tcp:35:cat.0 Request processed in 2422us (2800us total) trans 8589937377 rc 0/0 00000100:00100000:0.0:1746147212.316316:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6160 00000100:00100000:1.0:1746147212.325034:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.325134:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310397056 00000100:00100000:2.0:1746147212.325144:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310397056 00000100:00100000:2.0:1746147212.325185:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20005 00000100:00100000:2.0:1746147212.325193:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310397056:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147212.325211:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147212.325228:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098226e00/0x3139939425062dd4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f09a expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147212.325277:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311486848:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147212.325351:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147212.328450:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310396672:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 16201us (17278us total) trans 21474842653 rc 0/0 00000100:00100000:3.0:1746147212.328465:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1732 00002000:00100000:3.0:1746147212.328477:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2469888->3112959) req@ffff8800984d7100 x1830967310396672/t21474842653(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/448 e 0 to 0 dl 1746147223 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147212.328493:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d7100 with x1830967310396672 ext(2469888->3112959) 00010000:00010000:3.0:1746147212.328504:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 30 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147212.328521:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 30 pid: 1853 timeout: 850 lvb_type: 0 00002000:00010000:3.0:1746147212.328529:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800984d7100 00002000:00010000:2.0:1746147212.331343:0:13712:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746147211 -> 1746147212 00002000:00010000:2.0:1746147212.331351:0:13712:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime: 1746147211 -> 1746147212 00000100:00100000:2.0:1746147212.331376:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311486848:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147212.331410:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098226e00/0x3139939425062dd4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f09a expref: 29 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147212.331423:0:13712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098226e00/0x3139939425062dd4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f09a expref: 29 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147212.331449:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098226e00, rc 0) 00000100:00100000:2.0:1746147212.331500:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310397056:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6307us (6476us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147212.331508:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20005 00000100:00100000:0.0:1746147212.336952:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147212.337064:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310397184 00000100:00100000:1.0:1746147212.337074:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310397184 00010000:00010000:1.0:1746147212.337150:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 28 pid: 1853 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746147212.337180:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9079 00000100:00100000:1.0:1746147212.337188:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967310397184:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147212.337203:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147212.337223:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 28 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746147212.337236:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 28 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746147212.337258:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098226400/0x3139939425062d9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2469888->3112959) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f07e expref: 28 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746147212.337381:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147212.337383:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147212.337391:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098227e00/0x3139939425062da3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f085 expref: 8 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.337400:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098227e00/0x3139939425062da3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f085 expref: 8 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.337408:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147212.337409:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147212.337412:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425062dcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3997696->18446744073709551615] (req 3997696->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f093 expref: 8 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.337418:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425062dcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3997696->18446744073709551615] (req 3997696->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f093 expref: 8 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.337446:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425062dcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3997696->18446744073709551615] (req 3997696->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f093 expref: 8 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147212.337457:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311486976:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147212.338710:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098227e00/0x3139939425062da3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f085 expref: 8 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147212.338723:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311487104:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147212.339296:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147212.347265:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.347298:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.347455:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310397696 00000100:00100000:2.0:1746147212.347464:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310397696 00000100:00100000:2.0:1746147212.347513:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20006 00000100:00100000:2.0:1746147212.347522:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2899:x1830967310397696:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147212.347543:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147212.347562:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x3139939425062ddb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f0a1 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147212.347571:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311486976:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147212.347581:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311487104:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147212.347587:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.347589:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.347596:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x3139939425062ddb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a1 expref: 29 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.347601:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147212.347615:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x3139939425062ddb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a1 expref: 29 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.347632:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098226a00, rc 0) 00000100:00100000:2.0:1746147212.347654:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2899:x1830967310397696:12345-192.168.204.25@tcp:101:cat.0 Request processed in 133us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147212.347655:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967310397184:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 10468us (10713us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147212.347660:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20006 00000100:00100000:1.0:1746147212.347664:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9079 00000100:00100000:3.0:1746147212.347736:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310397568 00000100:00100000:3.0:1746147212.347740:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310397568 00002000:00100000:3.0:1746147212.347769:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3997696->4001791) req@ffff8800984d5180 x1830967310397568/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147212.347778:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d5180 with x1830967310397568 ext(3997696->4001791) 00002000:00010000:3.0:1746147212.347782:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d5180 00000100:00100000:3.0:1746147212.347797:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7345 00000100:00100000:3.0:1746147212.347803:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310397568:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147212.347914:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310397568:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 111us (660us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147212.347919:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7345 00002000:00100000:3.0:1746147212.347925:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3997696->4001791) req@ffff8800984d5180 x1830967310397568/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/4536 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147212.347932:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d5180 with x1830967310397568 ext(3997696->4001791) 00002000:00010000:3.0:1746147212.347935:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d5180 00000100:00100000:2.0:1746147212.358301:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.358341:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.358445:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.358483:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310397952 00000100:00100000:2.0:1746147212.358492:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310397952 00002000:00100000:2.0:1746147212.358537:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880095148000 x1830967310397952/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.358547:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095148000 with x1830967310397952 ext(2097152->3145727) 00002000:00010000:2.0:1746147212.358553:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095148000 00000100:00100000:2.0:1746147212.358587:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310398208 00000100:00100000:2.0:1746147212.358590:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310398208 00002000:00100000:2.0:1746147212.358602:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880095149180 x1830967310398208/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.358608:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095149180 with x1830967310398208 ext(2097152->3145727) 00002000:00010000:2.0:1746147212.358611:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095149180 00000100:00100000:2.0:1746147212.358636:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7346 00000100:00100000:2.0:1746147212.358644:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310397952:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147212.358684:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7347 00000100:00100000:1.0:1746147212.358693:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310398208:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147212.360823:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310398336 00000100:00100000:0.0:1746147212.360833:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310398336 00000100:00100000:0.0:1746147212.360877:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20007 00000100:00100000:0.0:1746147212.360884:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+28:2893:x1830967310398336:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147212.360899:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147212.360917:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062de2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f0a8 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.360945:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425062d56 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f054 expref: 35 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.360953:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098227c00/0x3139939425062d6b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f069 expref: 29 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.360963:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147212.360965:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147212.360968:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062de2 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->3481599] (req 3145728->3481599) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a8 expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.360997:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098227c00/0x3139939425062d6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f069 expref: 29 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.361009:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098227c00/0x3139939425062d6b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f069 expref: 29 pid: 13712 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746147212.361020:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311487232:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147212.361112:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425062d56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f054 expref: 35 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.361121:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425062d56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f054 expref: 35 pid: 1853 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746147212.361129:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4395180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311487360:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147212.361146:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147212.370438:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311487232:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147212.371077:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147212.372185:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310398464 00000100:00100000:1.0:1746147212.372193:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310398464 00010000:00010000:1.0:1746147212.372234:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425062d56 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f054 expref: 36 pid: 1853 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746147212.372265:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9080 00000100:00100000:1.0:1746147212.372273:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310398464:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147212.372288:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147212.372310:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425062d56 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f054 expref: 36 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746147212.372321:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425062d56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f054 expref: 36 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746147212.372350:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147212.372401:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310398464:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 128us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147212.372408:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9080 00010000:00010000:2.0:1746147212.372508:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092543c00/0x3139939425062d56 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f054 expref: 35 pid: 1853 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746147212.372525:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4395180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311487360:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147212.372556:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062de2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->3481599] (req 3145728->3481599) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a8 expref: 29 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.372566:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092562c00, rc 0) 00000100:00100000:2.0:1746147212.372588:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2893:x1830967310398336:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 11704us (14142us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147212.372594:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20007 00000100:00100000:3.0:1746147212.373490:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310397952:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 14845us (15200us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147212.373500:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7346 00002000:00100000:3.0:1746147212.373508:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880095148000 x1830967310397952/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147212.373517:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095148000 with x1830967310397952 ext(2097152->3145727) 00002000:00010000:3.0:1746147212.373521:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095148000 00000100:00100000:0.0:1746147212.377701:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.378022:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310398592 00000100:00100000:2.0:1746147212.378031:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310398592 00010000:00010000:2.0:1746147212.378068:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098227c00/0x3139939425062d6b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f069 expref: 29 pid: 13712 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746147212.378145:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9081 00000100:00100000:2.0:1746147212.378154:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2003:x1830967310398592:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147212.378167:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147212.378190:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098227c00/0x3139939425062d6b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f069 expref: 29 pid: 13712 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.378203:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098227c00/0x3139939425062d6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f069 expref: 29 pid: 13712 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.378232:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098227c00/0x3139939425062d6b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f069 expref: 29 pid: 13712 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.378248:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.378250:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.378257:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062de2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a8 expref: 28 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.378265:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062de2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a8 expref: 28 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.378296:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062de2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a8 expref: 28 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147212.378309:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311487488:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147212.378354:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310398208:12345-192.168.204.25@tcp:3:cat.0 Request processed in 19660us (20010us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147212.378365:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7347 00000100:00100000:2.0:1746147212.378366:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8f00 going to sleep for 11 seconds 00002000:00100000:1.0:1746147212.378376:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880095149180 x1830967310398208/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147212.378385:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095149180 with x1830967310398208 ext(2097152->3145727) 00002000:00010000:1.0:1746147212.378390:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095149180 00000100:00100000:2.0:1746147212.379275:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.379550:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310398720 00000100:00100000:3.0:1746147212.379556:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310398720 00000100:00100000:3.0:1746147212.379588:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20008 00000100:00100000:3.0:1746147212.379595:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2896:x1830967310398720:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147212.379608:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147212.379631:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4200/0x3139939425062de9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f0af expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.379651:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147212.379653:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147212.379659:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4200/0x3139939425062de9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0af expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.379670:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4200/0x3139939425062de9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0af expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.379678:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49c4200, rc 0) 00000100:00100000:3.0:1746147212.379705:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2896:x1830967310398720:12345-192.168.204.25@tcp:101:cat.0 Request processed in 110us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.379711:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20008 00000100:00100000:0.0:1746147212.392973:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.393014:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.393057:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.393126:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310399104 00000100:00100000:0.0:1746147212.393135:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310399104 00002000:00100000:0.0:1746147212.393183:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3145727) req@ffff8800a4397480 x1830967310399104/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147212.393194:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4397480 with x1830967310399104 ext(2097152->3145727) 00002000:00010000:0.0:1746147212.393199:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4397480 00000100:00100000:0.0:1746147212.393221:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310399360 00000100:00100000:0.0:1746147212.393224:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310399360 00002000:00100000:0.0:1746147212.393233:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x98:0x0] (3477504->3481599) req@ffff8800a4395c00 x1830967310399360/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147212.393240:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395c00 with x1830967310399360 ext(3477504->3481599) 00002000:00010000:0.0:1746147212.393244:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4395c00 00000100:00100000:0.0:1746147212.393256:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7348 00000100:00100000:0.0:1746147212.393263:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2001:x1830967310399104:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147212.394024:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7349 00000100:00100000:0.0:1746147212.394031:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2002:x1830967310399360:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147212.394118:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2002:x1830967310399360:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 87us (1059us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147212.394124:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7349 00002000:00100000:0.0:1746147212.394130:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (3477504->3481599) req@ffff8800a4395c00 x1830967310399360/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/4536 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147212.394136:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395c00 with x1830967310399360 ext(3477504->3481599) 00002000:00010000:0.0:1746147212.394138:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4395c00 00000100:00100000:3.0:1746147212.394309:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310398976 00000100:00100000:3.0:1746147212.394315:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310398976 00000100:00100000:3.0:1746147212.394342:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20009 00000100:00100000:3.0:1746147212.394347:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2899:x1830967310398976:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147212.394357:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147212.394381:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425062df0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f0b6 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.394412:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425062dcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3997696->18446744073709551615] (req 3997696->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f093 expref: 8 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.394420:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147212.394422:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147212.394425:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425062df0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0b6 expref: 29 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.394453:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425062dcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3997696->18446744073709551615] (req 3997696->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f093 expref: 8 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.394463:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425062dcd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3997696->18446744073709551615] (req 3997696->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f093 expref: 8 pid: 1853 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746147212.394474:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311487616:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147212.394541:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147212.396462:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311487488:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147212.396489:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147212.396537:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2003:x1830967310398592:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 18382us (18843us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147212.396547:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9081 00000100:00100000:3.0:1746147212.399874:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311487616:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147212.399903:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425062df0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0b6 expref: 29 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.399925:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49c5200, rc 0) 00000100:00100000:3.0:1746147212.399972:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2899:x1830967310398976:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5624us (7010us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.399980:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20009 00000100:00100000:0.0:1746147212.404249:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.406854:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310399104:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 13580us (13827us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147212.406868:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7348 00002000:00100000:0.0:1746147212.406881:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3145727) req@ffff8800a4397480 x1830967310399104/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147212.406890:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4397480 with x1830967310399104 ext(2097152->3145727) 00002000:00010000:0.0:1746147212.406896:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4397480 00000100:00100000:0.0:1746147212.406920:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310399488 00000100:00100000:0.0:1746147212.406927:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310399488 00002000:00100000:0.0:1746147212.406959:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3997696->4194303) req@ffff8800a4396680 x1830967310399488/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147212.406965:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4396680 with x1830967310399488 ext(3997696->4194303) 00010000:00010000:0.0:1746147212.406973:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425062dcd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3997696->18446744073709551615] (req 3997696->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f093 expref: 9 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746147212.406989:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425062dcd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3997696->18446744073709551615] (req 3997696->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f093 expref: 9 pid: 1853 timeout: 850 lvb_type: 0 00002000:00010000:0.0:1746147212.407002:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4396680 00000100:00100000:0.0:1746147212.407019:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1733 00000100:00100000:0.0:1746147212.407025:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310399488:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147212.418576:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.418651:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310399616 00000100:00100000:3.0:1746147212.418660:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310399616 00000100:00100000:3.0:1746147212.418701:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20010 00000100:00100000:3.0:1746147212.418709:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2896:x1830967310399616:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147212.418723:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147212.418741:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x3139939425062df7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f0bd expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.418768:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147212.418773:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x3139939425062df7 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0bd expref: 14 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.418785:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x3139939425062df7 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0bd expref: 14 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.418794:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095052400, rc 0) 00000100:00100000:3.0:1746147212.418849:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2896:x1830967310399616:12345-192.168.204.25@tcp:101:cat.0 Request processed in 141us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.418855:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20010 00000100:00100000:0.0:1746147212.419372:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310399488:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 12345us (15133us total) trans 21474842654 rc 0/0 00000100:00100000:0.0:1746147212.419381:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1733 00002000:00100000:0.0:1746147212.419390:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3997696->4194303) req@ffff8800a4396680 x1830967310399488/t21474842654(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/448 e 0 to 0 dl 1746147223 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147212.419398:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4396680 with x1830967310399488 ext(3997696->4194303) 00010000:00010000:0.0:1746147212.419403:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425062dcd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [3997696->18446744073709551615] (req 3997696->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f093 expref: 12 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746147212.419415:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425062dcd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [3997696->18446744073709551615] (req 3997696->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f093 expref: 12 pid: 1853 timeout: 850 lvb_type: 0 00002000:00010000:0.0:1746147212.419421:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4396680 00000100:00100000:0.0:1746147212.423592:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.423697:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310399744 00000100:00100000:2.0:1746147212.423705:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310399744 00010000:00010000:2.0:1746147212.423742:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425062dcd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [3997696->18446744073709551615] (req 3997696->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f093 expref: 12 pid: 1853 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746147212.423768:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9082 00000100:00100000:2.0:1746147212.423774:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967310399744:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147212.423787:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147212.423802:0:4349:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147211 -> 1746147212 00010000:00010000:2.0:1746147212.423808:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425062dcd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [3997696->18446744073709551615] (req 3997696->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f093 expref: 12 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.423820:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425062dcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [3997696->18446744073709551615] (req 3997696->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f093 expref: 12 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.423843:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092562400/0x3139939425062dcd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [3997696->18446744073709551615] (req 3997696->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f093 expref: 12 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.423873:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.423876:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.423883:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425062df0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0b6 expref: 28 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.423892:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425062df0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0b6 expref: 28 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.423900:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.423901:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.423904:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x3139939425062df7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0bd expref: 11 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.423914:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x3139939425062df7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0bd expref: 11 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.423945:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x3139939425062df7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0bd expref: 11 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147212.423957:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311487744:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147212.424357:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425062df0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0b6 expref: 28 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147212.424366:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311487872:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147212.426236:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147212.429004:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311487744:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147212.429018:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311487872:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147212.431303:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.431412:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147212.431497:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310400000 00000100:00100000:1.0:1746147212.431506:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310400000 00002000:00100000:1.0:1746147212.431555:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800a4395500 x1830967310400000/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147212.431565:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395500 with x1830967310400000 ext(3145728->4194303) 00002000:00010000:1.0:1746147212.431570:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4395500 00000100:00100000:1.0:1746147212.431588:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310400256 00000100:00100000:1.0:1746147212.431590:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310400256 00002000:00100000:1.0:1746147212.431603:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x98:0x0] (3481600->4194303) req@ffff8800a4394000 x1830967310400256/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147212.431610:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4394000 with x1830967310400256 ext(3481600->4194303) 00002000:00010000:1.0:1746147212.431613:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4394000 00000100:00100000:1.0:1746147212.431635:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7350 00000100:00100000:1.0:1746147212.431642:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310400000:12345-192.168.204.25@tcp:3:multiop.0 00010000:00010000:2.0:1746147212.432458:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147212.432521:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7351 00000100:00100000:0.0:1746147212.432528:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310400256:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147212.435070:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310399744:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 11284us (11476us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147212.435082:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9082 00000100:00100000:3.0:1746147212.437213:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.437763:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310400512 00000100:00100000:3.0:1746147212.437774:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310400512 00002000:00100000:3.0:1746147212.437820:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880098c70000 x1830967310400512/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147212.437830:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c70000 with x1830967310400512 ext(3145728->4194303) 00002000:00010000:3.0:1746147212.437836:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098c70000 00000100:00100000:3.0:1746147212.437859:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7352 00000100:00100000:3.0:1746147212.437867:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310400512:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147212.440703:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.441170:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310400768 00000100:00100000:3.0:1746147212.441179:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310400768 00000100:00100000:3.0:1746147212.441224:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16475 00000100:00100000:3.0:1746147212.441232:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2904:x1830967310400768:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147212.441256:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147212.441274:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f600/0x3139939425062dfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f0c4 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.441348:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x3139939425062e05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.441361:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x3139939425062e05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.441371:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x3139939425062e05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.441381:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e400/0x3139939425062e0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.441386:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e400/0x3139939425062e0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.441396:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e400/0x3139939425062e0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.441491:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fc00/0x3139939425062e13 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.441501:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fc00/0x3139939425062e13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.441507:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fc00/0x3139939425062e13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147212.441517:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147212.441590:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x3139939425062e05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.441597:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x3139939425062e05 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.441602:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x3139939425062e05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.441608:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a1e800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147212.441612:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x3139939425062e05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.441619:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x3139939425062e05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.441643:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147212.441645:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147212.441649:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x3139939425062e05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.441657:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e800/0x3139939425062e05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.445547:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e400/0x3139939425062e0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.445567:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e400/0x3139939425062e0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.445576:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e400/0x3139939425062e0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.445582:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a1e400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147212.445586:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e400/0x3139939425062e0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.445594:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e400/0x3139939425062e0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.445612:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098239e00) 00010000:00010000:3.0:1746147212.445614:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147212.445618:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e400/0x3139939425062e0c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.445631:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1e400/0x3139939425062e0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.445711:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1f600/0x3139939425062dfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0c4 expref: 41 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.445724:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fc00/0x3139939425062e13 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0c4 expref: 40 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.445735:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147212.445737:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147212.445739:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a1fc00, rc 0) 00000100:00100000:3.0:1746147212.445799:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2904:x1830967310400768:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4566us (5105us total) trans 8589937378 rc 0/0 00000100:00100000:3.0:1746147212.445808:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16475 00000100:00100000:2.0:1746147212.446252:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310400000:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 14609us (14957us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147212.446262:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7350 00002000:00100000:2.0:1746147212.446270:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800a4395500 x1830967310400000/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.446285:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395500 with x1830967310400000 ext(3145728->4194303) 00002000:00010000:2.0:1746147212.446290:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4395500 00000100:00100000:1.0:1746147212.453584:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2001:x1830967310400256:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 21043us (22157us total) trans 0 rc 712704/712704 00000100:00100000:1.0:1746147212.453600:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7351 00002000:00100000:1.0:1746147212.453612:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (3481600->4194303) req@ffff8800a4394000 x1830967310400256/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 712704/712704 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147212.453630:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4394000 with x1830967310400256 ext(3481600->4194303) 00002000:00010000:1.0:1746147212.453637:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4394000 00000100:00100000:2.0:1746147212.459515:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310400512:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21635us (22298us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147212.459530:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7352 00002000:00100000:2.0:1746147212.459544:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880098c70000 x1830967310400512/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.459554:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c70000 with x1830967310400512 ext(3145728->4194303) 00002000:00010000:2.0:1746147212.459561:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098c70000 00000100:00100000:0.0:1746147212.462193:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.462237:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.462282:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.462395:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310401024 00000100:00100000:2.0:1746147212.462405:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310401024 00000100:00100000:2.0:1746147212.462453:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6161 00000100:00100000:2.0:1746147212.462460:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2904:x1830967310401024:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147212.462686:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2904:x1830967310401024:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 225us (503us total) trans 8589937379 rc 0/0 00000100:00100000:2.0:1746147212.462693:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6161 00000100:00100000:3.0:1746147212.462774:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310401152 00000100:00100000:3.0:1746147212.462778:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310401152 00000100:00100000:3.0:1746147212.462807:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 998 00000100:00100000:3.0:1746147212.462813:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+41:2000:x1830967310401152:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147212.462823:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147212.462848:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a1fc00/0x3139939425062e13 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0c4 expref: 41 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.462866:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147212.462870:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147212.462887:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967310401152:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 74us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.462892:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 998 00000100:00100000:1.0:1746147212.463348:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310401280 00000100:00100000:1.0:1746147212.463352:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310401280 00000100:00100000:1.0:1746147212.463384:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20011 00000100:00100000:1.0:1746147212.463389:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2000:x1830967310401280:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147212.463399:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147212.463413:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f03c200/0x3139939425062e21 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f0cb expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147212.463456:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311488000:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147212.465834:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147212.467219:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.467315:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310401408 00000100:00100000:3.0:1746147212.467324:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310401408 00000100:00100000:3.0:1746147212.467378:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20012 00000100:00100000:3.0:1746147212.467386:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2899:x1830967310401408:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147212.467404:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147212.467425:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a1f200/0x3139939425062e28 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f0d2 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.467455:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062de2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a8 expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.467463:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147212.467464:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147212.467468:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a1f200/0x3139939425062e28 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d2 expref: 36 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.467497:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062de2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a8 expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.467508:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062de2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a8 expref: 30 pid: 1853 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746147212.467520:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311488128:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147212.468041:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20840 going to sleep for 11 seconds 00002000:00010000:0.0:1746147212.468934:0:1853:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime: 1746147211 -> 1746147212 00002000:00010000:0.0:1746147212.468938:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime: 1746147211 -> 1746147212 00002000:00010000:0.0:1746147212.468941:0:1853:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime: 1746147211 -> 1746147212 00000100:00100000:0.0:1746147212.468962:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311488000:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147212.468990:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f03c200/0x3139939425062e21 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0cb expref: 30 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147212.469003:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f03c200/0x3139939425062e21 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0cb expref: 30 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147212.469590:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147212.469605:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03c200, rc 0) 00000100:00100000:1.0:1746147212.469665:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310401536 00000100:00100000:0.0:1746147212.469703:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2000:x1830967310401280:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6312us (7419us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147212.469722:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310401536 00000100:00100000:1.0:1746147212.469767:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20013 00000100:00100000:1.0:1746147212.469774:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2904:x1830967310401536:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147212.469788:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147212.469802:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062e2f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f0d9 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.469823:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425062bc0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef5f expref: 30 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.469832:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4400/0x3139939425062c30 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efba expref: 13 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147212.469844:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062be3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef82 expref: 10 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.469850:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147212.469852:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147212.469855:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062e2f lrc: 6/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1933312->1994751] (req 1933312->1994751) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d9 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.469879:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062be3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef82 expref: 10 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.469889:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062be3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef82 expref: 10 pid: 1136 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746147212.469901:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311488256:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147212.469947:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ff4400/0x3139939425062c30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efba expref: 13 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147212.469956:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ff4400/0x3139939425062c30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efba expref: 13 pid: 12201 timeout: 850 lvb_type: 1 00000100:00100000:1.0:1746147212.469964:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311488384:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147212.469991:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425062bc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef5f expref: 30 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.470003:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425062bc0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef5f expref: 30 pid: 12201 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746147212.470012:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311488512:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147212.470029:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147212.470072:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20011 00000100:00100000:3.0:1746147212.472136:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311488128:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147212.472162:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a1f200/0x3139939425062e28 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d2 expref: 36 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.472177:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a1f200, rc 0) 00000100:00100000:3.0:1746147212.472220:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2899:x1830967310401408:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4835us (5010us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.472228:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20012 00000100:00100000:0.0:1746147212.476745:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.477206:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.477333:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310401792 00000100:00100000:2.0:1746147212.477341:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310401792 00010000:00010000:2.0:1746147212.477401:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ff4400/0x3139939425062c30 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efba expref: 14 pid: 12201 timeout: 850 lvb_type: 1 00000100:00100000:1.0:1746147212.477465:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311488256:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147212.477479:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311488384:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147212.477488:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311488512:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147212.477519:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062e2f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1933312->1994751] (req 1933312->1994751) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d9 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.477536:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03d200, rc 0) 00000100:00100000:1.0:1746147212.477583:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2904:x1830967310401536:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7810us (7995us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147212.477592:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20013 00000100:00080000:0.0:1746147212.477753:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147212.477778:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.478048:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310401664 00000100:00100000:3.0:1746147212.478053:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310401664 00002000:00100000:3.0:1746147212.478086:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->3481599) req@ffff8800a4395180 x1830967310401664/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147212.478115:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395180 with x1830967310401664 ext(3145728->3481599) 00010000:00010000:3.0:1746147212.478122:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062de2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a8 expref: 29 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147212.478133:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062de2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a8 expref: 29 pid: 1853 timeout: 850 lvb_type: 0 00002000:00010000:3.0:1746147212.478139:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4395180 00000100:00100000:3.0:1746147212.478154:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1734 00000100:00100000:3.0:1746147212.478160:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+29:2000:x1830967310401664:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147212.478518:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.478549:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.478565:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310401920 00000100:00100000:2.0:1746147212.478568:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310401920 00010000:00010000:2.0:1746147212.478584:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062be3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef82 expref: 11 pid: 1136 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746147212.478601:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9083 00000100:00100000:2.0:1746147212.478607:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967310401792:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147212.478616:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147212.478640:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ff4400/0x3139939425062c30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efba expref: 14 pid: 12201 timeout: 850 lvb_type: 1 00010000:00010000:2.0:1746147212.478649:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ff4400/0x3139939425062c30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efba expref: 14 pid: 12201 timeout: 850 lvb_type: 1 00010000:00010000:2.0:1746147212.478670:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ff4400/0x3139939425062c30 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efba expref: 14 pid: 12201 timeout: 850 lvb_type: 1 00010000:00010000:2.0:1746147212.478690:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147212.478710:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2003:x1830967310401792:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 103us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147212.478716:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9083 00000100:00100000:2.0:1746147212.478727:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9084 00000100:00100000:2.0:1746147212.478732:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2000:x1830967310401920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147212.478740:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147212.478746:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062be3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef82 expref: 11 pid: 1136 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.478753:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062be3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef82 expref: 11 pid: 1136 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.478764:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e3ee00/0x3139939425062be3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef82 expref: 11 pid: 1136 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.478771:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147212.478785:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310401920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 53us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147212.478789:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9084 00000100:00100000:2.0:1746147212.478832:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310402176 00000100:00100000:2.0:1746147212.478834:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310402176 00002000:00100000:2.0:1746147212.478847:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880094184380 x1830967310402176/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.478854:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094184380 with x1830967310402176 ext(4194304->4890623) 00002000:00010000:2.0:1746147212.478858:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094184380 00000100:00100000:2.0:1746147212.478872:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7353 00000100:00100000:2.0:1746147212.478877:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310402176:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147212.483294:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310402304 00000100:00100000:2.0:1746147212.483308:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310402304 00010000:00010000:2.0:1746147212.483347:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425062bc0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef5f expref: 30 pid: 12201 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746147212.483385:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9085 00000100:00100000:2.0:1746147212.483392:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967310402304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147212.483406:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147212.483425:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425062bc0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef5f expref: 30 pid: 12201 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.483436:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425062bc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef5f expref: 30 pid: 12201 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.483458:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0ae800/0x3139939425062bc0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef5f expref: 30 pid: 12201 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.483479:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.483481:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.483488:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062e2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->1994751) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d9 expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.483495:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062e2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->1994751) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d9 expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.483525:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062e2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->1994751) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d9 expref: 29 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147212.483538:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311488640:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147212.483631:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147212.486291:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2000:x1830967310401664:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 8119us (9075us total) trans 17179875269 rc 0/0 00000100:00100000:0.0:1746147212.486306:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1734 00002000:00100000:0.0:1746147212.486320:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->3481599) req@ffff8800a4395180 x1830967310401664/t17179875269(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/448 e 0 to 0 dl 1746147223 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147212.486330:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4395180 with x1830967310401664 ext(3145728->3481599) 00010000:00010000:0.0:1746147212.486339:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062de2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a8 expref: 31 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746147212.486355:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062de2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a8 expref: 31 pid: 1853 timeout: 850 lvb_type: 0 00002000:00010000:0.0:1746147212.486363:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4395180 00000100:00100000:3.0:1746147212.486851:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311488640:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147212.486872:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147212.486905:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967310402304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3513us (8354us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.486913:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9085 00000100:00100000:3.0:1746147212.487279:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.487353:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310402176:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8474us (8833us total) trans 0 rc 696320/696320 00000100:00100000:2.0:1746147212.487361:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7353 00002000:00100000:2.0:1746147212.487368:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880094184380 x1830967310402176/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.487375:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094184380 with x1830967310402176 ext(4194304->4890623) 00002000:00010000:2.0:1746147212.487379:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094184380 00000100:00100000:2.0:1746147212.487392:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310402560 00000100:00100000:2.0:1746147212.487398:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310402560 00002000:00100000:2.0:1746147212.487423:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1933312->1937407) req@ffff880098c72680 x1830967310402560/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.487430:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c72680 with x1830967310402560 ext(1933312->1937407) 00002000:00010000:2.0:1746147212.487433:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098c72680 00000100:00100000:2.0:1746147212.487448:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7354 00000100:00100000:2.0:1746147212.487455:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310402560:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147212.487552:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310402560:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 98us (274us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147212.487563:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7354 00002000:00100000:2.0:1746147212.487568:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1933312->1937407) req@ffff880098c72680 x1830967310402560/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/4536 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.487574:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c72680 with x1830967310402560 ext(1933312->1937407) 00002000:00010000:2.0:1746147212.487577:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098c72680 00000100:00100000:0.0:1746147212.490658:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.490685:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.490739:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147212.490761:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310402816 00000100:00100000:1.0:1746147212.490770:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310402816 00000100:00100000:0.0:1746147212.490807:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147212.490813:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310402688 00000100:00100000:1.0:1746147212.490815:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310402688 00000100:00100000:1.0:1746147212.490842:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20014 00000100:00100000:0.0:1746147212.490849:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20015 00000100:00100000:1.0:1746147212.490854:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2002:x1830967310402816:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147212.490858:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310403200 00000100:00100000:0.0:1746147212.490859:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2002:x1830967310402688:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147212.490862:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310403200 00010000:00010000:1.0:1746147212.490871:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147212.490871:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147212.490880:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062de2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a8 expref: 32 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746147212.490885:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f03dc00/0x3139939425062e3d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f0e7 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.490885:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a20c00/0x3139939425062e36 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f0e0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147212.490901:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9086 00000100:00100000:2.0:1746147212.490905:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2001:x1830967310403200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147212.490913:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147212.490928:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311488768:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147212.490928:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094184700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311488896:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147212.490931:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062de2 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a8 expref: 33 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.490943:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062de2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a8 expref: 33 pid: 1853 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746147212.490987:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310403072 00000100:00100000:1.0:1746147212.490990:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310403072 00000100:00100000:0.0:1746147212.490993:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489b40 going to sleep for 11 seconds 00002000:00100000:1.0:1746147212.491024:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1990656->1994751) req@ffff880094184a80 x1830967310403072/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147212.491037:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094184a80 with x1830967310403072 ext(1990656->1994751) 00002000:00010000:1.0:1746147212.491041:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094184a80 00010000:00010000:2.0:1746147212.491118:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.491120:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.491129:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a1f200/0x3139939425062e28 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d2 expref: 35 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.491139:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a1f200/0x3139939425062e28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d2 expref: 35 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.491163:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a1f200/0x3139939425062e28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d2 expref: 35 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147212.491172:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311489024:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147212.491214:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147212.491218:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7355 00000100:00100000:0.0:1746147212.491225:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967310403072:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147212.491352:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967310403072:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 127us (611us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147212.491358:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7355 00002000:00100000:0.0:1746147212.491364:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1990656->1994751) req@ffff880094184a80 x1830967310403072/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/4536 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147212.491371:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094184a80 with x1830967310403072 ext(1990656->1994751) 00002000:00010000:0.0:1746147212.491374:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094184a80 00000100:00100000:1.0:1746147212.491727:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc480 going to sleep for 11 seconds 00010000:00010000:1.0:1746147212.494573:0:1136:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff88009258f100 x1830967311488768) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062de2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a8 expref: 33 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746147212.494609:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092562c00/0x3139939425062de2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3481599) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a8 expref: 33 pid: 1853 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746147212.494636:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311488768:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147212.494667:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f03dc00/0x3139939425062e3d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0e7 expref: 32 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147212.494680:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f03dc00/0x3139939425062e3d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0e7 expref: 32 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147212.494687:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03dc00, rc 0) 00000100:00100000:1.0:1746147212.494727:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2002:x1830967310402816:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3874us (4076us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147212.494739:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20014 00000100:00100000:3.0:1746147212.494828:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311489024:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147212.494840:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147212.494857:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2001:x1830967310403200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3951us (4049us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.494865:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9086 00002000:00010000:2.0:1746147212.495022:0:1853:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746147210 -> 1746147212 00002000:00010000:2.0:1746147212.495026:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746147210 -> 1746147212 00002000:00010000:2.0:1746147212.495028:0:1853:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746147211 -> 1746147212 00000100:00100000:2.0:1746147212.495040:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094184700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311488896:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147212.495059:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a20c00/0x3139939425062e36 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0e0 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147212.495067:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a20c00/0x3139939425062e36 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0e0 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147212.495083:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a20c00, rc 0) 00000100:00100000:2.0:1746147212.495137:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2002:x1830967310402688:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4282us (4449us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147212.495142:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20015 00000100:00100000:0.0:1746147212.495541:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147212.495720:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310403456 00000100:00100000:1.0:1746147212.495727:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310403456 00002000:00100000:1.0:1746147212.495757:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff880094186d80 x1830967310403456/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147212.495767:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094186d80 with x1830967310403456 ext(3145728->4194303) 00002000:00010000:1.0:1746147212.495771:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094186d80 00000100:00100000:1.0:1746147212.495785:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7356 00000100:00100000:1.0:1746147212.495790:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310403456:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147212.502034:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.503426:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.503445:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310403584 00000100:00100000:2.0:1746147212.503457:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310403584 00000100:00100000:2.0:1746147212.503514:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20016 00000100:00100000:2.0:1746147212.503524:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2003:x1830967310403584:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147212.503583:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147212.503603:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425062e44 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f0ee expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147212.503671:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311489152:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147212.503696:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310403712 00000100:00100000:1.0:1746147212.503700:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310403712 00000100:00100000:1.0:1746147212.503720:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20017 00000100:00100000:1.0:1746147212.503726:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+30:2003:x1830967310403712:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147212.503733:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147212.503740:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8900 going to sleep for 11 seconds 00010000:00010000:1.0:1746147212.505847:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425062e4b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f0f5 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.505869:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147212.505871:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147212.505881:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425062e4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0f5 expref: 31 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147212.505897:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425062e4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0f5 expref: 31 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147212.505907:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2a600, rc 0) 00000100:00100000:1.0:1746147212.506741:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2003:x1830967310403712:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3012us (3316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147212.506750:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20017 00000100:00100000:2.0:1746147212.506976:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311489152:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147212.507002:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425062e44 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0ee expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147212.507013:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425062e44 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0ee expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147212.507022:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1200, rc 0) 00000100:00100000:1.0:1746147212.507050:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310403456:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 11259us (11510us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147212.507054:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2003:x1830967310403584:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3533us (5031us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147212.507058:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7356 00000100:00100000:2.0:1746147212.507062:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20016 00002000:00100000:1.0:1746147212.507066:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff880094186d80 x1830967310403456/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147212.507076:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094186d80 with x1830967310403456 ext(3145728->4194303) 00002000:00010000:1.0:1746147212.507080:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094186d80 00000100:00100000:2.0:1746147212.515071:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147212.515265:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310403968 00000100:00100000:1.0:1746147212.515275:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310403968 00002000:00100000:1.0:1746147212.515324:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880095148380 x1830967310403968/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147212.515334:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095148380 with x1830967310403968 ext(4194304->4890623) 00002000:00010000:1.0:1746147212.515339:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095148380 00000100:00100000:1.0:1746147212.515372:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7357 00000100:00100000:1.0:1746147212.515380:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310403968:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147212.525045:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310403968:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 9654us (9971us total) trans 0 rc 696320/696320 00000100:00100000:1.0:1746147212.525058:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7357 00002000:00100000:1.0:1746147212.525072:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880095148380 x1830967310403968/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 696320/696320 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147212.525081:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095148380 with x1830967310403968 ext(4194304->4890623) 00002000:00010000:1.0:1746147212.525118:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095148380 00000100:00100000:0.0:1746147212.568745:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.568817:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310404096 00000100:00100000:2.0:1746147212.568826:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310404096 00000100:00100000:2.0:1746147212.568885:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20018 00000100:00100000:2.0:1746147212.568894:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2908:x1830967310404096:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147212.568913:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147212.568932:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425062e52 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f0fc expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.568962:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f966000/0x3139939425062bab lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef4a expref: 35 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.568971:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x3139939425062c29 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efb3 expref: 16 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147212.568978:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0afa00/0x3139939425062bc7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef66 expref: 32 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.568984:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.568985:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.568988:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425062e52 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [2043904->2097151] (req 2043904->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0fc expref: 32 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.569019:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f0afa00/0x3139939425062bc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef66 expref: 32 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.569036:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f0afa00/0x3139939425062bc7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef66 expref: 32 pid: 12201 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746147212.569049:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311489280:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147212.569184:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x3139939425062c29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efb3 expref: 16 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147212.569192:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x3139939425062c29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efb3 expref: 16 pid: 1854 timeout: 850 lvb_type: 1 00000100:00100000:2.0:1746147212.569200:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311489408:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147212.569226:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f966000/0x3139939425062bab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef4a expref: 35 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.569234:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f966000/0x3139939425062bab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef4a expref: 35 pid: 1136 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746147212.569241:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311489536:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147212.569257:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147212.573281:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.573770:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310404224 00000100:00100000:3.0:1746147212.573779:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310404224 00010000:00010000:3.0:1746147212.573827:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x3139939425062c29 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efb3 expref: 17 pid: 1854 timeout: 850 lvb_type: 1 00000100:00100000:3.0:1746147212.573858:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9087 00000100:00100000:3.0:1746147212.573865:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967310404224:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147212.573879:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147212.573900:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x3139939425062c29 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efb3 expref: 17 pid: 1854 timeout: 850 lvb_type: 1 00010000:00010000:3.0:1746147212.573911:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x3139939425062c29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efb3 expref: 17 pid: 1854 timeout: 850 lvb_type: 1 00010000:00010000:3.0:1746147212.573937:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147212.573992:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967310404224:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 127us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.573998:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9087 00000100:00080000:0.0:1746147212.574298:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147212.574702:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147212.574869:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.575026:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310404352 00000100:00100000:3.0:1746147212.575030:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310404352 00010000:00010000:3.0:1746147212.575048:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0afa00/0x3139939425062bc7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef66 expref: 33 pid: 12201 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746147212.575067:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310404480 00000100:00100000:3.0:1746147212.575069:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310404480 00010000:00010000:3.0:1746147212.575078:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f966000/0x3139939425062bab lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef4a expref: 36 pid: 1136 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746147212.575124:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9088 00000100:00100000:3.0:1746147212.575131:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2001:x1830967310404352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147212.575138:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147212.575151:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f0afa00/0x3139939425062bc7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef66 expref: 33 pid: 12201 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147212.575160:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f0afa00/0x3139939425062bc7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef66 expref: 33 pid: 12201 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147212.575174:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147212.575201:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2001:x1830967310404352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 72us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.575207:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9088 00000100:00100000:3.0:1746147212.575219:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9089 00000100:00100000:3.0:1746147212.575223:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310404480:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147212.575229:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147212.575235:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f966000/0x3139939425062bab lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef4a expref: 36 pid: 1136 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147212.575244:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f966000/0x3139939425062bab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef4a expref: 36 pid: 1136 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147212.575255:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147212.575257:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147212.575264:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425062e52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0fc expref: 32 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.575272:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425062e52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0fc expref: 32 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.575302:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425062e52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0fc expref: 32 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147212.575313:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311489664:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147212.575367:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20840 going to sleep for 11 seconds 00010000:00010000:2.0:1746147212.577614:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0afa00/0x3139939425062bc7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef66 expref: 32 pid: 12201 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746147212.577663:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311489280:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147212.577682:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x3139939425062c29 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efb3 expref: 16 pid: 1854 timeout: 850 lvb_type: 1 00000100:00100000:2.0:1746147212.577691:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311489408:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147212.577702:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f966000/0x3139939425062bab lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef4a expref: 36 pid: 1136 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746147212.577711:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311489536:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147212.577743:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425062e52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0fc expref: 31 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.577755:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b0a00, rc 0) 00000100:00100000:2.0:1746147212.578048:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2908:x1830967310404096:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 9154us (9312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147212.578057:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20018 00000100:00100000:2.0:1746147212.579343:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311489664:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147212.579355:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147212.579381:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967310404480:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4157us (4512us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147212.579390:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9089 00000100:00100000:0.0:1746147212.582216:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.582386:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310404736 00000100:00100000:2.0:1746147212.582395:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310404736 00002000:00100000:2.0:1746147212.582447:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x97:0x0] (2043904->2047999) req@ffff880094186300 x1830967310404736/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.582456:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094186300 with x1830967310404736 ext(2043904->2047999) 00002000:00010000:2.0:1746147212.582462:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094186300 00000100:00100000:2.0:1746147212.582829:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7358 00000100:00100000:2.0:1746147212.582838:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2000:x1830967310404736:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147212.583206:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2000:x1830967310404736:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 369us (997us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147212.583212:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7358 00002000:00100000:2.0:1746147212.583218:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x97:0x0] (2043904->2047999) req@ffff880094186300 x1830967310404736/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/4536 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.583226:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094186300 with x1830967310404736 ext(2043904->2047999) 00002000:00010000:2.0:1746147212.583229:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094186300 00000100:00100000:0.0:1746147212.586002:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.586123:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310404864 00000100:00100000:2.0:1746147212.586132:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310404864 00000100:00100000:1.0:1746147212.586330:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20019 00000100:00100000:1.0:1746147212.586340:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e218450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2908:x1830967310404864:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147212.586358:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147212.586378:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425062e59 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f103 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.586407:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062e2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->1994751) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d9 expref: 28 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.586415:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147212.586417:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147212.586420:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425062e59 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->1548287] (req 1048576->1548287) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f103 expref: 11 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.586456:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062e2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->1994751) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d9 expref: 28 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.586469:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062e2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->1994751) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d9 expref: 28 pid: 1136 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746147212.586481:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311489792:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147212.586647:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147212.588858:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147212.588968:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311489792:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147212.588997:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425062e59 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->1548287] (req 1048576->1548287) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f103 expref: 11 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147212.589007:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310404992 00000100:00100000:2.0:1746147212.589015:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310404992 00010000:00010000:1.0:1746147212.589016:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2ac00, rc 0) 00002000:00100000:2.0:1746147212.589054:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1933312->1994751) req@ffff880094187100 x1830967310404992/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746147212.589058:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e218450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2908:x1830967310404864:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2719us (3065us total) trans 0 rc 0/0 00002000:00100000:2.0:1746147212.589063:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094187100 with x1830967310404992 ext(1933312->1994751) 00000100:00100000:1.0:1746147212.589067:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20019 00010000:00010000:2.0:1746147212.589070:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062e2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d9 expref: 29 pid: 1136 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.589082:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062e2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d9 expref: 29 pid: 1136 timeout: 850 lvb_type: 0 00002000:00010000:2.0:1746147212.589113:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094187100 00000100:00100000:2.0:1746147212.589134:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1735 00000100:00100000:2.0:1746147212.589140:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310404992:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147212.591505:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967310404992:12345-192.168.204.25@tcp:4:cat.0 Request processed in 2356us (2646us total) trans 21474842655 rc 0/0 00000100:00100000:2.0:1746147212.591518:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1735 00002000:00100000:2.0:1746147212.591530:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1933312->1994751) req@ffff880094187100 x1830967310404992/t21474842655(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/448 e 0 to 0 dl 1746147223 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.591540:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094187100 with x1830967310404992 ext(1933312->1994751) 00010000:00010000:2.0:1746147212.591548:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062e2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d9 expref: 31 pid: 1136 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.591561:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062e2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d9 expref: 31 pid: 1136 timeout: 850 lvb_type: 0 00002000:00010000:2.0:1746147212.591567:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094187100 00000100:00100000:0.0:1746147212.593067:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.593166:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310405120 00000100:00100000:2.0:1746147212.593172:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310405120 00010000:00010000:2.0:1746147212.593203:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062e2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d9 expref: 31 pid: 1136 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746147212.593232:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9090 00000100:00100000:2.0:1746147212.593239:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967310405120:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147212.593252:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147212.593270:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062e2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1933312->1994751) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d9 expref: 31 pid: 1136 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.593285:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062e2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1933312->1994751) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d9 expref: 31 pid: 1136 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.593310:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f03d200/0x3139939425062e2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1933312->1994751) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d9 expref: 31 pid: 1136 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.593335:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.593337:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.593345:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425062e59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f103 expref: 10 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.593352:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425062e59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f103 expref: 10 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.593382:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425062e59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f103 expref: 10 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147212.593393:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311489920:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147212.593458:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147212.595886:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311489920:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147212.595910:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147212.595952:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310405120:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2712us (2890us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147212.595963:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9090 00000100:00100000:0.0:1746147212.601352:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.601919:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310405376 00000100:00100000:2.0:1746147212.601928:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310405376 00002000:00100000:2.0:1746147212.601968:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1544192->1548287) req@ffff880094184000 x1830967310405376/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.601982:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094184000 with x1830967310405376 ext(1544192->1548287) 00002000:00010000:2.0:1746147212.601987:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094184000 00000100:00100000:2.0:1746147212.602018:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7359 00000100:00100000:2.0:1746147212.602025:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310405376:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147212.602269:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310405376:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 243us (923us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147212.602276:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7359 00002000:00100000:2.0:1746147212.602282:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1544192->1548287) req@ffff880094184000 x1830967310405376/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/4536 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.602288:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094184000 with x1830967310405376 ext(1544192->1548287) 00002000:00010000:2.0:1746147212.602291:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094184000 00000100:00100000:0.0:1746147212.622935:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.623148:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310405632 00000100:00100000:3.0:1746147212.623159:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310405632 00000100:00100000:3.0:1746147212.623209:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16476 00000100:00100000:3.0:1746147212.623218:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2911:x1830967310405632:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147212.623244:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147212.623264:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098227c00/0x3139939425062e60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f10a expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.623349:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098226400/0x3139939425062e67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623363:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098226400/0x3139939425062e67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623375:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098226400/0x3139939425062e67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623389:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623394:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623400:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623512:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098227800/0x3139939425062e75 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623523:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098227800/0x3139939425062e75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623529:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098227800/0x3139939425062e75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147212.623536:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147212.623638:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098226400/0x3139939425062e67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623645:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098226400/0x3139939425062e67 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623652:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098226400/0x3139939425062e67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623657:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098226400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147212.623661:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098226400/0x3139939425062e67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623667:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098226400/0x3139939425062e67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623679:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147212.623682:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147212.623686:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098226400/0x3139939425062e67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623691:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098226400/0x3139939425062e67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623722:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623728:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e6e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623732:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623736:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098227400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147212.623738:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623743:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e6e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623748:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098239100) 00010000:00010000:3.0:1746147212.623750:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147212.623752:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e6e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623756:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.623800:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098227c00/0x3139939425062e60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f10a expref: 43 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.623810:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098227800/0x3139939425062e75 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f10a expref: 42 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.623817:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147212.623820:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147212.623822:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098227800, rc 0) 00000100:00100000:3.0:1746147212.623898:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2911:x1830967310405632:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 681us (975us total) trans 8589937380 rc 0/0 00000100:00100000:3.0:1746147212.623905:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16476 00000100:00100000:0.0:1746147212.625362:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.625454:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.625546:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310406016 00000100:00100000:2.0:1746147212.625554:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310406016 00000100:00100000:2.0:1746147212.625599:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6162 00000100:00100000:2.0:1746147212.625606:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2911:x1830967310406016:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147212.625775:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310405760 00000100:00100000:3.0:1746147212.625779:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310405760 00000100:00100000:2.0:1746147212.626485:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2911:x1830967310406016:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 877us (1128us total) trans 8589937381 rc 0/0 00000100:00100000:2.0:1746147212.626495:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6162 00000100:00100000:3.0:1746147212.626704:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 999 00000100:00100000:3.0:1746147212.626710:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ce2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+43:2001:x1830967310405760:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147212.626722:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147212.626749:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098227800/0x3139939425062e75 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f10a expref: 43 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.626767:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147212.626771:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147212.626962:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ce2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2001:x1830967310405760:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 252us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.626968:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 999 00000100:00100000:0.0:1746147212.659613:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.659700:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310406272 00000100:00100000:3.0:1746147212.659710:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310406272 00000100:00100000:3.0:1746147212.659777:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16477 00000100:00100000:3.0:1746147212.659787:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+42:2915:x1830967310406272:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147212.659821:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147212.659842:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098227800/0x3139939425062e83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f111 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.659927:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098227c00/0x3139939425062e8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.659940:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098227c00/0x3139939425062e8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.659949:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098227c00/0x3139939425062e8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.659961:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.659965:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.659970:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.660067:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098226400/0x3139939425062e98 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.660077:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098226400/0x3139939425062e98 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.660083:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098226400/0x3139939425062e98 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147212.660984:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147212.661367:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098227c00/0x3139939425062e8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.661376:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098227c00/0x3139939425062e8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.661381:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098227c00/0x3139939425062e8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.661387:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098227c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147212.661392:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098227c00/0x3139939425062e8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.661398:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098227c00/0x3139939425062e8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.661410:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147212.661413:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147212.662215:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098227c00/0x3139939425062e8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.662225:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098227c00/0x3139939425062e8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.662255:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.662260:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.662265:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.662269:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098227400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147212.662272:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.662276:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.662284:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098239f00) 00010000:00010000:3.0:1746147212.662287:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147212.662289:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.662298:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098227400/0x3139939425062e91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.662349:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098227800/0x3139939425062e83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f111 expref: 45 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.662363:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098226400/0x3139939425062e98 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f111 expref: 44 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.662370:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147212.662372:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147212.662374:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098226400, rc 0) 00000100:00100000:3.0:1746147212.662437:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2915:x1830967310406272:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2651us (2845us total) trans 8589937382 rc 0/0 00000100:00100000:3.0:1746147212.662446:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16477 00000100:00100000:0.0:1746147212.666567:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.666636:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.669056:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310406656 00000100:00100000:2.0:1746147212.669070:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310406656 00000100:00100000:2.0:1746147212.669156:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6163 00000100:00100000:2.0:1746147212.669166:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2915:x1830967310406656:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147212.669416:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2915:x1830967310406656:12345-192.168.204.25@tcp:35:cat.0 Request processed in 251us (2778us total) trans 8589937383 rc 0/0 00000100:00100000:2.0:1746147212.669423:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6163 00000100:00100000:3.0:1746147212.669499:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310406400 00000100:00100000:3.0:1746147212.669504:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310406400 00000100:00100000:3.0:1746147212.669533:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1000 00000100:00100000:3.0:1746147212.669539:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+45:2002:x1830967310406400:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147212.669550:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147212.669577:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098226400/0x3139939425062e98 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f111 expref: 45 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.669590:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147212.669594:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147212.669612:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2002:x1830967310406400:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 73us (3057us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.669648:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1000 00000100:00100000:0.0:1746147212.675766:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.675821:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147212.675854:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310406784 00000100:00100000:1.0:1746147212.675864:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310406784 00000100:00100000:3.0:1746147212.675882:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310406912 00000100:00100000:3.0:1746147212.675887:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310406912 00000100:00100000:1.0:1746147212.675919:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20020 00000100:00100000:1.0:1746147212.675927:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967310406784:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147212.675945:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147212.675963:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2b400/0x3139939425062ea6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f118 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147212.676015:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311490048:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147212.676961:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20021 00000100:00100000:1.0:1746147212.676966:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147212.676969:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967310406912:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147212.676978:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147212.677052:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a56600/0x3139939425062ead lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f11f expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147212.677086:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311490176:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147212.678422:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147212.681715:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311490176:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147212.681752:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a56600/0x3139939425062ead lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f11f expref: 31 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147212.681767:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a56600/0x3139939425062ead lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f11f expref: 31 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147212.681778:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56600, rc 0) 00002000:00010000:1.0:1746147212.681898:0:1136:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime: 1746147211 -> 1746147212 00002000:00010000:1.0:1746147212.681902:0:1136:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime: 1746147210 -> 1746147212 00002000:00010000:1.0:1746147212.681904:0:1136:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime: 1746147211 -> 1746147212 00000100:00100000:1.0:1746147212.681917:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311490048:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147212.681937:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2b400/0x3139939425062ea6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f118 expref: 36 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147212.681945:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2b400/0x3139939425062ea6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f118 expref: 36 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147212.681962:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2b400, rc 0) 00000100:00100000:3.0:1746147212.682107:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967310406912:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5118us (6263us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147212.682117:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20021 00000100:00100000:1.0:1746147212.682185:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967310406784:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6259us (6430us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147212.682191:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20020 00000100:00100000:1.0:1746147212.697885:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.699891:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310407040 00000100:00100000:0.0:1746147212.699907:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310407040 00000100:00100000:0.0:1746147212.699969:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20022 00000100:00100000:0.0:1746147212.699978:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2915:x1830967310407040:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147212.699999:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147212.700018:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x3139939425062eb4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f126 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.700047:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425062e52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0fc expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.700054:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147212.700056:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147212.700059:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x3139939425062eb4 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f126 expref: 36 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.700104:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425062e52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0fc expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.700116:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425062e52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0fc expref: 30 pid: 1853 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746147212.700128:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094186a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311490304:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147212.700528:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147212.701952:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094186a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311490304:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147212.701981:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x3139939425062eb4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f126 expref: 36 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.702000:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03d400, rc 0) 00000100:00100000:1.0:1746147212.702041:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2915:x1830967310407040:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2064us (4166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147212.702049:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20022 00000100:00100000:0.0:1746147212.703713:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.703784:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310407168 00000100:00100000:2.0:1746147212.703791:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310407168 00002000:00100000:2.0:1746147212.703830:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x97:0x0] (2043904->2097151) req@ffff880094185180 x1830967310407168/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.703839:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094185180 with x1830967310407168 ext(2043904->2097151) 00010000:00010000:2.0:1746147212.703847:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425062e52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0fc expref: 31 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.703859:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425062e52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0fc expref: 31 pid: 1853 timeout: 850 lvb_type: 0 00002000:00010000:2.0:1746147212.703866:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094185180 00000100:00100000:2.0:1746147212.703897:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1736 00000100:00100000:2.0:1746147212.703905:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2001:x1830967310407168:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147212.711250:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2001:x1830967310407168:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 7331us (7531us total) trans 17179875270 rc 0/0 00000100:00100000:2.0:1746147212.711264:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1736 00002000:00100000:2.0:1746147212.711277:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x97:0x0] (2043904->2097151) req@ffff880094185180 x1830967310407168/t17179875270(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/448 e 0 to 0 dl 1746147223 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.711287:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094185180 with x1830967310407168 ext(2043904->2097151) 00010000:00010000:2.0:1746147212.711297:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425062e52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0fc expref: 33 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.711319:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425062e52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0fc expref: 33 pid: 1853 timeout: 850 lvb_type: 0 00002000:00010000:2.0:1746147212.711326:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094185180 00000100:00100000:0.0:1746147212.716370:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.716488:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310407296 00000100:00100000:3.0:1746147212.716520:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310407296 00010000:00010000:3.0:1746147212.716560:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425062e52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0fc expref: 33 pid: 1853 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746147212.716601:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9091 00000100:00100000:3.0:1746147212.716609:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2003:x1830967310407296:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147212.716633:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147212.716654:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425062e52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0fc expref: 33 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147212.716667:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425062e52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0fc expref: 33 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147212.716693:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b0a00/0x3139939425062e52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0fc expref: 33 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147212.716724:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147212.716726:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147212.716733:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x3139939425062eb4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f126 expref: 35 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.716741:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x3139939425062eb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f126 expref: 35 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.716772:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x3139939425062eb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f126 expref: 35 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147212.716783:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311490432:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147212.717351:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147212.721666:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.721949:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310407552 00000100:00100000:2.0:1746147212.721959:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310407552 00002000:00100000:2.0:1746147212.722010:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880094186a00 x1830967310407552/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.722020:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094186a00 with x1830967310407552 ext(1048576->2097151) 00002000:00010000:2.0:1746147212.722026:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094186a00 00000100:00100000:3.0:1746147212.722044:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311490432:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147212.722061:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7360 00010000:00010000:3.0:1746147212.722063:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147212.722067:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967310407552:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147212.722130:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2003:x1830967310407296:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5520us (5770us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.722139:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9091 00000100:00100000:0.0:1746147212.731565:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.732408:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310407680 00000100:00100000:3.0:1746147212.732419:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310407680 00000100:00100000:3.0:1746147212.732484:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20023 00000100:00100000:3.0:1746147212.732494:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2911:x1830967310407680:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147212.732516:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147212.732536:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x3139939425062ebb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f12d expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.732568:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a1f200/0x3139939425062e28 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d2 expref: 39 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.732578:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425062e4b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0f5 expref: 31 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147212.732584:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147212.732586:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147212.732590:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x3139939425062ebb lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3350528->4104191] (req 3350528->4104191) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f12d expref: 39 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.732633:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425062e4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0f5 expref: 31 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147212.732646:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425062e4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0f5 expref: 31 pid: 1136 timeout: 850 lvb_type: 1 00000100:00100000:3.0:1746147212.732661:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311490560:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147212.732759:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a1f200/0x3139939425062e28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d2 expref: 39 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.732767:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a1f200/0x3139939425062e28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d2 expref: 39 pid: 13712 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746147212.732775:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311490688:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147212.732795:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147212.737802:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.737857:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310407808 00000100:00100000:0.0:1746147212.737867:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310407808 00010000:00010000:0.0:1746147212.737904:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425062e4b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0f5 expref: 32 pid: 1136 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746147212.737952:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9092 00000100:00100000:0.0:1746147212.737960:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2003:x1830967310407808:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147212.737974:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147212.738003:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425062e4b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0f5 expref: 32 pid: 1136 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746147212.738014:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425062e4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0f5 expref: 32 pid: 1136 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746147212.738041:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147212.738114:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2003:x1830967310407808:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 154us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147212.738121:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9092 00000100:00100000:2.0:1746147212.738276:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967310407552:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16208us (16619us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147212.738284:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7360 00002000:00100000:2.0:1746147212.738293:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880094186a00 x1830967310407552/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.738303:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094186a00 with x1830967310407552 ext(1048576->2097151) 00002000:00010000:2.0:1746147212.738307:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094186a00 00010000:00010000:3.0:1746147212.738592:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2a600/0x3139939425062e4b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0f5 expref: 31 pid: 1136 timeout: 850 lvb_type: 1 00000100:00100000:3.0:1746147212.738627:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311490560:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147212.738640:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311490688:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147212.738664:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x3139939425062ebb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3350528->4104191] (req 3350528->4104191) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f12d expref: 37 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.738675:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56800, rc 0) 00000100:00100000:3.0:1746147212.739016:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2911:x1830967310407680:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6522us (7464us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.739023:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20023 00000100:00100000:0.0:1746147212.749365:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.749766:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.749987:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310407936 00000100:00100000:2.0:1746147212.749997:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310407936 00010000:00010000:2.0:1746147212.750036:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a1f200/0x3139939425062e28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d2 expref: 37 pid: 13712 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746147212.750120:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9093 00000100:00100000:2.0:1746147212.750128:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310407936:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147212.750143:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147212.750165:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a1f200/0x3139939425062e28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d2 expref: 37 pid: 13712 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.750177:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a1f200/0x3139939425062e28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d2 expref: 37 pid: 13712 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746147212.750241:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147212.750299:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310408192 00000100:00100000:1.0:1746147212.750303:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310408192 00000100:00100000:1.0:1746147212.750326:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310408064 00000100:00100000:1.0:1746147212.750328:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310408064 00000100:00100000:1.0:1746147212.750343:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20024 00000100:00100000:1.0:1746147212.750348:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2000:x1830967310408192:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147212.750364:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147212.750377:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x3139939425062ec2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f13b expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147212.750442:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20025 00000100:00100000:0.0:1746147212.750449:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2000:x1830967310408064:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147212.750457:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147212.750841:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x3139939425062ec9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f134 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.750878:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147212.750881:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147212.750888:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x3139939425062ec9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f134 expref: 34 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147212.750901:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x3139939425062ec9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f134 expref: 34 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147212.750911:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a20c00, rc 0) 00000100:00100000:0.0:1746147212.750951:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2000:x1830967310408064:12345-192.168.204.25@tcp:101:cat.0 Request processed in 503us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147212.750956:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20025 00000100:00100000:0.0:1746147212.751040:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.751055:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310408320 00010000:00010000:2.0:1746147212.751201:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a1f200/0x3139939425062e28 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0d2 expref: 37 pid: 13712 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746147212.751329:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147212.751340:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x3139939425062ec2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f13b expref: 33 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147212.751350:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2a800/0x3139939425062ec2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f13b expref: 33 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147212.751444:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.751446:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.751455:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x3139939425062ebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3350528->18446744073709551615] (req 3350528->4104191) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f12d expref: 36 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.751462:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x3139939425062ebb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3350528->18446744073709551615] (req 3350528->4104191) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f12d expref: 36 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.751488:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x3139939425062ebb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3350528->18446744073709551615] (req 3350528->4104191) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f12d expref: 36 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147212.751500:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311490816:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147212.751555:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8240 going to sleep for 11 seconds 00010000:00010000:1.0:1746147212.751556:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2a800, rc 0) 00000100:00100000:3.0:1746147212.751629:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2000:x1830967310408192:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1280us (1863us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147212.751763:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310408320 00000100:00100000:3.0:1746147212.751782:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20024 00000100:00100000:0.0:1746147212.752636:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20026 00000100:00100000:0.0:1746147212.752643:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2915:x1830967310408320:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147212.752653:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147212.752667:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a21400/0x3139939425062ed0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f142 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.752687:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425062e59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f103 expref: 10 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.752693:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147212.752695:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147212.752698:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a21400/0x3139939425062ed0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f142 expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.752719:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425062e59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f103 expref: 10 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147212.752731:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425062e59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f103 expref: 10 pid: 1136 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746147212.752740:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311490944:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147212.752781:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147212.759966:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.760010:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.760045:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310408448 00000100:00100000:0.0:1746147212.760053:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310408448 00002000:00100000:0.0:1746147212.760110:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1548287) req@ffff8800975a7100 x1830967310408448/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147212.760122:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a7100 with x1830967310408448 ext(1048576->1548287) 00010000:00010000:0.0:1746147212.760133:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425062e59 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f103 expref: 11 pid: 1136 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746147212.760148:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425062e59 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f103 expref: 11 pid: 1136 timeout: 850 lvb_type: 0 00002000:00010000:0.0:1746147212.760155:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800975a7100 00000100:00100000:1.0:1746147212.760244:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311490944:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147212.761688:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a21400/0x3139939425062ed0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f142 expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147212.761706:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a21400, rc 0) 00000100:00100000:1.0:1746147212.761764:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2915:x1830967310408320:12345-192.168.204.25@tcp:101:cat.0 Request processed in 9121us (10722us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147212.761775:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20026 00000100:00100000:2.0:1746147212.761934:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311490816:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147212.761947:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147212.761964:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310407936:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 11838us (12611us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147212.761972:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9093 00000100:00100000:0.0:1746147212.762891:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310408704 00000100:00100000:0.0:1746147212.762899:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310408704 00002000:00100000:0.0:1746147212.762934:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (3350528->3354623) req@ffff8800975a5500 x1830967310408704/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147212.762943:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a5500 with x1830967310408704 ext(3350528->3354623) 00002000:00010000:0.0:1746147212.762948:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800975a5500 00000100:00100000:3.0:1746147212.764057:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1737 00000100:00100000:3.0:1746147212.764068:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2000:x1830967310408448:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:1.0:1746147212.764478:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7361 00000100:00100000:1.0:1746147212.764486:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310408704:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147212.764595:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310408704:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 109us (4583us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147212.764601:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7361 00002000:00100000:1.0:1746147212.764606:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (3350528->3354623) req@ffff8800975a5500 x1830967310408704/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/4536 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147212.764613:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a5500 with x1830967310408704 ext(3350528->3354623) 00002000:00010000:1.0:1746147212.764627:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800975a5500 00000100:00100000:3.0:1746147212.776167:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.777289:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.777394:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310408960 00000100:00100000:0.0:1746147212.777406:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310408960 00002000:00100000:0.0:1746147212.777457:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880098c73800 x1830967310408960/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147212.777466:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c73800 with x1830967310408960 ext(1048576->2097151) 00002000:00010000:0.0:1746147212.777472:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098c73800 00000100:00100000:0.0:1746147212.777488:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310409216 00000100:00100000:0.0:1746147212.777490:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310409216 00002000:00100000:0.0:1746147212.777502:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x98:0x0] (4100096->4104191) req@ffff880098c70700 x1830967310409216/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746147212.777504:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7362 00002000:00100000:0.0:1746147212.777508:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c70700 with x1830967310409216 ext(4100096->4104191) 00002000:00010000:0.0:1746147212.777511:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098c70700 00000100:00100000:1.0:1746147212.777514:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2001:x1830967310408960:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147212.777519:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7363 00000100:00100000:0.0:1746147212.777523:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310409216:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147212.777655:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310409216:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 130us (368us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147212.777661:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7363 00002000:00100000:0.0:1746147212.777666:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x98:0x0] (4100096->4104191) req@ffff880098c70700 x1830967310409216/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/4536 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147212.777673:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c70700 with x1830967310409216 ext(4100096->4104191) 00002000:00010000:0.0:1746147212.777676:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098c70700 00000100:00100000:2.0:1746147212.781502:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310408448:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 17424us (21533us total) trans 21474842656 rc 0/0 00000100:00100000:2.0:1746147212.781516:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1737 00002000:00100000:2.0:1746147212.781529:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1548287) req@ffff8800975a7100 x1830967310408448/t21474842656(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/448 e 0 to 0 dl 1746147223 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.781540:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a7100 with x1830967310408448 ext(1048576->1548287) 00010000:00010000:2.0:1746147212.781551:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425062e59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f103 expref: 13 pid: 1136 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.781570:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425062e59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f103 expref: 13 pid: 1136 timeout: 850 lvb_type: 0 00002000:00010000:2.0:1746147212.781578:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800975a7100 00000100:00100000:0.0:1746147212.789157:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.789290:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310409344 00000100:00100000:2.0:1746147212.789300:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310409344 00010000:00010000:2.0:1746147212.789337:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425062e59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f103 expref: 13 pid: 1136 timeout: 850 lvb_type: 0 00000100:00100000:2.0:1746147212.789365:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9094 00000100:00100000:2.0:1746147212.789372:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310409344:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147212.789386:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147212.789406:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425062e59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f103 expref: 13 pid: 1136 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.789417:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425062e59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f103 expref: 13 pid: 1136 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.789440:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2ac00/0x3139939425062e59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f103 expref: 13 pid: 1136 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.790068:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.790072:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.790081:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a21400/0x3139939425062ed0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f142 expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.790108:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a21400/0x3139939425062ed0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f142 expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.790146:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095a21400/0x3139939425062ed0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f142 expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147212.790158:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311491072:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147212.791818:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147212.794319:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2001:x1830967310408960:12345-192.168.204.25@tcp:3:cat.0 Request processed in 16795us (18153us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147212.794332:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7362 00002000:00100000:1.0:1746147212.794344:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880098c73800 x1830967310408960/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147212.794353:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098c73800 with x1830967310408960 ext(1048576->2097151) 00002000:00010000:1.0:1746147212.794359:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098c73800 00000100:00100000:2.0:1746147212.795531:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7226:1830967311491072:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147212.795552:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147212.795575:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310409344:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6203us (6429us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147212.795584:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9094 00000100:00100000:2.0:1746147212.799018:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147212.799830:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310409600 00000100:00100000:1.0:1746147212.799842:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310409600 00002000:00100000:1.0:1746147212.799893:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800a4396a00 x1830967310409600/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147212.799903:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4396a00 with x1830967310409600 ext(1048576->2097151) 00002000:00010000:1.0:1746147212.799909:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4396a00 00000100:00100000:1.0:1746147212.799942:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7364 00000100:00100000:1.0:1746147212.799950:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967310409600:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147212.800065:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.800227:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310409728 00000100:00100000:2.0:1746147212.800230:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310409728 00000100:00100000:2.0:1746147212.800269:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20027 00000100:00100000:2.0:1746147212.800275:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2918:x1830967310409728:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147212.800285:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147212.800304:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f380c00/0x3139939425062ed7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f149 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.800326:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.800327:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147212.800334:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f380c00/0x3139939425062ed7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f149 expref: 13 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.800349:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f380c00/0x3139939425062ed7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f149 expref: 13 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147212.800358:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f380c00, rc 0) 00000100:00100000:2.0:1746147212.800404:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2918:x1830967310409728:12345-192.168.204.25@tcp:101:cat.0 Request processed in 129us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147212.800409:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20027 00000100:00100000:0.0:1746147212.804396:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.804810:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310409984 00000100:00100000:2.0:1746147212.804821:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310409984 00002000:00100000:2.0:1746147212.804868:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800975a4700 x1830967310409984/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.804883:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a4700 with x1830967310409984 ext(1048576->2097151) 00002000:00010000:2.0:1746147212.804888:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800975a4700 00000100:00100000:2.0:1746147212.804961:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7365 00000100:00100000:2.0:1746147212.804969:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310409984:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147212.807572:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967310409600:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 7611us (8551us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147212.807585:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7364 00002000:00100000:2.0:1746147212.807596:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800a4396a00 x1830967310409600/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.807609:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4396a00 with x1830967310409600 ext(1048576->2097151) 00002000:00010000:2.0:1746147212.807624:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4396a00 00010000:00010000:0.0:1746147212.816284:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147212.816874:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310409984:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11889us (12473us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147212.816893:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7365 00002000:00100000:2.0:1746147212.816913:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800975a4700 x1830967310409984/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.816929:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a4700 with x1830967310409984 ext(1048576->2097151) 00002000:00010000:2.0:1746147212.816937:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800975a4700 00000100:00100000:0.0:1746147212.820545:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.821418:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310410112 00000100:00100000:3.0:1746147212.821428:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310410112 00000100:00100000:3.0:1746147212.821481:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20028 00000100:00100000:3.0:1746147212.821488:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2915:x1830967310410112:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147212.821507:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147212.821524:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425062ede lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f150 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.821553:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x3139939425062ebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3350528->18446744073709551615] (req 3350528->4104191) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f12d expref: 37 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.821560:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147212.821562:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147212.821565:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425062ede lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f150 expref: 37 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.821593:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x3139939425062ebb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3350528->18446744073709551615] (req 3350528->4104191) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f12d expref: 37 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.821603:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x3139939425062ebb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3350528->18446744073709551615] (req 3350528->4104191) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f12d expref: 37 pid: 1853 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746147212.821629:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311491200:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147212.821722:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147212.823413:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311491200:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147212.823439:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425062ede lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f150 expref: 37 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.823456:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56e00, rc 0) 00000100:00100000:3.0:1746147212.823494:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2915:x1830967310410112:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2005us (2960us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.823503:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20028 00000100:00100000:0.0:1746147212.827651:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.827745:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310410240 00000100:00100000:2.0:1746147212.827755:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310410240 00002000:00100000:2.0:1746147212.827802:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (3350528->4104191) req@ffff8800975a4380 x1830967310410240/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.827812:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a4380 with x1830967310410240 ext(3350528->4104191) 00010000:00010000:2.0:1746147212.827821:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x3139939425062ebb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3350528->18446744073709551615] (req 3350528->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f12d expref: 37 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.827841:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x3139939425062ebb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [3350528->18446744073709551615] (req 3350528->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f12d expref: 37 pid: 1853 timeout: 850 lvb_type: 0 00002000:00010000:2.0:1746147212.827848:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800975a4380 00000100:00100000:2.0:1746147212.827871:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1738 00000100:00100000:2.0:1746147212.827879:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310410240:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147212.831783:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.831922:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310410368 00000100:00100000:3.0:1746147212.831931:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310410368 00000100:00100000:3.0:1746147212.832374:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20029 00000100:00100000:3.0:1746147212.832383:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2918:x1830967310410368:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147212.832401:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147212.832421:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a57200/0x3139939425062ee5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f157 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.832451:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147212.832457:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a57200/0x3139939425062ee5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f157 expref: 33 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.832470:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a57200/0x3139939425062ee5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f157 expref: 33 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.832486:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57200, rc 0) 00000100:00100000:3.0:1746147212.832873:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2918:x1830967310410368:12345-192.168.204.25@tcp:101:cat.0 Request processed in 490us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.832880:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20029 00000100:00100000:2.0:1746147212.836434:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967310410240:12345-192.168.204.25@tcp:4:cat.0 Request processed in 8541us (8780us total) trans 17179875271 rc 0/0 00000100:00100000:2.0:1746147212.836449:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1738 00002000:00100000:2.0:1746147212.836463:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (3350528->4104191) req@ffff8800975a4380 x1830967310410240/t17179875271(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/448 e 0 to 0 dl 1746147223 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.836473:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a4380 with x1830967310410240 ext(3350528->4104191) 00010000:00010000:2.0:1746147212.836484:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x3139939425062ebb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3350528->18446744073709551615] (req 3350528->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f12d expref: 39 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.836503:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x3139939425062ebb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3350528->18446744073709551615] (req 3350528->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f12d expref: 39 pid: 1853 timeout: 850 lvb_type: 0 00002000:00010000:2.0:1746147212.836510:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800975a4380 00000100:00100000:0.0:1746147212.839848:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.841201:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310410496 00000100:00100000:3.0:1746147212.841212:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310410496 00010000:00010000:3.0:1746147212.841253:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x3139939425062ebb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [3350528->18446744073709551615] (req 3350528->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f12d expref: 39 pid: 1853 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746147212.841339:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9095 00000100:00100000:3.0:1746147212.841348:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967310410496:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147212.841514:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147212.841537:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x3139939425062ebb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [3350528->18446744073709551615] (req 3350528->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f12d expref: 39 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147212.841550:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x3139939425062ebb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [3350528->18446744073709551615] (req 3350528->4104191) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f12d expref: 39 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147212.841575:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a56800/0x3139939425062ebb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [3350528->18446744073709551615] (req 3350528->4104191) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f12d expref: 39 pid: 1853 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147212.841607:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147212.841610:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147212.841623:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425062ede lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f150 expref: 38 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.841637:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425062ede lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f150 expref: 38 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.841645:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147212.841646:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147212.841650:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a57200/0x3139939425062ee5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f157 expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.841655:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a57200/0x3139939425062ee5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f157 expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.841688:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098a57200/0x3139939425062ee5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f157 expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147212.841701:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311491328:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147212.841803:0:7226:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425062ede lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f150 expref: 38 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147212.841812:0:7226:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311491456:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147212.841831:0:7226:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20840 going to sleep for 11 seconds 00000100:00100000:3.0:1746147212.847392:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311491328:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147212.847406:0:7226:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7226:1830967311491456:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147212.847428:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147212.847485:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310410496:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6137us (7645us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.847496:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9095 00000100:00100000:0.0:1746147212.848160:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.848300:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310410752 00000100:00100000:2.0:1746147212.848308:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310410752 00002000:00100000:2.0:1746147212.848350:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff8800909f8a80 x1830967310410752/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.848360:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8a80 with x1830967310410752 ext(3145728->4194303) 00002000:00010000:2.0:1746147212.848367:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909f8a80 00000100:00100000:2.0:1746147212.848384:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7366 00000100:00100000:2.0:1746147212.848392:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2000:x1830967310410752:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147212.855055:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.855718:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310411008 00000100:00100000:2.0:1746147212.855728:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310411008 00002000:00100000:2.0:1746147212.855775:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff8800909fa300 x1830967310411008/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.855785:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fa300 with x1830967310411008 ext(3145728->4194303) 00002000:00010000:2.0:1746147212.855889:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909fa300 00000100:00100000:2.0:1746147212.855922:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7367 00000100:00100000:2.0:1746147212.855931:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310411008:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147212.862622:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2000:x1830967310410752:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14209us (14441us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147212.862636:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7366 00002000:00100000:2.0:1746147212.862649:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff8800909f8a80 x1830967310410752/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.862660:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8a80 with x1830967310410752 ext(3145728->4194303) 00002000:00010000:2.0:1746147212.862668:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909f8a80 00000100:00100000:2.0:1746147212.864815:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310411008:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8875us (9760us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147212.864826:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7367 00002000:00100000:2.0:1746147212.864836:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff8800909fa300 x1830967310411008/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.864851:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fa300 with x1830967310411008 ext(3145728->4194303) 00002000:00010000:2.0:1746147212.864856:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909fa300 00000100:00100000:0.0:1746147212.919936:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.920004:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310411264 00000100:00100000:3.0:1746147212.920013:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310411264 00000100:00100000:3.0:1746147212.921383:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16478 00000100:00100000:3.0:1746147212.921396:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+44:2925:x1830967310411264:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147212.921423:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147212.921445:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56400/0x3139939425062eec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f15e expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.921526:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57800/0x3139939425062ef3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921539:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57800/0x3139939425062ef3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921549:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57800/0x3139939425062ef3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921563:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425062efa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921568:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425062efa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921573:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425062efa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921679:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56000/0x3139939425062f01 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921689:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56000/0x3139939425062f01 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921696:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56000/0x3139939425062f01 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147212.921703:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147212.921776:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57800/0x3139939425062ef3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921782:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57800/0x3139939425062ef3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921788:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57800/0x3139939425062ef3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921793:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a57800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147212.921797:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57800/0x3139939425062ef3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921803:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57800/0x3139939425062ef3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921813:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147212.921816:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147212.921819:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57800/0x3139939425062ef3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921823:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57800/0x3139939425062ef3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921853:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425062efa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921857:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425062efa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921865:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425062efa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921868:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a57c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147212.921870:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425062efa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921874:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425062efa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921879:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098239f00) 00010000:00010000:3.0:1746147212.921881:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147212.921882:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425062efa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921886:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57c00/0x3139939425062efa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147212.921922:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56400/0x3139939425062eec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f15e expref: 47 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.921933:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56000/0x3139939425062f01 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f15e expref: 46 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.921939:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147212.921941:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147212.921943:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56000, rc 0) 00000100:00100000:3.0:1746147212.922006:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2925:x1830967310411264:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 614us (2083us total) trans 8589937384 rc 0/0 00000100:00100000:3.0:1746147212.922013:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16478 00000100:00100000:0.0:1746147212.925765:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.925824:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310411520 00000100:00100000:2.0:1746147212.925834:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310411520 00000100:00100000:0.0:1746147212.925850:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.926026:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6164 00000100:00100000:2.0:1746147212.926036:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2925:x1830967310411520:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147212.927001:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310411648 00000100:00100000:3.0:1746147212.927009:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310411648 00000100:00100000:2.0:1746147212.927027:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2925:x1830967310411520:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 991us (1274us total) trans 8589937385 rc 0/0 00000100:00100000:2.0:1746147212.927035:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6164 00000100:00100000:3.0:1746147212.927052:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1001 00000100:00100000:3.0:1746147212.927060:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b43bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2000:x1830967310411648:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147212.927074:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147212.927129:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56000/0x3139939425062f01 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f15e expref: 48 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.927152:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147212.927157:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147212.927185:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b43bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2000:x1830967310411648:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 125us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.927191:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1001 00000100:00100000:0.0:1746147212.968719:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.968872:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310411776 00000100:00100000:3.0:1746147212.968885:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310411776 00000100:00100000:3.0:1746147212.968964:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20030 00000100:00100000:3.0:1746147212.968976:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2921:x1830967310411776:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147212.969000:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147212.969021:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425062f0f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f165 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.969056:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x3139939425062eb4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f126 expref: 37 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.969065:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x3139939425062ec9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f134 expref: 34 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147212.969077:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147212.969079:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147212.969083:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425062f0f lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1404928->2097151] (req 1404928->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f165 expref: 34 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.969232:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x3139939425062ec9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f134 expref: 34 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147212.969246:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x3139939425062ec9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f134 expref: 34 pid: 12225 timeout: 850 lvb_type: 1 00000100:00100000:3.0:1746147212.969260:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311491584:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147212.970673:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x3139939425062eb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f126 expref: 37 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.970685:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x3139939425062eb4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f126 expref: 37 pid: 1136 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746147212.970697:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311491712:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147212.971199:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147212.975278:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311491584:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147212.975298:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311491712:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147212.975333:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425062f0f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1404928->2097151] (req 1404928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f165 expref: 34 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.975357:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56a00, rc 0) 00000100:00100000:3.0:1746147212.975432:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2921:x1830967310411776:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6459us (6726us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147212.975441:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20030 00000100:00100000:0.0:1746147212.977214:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147212.977848:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.978029:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310411904 00000100:00100000:3.0:1746147212.978037:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310411904 00010000:00010000:3.0:1746147212.978073:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x3139939425062ec9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f134 expref: 34 pid: 12225 timeout: 850 lvb_type: 1 00000100:00100000:3.0:1746147212.978138:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310412032 00000100:00100000:3.0:1746147212.978140:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310412032 00010000:00010000:3.0:1746147212.978150:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x3139939425062eb4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f126 expref: 38 pid: 1136 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746147212.978172:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9096 00000100:00100000:3.0:1746147212.978177:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2000:x1830967310411904:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147212.978192:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147212.978215:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x3139939425062ec9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f134 expref: 34 pid: 12225 timeout: 850 lvb_type: 1 00000100:00100000:2.0:1746147212.978284:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9097 00000100:00100000:2.0:1746147212.978292:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967310412032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147212.978299:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147212.978307:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x3139939425062eb4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f126 expref: 38 pid: 1136 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.978318:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x3139939425062eb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f126 expref: 38 pid: 1136 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.978343:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f03d400/0x3139939425062eb4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f126 expref: 38 pid: 1136 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147212.978367:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147212.978655:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x3139939425062ec9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f134 expref: 34 pid: 12225 timeout: 850 lvb_type: 1 00010000:00010000:3.0:1746147212.978669:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a20c00/0x3139939425062ec9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f134 expref: 34 pid: 12225 timeout: 850 lvb_type: 1 00010000:00010000:3.0:1746147212.978692:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147212.978694:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147212.978703:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425062f0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1404928->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f165 expref: 33 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.978713:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425062f0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1404928->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f165 expref: 33 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.978751:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425062f0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1404928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f165 expref: 33 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147212.978766:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311491840:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147212.978962:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967310412032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 668us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147212.978973:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9097 00000100:00100000:3.0:1746147212.979215:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147212.981978:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.982179:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310412288 00000100:00100000:2.0:1746147212.982188:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310412288 00000100:00100000:3.0:1746147212.982211:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311491840:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147212.982234:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746147212.982236:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1404928->1409023) req@ffff8800909f8e00 x1830967310412288/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.982246:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8e00 with x1830967310412288 ext(1404928->1409023) 00002000:00010000:2.0:1746147212.982250:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909f8e00 00000100:00100000:2.0:1746147212.982274:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7368 00000100:00100000:3.0:1746147212.982281:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2000:x1830967310411904:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4103us (5077us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147212.982281:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2000:x1830967310412288:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147212.982289:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9096 00000100:00100000:2.0:1746147212.982883:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2000:x1830967310412288:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 599us (915us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147212.982891:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7368 00002000:00100000:2.0:1746147212.982898:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1404928->1409023) req@ffff8800909f8e00 x1830967310412288/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/4536 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.982905:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8e00 with x1830967310412288 ext(1404928->1409023) 00002000:00010000:2.0:1746147212.982909:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909f8e00 00000100:00100000:0.0:1746147212.994334:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147212.996852:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310412544 00000100:00100000:2.0:1746147212.996875:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310412544 00002000:00100000:2.0:1746147212.996950:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1404927) req@ffff8800909f9f80 x1830967310412544/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/0 e 0 to 0 dl 1746147223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147212.996963:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f9f80 with x1830967310412544 ext(1048576->1404927) 00002000:00010000:2.0:1746147212.996971:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909f9f80 00000100:00100000:2.0:1746147212.997026:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7369 00000100:00100000:2.0:1746147212.997036:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2003:x1830967310412544:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147212.997741:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147212.997812:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310412672 00000100:00100000:3.0:1746147212.997817:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310412672 00000100:00100000:3.0:1746147212.997856:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20031 00000100:00100000:3.0:1746147212.997861:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2921:x1830967310412672:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147212.997872:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147212.997889:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a56400/0x3139939425062f16 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f16c expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.997921:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a21400/0x3139939425062ed0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f142 expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.997928:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f380c00/0x3139939425062ed7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f149 expref: 14 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.997935:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147212.997936:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147212.997940:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a56400/0x3139939425062f16 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->1306623] (req 1048576->1306623) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f16c expref: 14 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.997971:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f380c00/0x3139939425062ed7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f149 expref: 14 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.997982:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f380c00/0x3139939425062ed7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f149 expref: 14 pid: 12225 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746147212.997995:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311491968:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147212.998104:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a21400/0x3139939425062ed0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f142 expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147212.998111:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a21400/0x3139939425062ed0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f142 expref: 30 pid: 12225 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746147212.998119:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311492096:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147212.998138:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147213.001237:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311491968:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147213.001256:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311492096:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147213.001292:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a56400/0x3139939425062f16 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->1306623] (req 1048576->1306623) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f16c expref: 14 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.001313:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56400, rc 0) 00000100:00100000:3.0:1746147213.001373:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2921:x1830967310412672:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3509us (3633us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147213.001383:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20031 00000100:00100000:0.0:1746147213.003340:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.005145:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147213.005489:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310412928 00000100:00100000:3.0:1746147213.005498:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310412928 00010000:00010000:3.0:1746147213.005541:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a21400/0x3139939425062ed0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f142 expref: 31 pid: 12225 timeout: 850 lvb_type: 0 00000100:00100000:3.0:1746147213.005582:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310412800 00000100:00100000:3.0:1746147213.005586:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310412800 00010000:00010000:3.0:1746147213.005599:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f380c00/0x3139939425062ed7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f149 expref: 14 pid: 12225 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746147213.005853:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2003:x1830967310412544:12345-192.168.204.25@tcp:3:cat.0 Request processed in 8818us (11534us total) trans 0 rc 356352/356352 00000100:00100000:0.0:1746147213.005862:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7369 00002000:00100000:0.0:1746147213.005871:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1404927) req@ffff8800909f9f80 x1830967310412544/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:588/0 lens 488/440 e 0 to 0 dl 1746147223 ref 1 fl Complete:/200/0 rc 356352/356352 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147213.005887:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f9f80 with x1830967310412544 ext(1048576->1404927) 00002000:00010000:0.0:1746147213.005891:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909f9f80 00000100:00100000:3.0:1746147213.006043:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9098 00000100:00100000:2.0:1746147213.006048:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9099 00000100:00100000:3.0:1746147213.006050:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967310412928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147213.006055:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310412800:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147213.006063:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147213.006063:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147213.006079:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a21400/0x3139939425062ed0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f142 expref: 31 pid: 12225 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147213.006079:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f380c00/0x3139939425062ed7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f149 expref: 14 pid: 12225 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147213.006105:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f380c00/0x3139939425062ed7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f149 expref: 14 pid: 12225 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147213.006115:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a21400/0x3139939425062ed0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f142 expref: 31 pid: 12225 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147213.006137:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f380c00/0x3139939425062ed7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f149 expref: 14 pid: 12225 timeout: 850 lvb_type: 0 00010000:00010000:3.0:1746147213.006227:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a21400/0x3139939425062ed0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f142 expref: 31 pid: 12225 timeout: 850 lvb_type: 0 00010000:00010000:2.0:1746147213.006228:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.006231:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.006238:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a56400/0x3139939425062f16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f16c expref: 13 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.006246:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a56400/0x3139939425062f16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f16c expref: 13 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.006269:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147213.006287:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098a56400/0x3139939425062f16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f16c expref: 13 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147213.006299:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967310412928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 251us (2970us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147213.006300:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311492224:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147213.006305:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9098 00000100:00100000:2.0:1746147213.006353:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147213.008145:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311492224:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147213.008165:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147213.008209:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310412800:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2153us (3072us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147213.008217:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9099 00000100:00100000:1.0:1746147213.010190:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.010289:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310413184 00000100:00100000:0.0:1746147213.010298:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310413184 00002000:00100000:0.0:1746147213.010348:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1302528->1306623) req@ffff8800933f6300 x1830967310413184/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:589/0 lens 488/0 e 0 to 0 dl 1746147224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147213.010359:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f6300 with x1830967310413184 ext(1302528->1306623) 00002000:00010000:0.0:1746147213.010364:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800933f6300 00000100:00100000:0.0:1746147213.010394:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7370 00000100:00100000:0.0:1746147213.010401:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310413184:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147213.010547:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310413184:12345-192.168.204.25@tcp:3:cat.0 Request processed in 146us (364us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147213.010553:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7370 00002000:00100000:0.0:1746147213.010559:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1302528->1306623) req@ffff8800933f6300 x1830967310413184/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:589/0 lens 488/4536 e 0 to 0 dl 1746147224 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147213.010565:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f6300 with x1830967310413184 ext(1302528->1306623) 00002000:00010000:0.0:1746147213.010568:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800933f6300 00000100:00100000:0.0:1746147213.019536:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147213.019778:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310413440 00000100:00100000:1.0:1746147213.019789:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310413440 00002000:00100000:1.0:1746147213.019836:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1306624->2097151) req@ffff8800909f8700 x1830967310413440/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:589/0 lens 488/0 e 0 to 0 dl 1746147224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147213.019847:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8700 with x1830967310413440 ext(1306624->2097151) 00002000:00010000:1.0:1746147213.019852:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909f8700 00000100:00100000:1.0:1746147213.019893:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7371 00000100:00100000:1.0:1746147213.019902:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2003:x1830967310413440:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147213.026647:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2003:x1830967310413440:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6732us (7107us total) trans 0 rc 790528/790528 00000100:00100000:1.0:1746147213.026662:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7371 00002000:00100000:1.0:1746147213.026675:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1306624->2097151) req@ffff8800909f8700 x1830967310413440/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:589/0 lens 488/440 e 0 to 0 dl 1746147224 ref 1 fl Complete:/200/0 rc 790528/790528 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147213.026686:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8700 with x1830967310413440 ext(1306624->2097151) 00002000:00010000:1.0:1746147213.026694:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909f8700 00000100:00100000:0.0:1746147213.030498:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147213.030686:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310413568 00000100:00100000:3.0:1746147213.030696:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310413568 00000100:00100000:3.0:1746147213.030750:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20032 00000100:00100000:3.0:1746147213.030902:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2925:x1830967310413568:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147213.030922:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147213.030941:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a57800/0x3139939425062f1d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f173 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.030973:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425062f0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1404928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f165 expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.030981:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147213.030983:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147213.030987:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a57800/0x3139939425062f1d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1593344->2097151] (req 1593344->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f173 expref: 38 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.031024:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425062f0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1404928->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f165 expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.031036:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425062f0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1404928->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f165 expref: 32 pid: 1136 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.031049:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311492352:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147213.031978:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147213.035536:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147213.035566:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311492352:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147213.035585:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147213.035595:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a57800/0x3139939425062f1d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1593344->2097151] (req 1593344->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f173 expref: 38 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.035623:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57800, rc 0) 00000100:00100000:1.0:1746147213.035660:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310413696 00000100:00100000:1.0:1746147213.035668:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310413696 00000100:00100000:3.0:1746147213.035677:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2925:x1830967310413568:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4918us (5190us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147213.035687:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20032 00000100:00100000:3.0:1746147213.035713:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20033 00000100:00100000:3.0:1746147213.035720:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+33:2001:x1830967310413696:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147213.035735:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147213.035751:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a57000/0x3139939425062f24 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f17a expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147213.035784:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310413824 00000100:00100000:1.0:1746147213.035788:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310413824 00000100:00100000:3.0:1746147213.035799:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311492480:192.168.204.25@tcp:106: 00002000:00100000:1.0:1746147213.035819:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x97:0x0] (1404928->2097151) req@ffff8800909f8000 x1830967310413824/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:589/0 lens 488/0 e 0 to 0 dl 1746147224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147213.035831:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8000 with x1830967310413824 ext(1404928->2097151) 00010000:00010000:1.0:1746147213.035838:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425062f0f lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1404928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f165 expref: 35 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746147213.035852:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425062f0f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1404928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f165 expref: 35 pid: 1136 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.035854:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20540 going to sleep for 11 seconds 00002000:00010000:1.0:1746147213.035860:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800909f8000 00000100:00100000:1.0:1746147213.035875:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1739 00000100:00100000:1.0:1746147213.035880:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+35:2000:x1830967310413824:12345-192.168.204.25@tcp:4:cat.0 00000100:00080000:3.0:1746147213.035883:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147213.039774:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311492480:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147213.039812:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a57000/0x3139939425062f24 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f17a expref: 36 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147213.039827:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a57000/0x3139939425062f24 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f17a expref: 36 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147213.039850:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57000, rc 0) 00000100:00100000:3.0:1746147213.039911:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+35:2001:x1830967310413696:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4190us (4388us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147213.039921:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20033 00000100:00100000:0.0:1746147213.043594:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147213.043686:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310413952 00000100:00100000:3.0:1746147213.043695:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310413952 00000100:00100000:3.0:1746147213.044460:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20034 00000100:00100000:3.0:1746147213.044471:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+37:2003:x1830967310413952:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147213.044665:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147213.044688:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a56600/0x3139939425062f2b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f181 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147213.044758:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311492608:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147213.044848:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20540 going to sleep for 11 seconds 00000100:00100000:1.0:1746147213.045981:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+37:2000:x1830967310413824:12345-192.168.204.25@tcp:4:cat.0 Request processed in 10094us (10388us total) trans 17179875272 rc 0/0 00000100:00100000:1.0:1746147213.045998:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1739 00002000:00100000:1.0:1746147213.046009:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x97:0x0] (1404928->2097151) req@ffff8800909f8000 x1830967310413824/t17179875272(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:589/0 lens 488/448 e 0 to 0 dl 1746147224 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147213.046019:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f8000 with x1830967310413824 ext(1404928->2097151) 00010000:00010000:1.0:1746147213.046028:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425062f0f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1404928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f165 expref: 37 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746147213.046043:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425062f0f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1404928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f165 expref: 37 pid: 1136 timeout: 851 lvb_type: 0 00002000:00010000:1.0:1746147213.046050:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800909f8000 00000100:00100000:3.0:1746147213.048008:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311492608:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147213.048046:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a56600/0x3139939425062f2b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f181 expref: 36 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147213.048066:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a56600/0x3139939425062f2b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f181 expref: 36 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147213.048123:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a56600, rc 0) 00000100:00100000:3.0:1746147213.048178:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+35:2003:x1830967310413952:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3707us (4595us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147213.048187:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20034 00000100:00100000:0.0:1746147213.048398:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.048468:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310414080 00000100:00100000:2.0:1746147213.048477:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310414080 00010000:00010000:2.0:1746147213.048507:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425062f0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1404928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f165 expref: 35 pid: 1136 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746147213.048543:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9100 00000100:00100000:2.0:1746147213.048550:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+35:2001:x1830967310414080:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147213.048564:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147213.048574:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425062f0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1404928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f165 expref: 35 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.048584:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425062f0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1404928->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f165 expref: 35 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.048605:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a56a00/0x3139939425062f0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1404928->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f165 expref: 35 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.048641:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.048643:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.048651:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a57800/0x3139939425062f1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f173 expref: 37 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.048658:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a57800/0x3139939425062f1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f173 expref: 37 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.048691:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098a57800/0x3139939425062f1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f173 expref: 37 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147213.048703:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311492736:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147213.048770:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147213.050642:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311492736:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147213.050834:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147213.050879:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2001:x1830967310414080:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2328us (2480us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147213.050889:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9100 00000100:00100000:0.0:1746147213.053548:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147213.053703:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310414336 00000100:00100000:1.0:1746147213.053712:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310414336 00002000:00100000:1.0:1746147213.053758:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x97:0x0] (1593344->1597439) req@ffff8800769af480 x1830967310414336/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:589/0 lens 488/0 e 0 to 0 dl 1746147224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147213.053769:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769af480 with x1830967310414336 ext(1593344->1597439) 00002000:00010000:1.0:1746147213.053774:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769af480 00000100:00100000:1.0:1746147213.053807:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7372 00000100:00100000:1.0:1746147213.053814:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310414336:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147213.053951:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310414336:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 137us (415us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147213.053957:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7372 00002000:00100000:1.0:1746147213.053962:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x97:0x0] (1593344->1597439) req@ffff8800769af480 x1830967310414336/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:589/0 lens 488/4536 e 0 to 0 dl 1746147224 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147213.053974:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769af480 with x1830967310414336 ext(1593344->1597439) 00002000:00010000:1.0:1746147213.053976:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769af480 00000100:00100000:0.0:1746147213.060182:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147213.060476:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310414464 00000100:00100000:3.0:1746147213.060490:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310414464 00000100:00100000:3.0:1746147213.060548:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20035 00000100:00100000:3.0:1746147213.060557:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2925:x1830967310414464:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147213.060577:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147213.060596:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425062f32 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f188 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.060635:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a56400/0x3139939425062f16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f16c expref: 12 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.060643:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147213.060645:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147213.060648:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425062f32 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->1327103] (req 1048576->1327103) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f188 expref: 31 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.060679:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a56400/0x3139939425062f16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f16c expref: 12 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.060694:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a56400/0x3139939425062f16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f16c expref: 12 pid: 1136 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.060706:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311492864:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147213.060791:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20540 going to sleep for 11 seconds 00000100:00100000:3.0:1746147213.063416:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311492864:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147213.063451:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.063514:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310414592 00000100:00100000:2.0:1746147213.063520:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310414592 00002000:00100000:2.0:1746147213.063559:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1306623) req@ffff8800769ae300 x1830967310414592/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:589/0 lens 488/0 e 0 to 0 dl 1746147224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147213.063568:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ae300 with x1830967310414592 ext(1048576->1306623) 00010000:00010000:2.0:1746147213.063577:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098a56400/0x3139939425062f16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f16c expref: 13 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.063591:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098a56400/0x3139939425062f16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f16c expref: 13 pid: 1136 timeout: 851 lvb_type: 0 00002000:00010000:2.0:1746147213.063596:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800769ae300 00000100:00100000:2.0:1746147213.063633:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1740 00010000:00010000:3.0:1746147213.063635:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425062f32 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->1327103] (req 1048576->1327103) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f188 expref: 31 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147213.063640:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310414592:12345-192.168.204.25@tcp:4:cat.0 00010000:00010000:3.0:1746147213.063650:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57c00, rc 0) 00000100:00100000:3.0:1746147213.063692:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2925:x1830967310414464:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3137us (3521us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147213.063700:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20035 00000100:00100000:0.0:1746147213.068078:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310414592:12345-192.168.204.25@tcp:4:cat.0 Request processed in 4426us (4616us total) trans 21474842657 rc 0/0 00000100:00100000:0.0:1746147213.068118:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1740 00002000:00100000:0.0:1746147213.068131:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1306623) req@ffff8800769ae300 x1830967310414592/t21474842657(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:589/0 lens 488/448 e 0 to 0 dl 1746147224 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147213.068140:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ae300 with x1830967310414592 ext(1048576->1306623) 00010000:00010000:0.0:1746147213.068150:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098a56400/0x3139939425062f16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f16c expref: 15 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.068166:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098a56400/0x3139939425062f16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f16c expref: 15 pid: 1136 timeout: 851 lvb_type: 0 00002000:00010000:0.0:1746147213.068173:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800769ae300 00000100:00100000:0.0:1746147213.074289:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.074358:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310414720 00000100:00100000:2.0:1746147213.074368:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310414720 00010000:00010000:2.0:1746147213.074407:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a56400/0x3139939425062f16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f16c expref: 15 pid: 1136 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746147213.074453:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9101 00000100:00100000:2.0:1746147213.074461:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2001:x1830967310414720:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147213.074478:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147213.074502:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a56400/0x3139939425062f16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f16c expref: 15 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.074514:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a56400/0x3139939425062f16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f16c expref: 15 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.074698:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a56400/0x3139939425062f16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f16c expref: 15 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.074730:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.074733:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.074745:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425062f32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1327103) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f188 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.074753:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425062f32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1327103) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f188 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.074794:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425062f32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1327103) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f188 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147213.074815:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311492992:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147213.074923:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147213.077492:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311492992:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147213.077515:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147213.077558:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310414720:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3097us (3280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147213.077569:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9101 00000100:00100000:0.0:1746147213.078484:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147213.078756:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310414976 00000100:00100000:1.0:1746147213.078764:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310414976 00002000:00100000:1.0:1746147213.078808:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1323008->1327103) req@ffff8800769afb80 x1830967310414976/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:589/0 lens 488/0 e 0 to 0 dl 1746147224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147213.078818:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769afb80 with x1830967310414976 ext(1323008->1327103) 00002000:00010000:1.0:1746147213.078823:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769afb80 00000100:00100000:1.0:1746147213.078841:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7373 00000100:00100000:1.0:1746147213.078848:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967310414976:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147213.078976:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967310414976:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 129us (496us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147213.078983:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7373 00002000:00100000:1.0:1746147213.078988:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1323008->1327103) req@ffff8800769afb80 x1830967310414976/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:589/0 lens 488/4536 e 0 to 0 dl 1746147224 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147213.078996:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769afb80 with x1830967310414976 ext(1323008->1327103) 00002000:00010000:1.0:1746147213.078999:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769afb80 00000100:00100000:0.0:1746147213.090065:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147213.090173:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310415232 00000100:00100000:3.0:1746147213.090184:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310415232 00000100:00100000:3.0:1746147213.090269:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16479 00000100:00100000:3.0:1746147213.090279:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2934:x1830967310415232:12345-192.168.204.25@tcp:101:cat.0 00000100:00080000:0.0:1746147213.090293:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746147213.090306:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147213.090329:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56000/0x3139939425062f39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f18f expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.090414:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x3139939425062f40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090426:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x3139939425062f40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090438:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x3139939425062f40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090448:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425062f47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090452:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425062f47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090455:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425062f47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090544:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x3139939425062f4e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090551:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x3139939425062f4e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090554:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x3139939425062f4e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147213.090560:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147213.090639:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x3139939425062f40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090644:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x3139939425062f40 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090648:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x3139939425062f40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090651:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a56a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147213.090654:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x3139939425062f40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090659:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x3139939425062f40 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090666:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147213.090668:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147213.090671:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x3139939425062f40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090676:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56a00/0x3139939425062f40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090701:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425062f47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090706:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425062f47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090711:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425062f47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090714:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a56600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147213.090717:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425062f47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090722:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425062f47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090728:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098239f00) 00010000:00010000:3.0:1746147213.090730:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147213.090732:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425062f47 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090736:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56600/0x3139939425062f47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.090773:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56000/0x3139939425062f39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f18f expref: 49 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.090793:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x3139939425062f4e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f18f expref: 48 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.090800:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147213.090805:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147213.090808:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a57000, rc 0) 00000100:00100000:3.0:1746147213.090866:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2934:x1830967310415232:12345-192.168.204.25@tcp:101:cat.0 Request processed in 589us (812us total) trans 8589937386 rc 0/0 00000100:00100000:3.0:1746147213.090873:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16479 00000100:00100000:0.0:1746147213.092790:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.092845:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.092846:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310415488 00000100:00100000:2.0:1746147213.092855:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310415488 00000100:00100000:2.0:1746147213.092912:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6165 00000100:00100000:2.0:1746147213.092921:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2934:x1830967310415488:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147213.092929:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310415616 00000100:00100000:3.0:1746147213.092933:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310415616 00000100:00100000:3.0:1746147213.092966:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1002 00000100:00100000:3.0:1746147213.092972:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5235050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2001:x1830967310415616:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147213.092986:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147213.093007:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a57000/0x3139939425062f4e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f18f expref: 49 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.093021:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147213.093025:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147213.093055:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5235050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2001:x1830967310415616:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 82us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147213.093060:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1002 00000100:00100000:2.0:1746147213.093120:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2934:x1830967310415488:12345-192.168.204.25@tcp:35:cat.0 Request processed in 169us (307us total) trans 8589937387 rc 0/0 00000100:00100000:2.0:1746147213.093127:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6165 00000100:00100000:0.0:1746147213.104268:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.104324:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147213.104481:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310416000 00000100:00100000:1.0:1746147213.104491:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310416000 00002000:00100000:1.0:1746147213.104545:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1593343) req@ffff8800769aea00 x1830967310416000/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:589/0 lens 488/0 e 0 to 0 dl 1746147224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147213.104556:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769aea00 with x1830967310416000 ext(1048576->1593343) 00002000:00010000:1.0:1746147213.104562:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769aea00 00000100:00100000:1.0:1746147213.104864:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310416128 00000100:00100000:1.0:1746147213.104868:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310416128 00002000:00100000:1.0:1746147213.104886:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1327104->2097151) req@ffff8800769ac700 x1830967310416128/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:589/0 lens 488/0 e 0 to 0 dl 1746147224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147213.104893:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ac700 with x1830967310416128 ext(1327104->2097151) 00002000:00010000:1.0:1746147213.104897:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769ac700 00000100:00100000:2.0:1746147213.104928:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7374 00000100:00100000:2.0:1746147213.104938:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310416000:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147213.105980:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7375 00000100:00100000:0.0:1746147213.105991:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967310416128:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147213.112166:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310416000:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7216us (7894us total) trans 0 rc 544768/544768 00000100:00100000:2.0:1746147213.112182:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7374 00002000:00100000:2.0:1746147213.112195:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->1593343) req@ffff8800769aea00 x1830967310416000/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:589/0 lens 488/440 e 0 to 0 dl 1746147224 ref 1 fl Complete:/200/0 rc 544768/544768 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147213.112205:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769aea00 with x1830967310416000 ext(1048576->1593343) 00002000:00010000:2.0:1746147213.112213:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769aea00 00000100:00100000:2.0:1746147213.115138:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967310416128:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9137us (10802us total) trans 0 rc 770048/770048 00000100:00100000:2.0:1746147213.115150:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7375 00002000:00100000:2.0:1746147213.115162:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1327104->2097151) req@ffff8800769ac700 x1830967310416128/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:589/0 lens 488/440 e 0 to 0 dl 1746147224 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147213.115172:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ac700 with x1830967310416128 ext(1327104->2097151) 00002000:00010000:2.0:1746147213.115178:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769ac700 00000100:00100000:1.0:1746147213.132383:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147213.132554:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310416256 00000100:00100000:3.0:1746147213.132563:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310416256 00000100:00100000:3.0:1746147213.132795:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16480 00000100:00100000:3.0:1746147213.132805:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2936:x1830967310416256:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147213.132832:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147213.132853:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260200/0x3139939425062f5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f196 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.132912:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260e00/0x3139939425062f63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.132924:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260e00/0x3139939425062f63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.132934:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260e00/0x3139939425062f63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.132944:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261e00/0x3139939425062f6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.132949:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261e00/0x3139939425062f6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.132953:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261e00/0x3139939425062f6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.133019:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261a00/0x3139939425062f71 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.133029:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f070 expref: 47 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.133036:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098227600/0x3139939425062d8e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f077 expref: 19 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.133046:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261a00/0x3139939425062f71 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.133073:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098227600/0x3139939425062d8e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f077 expref: 19 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.133083:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098227600/0x3139939425062d8e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f077 expref: 19 pid: 6215 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.133112:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311493120:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147213.133220:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f070 expref: 47 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.133768:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f070 expref: 47 pid: 6215 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.133777:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311493248:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147213.133896:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147213.135864:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147213.135976:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311493120:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147213.135987:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311493248:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147213.136010:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261a00/0x3139939425062f71 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:2.0:1746147213.136129:0:16750:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310416512 00000100:00100000:2.0:1746147213.136136:0:16750:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310416512 00000100:00100000:2.0:1746147213.136195:0:16750:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6166 00000100:00100000:2.0:1746147213.136203:0:16750:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:30748:x1830967310416512:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746147213.136418:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147213.136486:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310416768 00000100:00100000:1.0:1746147213.136490:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310416768 00000100:00100000:1.0:1746147213.136514:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6167 00000100:00100000:1.0:1746147213.136519:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:30749:x1830967310416768:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147213.136628:0:16750:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:30748:x1830967310416512:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 423us (773us total) trans 8589937388 rc 0/0 00000100:00100000:2.0:1746147213.136635:0:16750:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6166 00000100:00100000:1.0:1746147213.136836:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:30749:x1830967310416768:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 315us (417us total) trans 8589937389 rc 0/0 00000100:00100000:1.0:1746147213.136842:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6167 00000100:00100000:0.0:1746147213.138444:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.138487:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147213.138519:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310416896 00000100:00100000:3.0:1746147213.138525:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310416896 00000100:00100000:2.0:1746147213.138540:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310417024 00000100:00100000:2.0:1746147213.138544:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310417024 00010000:00010000:2.0:1746147213.138562:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f070 expref: 49 pid: 6215 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746147213.138569:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098227600/0x3139939425062d8e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f077 expref: 21 pid: 6215 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746147213.138596:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9102 00000100:00100000:2.0:1746147213.138603:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2001:x1830967310417024:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147213.138605:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9103 00000100:00100000:3.0:1746147213.138619:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310416896:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147213.138623:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147213.138625:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147213.138629:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098227600/0x3139939425062d8e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f077 expref: 21 pid: 6215 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.138629:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f070 expref: 49 pid: 6215 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746147213.138639:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098227600/0x3139939425062d8e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f077 expref: 21 pid: 6215 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.138715:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f070 expref: 49 pid: 6215 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746147213.138755:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098227600/0x3139939425062d8e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f077 expref: 21 pid: 6215 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.138759:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425062d79 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f070 expref: 49 pid: 6215 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.138769:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147213.138774:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261a00/0x3139939425062f71 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147213.138783:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261a00/0x3139939425062f71 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147213.138790:0:13715:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261a00/0x3139939425062f71 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.138796:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147213.138798:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147213.138810:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147213.138830:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310416896:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 219us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147213.138830:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2001:x1830967310417024:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 228us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147213.138835:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9102 00000100:00100000:3.0:1746147213.138838:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9103 00010000:00010000:3.0:1746147213.138856:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261a00/0x3139939425062f71 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.138862:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261a00/0x3139939425062f71 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147213.138915:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147213.138920:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147213.138934:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261a00/0x3139939425062f71 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.138947:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261a00/0x3139939425062f71 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.138955:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260e00/0x3139939425062f63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.138960:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260e00/0x3139939425062f63 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.138965:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260e00/0x3139939425062f63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.138970:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e260e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147213.138974:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260e00/0x3139939425062f63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.138980:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260e00/0x3139939425062f63 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.138988:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147213.138990:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147213.138994:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260e00/0x3139939425062f63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.138998:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260e00/0x3139939425062f63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.139005:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261e00/0x3139939425062f6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.139010:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261e00/0x3139939425062f6a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.139014:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261e00/0x3139939425062f6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.139023:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e261e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147213.139025:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261e00/0x3139939425062f6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.139029:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261e00/0x3139939425062f6a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.139034:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098239d00) 00010000:00010000:3.0:1746147213.139036:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147213.139038:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261e00/0x3139939425062f6a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.139042:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261e00/0x3139939425062f6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.139073:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260200/0x3139939425062f5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f196 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.139085:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261a00/0x3139939425062f71 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f196 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.139128:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147213.139130:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147213.139132:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261a00, rc 0) 00000100:00100000:3.0:1746147213.139154:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2936:x1830967310416256:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 6352us (6782us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147213.139160:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16480 00000100:00100000:0.0:1746147213.141641:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.141681:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.141708:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.141745:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.141753:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310417152 00000100:00100000:2.0:1746147213.141762:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310417152 00000100:00100000:3.0:1746147213.141764:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310417280 00000100:00100000:3.0:1746147213.141767:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310417280 00000100:00100000:3.0:1746147213.141803:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310417408 00000100:00100000:3.0:1746147213.141805:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310417408 00000100:00100000:1.0:1746147213.141893:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310417536 00000100:00100000:1.0:1746147213.141898:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310417536 00000100:00100000:2.0:1746147213.141962:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20036 00000100:00100000:2.0:1746147213.141970:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967310417280:12345-192.168.204.25@tcp:101:mirror_io.0 00000100:00100000:3.0:1746147213.141979:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20037 00000100:00100000:3.0:1746147213.141984:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967310417152:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147213.141991:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147213.141991:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147213.142010:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e260a00/0x3139939425062f78 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f19d expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.142010:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2b400/0x3139939425062f7f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f1a4 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147213.142058:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311493376:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147213.142058:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311493504:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147213.142164:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20038 00000100:00100000:1.0:1746147213.142170:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967310417408:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:1.0:1746147213.142176:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147213.142182:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425062f86 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f1ab expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147213.142193:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147213.142195:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147213.142203:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425062f86 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ab expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147213.142220:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425062f86 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ab expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147213.142229:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38c200, rc 0) 00000100:00100000:0.0:1746147213.142510:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20039 00000100:00100000:0.0:1746147213.142517:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2003:x1830967310417536:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147213.142524:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147213.142531:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425062f8d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f1b2 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147213.142671:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147213.142688:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147213.142956:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2003:x1830967310417408:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 784us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147213.142962:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20038 00010000:00010000:0.0:1746147213.142988:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147213.142990:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147213.142996:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425062f8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1b2 expref: 19 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147213.143006:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425062f8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1b2 expref: 19 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147213.143014:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f381e00, rc 0) 00000100:00100000:0.0:1746147213.143032:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2003:x1830967310417536:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 517us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147213.143037:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20039 00002000:00010000:3.0:1746147213.146086:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime: 1746147212 -> 1746147213 00000100:00100000:3.0:1746147213.146130:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311493376:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147213.146164:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e260a00/0x3139939425062f78 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f19d expref: 18 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147213.146177:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e260a00/0x3139939425062f78 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f19d expref: 18 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147213.146187:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e260a00, rc 0) 00000100:00100000:3.0:1746147213.146235:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967310417152:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 4249us (4602us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147213.146244:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20037 00002000:00010000:0.0:1746147213.147485:0:13712:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746147212 -> 1746147213 00000100:00100000:0.0:1746147213.147503:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311493504:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147213.147526:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2b400/0x3139939425062f7f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1a4 expref: 15 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147213.147538:0:13712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2b400/0x3139939425062f7f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1a4 expref: 15 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147213.147561:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2b400, rc 0) 00000100:00100000:0.0:1746147213.147599:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967310417280:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 5629us (5916us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147213.147606:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20036 00000100:00100000:3.0:1746147213.155536:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.155770:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310417792 00000100:00100000:0.0:1746147213.155781:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310417792 00000100:00100000:0.0:1746147213.155847:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16481 00000100:00100000:0.0:1746147213.155855:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2936:x1830967310417792:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147213.155874:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147213.155896:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381400/0x3139939425062f94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f1b9 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.156001:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x3139939425062f9b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147213.156016:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261a00/0x3139939425062f71 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f196 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.156023:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x3139939425062f9b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147213.156058:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261a00/0x3139939425062f71 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f196 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.156071:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261a00/0x3139939425062f71 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f196 expref: 10 pid: 6215 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746147213.156084:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311493632:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147213.160111:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147213.169244:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311493632:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147213.169276:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x3139939425062f9b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:3.0:1746147213.170521:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.172503:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310417920 00000100:00100000:2.0:1746147213.172515:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310417920 00010000:00010000:2.0:1746147213.172556:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261a00/0x3139939425062f71 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f196 expref: 11 pid: 6215 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746147213.172592:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9104 00000100:00100000:2.0:1746147213.172600:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2002:x1830967310417920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147213.172623:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147213.172629:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261a00/0x3139939425062f71 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f196 expref: 11 pid: 6215 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.172642:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261a00/0x3139939425062f71 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f196 expref: 11 pid: 6215 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.172667:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e261a00/0x3139939425062f71 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f196 expref: 11 pid: 6215 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.172695:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147213.172700:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x3139939425062f9b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147213.172711:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x3139939425062f9b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147213.172718:0:13715:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x3139939425062f9b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147213.172739:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147213.172785:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2002:x1830967310417920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 187us (2267us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147213.172792:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9104 00010000:00010000:2.0:1746147213.172815:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x3139939425062f9b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147213.172822:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x3139939425062f9b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147213.172840:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147213.172963:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381400/0x3139939425062f94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1b9 expref: 11 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.172975:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x3139939425062f9b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1b9 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.172981:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147213.172984:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147213.172986:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f380c00, rc 0) 00000100:00100000:2.0:1746147213.173013:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2936:x1830967310417792:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 17159us (17489us total) trans 8589937390 rc 0/0 00000100:00100000:2.0:1746147213.173019:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16481 00000100:00100000:3.0:1746147213.176345:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.177126:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310418176 00000100:00100000:2.0:1746147213.177137:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310418176 00000100:00100000:2.0:1746147213.180683:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16482 00000100:00100000:2.0:1746147213.180703:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2936:x1830967310418176:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147213.180729:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147213.180733:0:6215:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147213.180767:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x3139939425062f9b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1b9 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.180787:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147213.180792:0:6215:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147213.180804:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425062fa9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f1c0 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.180903:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425062fb0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147213.180917:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425062fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147213.180927:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425062fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147213.180937:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147213.181031:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ba00/0x3139939425062fa9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1c0 expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.181044:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425062fb0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1c0 expref: 11 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.181050:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147213.181053:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147213.181055:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2ae00, rc 0) 00000100:00100000:2.0:1746147213.181139:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2936:x1830967310418176:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 443us (4803us total) trans 8589937391 rc 0/0 00000100:00100000:2.0:1746147213.181145:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16482 00000100:00100000:1.0:1746147213.186503:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.186582:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310418304 00000100:00100000:0.0:1746147213.186592:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310418304 00000100:00100000:0.0:1746147213.186661:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16483 00000100:00100000:0.0:1746147213.186670:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2936:x1830967310418304:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:0.0:1746147213.186693:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147213.186714:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932e3800/0x3139939425062fbe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f1c7 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.186773:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932e3800/0x3139939425062fbe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1c7 expref: 12 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.186788:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932e3800/0x3139939425062fbe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1c7 expref: 12 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.186802:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147213.186805:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147213.186809:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932e3800, rc 0) 00000100:00100000:0.0:1746147213.186851:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2936:x1830967310418304:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 182us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147213.186857:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16483 00000100:00100000:2.0:1746147213.191840:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.191864:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.191890:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.192775:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.193104:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.193197:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310418432 00000100:00100000:0.0:1746147213.193208:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310418432 00000100:00100000:0.0:1746147213.193253:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310418560 00000100:00100000:0.0:1746147213.193255:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310418560 00000100:00100000:0.0:1746147213.193271:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310418688 00000100:00100000:0.0:1746147213.193273:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310418688 00000100:00100000:0.0:1746147213.193283:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310418816 00000100:00100000:0.0:1746147213.193285:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310418816 00000100:00100000:0.0:1746147213.193306:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20040 00000100:00100000:0.0:1746147213.193314:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310418432:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147213.193364:0:13712:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425062fc5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.193384:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x3139939425062b34 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eef6 expref: 13 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.193391:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425062c22 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efa5 expref: 15 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147213.193398:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b80a00/0x3139939425062b49 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef04 expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.193403:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147213.193405:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147213.193408:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425062fc5 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.193441:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096b80a00/0x3139939425062b49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef04 expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.193454:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096b80a00/0x3139939425062b49 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef04 expref: 30 pid: 12225 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746147213.193468:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311493760:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147213.193551:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425062c22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efa5 expref: 15 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147213.193559:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425062c22 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efa5 expref: 15 pid: 9584 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746147213.193567:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311493888:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147213.193587:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x3139939425062b34 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eef6 expref: 13 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.193596:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x3139939425062b34 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eef6 expref: 13 pid: 10340 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746147213.193603:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311494016:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147213.193630:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147213.193652:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20041 00000100:00100000:0.0:1746147213.193657:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310418560:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:0.0:1746147213.193677:0:1136:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011db32800/0x3139939425062fcc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.193687:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d90600/0x3139939425062bb9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef58 expref: 33 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.193699:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x3139939425062c37 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efac expref: 18 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147213.193706:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ff5c00/0x3139939425062bd5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef6d expref: 37 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147213.193711:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147213.193712:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147213.193714:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db32800/0x3139939425062fcc lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.193730:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097ff5c00/0x3139939425062bd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef6d expref: 37 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147213.193738:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097ff5c00/0x3139939425062bd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef6d expref: 37 pid: 13712 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746147213.193747:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311494144:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147213.193771:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x3139939425062c37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efac expref: 18 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147213.193778:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x3139939425062c37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efac expref: 18 pid: 9584 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746147213.193785:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311494272:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147213.193804:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d90600/0x3139939425062bb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef58 expref: 33 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.193812:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d90600/0x3139939425062bb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef58 expref: 33 pid: 12201 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746147213.193819:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311494400:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147213.193831:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147213.194338:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20042 00000100:00100000:3.0:1746147213.194348:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310418688:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147213.194365:0:1853:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425062fd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.194376:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a57800/0x3139939425062f1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f173 expref: 37 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.194382:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147213.194384:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147213.194386:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425062fd3 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.194401:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a57800/0x3139939425062f1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f173 expref: 37 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.194409:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a57800/0x3139939425062f1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f173 expref: 37 pid: 1136 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.194417:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311494528:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147213.194446:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147213.194464:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20043 00000100:00100000:3.0:1746147213.194469:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310418816:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147213.194486:0:10340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425062fda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.194496:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425062f32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1327103) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f188 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.194507:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147213.194509:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147213.194511:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425062fda lrc: 4/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.194524:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425062f32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1327103) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f188 expref: 30 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.194531:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425062f32 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1327103) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f188 expref: 30 pid: 1136 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.194540:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311494656:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147213.194555:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147213.195407:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310418944 00000100:00100000:1.0:1746147213.195416:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310418944 00000100:00100000:1.0:1746147213.195465:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20044 00000100:00100000:1.0:1746147213.195471:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310418944:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:1.0:1746147213.195495:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425062fe1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147213.195507:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098227e00/0x3139939425062da3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f085 expref: 13 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147213.195514:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425062df0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0b6 expref: 30 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147213.195520:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425062f86 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ab expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147213.195527:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x3139939425062df7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0bd expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147213.195534:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x3139939425062ddb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a1 expref: 30 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147213.195540:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147213.195541:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147213.195543:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425062fe1 lrc: 8/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147213.195563:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x3139939425062ddb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a1 expref: 30 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147213.195572:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x3139939425062ddb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a1 expref: 30 pid: 13712 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746147213.195581:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311494784:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147213.195649:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x3139939425062df7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0bd expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147213.195657:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x3139939425062df7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0bd expref: 13 pid: 13712 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746147213.195664:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311494912:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147213.195690:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425062f86 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ab expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147213.195702:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425062f86 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ab expref: 16 pid: 12225 timeout: 851 lvb_type: 1 00000100:00100000:1.0:1746147213.195710:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311495040:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147213.195731:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425062df0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0b6 expref: 30 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147213.195737:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425062df0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0b6 expref: 30 pid: 13712 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746147213.195744:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311495168:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147213.195762:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098227e00/0x3139939425062da3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f085 expref: 13 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147213.195769:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098227e00/0x3139939425062da3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f085 expref: 13 pid: 1853 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746147213.195777:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311495296:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147213.195793:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1ccf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147213.196720:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147213.196827:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310419072 00000100:00100000:3.0:1746147213.196833:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310419072 00000100:00100000:3.0:1746147213.197254:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20045 00000100:00100000:3.0:1746147213.197261:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310419072:12345-192.168.204.25@tcp:1:mirror_io.0 00010000:00010000:3.0:1746147213.197293:0:12225:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e261e00/0x3139939425062fe8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.197309:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425062ede lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f150 expref: 37 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.197316:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425062f8d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1b2 expref: 19 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147213.197328:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a57200/0x3139939425062ee5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f157 expref: 33 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.197334:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425062d2c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f038 expref: 37 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.197341:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4200/0x3139939425062de9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0af expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.197347:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147213.197349:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746147213.197351:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e261e00/0x3139939425062fe8 lrc: 8/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.197376:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4200/0x3139939425062de9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0af expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.197385:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4200/0x3139939425062de9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0af expref: 33 pid: 1853 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.197401:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311495424:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147213.197921:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311494144:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147213.197958:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311494400:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147213.198548:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311494528:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147213.198567:0:1853:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425062fd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147213.198598:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311494656:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147213.198622:0:10340:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425062fda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.198861:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425062d2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f038 expref: 37 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.198873:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425062d2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f038 expref: 37 pid: 1853 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.198889:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311495552:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147213.198982:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311493760:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147213.198992:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311493888:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147213.199000:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311494016:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147213.199021:0:13712:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425062fc5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.199691:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a57200/0x3139939425062ee5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f157 expref: 33 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.199700:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a57200/0x3139939425062ee5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f157 expref: 33 pid: 1136 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.199709:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311495680:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147213.200460:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425062f8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1b2 expref: 19 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147213.200471:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425062f8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1b2 expref: 19 pid: 9585 timeout: 851 lvb_type: 1 00000100:00100000:3.0:1746147213.200481:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311495808:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147213.200518:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425062ede lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f150 expref: 37 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.200527:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425062ede lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f150 expref: 37 pid: 1136 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.200534:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311495936:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147213.200549:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f206c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147213.201464:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.201470:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311494272:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147213.201494:0:1136:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88011db32800/0x3139939425062fcc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147213.201494:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.201518:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310419200 00000100:00100000:0.0:1746147213.201519:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.201524:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310419200 00010000:00010000:2.0:1746147213.201551:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425062c22 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efa5 expref: 17 pid: 9584 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746147213.201571:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310419328 00000100:00100000:2.0:1746147213.201573:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310419328 00010000:00010000:2.0:1746147213.201581:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096b80a00/0x3139939425062b49 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef04 expref: 31 pid: 12225 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746147213.201595:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.201599:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9105 00000100:00100000:2.0:1746147213.201616:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967310419200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147213.201626:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147213.201627:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9106 00000100:00100000:0.0:1746147213.201635:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967310419328:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147213.201642:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147213.201645:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425062c22 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efa5 expref: 17 pid: 9584 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746147213.201651:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096b80a00/0x3139939425062b49 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef04 expref: 31 pid: 12225 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.201655:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425062c22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efa5 expref: 17 pid: 9584 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746147213.201663:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096b80a00/0x3139939425062b49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef04 expref: 31 pid: 12225 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746147213.202933:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311494784:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147213.202946:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311494912:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147213.202955:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311495040:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147213.202963:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311495168:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147213.203048:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310419456 00000100:00100000:3.0:1746147213.203055:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310419456 00002000:00100000:3.0:1746147213.203118:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x97:0x0] (1593344->2097151) req@ffff880097d74000 x1830967310419456/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:589/0 lens 488/0 e 0 to 0 dl 1746147224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147213.203128:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d74000 with x1830967310419456 ext(1593344->2097151) 00010000:00010000:3.0:1746147213.203137:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098a57800/0x3139939425062f1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f173 expref: 38 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746147213.203148:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098a57800/0x3139939425062f1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f173 expref: 38 pid: 1136 timeout: 851 lvb_type: 0 00002000:00010000:3.0:1746147213.203155:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d74000 00000100:00100000:3.0:1746147213.203171:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310419584 00000100:00100000:3.0:1746147213.203175:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310419584 00002000:00100000:3.0:1746147213.203187:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1327103) req@ffff880097d76300 x1830967310419584/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:589/0 lens 488/0 e 0 to 0 dl 1746147224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147213.203193:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d76300 with x1830967310419584 ext(1048576->1327103) 00010000:00010000:3.0:1746147213.203198:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425062f32 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1327103) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f188 expref: 32 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746147213.203205:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425062f32 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1327103) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f188 expref: 32 pid: 1136 timeout: 851 lvb_type: 0 00002000:00010000:3.0:1746147213.203210:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097d76300 00000100:00100000:3.0:1746147213.203221:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1741 00000100:00100000:3.0:1746147213.203227:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967310419456:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147213.203378:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1742 00000100:00100000:3.0:1746147213.203384:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967310419584:12345-192.168.204.25@tcp:4:cat.0 00010000:00010000:2.0:1746147213.203551:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425062c22 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efa5 expref: 17 pid: 9584 timeout: 851 lvb_type: 1 00010000:00010000:2.0:1746147213.203572:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147213.203597:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2003:x1830967310419200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1991us (2137us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147213.203615:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9105 00010000:00010000:0.0:1746147213.204147:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b80a00/0x3139939425062b49 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef04 expref: 33 pid: 12225 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.204171:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147213.204194:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967310419328:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2560us (2698us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147213.204200:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9106 00000100:00100000:0.0:1746147213.204923:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147213.205086:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310420224 00000100:00100000:1.0:1746147213.205107:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310420224 00010000:00010000:1.0:1746147213.205133:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425062d2c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f038 expref: 40 pid: 1853 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746147213.205164:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9107 00000100:00100000:1.0:1746147213.205170:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2002:x1830967310420224:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147213.205180:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147213.205199:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425062d2c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f038 expref: 40 pid: 1853 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746147213.205208:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425062d2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f038 expref: 40 pid: 1853 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746147213.205225:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147213.205249:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2002:x1830967310420224:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 78us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147213.205254:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9107 00010000:00010000:3.0:1746147213.205399:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092542600/0x3139939425062d2c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f038 expref: 39 pid: 1853 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.205413:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311495552:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147213.207415:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.207437:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310419712 00000100:00100000:2.0:1746147213.207444:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310419712 00010000:00010000:2.0:1746147213.207475:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x3139939425062b34 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eef6 expref: 14 pid: 10340 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746147213.207499:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9108 00000100:00100000:2.0:1746147213.207507:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5234c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310419712:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147213.207519:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147213.207539:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x3139939425062b34 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eef6 expref: 14 pid: 10340 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.207550:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x3139939425062b34 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eef6 expref: 14 pid: 10340 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.207570:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b81400/0x3139939425062b34 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7eef6 expref: 14 pid: 10340 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.207586:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.207588:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.207592:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425062fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.207600:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425062fc5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.207634:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147213.207669:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5234c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310419712:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 161us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147213.207675:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9108 00010000:00010000:2.0:1746147213.207726:0:13712:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425062fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.207734:0:13712:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425062fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.207756:0:13712:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425062fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.207764:0:13712:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425062fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.207771:0:13712:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425062fc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.207777:0:13712:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db33400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147213.207780:0:13712:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425062fc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.207787:0:13712:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425062fc5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147213.207794:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311495296:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147213.207796:0:13712:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425062fc5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.207802:0:13712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db33400/0x3139939425062fc5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.207830:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425062fe1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147213.207847:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310418432:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 14534us (16019us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147213.207855:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20040 00000100:00100000:3.0:1746147213.208231:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311495424:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147213.211278:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147213.211717:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310419968 00000100:00100000:1.0:1746147213.211725:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310419968 00010000:00010000:1.0:1746147213.211758:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x3139939425062ddb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a1 expref: 32 pid: 13712 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746147213.211784:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9109 00000100:00100000:1.0:1746147213.211790:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967310419968:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147213.211802:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147213.211822:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x3139939425062ddb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a1 expref: 32 pid: 13712 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746147213.211832:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x3139939425062ddb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a1 expref: 32 pid: 13712 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746147213.211855:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098226a00/0x3139939425062ddb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0a1 expref: 32 pid: 13712 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746147213.211881:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147213.211923:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967310419968:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 134us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147213.211930:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9109 00000100:00100000:2.0:1746147213.214698:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.214743:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.214768:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.214796:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.214809:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.214827:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147213.214938:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310420352 00000100:00100000:1.0:1746147213.214947:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310420352 00010000:00010000:1.0:1746147213.214982:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ff5c00/0x3139939425062bd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef6d expref: 39 pid: 13712 timeout: 851 lvb_type: 1 00000100:00100000:1.0:1746147213.215008:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310419840 00000100:00100000:1.0:1746147213.215010:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310419840 00010000:00010000:1.0:1746147213.215021:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x3139939425062c37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efac expref: 20 pid: 9584 timeout: 851 lvb_type: 1 00000100:00100000:1.0:1746147213.215029:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310420096 00000100:00100000:1.0:1746147213.215031:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310420096 00010000:00010000:1.0:1746147213.215041:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425062f86 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ab expref: 15 pid: 12225 timeout: 851 lvb_type: 1 00000100:00100000:1.0:1746147213.215050:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310420480 00000100:00100000:1.0:1746147213.215052:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310420480 00010000:00010000:1.0:1746147213.215061:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4200/0x3139939425062de9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0af expref: 34 pid: 1853 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746147213.215069:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310420608 00000100:00100000:1.0:1746147213.215071:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310420608 00010000:00010000:1.0:1746147213.215079:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d90600/0x3139939425062bb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef58 expref: 35 pid: 12201 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746147213.215086:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310420736 00000100:00100000:1.0:1746147213.215109:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310420736 00010000:00010000:1.0:1746147213.215119:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098227e00/0x3139939425062da3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f085 expref: 13 pid: 1853 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746147213.215130:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9110 00000100:00100000:1.0:1746147213.215136:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967310420352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147213.215148:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147213.215169:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ff5c00/0x3139939425062bd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef6d expref: 39 pid: 13712 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746147213.215185:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ff5c00/0x3139939425062bd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef6d expref: 39 pid: 13712 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746147213.215206:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ff5c00/0x3139939425062bd5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef6d expref: 39 pid: 13712 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746147213.215220:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147213.215254:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310420352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 118us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147213.215260:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9110 00000100:00100000:1.0:1746147213.215273:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9111 00000100:00100000:1.0:1746147213.215278:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967310419840:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147213.215286:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147213.215292:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x3139939425062c37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efac expref: 20 pid: 9584 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746147213.215300:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x3139939425062c37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efac expref: 20 pid: 9584 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746147213.215317:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9e00/0x3139939425062c37 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efac expref: 20 pid: 9584 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746147213.215325:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147213.215339:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310419840:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 61us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147213.215348:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9111 00000100:00100000:1.0:1746147213.215357:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9112 00000100:00100000:1.0:1746147213.215362:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310420096:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147213.215368:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147213.215381:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425062f86 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ab expref: 15 pid: 12225 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746147213.215389:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425062f86 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ab expref: 15 pid: 12225 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746147213.215402:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425062f86 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ab expref: 15 pid: 12225 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746147213.215410:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147213.215423:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310420096:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 61us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147213.215428:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9112 00000100:00100000:1.0:1746147213.215437:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9113 00000100:00100000:1.0:1746147213.215441:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+35:2000:x1830967310420480:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147213.215446:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147213.215454:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4200/0x3139939425062de9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0af expref: 35 pid: 1853 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746147213.215559:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9114 00000100:00100000:0.0:1746147213.215568:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+35:2002:x1830967310420608:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147213.215575:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147213.215583:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d90600/0x3139939425062bb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef58 expref: 35 pid: 12201 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.215591:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d90600/0x3139939425062bb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef58 expref: 35 pid: 12201 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.215603:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d90600/0x3139939425062bb9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef58 expref: 35 pid: 12201 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.215628:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147213.215630:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147213.215635:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db32800/0x3139939425062fcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.215644:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db32800/0x3139939425062fcc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.215666:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147213.215683:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+34:2002:x1830967310420608:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 116us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147213.215688:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9114 00000100:00100000:0.0:1746147213.215700:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9115 00000100:00100000:0.0:1746147213.215705:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5234850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2002:x1830967310420736:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147213.215712:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147213.215719:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098227e00/0x3139939425062da3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f085 expref: 13 pid: 1853 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.215727:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098227e00/0x3139939425062da3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f085 expref: 13 pid: 1853 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.215738:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098227e00/0x3139939425062da3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f085 expref: 13 pid: 1853 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.215746:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147213.215760:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5234850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2002:x1830967310420736:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 55us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147213.215765:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9115 00010000:00010000:0.0:1746147213.215783:0:1136:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88011db32800/0x3139939425062fcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.215791:0:1136:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db32800/0x3139939425062fcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.215806:0:1136:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88011db32800/0x3139939425062fcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.215813:0:1136:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011db32800/0x3139939425062fcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147213.215906:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311495680:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147213.215916:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311495808:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147213.215924:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311495936:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147213.216999:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4200/0x3139939425062de9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0af expref: 33 pid: 1853 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746147213.217217:0:12225:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e261e00/0x3139939425062fe8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147213.217225:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a49c4200/0x3139939425062de9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0af expref: 33 pid: 1853 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746147213.217237:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147213.217271:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2000:x1830967310420480:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1829us (2474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147213.217278:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9113 00010000:00010000:0.0:1746147213.217432:0:1136:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011db32800/0x3139939425062fcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.217438:0:1136:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db32800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147213.217442:0:1136:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011db32800/0x3139939425062fcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.217451:0:1136:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011db32800/0x3139939425062fcc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.217461:0:1136:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011db32800/0x3139939425062fcc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.217467:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db32800/0x3139939425062fcc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147213.217512:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.217515:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310418560:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 23858us (25650us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147213.217524:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20041 00000100:00100000:2.0:1746147213.218172:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.218188:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.218205:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310420864 00000100:00100000:2.0:1746147213.218211:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310420864 00010000:00010000:2.0:1746147213.218233:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425062f8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1b2 expref: 18 pid: 9585 timeout: 851 lvb_type: 1 00000100:00100000:2.0:1746147213.218259:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310421120 00000100:00100000:2.0:1746147213.218261:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310421120 00010000:00010000:2.0:1746147213.218272:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x3139939425062df7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0bd expref: 12 pid: 13712 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746147213.218283:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310420992 00000100:00100000:2.0:1746147213.218285:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310420992 00010000:00010000:2.0:1746147213.218293:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425062df0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0b6 expref: 31 pid: 13712 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746147213.218307:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9116 00000100:00100000:2.0:1746147213.218312:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310420864:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147213.218321:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147213.218325:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9117 00000100:00100000:0.0:1746147213.218331:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967310421120:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147213.218334:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425062f8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1b2 expref: 18 pid: 9585 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746147213.218337:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147213.218348:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x3139939425062df7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0bd expref: 12 pid: 13712 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.218352:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425062f8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1b2 expref: 18 pid: 9585 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746147213.218355:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x3139939425062df7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0bd expref: 12 pid: 13712 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.218364:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x3139939425062f8d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1b2 expref: 18 pid: 9585 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746147213.218365:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095052400/0x3139939425062df7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0bd expref: 12 pid: 13712 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.218373:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147213.218375:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147213.218376:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9118 00000100:00100000:1.0:1746147213.218383:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967310420992:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147213.218390:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147213.218395:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2000:x1830967310421120:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 64us (223us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147213.218399:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425062df0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0b6 expref: 31 pid: 13712 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746147213.218400:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9117 00010000:00010000:1.0:1746147213.218409:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425062df0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0b6 expref: 31 pid: 13712 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746147213.218421:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425062df0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f0b6 expref: 31 pid: 13712 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746147213.218430:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147213.218432:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147213.218436:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425062fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147213.218444:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425062fe1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147213.218473:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147213.218494:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425062fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.218505:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425062fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.218522:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425062fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.218534:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425062fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.218540:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425062fe1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.218545:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38cc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147213.218548:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425062fe1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.218554:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425062fe1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.218564:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425062fe1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.218570:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38cc00/0x3139939425062fe1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147213.218741:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310420864:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 427us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147213.218746:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9116 00000100:00100000:2.0:1746147213.218771:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.218781:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310421248 00000100:00100000:2.0:1746147213.218783:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310421248 00010000:00010000:2.0:1746147213.218792:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425062ede lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f150 expref: 40 pid: 1136 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746147213.218804:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9119 00000100:00100000:2.0:1746147213.218808:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2000:x1830967310421248:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147213.218813:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147213.218813:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310420992:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 430us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147213.218815:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310418944:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 23344us (25710us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147213.218819:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425062ede lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f150 expref: 40 pid: 1136 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746147213.218819:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9118 00000100:00100000:0.0:1746147213.218821:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20044 00010000:00010000:2.0:1746147213.218827:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425062ede lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f150 expref: 40 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.218842:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a56e00/0x3139939425062ede lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f150 expref: 40 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.218849:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147213.218863:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2000:x1830967310421248:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 54us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147213.218867:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9119 00000100:00100000:2.0:1746147213.218911:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.222311:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967310419456:12345-192.168.204.25@tcp:4:cat.0 Request processed in 19071us (20778us total) trans 17179875273 rc 0/0 00000100:00100000:2.0:1746147213.222324:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1741 00002000:00100000:2.0:1746147213.222336:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x97:0x0] (1593344->2097151) req@ffff880097d74000 x1830967310419456/t17179875273(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:589/0 lens 488/448 e 0 to 0 dl 1746147224 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147213.222347:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d74000 with x1830967310419456 ext(1593344->2097151) 00010000:00010000:2.0:1746147213.222358:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098a57800/0x3139939425062f1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f173 expref: 37 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.222370:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098a57800/0x3139939425062f1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f173 expref: 37 pid: 1136 timeout: 851 lvb_type: 0 00002000:00010000:2.0:1746147213.222377:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d74000 00000100:00100000:0.0:1746147213.223268:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310421376 00000100:00100000:0.0:1746147213.223276:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310421376 00010000:00010000:0.0:1746147213.223303:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a57200/0x3139939425062ee5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f157 expref: 32 pid: 1136 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746147213.223342:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9120 00000100:00100000:0.0:1746147213.223350:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+32:2003:x1830967310421376:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147213.223363:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147213.223602:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967310419584:12345-192.168.204.25@tcp:4:cat.0 Request processed in 20217us (22007us total) trans 21474842658 rc 0/0 00000100:00100000:3.0:1746147213.223617:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1742 00002000:00100000:3.0:1746147213.225512:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1327103) req@ffff880097d76300 x1830967310419584/t21474842658(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:589/0 lens 488/448 e 0 to 0 dl 1746147224 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147213.225529:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d76300 with x1830967310419584 ext(1048576->1327103) 00010000:00010000:3.0:1746147213.225542:0:29479:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425062f32 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1327103) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f188 expref: 30 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746147213.225555:0:29479:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425062f32 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1327103) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f188 expref: 30 pid: 1136 timeout: 851 lvb_type: 0 00002000:00010000:3.0:1746147213.225568:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097d76300 00010000:00010000:0.0:1746147213.225679:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a57200/0x3139939425062ee5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f157 expref: 32 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.225689:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a57200/0x3139939425062ee5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f157 expref: 32 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.225711:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a57200/0x3139939425062ee5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f157 expref: 32 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.225726:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147213.225728:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147213.225732:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e261e00/0x3139939425062fe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.225740:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e261e00/0x3139939425062fe8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.225786:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147213.225832:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+31:2003:x1830967310421376:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2483us (6920us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147213.225839:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9120 00010000:00010000:3.0:1746147213.225900:0:12225:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e261e00/0x3139939425062fe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.225908:0:12225:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e261e00/0x3139939425062fe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.225925:0:12225:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e261e00/0x3139939425062fe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.225932:0:12225:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e261e00/0x3139939425062fe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.225939:0:12225:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e261e00/0x3139939425062fe8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.225946:0:12225:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e261e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147213.225949:0:12225:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e261e00/0x3139939425062fe8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.225956:0:12225:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e261e00/0x3139939425062fe8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.225966:0:12225:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e261e00/0x3139939425062fe8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.225976:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e261e00/0x3139939425062fe8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147213.226025:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310419072:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 28764us (29307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147213.226033:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20045 00000100:00100000:0.0:1746147213.230018:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.230116:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310421504 00000100:00100000:2.0:1746147213.230126:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310421504 00010000:00010000:2.0:1746147213.230169:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a57800/0x3139939425062f1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f173 expref: 37 pid: 1136 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746147213.230205:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9121 00000100:00100000:2.0:1746147213.230211:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967310421504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147213.230226:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147213.230247:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a57800/0x3139939425062f1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f173 expref: 37 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.230258:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a57800/0x3139939425062f1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f173 expref: 37 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.230281:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a57800/0x3139939425062f1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f173 expref: 37 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.230295:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.230297:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.230301:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425062fd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.230309:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425062fd3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.230331:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147213.230370:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967310421504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 160us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147213.230377:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9121 00010000:00010000:3.0:1746147213.230514:0:1853:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425062fd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.230523:0:1853:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425062fd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.230541:0:1853:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425062fd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.230548:0:1853:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425062fd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.230555:0:1853:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425062fd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.230561:0:1853:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e261c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147213.230564:0:1853:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425062fd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.230571:0:1853:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425062fd3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.230582:0:1853:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425062fd3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.230587:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e261c00/0x3139939425062fd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147213.230644:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310418688:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 36298us (38752us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147213.230652:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20042 00000100:00100000:2.0:1746147213.231460:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.233293:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310421632 00000100:00100000:0.0:1746147213.233303:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310421632 00010000:00010000:0.0:1746147213.233342:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425062f32 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1327103) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f188 expref: 30 pid: 1136 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746147213.233385:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9122 00000100:00100000:0.0:1746147213.233392:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5237450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967310421632:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147213.233404:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147213.233423:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425062f32 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1327103) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f188 expref: 30 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.233434:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425062f32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1327103) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f188 expref: 30 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.233454:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a57c00/0x3139939425062f32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1327103) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f188 expref: 30 pid: 1136 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.233468:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147213.233469:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147213.233473:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425062fda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.233481:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425062fda lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147213.233502:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147213.233554:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5237450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967310421632:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 162us (2094us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147213.233560:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9122 00010000:00010000:3.0:1746147213.233793:0:10340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425062fda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.233803:0:10340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425062fda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.233821:0:10340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425062fda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.233828:0:10340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425062fda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.233834:0:10340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425062fda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.233840:0:10340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e260c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147213.233844:0:10340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425062fda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.233851:0:10340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425062fda lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.233860:0:10340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425062fda lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.233865:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e260c00/0x3139939425062fda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147213.233985:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310418816:12345-192.168.204.25@tcp:1:mirror_io.0 Request processed in 39513us (41209us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147213.233993:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20043 00000100:00100000:0.0:1746147213.239541:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147213.239569:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310421888 00000100:00100000:3.0:1746147213.239579:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310421888 00000100:00100000:3.0:1746147213.239651:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16484 00000100:00100000:3.0:1746147213.239660:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2936:x1830967310421888:12345-192.168.204.25@tcp:36:mirror_io.0 00010000:00010000:3.0:1746147213.239712:0:6215:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147213.239742:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932e3800/0x3139939425062fbe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1c7 expref: 12 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.239760:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147213.239765:0:6215:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147213.239794:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.239808:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49200/0x3139939425062c6f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efd6 expref: 19 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.239816:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73c00/0x3139939425062dbf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f08c expref: 47 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.239823:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef20 expref: 19 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.239829:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425062b88 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef27 expref: 19 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.239835:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6800/0x3139939425062b96 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef35 expref: 47 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.239841:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x3139939425062ced lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f015 expref: 47 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.239847:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542c00/0x3139939425062d3a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f03f expref: 19 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.239852:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 10/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.239885:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092542c00/0x3139939425062d3a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f03f expref: 19 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.239897:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542c00/0x3139939425062d3a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f03f expref: 19 pid: 6215 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.239911:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311496064:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147213.241214:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x3139939425062ced lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f015 expref: 47 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.241226:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x3139939425062ced lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f015 expref: 47 pid: 6215 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.241239:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311496192:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147213.241294:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6800/0x3139939425062b96 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef35 expref: 47 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.241301:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6800/0x3139939425062b96 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef35 expref: 47 pid: 7239 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.241308:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311496320:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147213.241370:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425062b88 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef27 expref: 19 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.241377:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425062b88 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef27 expref: 19 pid: 7239 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.241384:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311496448:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147213.241402:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef20 expref: 19 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.241408:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef20 expref: 19 pid: 7237 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.241420:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311496576:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147213.241437:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73c00/0x3139939425062dbf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f08c expref: 47 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.241443:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73c00/0x3139939425062dbf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f08c expref: 47 pid: 7237 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.241449:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311496704:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147213.241463:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49200/0x3139939425062c6f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efd6 expref: 19 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.241469:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49200/0x3139939425062c6f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efd6 expref: 19 pid: 6215 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.241475:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311496832:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147213.241487:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147213.245769:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311496064:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147213.245783:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311496192:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147213.246573:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.246784:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.246824:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.246861:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.246887:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310422528 00000100:00100000:0.0:1746147213.246895:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310422528 00010000:00010000:0.0:1746147213.246935:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6800/0x3139939425062b96 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef35 expref: 48 pid: 7239 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746147213.246963:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310422784 00000100:00100000:0.0:1746147213.246965:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310422784 00010000:00010000:0.0:1746147213.246975:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef20 expref: 20 pid: 7237 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746147213.246991:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9123 00000100:00100000:0.0:1746147213.246998:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2000:x1830967310422528:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147213.247012:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147213.247017:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6800/0x3139939425062b96 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef35 expref: 48 pid: 7239 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.247028:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6800/0x3139939425062b96 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef35 expref: 48 pid: 7239 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.247052:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147213.247062:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147213.247072:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147213.247120:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310422144 00000100:00100000:2.0:1746147213.247125:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310422144 00000100:00100000:0.0:1746147213.247138:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:2000:x1830967310422528:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 139us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147213.247144:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9123 00000100:00100000:2.0:1746147213.247147:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310422400 00000100:00100000:2.0:1746147213.247149:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310422400 00000100:00100000:0.0:1746147213.247158:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9124 00000100:00100000:2.0:1746147213.247160:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6168 00000100:00100000:0.0:1746147213.247163:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310422784:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147213.247164:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:30600:x1830967310422144:12345-192.168.204.25@tcp:35:ldlm_bl.0 00010000:00010000:0.0:1746147213.247169:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147213.247172:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef20 expref: 21 pid: 7237 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.247180:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef20 expref: 21 pid: 7237 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.247190:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147213.247192:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147213.247197:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147213.247210:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310422784:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 47us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147213.247214:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9124 00000100:00100000:0.0:1746147213.247242:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.247255:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310422912 00000100:00100000:0.0:1746147213.247257:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310422912 00010000:00010000:0.0:1746147213.247266:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73c00/0x3139939425062dbf lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f08c expref: 49 pid: 7237 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746147213.247279:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9125 00000100:00100000:0.0:1746147213.247283:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2003:x1830967310422912:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147213.247292:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147213.247294:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73c00/0x3139939425062dbf lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f08c expref: 49 pid: 7237 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.247301:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73c00/0x3139939425062dbf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f08c expref: 49 pid: 7237 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746147213.247310:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147213.247313:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147213.247317:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147213.247329:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:2003:x1830967310422912:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 44us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147213.247587:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6169 00000100:00100000:1.0:1746147213.247596:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+49:30601:x1830967310422400:12345-192.168.204.25@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1746147213.247763:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6800/0x3139939425062b96 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef35 expref: 50 pid: 7239 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.247777:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311496320:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147213.247788:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311496448:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147213.247799:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x3139939425062b81 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef20 expref: 21 pid: 7237 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.247808:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311496576:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147213.247815:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a73c00/0x3139939425062dbf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f08c expref: 49 pid: 7237 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.247823:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311496704:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147213.248131:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:30600:x1830967310422144:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 964us (1560us total) trans 8589937392 rc 0/0 00000100:00100000:2.0:1746147213.248138:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6168 00000100:00100000:1.0:1746147213.248227:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+48:30601:x1830967310422400:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 631us (1441us total) trans 8589937393 rc 0/0 00000100:00100000:1.0:1746147213.248233:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6169 00000100:00100000:1.0:1746147213.248275:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147213.248341:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.248397:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310422656 00000100:00100000:2.0:1746147213.248401:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310422656 00010000:00010000:2.0:1746147213.248416:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425062b88 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef27 expref: 20 pid: 7239 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746147213.248436:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310423040 00000100:00100000:2.0:1746147213.248437:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310423040 00010000:00010000:2.0:1746147213.248444:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49200/0x3139939425062c6f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efd6 expref: 21 pid: 6215 timeout: 851 lvb_type: 0 00000100:00100000:2.0:1746147213.248456:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9126 00000100:00100000:2.0:1746147213.248460:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310422656:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147213.248468:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147213.248472:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425062b88 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef27 expref: 21 pid: 7239 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.248480:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425062b88 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef27 expref: 21 pid: 7239 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.248494:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a7c00/0x3139939425062b88 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7ef27 expref: 21 pid: 7239 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.248503:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147213.248507:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147213.248513:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147213.248528:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310422656:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 68us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147213.248533:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9126 00000100:00100000:2.0:1746147213.248541:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9127 00000100:00100000:2.0:1746147213.248544:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2000:x1830967310423040:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147213.248549:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147213.248552:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49200/0x3139939425062c6f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efd6 expref: 19 pid: 6215 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.248559:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49200/0x3139939425062c6f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efd6 expref: 19 pid: 6215 timeout: 851 lvb_type: 0 00010000:00010000:2.0:1746147213.248566:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147213.248568:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147213.248571:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147213.248581:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2000:x1830967310423040:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 36us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147213.248585:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9127 00000100:00100000:0.0:1746147213.248639:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9125 00010000:00010000:3.0:1746147213.248691:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49200/0x3139939425062c6f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7efd6 expref: 18 pid: 6215 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746147213.248701:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311496832:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147213.248738:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147213.252040:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.252141:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147213.252299:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310423296 00000100:00100000:1.0:1746147213.252309:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310423296 00000100:00100000:3.0:1746147213.252345:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310423168 00000100:00100000:3.0:1746147213.252349:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310423168 00010000:00010000:1.0:1746147213.252351:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x3139939425062ced lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f015 expref: 47 pid: 6215 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746147213.252366:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092542c00/0x3139939425062d3a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f03f expref: 18 pid: 6215 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746147213.252393:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9128 00000100:00100000:1.0:1746147213.252401:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+47:2003:x1830967310423296:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746147213.252428:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9129 00000100:00100000:3.0:1746147213.252434:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5237850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310423168:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147213.252447:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147213.252454:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092542c00/0x3139939425062d3a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f03f expref: 18 pid: 6215 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746147213.252465:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092542c00/0x3139939425062d3a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f03f expref: 18 pid: 6215 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746147213.252492:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542c00/0x3139939425062d3a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f03f expref: 18 pid: 6215 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746147213.252506:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147213.252511:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.252519:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147213.252564:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5237850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310423168:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 129us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147213.252572:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9129 00010000:00010000:1.0:1746147213.252582:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147213.252588:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x3139939425062ced lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f015 expref: 47 pid: 6215 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746147213.252599:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x3139939425062ced lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f015 expref: 47 pid: 6215 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746147213.252631:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c7fc00/0x3139939425062ced lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f015 expref: 47 pid: 6215 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746147213.252642:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147213.252646:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147213.252654:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147213.252660:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147213.252695:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147213.252714:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+46:2003:x1830967310423296:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 314us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147213.252720:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9128 00010000:00010000:3.0:1746147213.252724:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.252730:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000040:00080000:3.0:1746147213.253005:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1290, 88 off121376 00000004:00080000:3.0:1746147213.253013:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751242923106ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147213.253619:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1286, 88 off121024 00000004:00080000:3.0:1746147213.253629:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751243539229ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147213.253657:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1287, 88 off121112 00000004:00080000:3.0:1746147213.253661:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751243571402ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147213.253670:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1291, 88 off121464 00000004:00080000:3.0:1746147213.253673:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751243583495ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147213.253680:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1292, 88 off121552 00000004:00080000:3.0:1746147213.253684:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751243594415ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147213.253716:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1288, 88 off121200 00000004:00080000:3.0:1746147213.253720:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751243630841ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147213.253730:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1289, 88 off121288 00000004:00080000:3.0:1746147213.253733:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751243643596ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147213.253740:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1290, 88 off121376 00000004:00080000:3.0:1746147213.253743:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751243653392ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147213.253750:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1293, 88 off121640 00000004:00080000:3.0:1746147213.253754:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751243664152ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147213.253761:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1291, 88 off121464 00000004:00080000:3.0:1746147213.253763:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751243673985ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147213.253772:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1294, 88 off121728 00000004:00080000:3.0:1746147213.253775:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751243685745ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147213.253784:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1292, 88 off121552 00000004:00080000:3.0:1746147213.253786:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751243696632ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147213.253801:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1295, 88 off121816 00000004:00080000:3.0:1746147213.253804:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751243714165ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147213.253820:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1296, 88 off121904 00000004:00080000:3.0:1746147213.253823:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751243733439ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147213.253830:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1297, 88 off121992 00000004:00080000:3.0:1746147213.253833:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751243743486ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147213.253842:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1298, 88 off122080 00000004:00080000:3.0:1746147213.253845:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 751243755570ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147213.253854:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1293, 88 off121640 00000004:00080000:3.0:1746147213.253858:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 751243768294ns, next at 694367916532ns, rc = 0 00000001:00080000:2.0:1746147213.255635:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937394 is committed 00000004:00080000:2.0:1746147213.255646:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1270 committed 00000004:00080000:2.0:1746147213.255661:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1278 committed 00000004:00080000:2.0:1746147213.255668:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1277 committed 00000004:00080000:2.0:1746147213.255669:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1276 committed 00000004:00080000:2.0:1746147213.255671:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1275 committed 00000004:00080000:2.0:1746147213.255673:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1269 committed 00000004:00080000:2.0:1746147213.255674:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1274 committed 00000004:00080000:2.0:1746147213.255676:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1268 committed 00000004:00080000:2.0:1746147213.255678:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1273 committed 00000004:00080000:2.0:1746147213.255680:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1267 committed 00000004:00080000:2.0:1746147213.255683:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1266 committed 00000004:00080000:2.0:1746147213.255685:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1265 committed 00000004:00080000:2.0:1746147213.255686:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1272 committed 00000004:00080000:2.0:1746147213.255688:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1271 committed 00000004:00080000:2.0:1746147213.255690:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1264 committed 00000004:00080000:2.0:1746147213.255692:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1263 committed 00000004:00080000:2.0:1746147213.255694:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1270 committed 00000001:00080000:2.0:1746147213.255699:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937393 is committed 00000001:00080000:2.0:1746147213.255706:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937392 is committed 00000100:00100000:3.0:1746147213.255831:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311497344:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147213.255893:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147213.255944:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311497088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147213.255963:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311496960:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147213.255971:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147213.255987:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147213.255995:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311497600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147213.256003:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311497472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147213.256012:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147213.256019:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311497216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147213.256035:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147213.256045:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311497728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147213.256057:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147213.256069:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311498240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147213.256084:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147213.256113:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746147213.256118:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311498752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147213.256133:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147213.256169:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311497344 00000100:00100000:3.0:1746147213.256170:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311497856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147213.256176:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311497344 00000100:00100000:3.0:1746147213.256190:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147213.256202:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311498368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147213.256214:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147213.256263:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311497088 00000100:00100000:2.0:1746147213.256267:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311497088 00000100:00100000:2.0:1746147213.256318:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311496960 00000100:00100000:2.0:1746147213.256321:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311496960 00000100:00100000:2.0:1746147213.256334:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311497600 00000100:00100000:2.0:1746147213.256336:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311497600 00000100:00100000:2.0:1746147213.256342:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311497216 00000100:00100000:2.0:1746147213.256344:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311497216 00000100:00100000:2.0:1746147213.256351:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311497728 00000100:00100000:2.0:1746147213.256352:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311497728 00000100:00100000:2.0:1746147213.256359:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311498240 00000100:00100000:2.0:1746147213.256361:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311498240 00000100:00100000:2.0:1746147213.256372:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311498752 00000100:00100000:2.0:1746147213.256374:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311498752 00000100:00100000:2.0:1746147213.256381:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311497856 00000100:00100000:2.0:1746147213.256382:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311497856 00000100:00100000:2.0:1746147213.256389:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311498368 00000100:00100000:2.0:1746147213.256390:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311498368 00000100:00100000:1.0:1746147213.256416:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20046 00000100:00100000:1.0:1746147213.256425:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3764:x1830967311497344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147213.256518:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20047 00000100:00100000:2.0:1746147213.256523:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+59:3766:x1830967311497088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147213.256665:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311498880:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147213.256689:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147213.256700:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746147213.256704:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311497984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147213.256719:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147213.256726:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311498496:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147213.256738:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147213.256754:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311498880 00000100:00100000:3.0:1746147213.256757:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311498880 00000100:00100000:3.0:1746147213.256769:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311497984 00000100:00100000:3.0:1746147213.256771:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311497984 00000100:00100000:3.0:1746147213.256778:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311498496 00000100:00100000:3.0:1746147213.256779:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311498496 00000100:00100000:3.0:1746147213.256786:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20048 00000100:00100000:3.0:1746147213.256790:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3765:x1830967311496960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147213.256888:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147213.256892:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147213.256894:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147213.256896:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147213.256898:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746147213.256901:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3765:x1830967311496960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (912us total) trans 17179875275 rc 0/0 00000100:00100000:3.0:1746147213.256907:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20048 00000100:00100000:3.0:1746147213.256920:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20049 00000100:00100000:3.0:1746147213.256924:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3766:x1830967311497600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147213.256929:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3764:x1830967311497344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 501us (1033us total) trans 17179875274 rc 0/0 00000100:00100000:1.0:1746147213.256935:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20046 00000100:00100000:1.0:1746147213.256947:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20050 00000100:00100000:1.0:1746147213.256951:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3767:x1830967311497216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147213.256968:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:3.0:1746147213.256971:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147213.256972:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147213.256975:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147213.256976:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000004:00080000:1.0:1746147213.256980:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d76d80/2, rc 0, transno 17179875274 00000100:00100000:1.0:1746147213.256985:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311497344:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147213.256997:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3766:x1830967311497600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (984us total) trans 17179875276 rc 0/0 00000004:00080000:1.0:1746147213.257000:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d77800/2, rc 0, transno 17179875276 00000100:00100000:3.0:1746147213.257002:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20049 00000100:00100000:1.0:1746147213.257003:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311497600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147213.257011:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20051 00000100:00100000:3.0:1746147213.257015:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3767:x1830967311497728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147213.257059:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311498112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147213.257082:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147213.257107:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311498624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147213.257123:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147213.257143:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311498112 00000100:00100000:0.0:1746147213.257146:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311498112 00000100:00100000:0.0:1746147213.257157:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311498624 00000100:00100000:0.0:1746147213.257159:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311498624 00000100:00100000:0.0:1746147213.257167:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20052 00000100:00100000:0.0:1746147213.257172:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3767:x1830967311498240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147213.257511:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3767:x1830967311498240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 338us (1424us total) trans 21474842659 rc 0/0 00000100:00100000:0.0:1746147213.257516:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20052 00000100:00100000:2.0:1746147213.257527:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+61:3766:x1830967311497088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1003us (1554us total) trans 17179875278 rc 0/0 00000100:00100000:0.0:1746147213.257527:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20053 00000100:00100000:0.0:1746147213.257532:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3767:x1830967311498752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147213.257534:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20047 00000100:00100000:2.0:1746147213.257545:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20054 00000100:00100000:2.0:1746147213.257550:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+60:3764:x1830967311497856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147213.257575:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147213.257577:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147213.257579:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147213.257581:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147213.257582:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:0.0:1746147213.257603:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3767:x1830967311498752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (1469us total) trans 21474842660 rc 0/0 00000100:00100000:0.0:1746147213.257619:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20053 00000100:00100000:2.0:1746147213.257629:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+61:3764:x1830967311497856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (1438us total) trans 17179875279 rc 0/0 00000100:00100000:0.0:1746147213.257631:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20055 00000100:00100000:2.0:1746147213.257635:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20054 00000100:00100000:0.0:1746147213.257635:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3764:x1830967311498368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147213.257647:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20056 00000100:00100000:2.0:1746147213.257652:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+39:3764:x1830967311498880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147213.257668:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746147213.257671:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147213.257672:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147213.257674:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147213.257676:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:0.0:1746147213.257691:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3764:x1830967311498368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (1475us total) trans 21474842661 rc 0/0 00002000:00010000:2.0:1746147213.257694:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00000100:00100000:0.0:1746147213.257694:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20055 00002000:00010000:2.0:1746147213.257697:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147213.257699:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147213.257700:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147213.257702:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:0.0:1746147213.257702:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20057 00000100:00100000:0.0:1746147213.257705:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3764:x1830967311497984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147213.257722:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3764:x1830967311498880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1033us total) trans 21474842662 rc 0/0 00000100:00100000:2.0:1746147213.257727:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20056 00000100:00100000:2.0:1746147213.257740:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20058 00000100:00100000:0.0:1746147213.257743:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3764:x1830967311497984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 37us (1022us total) trans 21474842663 rc 0/0 00000100:00100000:2.0:1746147213.257745:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3764:x1830967311498496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147213.257747:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20057 00000100:00100000:0.0:1746147213.257756:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20059 00000100:00100000:0.0:1746147213.257761:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3767:x1830967311498112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147213.257797:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3764:x1830967311498496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (1058us total) trans 21474842664 rc 0/0 00000100:00100000:2.0:1746147213.257802:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20058 00000100:00100000:0.0:1746147213.257810:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3767:x1830967311498112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (726us total) trans 21474842665 rc 0/0 00000100:00100000:2.0:1746147213.257811:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20060 00000100:00100000:2.0:1746147213.257815:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3767:x1830967311498624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147213.257815:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20059 00000100:00100000:0.0:1746147213.257832:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746147213.257855:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d77100/2, rc 0, transno 17179875275 00000100:00100000:0.0:1746147213.257859:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311496960:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147213.257864:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3767:x1830967311498624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (740us total) trans 21474842666 rc 0/0 00000100:00100000:2.0:1746147213.257869:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20060 00000100:00100000:0.0:1746147213.257869:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311497472 00000100:00100000:0.0:1746147213.257871:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311497472 00000100:00080000:2.0:1746147213.257886:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147213.257888:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:3767:x1830967311497216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 937us (1852us total) trans 17179875277 rc 0/0 00000100:00080000:2.0:1746147213.257889:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746147213.257889:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20061 00000100:00100000:0.0:1746147213.257893:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e218050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+61:3765:x1830967311497472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147213.257894:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20050 00000004:00080000:1.0:1746147213.257913:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d77b80/2, rc 0, transno 17179875278 00000100:00100000:1.0:1746147213.257916:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311497088:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147213.257930:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258c380/2, rc 0, transno 21474842663 00000100:00100000:1.0:1746147213.257936:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311497984:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147213.257942:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4397b80/2, rc 0, transno 21474842664 00000100:00100000:1.0:1746147213.257945:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311498496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147213.257948:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e218050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+61:3765:x1830967311497472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (115us total) trans 17179875280 rc 0/0 00000004:00080000:1.0:1746147213.257951:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d75880/2, rc 0, transno 17179875279 00000100:00100000:1.0:1746147213.257953:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311497856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147213.257953:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20061 00000004:00080000:1.0:1746147213.257958:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258ed80/2, rc 0, transno 21474842661 00000100:00100000:1.0:1746147213.257960:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311498368:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147213.257965:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5575180/2, rc 0, transno 21474842662 00000100:00100000:1.0:1746147213.257967:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311498880:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147213.257971:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d75c00/2, rc 0, transno 17179875280 00000100:00100000:0.0:1746147213.257974:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311497472:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746147213.257993:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4394380/2, rc 0, transno 21474842660 00000100:00100000:0.0:1746147213.257996:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311498752:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147213.258001:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258ca80/2, rc 0, transno 21474842665 00000100:00100000:0.0:1746147213.258004:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311498112:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147213.258009:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4397800/2, rc 0, transno 21474842666 00000100:00100000:0.0:1746147213.258011:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311498624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147213.258012:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311499008:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147213.258016:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258f100/2, rc 0, transno 21474842659 00000100:00100000:0.0:1746147213.258018:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311498240:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147213.258024:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d76a00/2, rc 0, transno 17179875277 00000100:00100000:0.0:1746147213.258026:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311497216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147213.258032:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147213.258305:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3767:x1830967311497728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1287us (2245us total) trans 17179875281 rc 0/0 00000100:00100000:3.0:1746147213.258311:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20051 00000100:00100000:3.0:1746147213.258423:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311499008 00000100:00100000:3.0:1746147213.258426:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311499008 00000004:00080000:1.0:1746147213.258426:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d75180/2, rc 0, transno 17179875281 00000100:00100000:1.0:1746147213.258430:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311497728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147213.258734:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20062 00000100:00100000:0.0:1746147213.258741:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3765:x1830967311499008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147213.258819:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3765:x1830967311499008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (785us total) trans 21474842667 rc 0/0 00000100:00100000:0.0:1746147213.258824:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20062 00000004:00080000:1.0:1746147213.258888:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5577100/2, rc 0, transno 21474842667 00000100:00100000:1.0:1746147213.258892:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311499008:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746147213.258957:0:6215:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880097d74380 reply state ffff880134a2a800 transno 8589937394 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.258977:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.258987:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147213.258991:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746147213.258995:0:6215:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746147213.259077:0:6215:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746147213.259111:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2936:x1830967310421888:12345-192.168.204.25@tcp:36:mirror_io.0 Request processed in 19429us (19558us total) trans 8589937394 rc 0/0 00000100:00100000:3.0:1746147213.259118:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16484 00010000:00010000:1.0:1746147213.259177:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147213.259186:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147213.259193:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147213.259198:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e260000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147213.259202:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147213.259208:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147213.259218:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147213.259220:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147213.259223:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147213.259228:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e260000/0x3139939425062fef lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147213.263461:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147213.263645:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310423424 00000100:00100000:3.0:1746147213.263654:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310423424 00000100:00100000:3.0:1746147213.263699:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16485 00000100:00100000:3.0:1746147213.263707:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2936:x1830967310423424:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147213.263732:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147213.263751:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425062ff6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f1ce expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.263807:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425062ff6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ce expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.263819:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425062ff6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ce expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.263833:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147213.263836:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147213.263839:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0f600, rc 0) 00000100:00100000:3.0:1746147213.264209:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2936:x1830967310423424:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 501us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147213.264215:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16485 00000100:00100000:0.0:1746147213.267269:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147213.267411:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310423552 00000100:00100000:3.0:1746147213.267420:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310423552 00000100:00100000:3.0:1746147213.267468:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16486 00000100:00100000:3.0:1746147213.267477:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2936:x1830967310423552:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:3.0:1746147213.267497:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147213.267521:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425062ffd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f1d5 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.267629:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425063004 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.267643:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425063004 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.267654:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425063004 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147213.267683:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147213.267688:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147213.267705:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425063004 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147213.267729:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0fa00/0x3139939425062ffd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1d5 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.267747:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425063004 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1d5 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147213.267756:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147213.267758:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147213.267761:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0f400, rc 0) 00000100:00100000:3.0:1746147213.267805:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2936:x1830967310423552:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 329us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147213.267811:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16486 00000100:00100000:0.0:1746147213.270322:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.270361:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.270503:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310423680 00000100:00100000:0.0:1746147213.270506:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.270513:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310423680 00000100:00100000:0.0:1746147213.270597:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.271628:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310423808 00000100:00100000:2.0:1746147213.271633:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310423808 00000100:00100000:2.0:1746147213.271658:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310423936 00000100:00100000:2.0:1746147213.271661:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310423936 00000100:00100000:2.0:1746147213.271679:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310424064 00000100:00100000:2.0:1746147213.271681:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310424064 00000100:00100000:2.0:1746147213.271698:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20063 00000100:00100000:2.0:1746147213.271705:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310423680:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147213.271721:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147213.271738:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b0800/0x313993942506300b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f1dc expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147213.271758:0:9584:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x93:0x0] initial LVB size: 1048576, mtime: 0x6814178a, atime: 0x6814178a, ctime: 0x6814178b, blocks: 0x7e8 00010000:00010000:2.0:1746147213.271774:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.271775:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.271782:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b0800/0x313993942506300b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1dc expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147213.271797:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b0800/0x313993942506300b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1dc expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147213.271807:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b0800, rc 0) 00000100:00100000:2.0:1746147213.271858:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310423680:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 153us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147213.271864:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20063 00000100:00100000:1.0:1746147213.271873:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20064 00000100:00100000:2.0:1746147213.271885:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20065 00000100:00100000:1.0:1746147213.271889:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310423808:12345-192.168.204.25@tcp:101:mirror_io.0 00000100:00100000:2.0:1746147213.271891:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310423936:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147213.271898:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147213.271904:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147213.271908:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b0000/0x3139939425063012 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f1ea expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147213.271921:0:9584:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x97:0x0] initial LVB size: 2097152, mtime: 0x6814178c, atime: 0x6814178d, ctime: 0x6814178c, blocks: 0x800 00010000:00010000:1.0:1746147213.271923:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425063019 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f1e3 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147213.271928:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.271929:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.271933:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b0000/0x3139939425063012 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ea expref: 17 pid: 9584 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746147213.271942:0:17600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x96:0x0] initial LVB size: 2097152, mtime: 0x6814178b, atime: 0x6814178a, ctime: 0x6814178b, blocks: 0x808 00010000:00010000:2.0:1746147213.271943:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b0000/0x3139939425063012 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ea expref: 17 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147213.271949:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b0000, rc 0) 00010000:00010000:1.0:1746147213.271958:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147213.271960:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147213.271965:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310423936:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 74us (1459us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147213.271967:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425063019 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1e3 expref: 18 pid: 17600 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147213.271973:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20065 00010000:00010000:1.0:1746147213.271979:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425063019 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1e3 expref: 18 pid: 17600 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147213.271984:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20066 00010000:00010000:1.0:1746147213.271988:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f15f800, rc 0) 00000100:00100000:2.0:1746147213.271989:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310424064:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147213.271994:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147213.272001:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425063020 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f1f1 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147213.272009:0:9584:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6814178c, atime: 0x6814178d, ctime: 0x6814178c, blocks: 0x808 00010000:00010000:2.0:1746147213.272016:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.272017:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.272021:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425063020 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1f1 expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147213.272026:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310423808:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 143us (1663us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147213.272030:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425063020 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1f1 expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147213.272032:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20064 00010000:00010000:2.0:1746147213.272036:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1200, rc 0) 00000100:00100000:2.0:1746147213.272052:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310424064:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 63us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147213.272058:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20066 00000100:00100000:0.0:1746147213.272214:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147213.272291:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147213.272363:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310424192 00000100:00100000:2.0:1746147213.272367:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310424192 00000100:00100000:2.0:1746147213.272383:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310424320 00000100:00100000:2.0:1746147213.272385:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310424320 00000100:00100000:2.0:1746147213.272397:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20067 00000100:00100000:2.0:1746147213.272401:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310424192:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147213.272408:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147213.272416:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b1e00/0x3139939425063027 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f1f8 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147213.272425:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4886560, mtime: 0x6814178c, atime: 0x6814178c, ctime: 0x6814178c, blocks: 0x1558 00010000:00010000:2.0:1746147213.272431:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.272433:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.272437:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1e00/0x3139939425063027 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1f8 expref: 15 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147213.272445:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1e00/0x3139939425063027 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1f8 expref: 15 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147213.272453:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1e00, rc 0) 00000100:00100000:2.0:1746147213.272470:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310424192:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 68us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147213.272475:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20067 00000100:00100000:2.0:1746147213.272484:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20068 00000100:00100000:2.0:1746147213.272488:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310424320:12345-192.168.204.25@tcp:101:mirror_io.0 00010000:00010000:2.0:1746147213.272494:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147213.272502:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x313993942506302e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f1ff expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147213.272510:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x98:0x0] initial LVB size: 4194304, mtime: 0x6814178c, atime: 0x6814178c, ctime: 0x6814178c, blocks: 0x1008 00010000:00010000:2.0:1746147213.272516:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.272518:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147213.272522:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x313993942506302e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ff expref: 18 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147213.272529:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x313993942506302e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ff expref: 18 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147213.272536:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1a00, rc 0) 00000100:00100000:2.0:1746147213.272551:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310424320:12345-192.168.204.25@tcp:101:mirror_io.0 Request processed in 62us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147213.272556:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20068 00000001:00080000:2.0:1746147213.728670:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875281 is committed 00000001:00080000:2.0:1746147213.728691:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875273 is committed 00000001:00080000:2.0:1746147213.728697:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875272 is committed 00000001:00080000:2.0:1746147213.728742:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875247 is committed 00010000:00010000:1.0:1746147213.817616:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147214.010117:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746147214.010136:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311499136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746147214.010193:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147214.010317:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311499136 00000100:00100000:1.0:1746147214.010324:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311499136 00000100:00100000:1.0:1746147214.010371:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1746147214.010379:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311499136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1746147214.010411:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1314817088 pending 3186688 free 3905277952 avail 3673755648 00000100:00100000:1.0:1746147214.010448:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311499136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147214.010455:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00080000:3.0:1746147214.013822:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147214.013907:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311499136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746147214.278377:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.278653:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.278743:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.279124:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310424576 00000100:00100000:2.0:1746147214.279132:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310424576 00000100:00080000:2.0:1746147214.279156:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147214.279187:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310424448 00000100:00100000:2.0:1746147214.279190:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310424448 00000100:00100000:2.0:1746147214.279205:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310424832 00000100:00100000:2.0:1746147214.279207:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310424832 00000100:00100000:2.0:1746147214.279220:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20069 00000100:00100000:2.0:1746147214.279226:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2003:x1830967310424576:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:2.0:1746147214.279333:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2003:x1830967310424576:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 106us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.279340:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20069 00000100:00100000:2.0:1746147214.279353:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20070 00000100:00100000:2.0:1746147214.279357:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2002:x1830967310424448:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:2.0:1746147214.279399:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2002:x1830967310424448:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 41us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.279403:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20070 00000100:00100000:2.0:1746147214.279411:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20071 00000100:00100000:2.0:1746147214.279416:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967310424832:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:2.0:1746147214.279439:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967310424832:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 23us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.279443:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20071 00000100:00080000:2.0:1746147214.279452:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147214.279615:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147214.279827:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310425088 00000100:00100000:3.0:1746147214.279831:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310425088 00000100:00100000:3.0:1746147214.279849:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20072 00000100:00100000:3.0:1746147214.279854:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2003:x1830967310425088:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:3.0:1746147214.279892:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2003:x1830967310425088:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 37us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147214.279897:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20072 00000100:00100000:2.0:1746147214.284027:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.284067:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147214.284148:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310424704 00000100:00100000:3.0:1746147214.284156:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310424704 00000100:00100000:3.0:1746147214.284189:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310424960 00000100:00100000:3.0:1746147214.284192:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310424960 00000100:00100000:3.0:1746147214.284206:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20073 00000100:00100000:3.0:1746147214.284212:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2002:x1830967310424704:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:3.0:1746147214.284305:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2002:x1830967310424704:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 93us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147214.284310:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20073 00000100:00100000:3.0:1746147214.284322:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20074 00000100:00100000:3.0:1746147214.284325:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2002:x1830967310424960:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:3.0:1746147214.284353:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2002:x1830967310424960:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 27us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147214.284357:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20074 00000100:00100000:0.0:1746147214.290182:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.290668:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.290838:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.291164:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.291280:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310425344 00000100:00100000:2.0:1746147214.291287:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310425344 00000100:00100000:2.0:1746147214.291319:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310425600 00000100:00100000:2.0:1746147214.291321:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310425600 00000100:00100000:2.0:1746147214.291334:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310425856 00000100:00100000:2.0:1746147214.291335:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310425856 00000100:00100000:2.0:1746147214.291346:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20075 00000100:00100000:2.0:1746147214.291353:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310425344:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:2.0:1746147214.291433:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310425344:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 80us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.291438:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20075 00000100:00100000:2.0:1746147214.291448:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20076 00000100:00100000:2.0:1746147214.291452:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310425600:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:2.0:1746147214.291480:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310425600:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 27us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.291485:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20076 00000100:00100000:2.0:1746147214.291493:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20077 00000100:00100000:2.0:1746147214.291497:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310425856:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:2.0:1746147214.291522:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310425856:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 24us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.291527:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20077 00000100:00100000:0.0:1746147214.291779:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310425216 00000100:00100000:0.0:1746147214.291781:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310425216 00000100:00100000:0.0:1746147214.291797:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20078 00000100:00100000:0.0:1746147214.291801:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310425216:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:0.0:1746147214.291832:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310425216:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 31us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147214.291836:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20078 00000100:00100000:0.0:1746147214.292333:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.292354:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147214.292389:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310425472 00000100:00100000:3.0:1746147214.292393:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310425472 00000100:00100000:3.0:1746147214.292420:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310425728 00000100:00100000:3.0:1746147214.292423:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310425728 00000100:00100000:3.0:1746147214.292444:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20079 00000100:00100000:3.0:1746147214.292449:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310425472:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:1.0:1746147214.292480:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20080 00000100:00100000:1.0:1746147214.292486:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310425728:12345-192.168.204.25@tcp:23:mirror_io.0 00000100:00100000:3.0:1746147214.292553:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310425472:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 103us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147214.292682:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20079 00000100:00100000:1.0:1746147214.292725:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310425728:12345-192.168.204.25@tcp:23:mirror_io.0 Request processed in 238us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147214.292730:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20080 00000100:00100000:0.0:1746147214.298107:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.298485:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310425984 00000100:00100000:2.0:1746147214.298493:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310425984 00000100:00100000:2.0:1746147214.298543:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20081 00000100:00100000:2.0:1746147214.298551:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310425984:12345-192.168.204.25@tcp:22:mirror_io.0 00002000:00010000:2.0:1746147214.298745:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147214.298748:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147214.298750:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147214.298752:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147214.298754:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:2.0:1746147214.298799:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310425984:12345-192.168.204.25@tcp:22:mirror_io.0 Request processed in 249us (717us total) trans 17179875282 rc 0/0 00000100:00100000:2.0:1746147214.298805:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20081 00000100:00100000:0.0:1746147214.302618:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.303788:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310426112 00000100:00100000:2.0:1746147214.303797:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310426112 00000100:00100000:2.0:1746147214.303847:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20082 00000100:00100000:2.0:1746147214.303854:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967310426112:12345-192.168.204.25@tcp:22:mirror_io.0 00002000:00010000:2.0:1746147214.304151:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147214.304154:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147214.304157:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147214.304159:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147214.304161:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:2.0:1746147214.304209:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2003:x1830967310426112:12345-192.168.204.25@tcp:22:mirror_io.0 Request processed in 355us (1598us total) trans 21474842668 rc 0/0 00000100:00100000:2.0:1746147214.304215:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20082 00000100:00100000:0.0:1746147214.315478:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.315530:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.315639:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310426368 00000100:00100000:2.0:1746147214.315651:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310426368 00000100:00100000:2.0:1746147214.315707:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310426624 00000100:00100000:2.0:1746147214.315710:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310426624 00000100:00100000:2.0:1746147214.315729:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7376 00000100:00100000:2.0:1746147214.315736:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310426368:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:2.0:1746147214.315766:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063035 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.315779:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.315781:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.315785:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063035 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.315797:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063035 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147214.315893:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7377 00000100:00100000:3.0:1746147214.315901:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310426624:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:3.0:1746147214.315920:0:29479:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x313993942506303c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.315927:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147214.315929:0:29479:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147214.315932:0:29479:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x313993942506303c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.315941:0:29479:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x313993942506303c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147214.320737:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.320785:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.320871:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310426880 00000100:00100000:1.0:1746147214.320876:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310427136 00000100:00100000:2.0:1746147214.320879:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310426880 00000100:00100000:1.0:1746147214.320880:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310427136 00000100:00100000:1.0:1746147214.320920:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7378 00000100:00100000:1.0:1746147214.320926:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310427136:12345-192.168.204.25@tcp:3:mirror_io.0 00000100:00100000:2.0:1746147214.320928:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7379 00000100:00100000:2.0:1746147214.320933:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310426880:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:2.0:1746147214.320952:0:13334:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f588c00/0x313993942506304a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.320952:0:29474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063043 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.320963:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147214.320963:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.320965:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147214.320965:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147214.320968:0:29474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063043 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.320972:0:13334:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f588c00/0x313993942506304a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.320979:0:29474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063043 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.320980:0:13334:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f588c00/0x313993942506304a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147214.326231:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.326280:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147214.326384:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310427392 00000100:00100000:1.0:1746147214.326393:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310427392 00000100:00100000:1.0:1746147214.326456:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310427648 00000100:00100000:1.0:1746147214.326459:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310427648 00000100:00100000:1.0:1746147214.326479:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7380 00000100:00100000:1.0:1746147214.326486:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967310427392:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:1.0:1746147214.326516:0:9589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88011db32200/0x3139939425063051 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.326528:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147214.326530:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147214.326534:0:9589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011db32200/0x3139939425063051 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.326545:0:9589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011db32200/0x3139939425063051 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147214.326648:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7381 00000100:00100000:2.0:1746147214.326657:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310427648:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:2.0:1746147214.326673:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063058 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.326681:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.326682:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.326685:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063058 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.326693:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063058 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147214.332595:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.335072:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147214.337987:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310427904 00000100:00100000:3.0:1746147214.337999:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310427904 00000100:00100000:3.0:1746147214.338047:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310428160 00000100:00100000:3.0:1746147214.338050:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310428160 00000100:00100000:3.0:1746147214.338074:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7382 00000100:00100000:3.0:1746147214.338081:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2000:x1830967310427904:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:3.0:1746147214.338140:0:29476:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x313993942506305f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.338154:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147214.338156:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147214.338161:0:29476:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x313993942506305f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.338174:0:29476:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x313993942506305f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147214.338803:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7383 00000100:00100000:3.0:1746147214.338810:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310428160:12345-192.168.204.25@tcp:3:mirror_io.0 00010000:00010000:3.0:1746147214.338826:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425063066 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.338833:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147214.338834:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147214.338837:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425063066 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.338846:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425063066 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.339628:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063035 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.339638:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063035 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.339645:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063035 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.339651:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e573e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147214.339655:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063035 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.339661:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063035 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.339673:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063035 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.339678:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063035 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147214.339742:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2000:x1830967310426368:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 24005us (24271us total) trans 0 rc 1032192/1032192 00000100:00100000:2.0:1746147214.339748:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7376 00010000:00010000:3.0:1746147214.343527:0:29479:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x313993942506303c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.343541:0:29479:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x313993942506303c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.343549:0:29479:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x313993942506303c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.343554:0:29479:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0e000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147214.343557:0:29479:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x313993942506303c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.343563:0:29479:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x313993942506303c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.343578:0:29479:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x313993942506303c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.343595:0:29479:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x313993942506303c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29479 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147214.343687:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310426624:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 27783us (28153us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147214.343697:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7377 00010000:00010000:1.0:1746147214.353407:0:29474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063043 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.353422:0:29474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063043 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.353430:0:29474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063043 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.353436:0:29474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932e2a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147214.353440:0:29474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063043 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.353446:0:29474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063043 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.353460:0:29474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063043 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.353471:0:29474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063043 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147214.353554:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967310427136:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 32624us (32764us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147214.353563:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7378 00010000:00010000:0.0:1746147214.366597:0:13334:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f588c00/0x313993942506304a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147214.366611:0:13334:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f588c00/0x313993942506304a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147214.366619:0:13334:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f588c00/0x313993942506304a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147214.366625:0:13334:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f588c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147214.366629:0:13334:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f588c00/0x313993942506304a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147214.366635:0:13334:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f588c00/0x313993942506304a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147214.366649:0:13334:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f588c00/0x313993942506304a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147214.366660:0:13334:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f588c00/0x313993942506304a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147214.366752:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310426880:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 45814us (46018us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147214.366761:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7379 00010000:00010000:1.0:1746147214.369211:0:9589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88011db32200/0x3139939425063051 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.369224:0:9589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011db32200/0x3139939425063051 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.369231:0:9589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011db32200/0x3139939425063051 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.369237:0:9589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db32200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147214.369240:0:9589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db32200/0x3139939425063051 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.369246:0:9589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011db32200/0x3139939425063051 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.369260:0:9589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011db32200/0x3139939425063051 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.369265:0:9589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011db32200/0x3139939425063051 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147214.369355:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310427392:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 42866us (43130us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147214.369364:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7380 00010000:00010000:2.0:1746147214.378210:0:29477:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063058 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.378226:0:29477:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063058 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.378233:0:29477:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063058 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.378239:0:29477:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f588e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147214.378242:0:29477:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063058 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.378250:0:29477:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063058 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.378264:0:29477:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063058 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.378270:0:29477:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063058 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147214.378348:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310427648:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 51687us (52062us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147214.378356:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7381 00010000:00010000:3.0:1746147214.385446:0:29476:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x313993942506305f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.385462:0:29476:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x313993942506305f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.385470:0:29476:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x313993942506305f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.385476:0:29476:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0fa00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147214.385480:0:29476:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x313993942506305f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.385487:0:29476:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x313993942506305f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.385504:0:29476:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x313993942506305f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.385510:0:29476:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x313993942506305f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147214.385634:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310427904:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 47548us (53051us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147214.385647:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7382 00010000:00010000:3.0:1746147214.393552:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425063066 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.393566:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425063066 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.393572:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425063066 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.393579:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0f200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147214.393582:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425063066 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.393598:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425063066 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.393614:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425063066 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.393620:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0f200/0x3139939425063066 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147214.394240:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310428160:12345-192.168.204.25@tcp:3:mirror_io.0 Request processed in 55425us (59169us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147214.394253:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7383 00000100:00100000:0.0:1746147214.400491:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147214.400754:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310428288 00000100:00100000:1.0:1746147214.400761:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310428288 00000100:00100000:1.0:1746147214.400821:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1003 00000100:00100000:1.0:1746147214.400829:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2936:x1830967310428288:12345-192.168.204.25@tcp:103:mirror_io.0 00010000:00010000:1.0:1746147214.400841:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147214.400861:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2ae00/0x3139939425062fb0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1c0 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746147214.400935:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746147214.401055:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147214.401059:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147214.401198:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2936:x1830967310428288:12345-192.168.204.25@tcp:103:mirror_io.0 Request processed in 370us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147214.401204:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1003 00000100:00100000:0.0:1746147214.402861:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147214.402952:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310428544 00000100:00100000:1.0:1746147214.402958:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310428544 00000100:00100000:1.0:1746147214.402999:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6170 00000100:00100000:1.0:1746147214.403004:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f8b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2936:x1830967310428544:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:1.0:1746147214.403157:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f8b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2936:x1830967310428544:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 152us (301us total) trans 8589937395 rc 0/0 00000100:00100000:1.0:1746147214.403162:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6170 00000100:00100000:0.0:1746147214.404254:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.404319:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310428800 00000100:00100000:2.0:1746147214.404324:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310428800 00000100:00100000:2.0:1746147214.404354:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6171 00000100:00100000:2.0:1746147214.404360:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2936:x1830967310428800:12345-192.168.204.25@tcp:35:mirror_io.0 00000100:00100000:2.0:1746147214.404451:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2936:x1830967310428800:12345-192.168.204.25@tcp:35:mirror_io.0 Request processed in 91us (200us total) trans 8589937396 rc 0/0 00000100:00100000:2.0:1746147214.404457:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6171 00000100:00100000:0.0:1746147214.429185:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.429240:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147214.429304:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310429184 00000100:00100000:3.0:1746147214.429313:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310429184 00000100:00100000:3.0:1746147214.429352:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310429312 00000100:00100000:3.0:1746147214.429354:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310429312 00000100:00100000:3.0:1746147214.429388:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16487 00000100:00100000:3.0:1746147214.429395:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2950:x1830967310429184:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147214.429417:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147214.429433:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x313993942506306d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f206 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147214.429448:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16488 00000100:00100000:1.0:1746147214.429456:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2948:x1830967310429312:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147214.429465:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147214.429473:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x3139939425063074 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f20d expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.429496:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x313993942506307b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147214.429502:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425063082 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.429508:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x313993942506307b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.429518:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x313993942506307b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.429529:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380800/0x3139939425063089 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.429533:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380800/0x3139939425063089 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.429538:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380800/0x3139939425063089 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147214.429567:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425063082 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.429575:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425063082 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.429592:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425063090 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.429598:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425063090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.429603:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425063090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.429634:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381400/0x3139939425063097 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147214.429641:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942506309e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.429645:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381400/0x3139939425063097 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.429650:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381400/0x3139939425063097 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147214.429659:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147214.429715:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x313993942506307b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.429722:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x313993942506307b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.429727:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x313993942506307b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.429732:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f380c00 already unused, calling callback (ffffffffa0efd690) 00000100:00080000:2.0:1746147214.429733:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746147214.429735:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x313993942506307b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.429740:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x313993942506307b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.429748:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147214.429751:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147214.429754:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x313993942506307b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.429758:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380c00/0x313993942506307b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.429786:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380800/0x3139939425063089 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.429794:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380800/0x3139939425063089 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.429798:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380800/0x3139939425063089 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.429802:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f380800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147214.429804:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380800/0x3139939425063089 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.429808:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380800/0x3139939425063089 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.429813:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800930f4500) 00010000:00010000:3.0:1746147214.429816:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147214.429817:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380800/0x3139939425063089 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.429822:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f380800/0x3139939425063089 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147214.429958:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942506309e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.429965:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942506309e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147214.429972:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147214.430004:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425063082 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.430010:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425063082 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.430014:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425063082 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.430019:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425063082 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.430022:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db33c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147214.430024:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425063082 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.430028:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425063082 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.430034:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:1.0:1746147214.430036:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147214.430038:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425063082 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.430042:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x3139939425063082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.430059:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425063090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.430064:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425063090 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.430067:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425063090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.430071:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011db32e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147214.430073:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425063090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.430077:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425063090 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.430082:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800930f4500) 00010000:00010000:1.0:1746147214.430084:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147214.430087:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425063090 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.430109:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x3139939425063090 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.430136:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32800/0x3139939425063074 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f20d expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.430147:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942506309e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f20d expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.430152:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147214.430153:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147214.430155:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33000, rc 0) 00000100:00100000:1.0:1746147214.430204:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2948:x1830967310429312:12345-192.168.204.25@tcp:101:cat.0 Request processed in 748us (963us total) trans 8589937398 rc 0/0 00000100:00100000:1.0:1746147214.430210:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16488 00010000:00010000:3.0:1746147214.432870:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x313993942506306d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f206 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.432890:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381400/0x3139939425063097 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f206 expref: 28 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.432898:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147214.432900:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147214.432903:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f381400, rc 0) 00000100:00100000:3.0:1746147214.432966:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2950:x1830967310429184:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3571us (3789us total) trans 8589937397 rc 0/0 00000100:00100000:3.0:1746147214.432974:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16487 00000100:00100000:0.0:1746147214.437751:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.437786:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.437810:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.437836:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.437856:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310429440 00000100:00100000:3.0:1746147214.437861:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310429568 00000100:00100000:0.0:1746147214.437864:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310429440 00000100:00100000:3.0:1746147214.437866:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310429568 00000100:00100000:0.0:1746147214.437906:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310429696 00000100:00100000:0.0:1746147214.437909:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310429696 00000100:00100000:3.0:1746147214.437916:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310429824 00000100:00100000:3.0:1746147214.437918:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310429824 00000100:00100000:0.0:1746147214.437923:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20083 00000100:00100000:0.0:1746147214.437930:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310429440:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:3.0:1746147214.437936:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20084 00000100:00100000:3.0:1746147214.437940:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+6:2001:x1830967310429568:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147214.437944:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147214.437948:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147214.437959:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f380c00/0x31399394250630ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f21b expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147214.437959:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e6800/0x31399394250630b3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f214 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.437978:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147214.437978:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147214.437980:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147214.437981:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147214.437987:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f380c00/0x31399394250630ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f21b expref: 7 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147214.437987:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e6800/0x31399394250630b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f214 expref: 13 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147214.437998:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f380c00/0x31399394250630ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f21b expref: 7 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147214.437999:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e6800/0x31399394250630b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f214 expref: 13 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147214.438007:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f380c00, rc 0) 00010000:00010000:0.0:1746147214.438007:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e6800, rc 0) 00000100:00100000:3.0:1746147214.438048:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2001:x1830967310429568:12345-192.168.204.25@tcp:101:cat.0 Request processed in 107us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147214.438054:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20084 00000100:00100000:3.0:1746147214.438066:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20085 00000100:00100000:3.0:1746147214.438071:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+6:2001:x1830967310429696:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147214.438076:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147214.438080:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20086 00010000:00010000:3.0:1746147214.438082:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x31399394250630c1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f222 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147214.438086:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310429824:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147214.438110:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147214.438111:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147214.438112:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147214.438116:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x31399394250630c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f222 expref: 7 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.438117:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a20c00/0x31399394250630c8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f229 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.438123:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x31399394250630c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f222 expref: 7 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.438127:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.438128:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147214.438129:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f381e00, rc 0) 00010000:00010000:2.0:1746147214.438132:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a20c00/0x31399394250630c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f229 expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.438140:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a20c00/0x31399394250630c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f229 expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.438147:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a20c00, rc 0) 00000100:00100000:3.0:1746147214.438292:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2001:x1830967310429696:12345-192.168.204.25@tcp:101:cat.0 Request processed in 220us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147214.438294:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310429440:12345-192.168.204.25@tcp:101:cat.0 Request processed in 363us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147214.438297:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20085 00000100:00100000:0.0:1746147214.438300:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20083 00000100:00080000:3.0:1746147214.438340:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147214.438352:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310429824:12345-192.168.204.25@tcp:101:cat.0 Request processed in 266us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.438358:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20086 00000100:00100000:3.0:1746147214.438603:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147214.439180:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.439220:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310429952 00000100:00100000:0.0:1746147214.439224:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310429952 00000100:00100000:0.0:1746147214.439252:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310430080 00000100:00100000:0.0:1746147214.439254:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310430080 00000100:00100000:0.0:1746147214.439266:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20087 00000100:00100000:0.0:1746147214.439270:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310429952:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147214.439277:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147214.439285:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x31399394250630cf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f230 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147214.439296:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147214.439297:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147214.439301:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x31399394250630cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f230 expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147214.439310:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x31399394250630cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f230 expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147214.439322:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e7800, rc 0) 00000100:00100000:0.0:1746147214.439343:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310429952:12345-192.168.204.25@tcp:101:cat.0 Request processed in 72us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147214.439347:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20087 00000100:00100000:0.0:1746147214.439357:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20088 00000100:00100000:0.0:1746147214.439361:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2001:x1830967310430080:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147214.439366:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147214.439372:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x31399394250630d6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f237 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147214.439381:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147214.439382:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147214.439385:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x31399394250630d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f237 expref: 8 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147214.439393:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x31399394250630d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f237 expref: 8 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147214.439399:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e7600, rc 0) 00000100:00100000:0.0:1746147214.439412:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2001:x1830967310430080:12345-192.168.204.25@tcp:101:cat.0 Request processed in 51us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147214.439417:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20088 00000100:00100000:0.0:1746147214.444308:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.444351:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147214.444420:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310430336 00000100:00100000:1.0:1746147214.444428:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310430336 00000100:00100000:1.0:1746147214.444462:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310430720 00000100:00100000:1.0:1746147214.444463:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310430720 00000100:00100000:3.0:1746147214.444470:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16489 00000100:00100000:3.0:1746147214.444480:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2944:x1830967310430336:12345-192.168.204.25@tcp:101:multiop.0 00000100:00100000:1.0:1746147214.444494:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16490 00010000:00010000:3.0:1746147214.444500:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147214.444500:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2949:x1830967310430720:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147214.444510:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147214.444517:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381800/0x31399394250630dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f23e expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.444517:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x31399394250630e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f24c expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.444597:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x31399394250630f2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147214.444597:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.444608:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425063004 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1d5 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.444618:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381400/0x3139939425063097 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f206 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.444626:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942506309e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f20d expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.444631:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 6/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.444721:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x31399394250630f2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.444742:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x31399394250630f2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147214.444754:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942506309e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f20d expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.444763:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942506309e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f20d expref: 10 pid: 7238 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746147214.444774:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5574a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311499264:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147214.444851:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381400/0x3139939425063097 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f206 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.444861:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381400/0x3139939425063097 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f206 expref: 29 pid: 6215 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746147214.444867:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311499392:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147214.445178:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425063004 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1d5 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.445185:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425063004 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1d5 expref: 9 pid: 6215 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746147214.445192:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311499520:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147214.445231:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147214.450459:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.450494:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.450517:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.450543:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.451437:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147214.451616:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310430464 00000100:00100000:3.0:1746147214.451625:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310430464 00000100:00100000:0.0:1746147214.451629:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310430848 00000100:00100000:0.0:1746147214.451633:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310430848 00000100:00080000:3.0:1746147214.451648:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746147214.451651:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147214.451666:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310430976 00000100:00100000:0.0:1746147214.451668:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310430976 00000100:00100000:3.0:1746147214.451671:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310431104 00000100:00100000:3.0:1746147214.451674:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310431104 00000100:00100000:0.0:1746147214.451678:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310431232 00000100:00100000:0.0:1746147214.451679:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310431232 00000100:00100000:3.0:1746147214.451690:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20089 00000100:00100000:0.0:1746147214.451697:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20090 00000100:00100000:3.0:1746147214.451698:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967310430848:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147214.451702:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967310430464:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147214.451712:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147214.451712:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147214.451725:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f007c00/0x3139939425063100 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f253 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147214.451725:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e6a00/0x31399394250630f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f245 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.451743:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147214.451743:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147214.451744:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147214.451745:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147214.451752:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f007c00/0x3139939425063100 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f253 expref: 24 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147214.451752:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e6a00/0x31399394250630f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f245 expref: 32 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147214.451765:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f007c00/0x3139939425063100 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f253 expref: 24 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147214.451765:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e6a00/0x31399394250630f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f245 expref: 32 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147214.451774:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f007c00, rc 0) 00010000:00010000:0.0:1746147214.451774:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e6a00, rc 0) 00000100:00100000:0.0:1746147214.451808:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967310430464:12345-192.168.204.25@tcp:101:cat.0 Request processed in 106us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.451813:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20091 00000100:00100000:0.0:1746147214.451818:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20090 00000100:00100000:2.0:1746147214.451820:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967310430976:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147214.451827:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147214.451829:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20092 00010000:00010000:2.0:1746147214.451834:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x3139939425063107 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f25a expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147214.451834:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967310431104:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147214.451839:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147214.451843:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147214.451844:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e6600/0x313993942506310e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f261 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.451845:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.451849:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x3139939425063107 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f25a expref: 25 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147214.451852:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147214.451853:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.451857:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x3139939425063107 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f25a expref: 25 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147214.451857:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e6600/0x313993942506310e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f261 expref: 32 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147214.451865:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e6600/0x313993942506310e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f261 expref: 32 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.451867:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a21400, rc 0) 00010000:00010000:0.0:1746147214.451871:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e6600, rc 0) 00000100:00100000:3.0:1746147214.451904:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310430848:12345-192.168.204.25@tcp:101:cat.0 Request processed in 206us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147214.451909:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20089 00000100:00100000:1.0:1746147214.451914:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20093 00000100:00100000:1.0:1746147214.451920:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967310431232:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147214.451925:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147214.451931:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425063115 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f268 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.451940:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147214.451941:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147214.451945:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425063115 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f268 expref: 33 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147214.451953:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425063115 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f268 expref: 33 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147214.451954:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147214.451964:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9b200, rc 0) 00000100:00100000:3.0:1746147214.451968:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310431360 00000100:00100000:3.0:1746147214.451970:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310431360 00000100:00100000:1.0:1746147214.451977:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967310431232:12345-192.168.204.25@tcp:101:cat.0 Request processed in 59us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147214.451982:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20093 00000100:00100000:3.0:1746147214.451991:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20094 00000100:00100000:3.0:1746147214.451996:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310431360:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147214.452003:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147214.452009:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096b81400/0x313993942506311c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f26f expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.452018:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147214.452019:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147214.452024:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096b81400/0x313993942506311c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f26f expref: 26 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147214.452032:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096b81400/0x313993942506311c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f26f expref: 26 pid: 13695 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147214.452066:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310430976:12345-192.168.204.25@tcp:101:cat.0 Request processed in 246us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147214.452068:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967310431104:12345-192.168.204.25@tcp:101:cat.0 Request processed in 232us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.452071:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20091 00000100:00100000:0.0:1746147214.452074:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20092 00000100:00100000:0.0:1746147214.452230:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.452252:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.452272:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310431744 00000100:00100000:2.0:1746147214.452275:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310431744 00000100:00100000:0.0:1746147214.452277:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.452291:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310431616 00000100:00100000:0.0:1746147214.452294:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310431616 00000100:00100000:2.0:1746147214.452297:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16491 00000100:00100000:2.0:1746147214.452307:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2948:x1830967310431744:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147214.452312:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381400/0x3139939425063097 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f206 expref: 30 pid: 6215 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746147214.452315:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147214.452325:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x3139939425063123 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f276 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147214.452325:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310431488 00000100:00100000:0.0:1746147214.452327:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310431488 00010000:00010000:0.0:1746147214.452334:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942506309e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f20d expref: 13 pid: 7238 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746147214.452359:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9130 00010000:00010000:2.0:1746147214.452365:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x3139939425063123 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f276 expref: 13 pid: 7237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147214.452365:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2002:x1830967310431616:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147214.452372:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147214.452375:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x3139939425063123 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f276 expref: 13 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147214.452375:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381400/0x3139939425063097 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f206 expref: 30 pid: 6215 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746147214.452382:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381400/0x3139939425063097 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f206 expref: 30 pid: 6215 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746147214.452401:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147214.452404:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147214.452410:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a20600, rc 0) 00000100:00100000:2.0:1746147214.452432:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2948:x1830967310431744:12345-192.168.204.25@tcp:101:cat.0 Request processed in 130us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.452437:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16491 00010000:00010000:3.0:1746147214.452646:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81400, rc 0) 00000100:00100000:3.0:1746147214.452664:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310431360:12345-192.168.204.25@tcp:101:cat.0 Request processed in 667us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147214.452668:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20094 00000100:00100000:3.0:1746147214.452685:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9131 00000100:00100000:3.0:1746147214.452690:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2002:x1830967310431488:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147214.452696:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147214.452700:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942506309e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f20d expref: 12 pid: 7238 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746147214.453033:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5574a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311499264:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147214.453043:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381400/0x3139939425063097 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f206 expref: 30 pid: 6215 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746147214.453063:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311499392:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147214.453254:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147214.453259:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147214.453265:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147214.453269:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147214.453286:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967310431616:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 921us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147214.453291:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9130 00010000:00010000:3.0:1746147214.453379:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942506309e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f20d expref: 12 pid: 7238 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746147214.453393:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33000/0x313993942506309e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f20d expref: 12 pid: 7238 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746147214.453418:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147214.453422:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.453427:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.453435:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147214.453460:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2002:x1830967310431488:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 765us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147214.453466:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9131 00000100:00100000:1.0:1746147214.458236:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311499520:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147214.458268:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147214.467328:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.467417:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.467509:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310432000 00000100:00100000:2.0:1746147214.467518:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310432000 00000100:00100000:2.0:1746147214.467564:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16492 00000100:00100000:2.0:1746147214.467571:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2950:x1830967310432000:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147214.467596:0:7239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147214.467613:0:7239:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588e00/0x313993942506312a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f27d expref: -99 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.467664:0:7239:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588e00/0x313993942506312a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f27d expref: 30 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.467674:0:7239:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588e00/0x313993942506312a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f27d expref: 30 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.467689:0:7239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147214.467692:0:7239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147214.467694:0:7239:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f588e00, rc 0) 00000100:00100000:2.0:1746147214.467732:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2950:x1830967310432000:12345-192.168.204.25@tcp:101:cat.0 Request processed in 162us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.467737:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16492 00000100:00100000:3.0:1746147214.468373:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310431872 00000100:00100000:3.0:1746147214.468377:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310431872 00010000:00010000:3.0:1746147214.468393:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425063004 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1d5 expref: 10 pid: 6215 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746147214.468488:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9132 00000100:00100000:3.0:1746147214.468494:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310431872:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147214.468503:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147214.468507:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425063004 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1d5 expref: 10 pid: 6215 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746147214.468517:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425063004 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1d5 expref: 10 pid: 6215 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746147214.468535:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f400/0x3139939425063004 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1d5 expref: 10 pid: 6215 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746147214.468665:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147214.468669:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.468676:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.468681:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.468686:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x31399394250630f2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.468691:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x31399394250630f2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.468695:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x31399394250630f2 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.469421:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147214.469559:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x31399394250630f2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147214.469565:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x31399394250630f2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147214.469581:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147214.469694:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381800/0x31399394250630dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f23e expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.469743:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147214.469749:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:1.0:1746147214.469759:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147214.469798:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db32e00/0x31399394250630e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f24c expref: 31 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.469819:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f24c expref: 30 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.469828:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147214.469830:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746147214.469832:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db33c00, rc 0) 00000100:00100000:3.0:1746147214.473725:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310431872:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5220us (6395us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147214.473743:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9132 00000100:00100000:1.0:1746147214.474020:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2949:x1830967310430720:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 29518us (29666us total) trans 8589937400 rc 0/0 00000100:00100000:1.0:1746147214.474028:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16490 00010000:00010000:2.0:1746147214.474110:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x31399394250630f2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f23e expref: 11 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.474126:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147214.474128:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746147214.474131:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f381a00, rc 0) 00000100:00100000:2.0:1746147214.474179:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2944:x1830967310430336:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 29702us (29878us total) trans 8589937399 rc 0/0 00000100:00100000:2.0:1746147214.474184:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16489 00000100:00100000:0.0:1746147214.474297:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.474394:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.474416:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.474453:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147214.474503:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310432384 00000100:00100000:3.0:1746147214.474510:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310432384 00002000:00100000:3.0:1746147214.474538:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880099150380 x1830967310432384/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.474552:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150380 with x1830967310432384 ext(0->1048575) 00002000:00010000:3.0:1746147214.474556:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099150380 00000100:00100000:3.0:1746147214.474567:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310432640 00000100:00100000:3.0:1746147214.474568:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310432640 00002000:00100000:3.0:1746147214.474577:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880099153480 x1830967310432640/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.474593:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099153480 with x1830967310432640 ext(1048576->2097151) 00002000:00010000:3.0:1746147214.474596:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099153480 00000100:00100000:3.0:1746147214.474603:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310432768 00000100:00100000:3.0:1746147214.474604:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310432768 00002000:00100000:3.0:1746147214.474612:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880099152300 x1830967310432768/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.474618:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152300 with x1830967310432768 ext(1048576->2097151) 00002000:00010000:3.0:1746147214.474620:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099152300 00000100:00100000:3.0:1746147214.474626:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310433024 00000100:00100000:3.0:1746147214.474627:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310433024 00002000:00100000:3.0:1746147214.474638:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099151180 x1830967310433024/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.474644:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151180 with x1830967310433024 ext(1048576->2097151) 00002000:00010000:3.0:1746147214.474647:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099151180 00000100:00100000:3.0:1746147214.474655:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7384 00000100:00100000:3.0:1746147214.474660:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310432384:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147214.475215:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7385 00000100:00100000:1.0:1746147214.475222:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310432640:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147214.475784:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7386 00000100:00100000:1.0:1746147214.475789:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310432768:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147214.476366:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7387 00000100:00100000:2.0:1746147214.476373:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310433024:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147214.482336:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.482375:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147214.483230:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310433280 00000100:00100000:1.0:1746147214.483239:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310433280 00000100:00100000:0.0:1746147214.483239:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.483254:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310433536 00000100:00100000:0.0:1746147214.483257:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310433536 00002000:00100000:1.0:1746147214.483275:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880099150000 x1830967310433280/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147214.483275:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880099153100 x1830967310433536/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147214.483284:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150000 with x1830967310433280 ext(0->1048575) 00002000:00100000:0.0:1746147214.483284:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099153100 with x1830967310433536 ext(1048576->2097151) 00002000:00010000:1.0:1746147214.483289:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099150000 00002000:00010000:0.0:1746147214.483289:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099153100 00000100:00100000:2.0:1746147214.483314:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310433792 00000100:00100000:2.0:1746147214.483316:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310433792 00002000:00100000:2.0:1746147214.483333:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880099150700 x1830967310433792/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147214.483340:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150700 with x1830967310433792 ext(1048576->2097151) 00002000:00010000:2.0:1746147214.483342:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099150700 00000100:00100000:0.0:1746147214.483555:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7388 00000100:00100000:0.0:1746147214.483562:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310433536:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147214.484126:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7389 00000100:00100000:1.0:1746147214.484132:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967310433280:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147214.484513:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7390 00000100:00100000:2.0:1746147214.484519:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310433792:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147214.487808:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147214.487869:0:29479:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310434048 00000100:00100000:3.0:1746147214.487877:0:29479:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310434048 00002000:00100000:3.0:1746147214.487915:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099152d80 x1830967310434048/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.487925:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152d80 with x1830967310434048 ext(1048576->2097151) 00002000:00010000:3.0:1746147214.487930:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099152d80 00000100:00100000:3.0:1746147214.487966:0:29479:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7391 00000100:00100000:3.0:1746147214.487974:0:29479:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967310434048:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147214.496312:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310432640:12345-192.168.204.25@tcp:3:cat.0 Request processed in 21077us (21904us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147214.496324:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7385 00002000:00100000:1.0:1746147214.496336:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880099153480 x1830967310432640/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147214.496350:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099153480 with x1830967310432640 ext(1048576->2097151) 00002000:00010000:1.0:1746147214.496355:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099153480 00000100:00100000:1.0:1746147214.506899:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2001:x1830967310432768:12345-192.168.204.25@tcp:3:cat.0 Request processed in 31100us (32472us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147214.506908:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7386 00002000:00100000:1.0:1746147214.506917:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880099152300 x1830967310432768/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147214.506925:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152300 with x1830967310432768 ext(1048576->2097151) 00002000:00010000:1.0:1746147214.506930:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099152300 00000100:00100000:0.0:1746147214.511862:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.512114:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310434304 00000100:00100000:2.0:1746147214.512123:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310434304 00000100:00100000:2.0:1746147214.512176:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16493 00000100:00100000:2.0:1746147214.512182:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2949:x1830967310434304:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147214.512203:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147214.512206:0:6215:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746147214.512227:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f588e00/0x313993942506312a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f27d expref: 30 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.512244:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147214.512248:0:6215:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147214.512256:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4e00/0x313993942506313f lrc: 2/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f284 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.512294:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425063146 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147214.512303:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425062ff6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ce expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.512309:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x3139939425063123 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f276 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.512315:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425063146 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147214.512343:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x3139939425063123 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f276 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.512353:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x3139939425063123 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f276 expref: 10 pid: 7237 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746147214.512363:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311499648:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147214.512454:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425062ff6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ce expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.512462:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425062ff6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ce expref: 8 pid: 6215 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746147214.512469:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311499776:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147214.512485:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147214.514756:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310433024:12345-192.168.204.25@tcp:3:cat.0 Request processed in 38376us (40293us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147214.514768:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7387 00002000:00100000:3.0:1746147214.514778:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099151180 x1830967310433024/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.514787:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099151180 with x1830967310433024 ext(1048576->2097151) 00002000:00010000:3.0:1746147214.514792:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099151180 00000100:00100000:2.0:1746147214.523228:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311499648:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147214.523240:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311499776:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147214.523261:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425063146 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147214.528382:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147214.528450:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310434560 00000100:00100000:3.0:1746147214.528459:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310434560 00010000:00010000:3.0:1746147214.528491:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425062ff6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ce expref: 9 pid: 6215 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746147214.528918:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147214.530395:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310434432 00000100:00100000:0.0:1746147214.530402:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9133 00000100:00100000:3.0:1746147214.530403:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310434432 00000100:00100000:0.0:1746147214.530412:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310434560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147214.530425:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x3139939425063123 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f276 expref: 11 pid: 7237 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746147214.530426:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147214.530432:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425062ff6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ce expref: 9 pid: 6215 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746147214.530442:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425062ff6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ce expref: 9 pid: 6215 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746147214.530458:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0f600/0x3139939425062ff6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ce expref: 9 pid: 6215 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746147214.530737:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147214.530743:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425063146 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147214.530750:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425063146 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147214.530756:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147214.530800:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2001:x1830967310434560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 390us (2424us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147214.530805:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9133 00000100:00100000:0.0:1746147214.530820:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9134 00000100:00100000:0.0:1746147214.530824:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2000:x1830967310434432:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147214.530830:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147214.530833:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x3139939425063123 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f276 expref: 11 pid: 7237 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746147214.530841:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x3139939425063123 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f276 expref: 11 pid: 7237 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746147214.530851:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a20600/0x3139939425063123 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f276 expref: 11 pid: 7237 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746147214.530858:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147214.530861:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425063146 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147214.530867:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425063146 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147214.530872:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425063146 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147214.531045:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147214.531060:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310434432:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 236us (2142us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147214.531066:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9134 00010000:00010000:2.0:1746147214.531108:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425063146 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147214.531114:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425063146 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000040:00080000:2.0:1746147214.531332:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1299, 88 off122168 00000004:00080000:2.0:1746147214.531338:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752521248129ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147214.531389:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1294, 88 off121728 00000004:00080000:2.0:1746147214.531394:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752521304541ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147214.531421:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1295, 88 off121816 00000004:00080000:2.0:1746147214.531424:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752521334224ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147214.531436:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1300, 88 off122256 00000004:00080000:2.0:1746147214.531438:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752521348974ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147214.531450:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1301, 88 off122344 00000004:00080000:2.0:1746147214.531452:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752521362722ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147214.531463:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1296, 88 off121904 00000004:00080000:2.0:1746147214.531466:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752521376689ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147214.531477:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1297, 88 off121992 00000004:00080000:2.0:1746147214.531485:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752521395202ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147214.531497:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1298, 88 off122080 00000004:00080000:2.0:1746147214.531499:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752521409766ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147214.531510:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1302, 88 off122432 00000004:00080000:2.0:1746147214.531513:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752521423829ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147214.531524:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1299, 88 off122168 00000004:00080000:2.0:1746147214.531527:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752521437139ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147214.531546:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1303, 88 off122520 00000004:00080000:2.0:1746147214.531549:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752521459510ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147214.531564:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1300, 88 off122256 00000004:00080000:2.0:1746147214.531567:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752521477261ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147214.531577:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1304, 88 off122608 00000004:00080000:2.0:1746147214.531579:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752521490011ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147214.531606:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1305, 88 off122696 00000004:00080000:2.0:1746147214.531608:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752521519106ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147214.531616:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1306, 88 off122784 00000004:00080000:2.0:1746147214.531618:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752521529120ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147214.531706:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1308, 88 off122968 00000004:00080000:2.0:1746147214.531710:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752521620814ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147214.531727:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1301, 88 off122344 00000004:00080000:2.0:1746147214.531730:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752521640674ns, next at 694367916532ns, rc = 0 00000100:00100000:2.0:1746147214.539137:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310432384:12345-192.168.204.25@tcp:3:cat.0 Request processed in 64466us (64831us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147214.539147:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7384 00002000:00100000:2.0:1746147214.539158:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880099150380 x1830967310432384/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147214.539173:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150380 with x1830967310432384 ext(0->1048575) 00002000:00010000:2.0:1746147214.539177:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099150380 00000100:00100000:2.0:1746147214.543637:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310433536:12345-192.168.204.25@tcp:3:cat.0 Request processed in 60033us (61220us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147214.543691:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7388 00002000:00100000:2.0:1746147214.543723:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880099153100 x1830967310433536/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147214.543747:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099153100 with x1830967310433536 ext(1048576->2097151) 00002000:00010000:2.0:1746147214.543753:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099153100 00000001:00080000:3.0:1746147214.546260:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937401 is committed 00000004:00080000:3.0:1746147214.546269:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1278 committed 00000004:00080000:3.0:1746147214.546283:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1287 committed 00000004:00080000:3.0:1746147214.546293:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1286 committed 00000004:00080000:3.0:1746147214.546295:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1285 committed 00000004:00080000:3.0:1746147214.546296:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1284 committed 00000004:00080000:3.0:1746147214.546297:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1277 committed 00000004:00080000:3.0:1746147214.546299:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1283 committed 00000004:00080000:3.0:1746147214.546300:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1276 committed 00000004:00080000:3.0:1746147214.546302:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1282 committed 00000004:00080000:3.0:1746147214.546303:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1275 committed 00000004:00080000:3.0:1746147214.546304:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1274 committed 00000004:00080000:3.0:1746147214.546305:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1273 committed 00000004:00080000:3.0:1746147214.546307:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1281 committed 00000004:00080000:3.0:1746147214.546308:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1280 committed 00000004:00080000:3.0:1746147214.546309:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1272 committed 00000004:00080000:3.0:1746147214.546310:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1271 committed 00000004:00080000:3.0:1746147214.546312:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1279 committed 00000001:00080000:3.0:1746147214.546319:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937399 is committed 00000001:00080000:3.0:1746147214.546325:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937396 is committed 00010000:00010000:3.0:1746147214.546376:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425063146 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f284 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.546386:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147214.546388:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746147214.546401:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4e00/0x313993942506313f lrc: 0/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f284 expref: 29 pid: 6215 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1746147214.547398:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746147214.547413:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311499904:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147214.547458:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746147214.547830:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425063146 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f284 expref: 28 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.547855:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147214.547857:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746147214.547859:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ff4200, rc 0) 00000100:00100000:3.0:1746147214.547897:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2949:x1830967310434304:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 35715us (36043us total) trans 8589937401 rc 0/0 00000100:00100000:3.0:1746147214.547904:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16493 00000100:00100000:1.0:1746147214.548729:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311500032:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147214.548757:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147214.548778:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746147214.548782:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098c72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311500160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147214.548795:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147214.548812:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311499904 00000100:00100000:1.0:1746147214.548817:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311499904 00000100:00100000:1.0:1746147214.548839:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311500032 00000100:00100000:1.0:1746147214.548840:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311500032 00000100:00100000:1.0:1746147214.548849:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311500160 00000100:00100000:1.0:1746147214.548851:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311500160 00000100:00100000:1.0:1746147214.548860:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20095 00000100:00100000:1.0:1746147214.548865:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+42:3766:x1830967311499904:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147214.548957:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147214.548960:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147210 -> 1746147210 00002000:00010000:1.0:1746147214.548962:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:1.0:1746147214.548964:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147211 -> 1746147211 00002000:00010000:1.0:1746147214.548965:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:1.0:1746147214.548984:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+43:3766:x1830967311499904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (1527us total) trans 21474842669 rc 0/0 00000100:00100000:1.0:1746147214.548989:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20095 00000100:00100000:1.0:1746147214.548997:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20096 00000100:00100000:1.0:1746147214.549001:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+42:3764:x1830967311500032:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147214.549030:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147214.549032:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147212 -> 1746147212 00002000:00010000:1.0:1746147214.549034:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147213 -> 1746147213 00002000:00010000:1.0:1746147214.549035:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147212 -> 1746147212 00002000:00010000:1.0:1746147214.549037:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147214.549052:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+43:3764:x1830967311500032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (295us total) trans 21474842670 rc 0/0 00000100:00100000:1.0:1746147214.549056:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20096 00000100:00100000:1.0:1746147214.549062:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20097 00000100:00100000:1.0:1746147214.549065:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3764:x1830967311500160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147214.549123:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147214.549125:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147211 -> 1746147211 00002000:00010000:1.0:1746147214.549126:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:1.0:1746147214.549128:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147211 -> 1746147211 00002000:00010000:1.0:1746147214.549129:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147214.549144:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3764:x1830967311500160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (348us total) trans 17179875283 rc 0/0 00000100:00100000:1.0:1746147214.549148:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20097 00000100:00100000:1.0:1746147214.549172:0:3764:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875281 gen 2 00000004:00080000:1.0:1746147214.549176:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ee680, transno 17179875206 00000004:00080000:1.0:1746147214.549178:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312efb80, transno 17179875207 00000004:00080000:1.0:1746147214.549180:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ec380, transno 17179875208 00000004:00080000:1.0:1746147214.549182:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312edf80, transno 17179875209 00000004:00080000:1.0:1746147214.549183:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312eca80, transno 17179875210 00000004:00080000:1.0:1746147214.549185:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ec000, transno 17179875211 00000004:00080000:1.0:1746147214.549186:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ed180, transno 17179875212 00000004:00080000:1.0:1746147214.549188:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ef100, transno 17179875213 00000004:00080000:1.0:1746147214.549189:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca10700, transno 17179875218 00000004:00080000:1.0:1746147214.549191:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca13800, transno 17179875219 00000004:00080000:1.0:1746147214.549193:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca13100, transno 17179875220 00000004:00080000:1.0:1746147214.549194:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca10e00, transno 17179875221 00000004:00080000:1.0:1746147214.549196:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca12a00, transno 17179875222 00000004:00080000:1.0:1746147214.549197:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca11500, transno 17179875223 00000004:00080000:1.0:1746147214.549199:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca13480, transno 17179875224 00000004:00080000:1.0:1746147214.549201:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca10000, transno 17179875225 00000004:00080000:1.0:1746147214.549202:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099156a00, transno 17179875226 00000004:00080000:1.0:1746147214.549204:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099154a80, transno 17179875227 00000004:00080000:1.0:1746147214.549206:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099155880, transno 17179875228 00000004:00080000:1.0:1746147214.549207:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099156d80, transno 17179875229 00000004:00080000:1.0:1746147214.549209:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099155f80, transno 17179875230 00000004:00080000:1.0:1746147214.549210:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099154e00, transno 17179875231 00000004:00080000:1.0:1746147214.549212:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099155c00, transno 17179875232 00000004:00080000:1.0:1746147214.549213:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099156680, transno 17179875233 00000004:00080000:1.0:1746147214.549215:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800933f4000, transno 17179875236 00000004:00080000:1.0:1746147214.549217:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800933f4380, transno 17179875237 00000004:00080000:1.0:1746147214.549218:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800933f5180, transno 17179875238 00000004:00080000:1.0:1746147214.549221:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800933f4a80, transno 17179875239 00000004:00080000:1.0:1746147214.549223:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800933f5f80, transno 17179875240 00000004:00080000:1.0:1746147214.549225:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800933f7b80, transno 17179875241 00000004:00080000:1.0:1746147214.549227:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800933f4700, transno 17179875242 00000004:00080000:1.0:1746147214.549229:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800933f7480, transno 17179875243 00000004:00080000:1.0:1746147214.549231:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8b2d80, transno 17179875248 00000004:00080000:1.0:1746147214.549232:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3ced80, transno 17179875249 00000004:00080000:1.0:1746147214.549234:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cc700, transno 17179875250 00000004:00080000:1.0:1746147214.549236:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3ce300, transno 17179875251 00000004:00080000:1.0:1746147214.549238:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8b1f80, transno 17179875252 00000004:00080000:1.0:1746147214.549239:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3ce680, transno 17179875253 00000004:00080000:1.0:1746147214.549241:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cf800, transno 17179875254 00000004:00080000:1.0:1746147214.549243:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cd180, transno 17179875255 00000004:00080000:1.0:1746147214.549245:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e487480, transno 17179875256 00000004:00080000:1.0:1746147214.549246:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca12300, transno 17179875257 00000004:00080000:1.0:1746147214.549248:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e485f80, transno 17179875258 00000004:00080000:1.0:1746147214.549249:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e486300, transno 17179875259 00000004:00080000:1.0:1746147214.549251:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e485180, transno 17179875260 00000004:00080000:1.0:1746147214.549253:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca12d80, transno 17179875261 00000004:00080000:1.0:1746147214.549254:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e484000, transno 17179875262 00000004:00080000:1.0:1746147214.549256:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ca11880, transno 17179875263 00000004:00080000:1.0:1746147214.549258:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d76d80, transno 17179875274 00000004:00080000:1.0:1746147214.549260:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d77100, transno 17179875275 00000004:00080000:1.0:1746147214.549261:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d77800, transno 17179875276 00000004:00080000:1.0:1746147214.549263:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d76a00, transno 17179875277 00000004:00080000:1.0:1746147214.549265:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d77b80, transno 17179875278 00000004:00080000:1.0:1746147214.549266:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d75880, transno 17179875279 00000004:00080000:1.0:1746147214.549268:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d75c00, transno 17179875280 00000004:00080000:1.0:1746147214.549269:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d75180, transno 17179875281 00000100:00100000:1.0:1746147214.549273:0:3764:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880098c72300 x1830967311500160/t17179875283(17179875283) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147230 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746147214.549284:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098c72300/2, rc 0, transno 17179875283 00000100:00100000:1.0:1746147214.549288:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098c72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311500160:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147214.549295:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099151c00/2, rc 0, transno 21474842670 00000100:00100000:1.0:1746147214.549297:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311500032:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147214.549517:0:8112:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 7 changes, 1 in progress, 0 in flight, 56 done 00000100:00100000:3.0:1746147214.549638:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311500288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147214.549663:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147214.549699:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099150e00/2, rc 0, transno 21474842669 00000100:00100000:3.0:1746147214.549703:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311499904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147214.549711:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746147214.549716:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311500416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147214.549732:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147214.549748:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311500288 00000100:00100000:3.0:1746147214.549751:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311500288 00000100:00100000:3.0:1746147214.549765:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311500416 00000100:00100000:3.0:1746147214.549767:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311500416 00000100:00100000:3.0:1746147214.549776:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20098 00000100:00100000:3.0:1746147214.549779:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3766:x1830967311500288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147214.549827:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147214.549829:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147212 -> 1746147212 00002000:00010000:3.0:1746147214.549831:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147213 -> 1746147213 00002000:00010000:3.0:1746147214.549832:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147212 -> 1746147212 00002000:00010000:3.0:1746147214.549834:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746147214.549854:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3766:x1830967311500288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (191us total) trans 17179875284 rc 0/0 00000100:00100000:3.0:1746147214.549859:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20098 00000100:00100000:3.0:1746147214.549870:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20099 00000100:00100000:3.0:1746147214.549874:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3766:x1830967311500416:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147214.549911:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147214.549913:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147212 -> 1746147212 00002000:00010000:3.0:1746147214.549915:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147212 -> 1746147212 00002000:00010000:3.0:1746147214.549916:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147212 -> 1746147212 00002000:00010000:3.0:1746147214.549917:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746147214.549934:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3766:x1830967311500416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (201us total) trans 17179875285 rc 0/0 00000100:00100000:3.0:1746147214.549939:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20099 00000004:00080000:3.0:1746147214.549958:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312efb80/2, rc 0, transno 17179875285 00000100:00100000:3.0:1746147214.549961:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311500416:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147214.549968:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ee680/2, rc 0, transno 17179875284 00000100:00100000:3.0:1746147214.549970:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311500288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147214.550003:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746147214.550419:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311501056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147214.550458:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147214.550663:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311501568:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147214.550677:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147214.550687:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1746147214.550691:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311500672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147214.550701:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147214.550708:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311501184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147214.550717:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147214.550723:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311501696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147214.550732:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147214.550744:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311501056 00000100:00100000:1.0:1746147214.550747:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311501056 00000100:00100000:1.0:1746147214.550759:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311501568 00000100:00100000:1.0:1746147214.550760:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311501568 00000100:00100000:1.0:1746147214.550768:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311500672 00000100:00100000:1.0:1746147214.550769:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311500672 00000100:00100000:1.0:1746147214.550775:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311501184 00000100:00100000:1.0:1746147214.550776:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311501184 00000100:00100000:1.0:1746147214.550783:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20100 00000100:00100000:1.0:1746147214.550787:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3764:x1830967311501056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147214.550841:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3764:x1830967311501056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (383us total) trans 21474842671 rc 0/0 00000100:00100000:1.0:1746147214.550846:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20100 00000100:00100000:1.0:1746147214.550950:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311501696 00000100:00100000:1.0:1746147214.550952:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311501696 00000100:00100000:1.0:1746147214.550969:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20101 00000100:00100000:1.0:1746147214.550973:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3764:x1830967311501568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147214.551022:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3764:x1830967311501568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (343us total) trans 17179875286 rc 0/0 00000100:00100000:1.0:1746147214.551026:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20101 00000100:00100000:1.0:1746147214.551034:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20102 00000100:00100000:1.0:1746147214.551037:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3764:x1830967311500672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147214.551067:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:1.0:1746147214.551070:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147212 -> 1746147212 00002000:00010000:1.0:1746147214.551071:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147212 -> 1746147212 00002000:00010000:1.0:1746147214.551073:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147212 -> 1746147212 00002000:00010000:1.0:1746147214.551074:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:1.0:1746147214.551105:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3764:x1830967311500672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (386us total) trans 21474842672 rc 0/0 00000100:00100000:1.0:1746147214.551109:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20102 00000100:00100000:1.0:1746147214.551117:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20103 00000100:00100000:1.0:1746147214.551120:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3764:x1830967311501184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147214.551152:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147214.551154:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147214.551155:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147214.551157:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147214.551159:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:1.0:1746147214.551174:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3764:x1830967311501184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (456us total) trans 21474842673 rc 0/0 00000100:00100000:1.0:1746147214.551178:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20103 00000100:00100000:1.0:1746147214.551185:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20104 00000100:00100000:1.0:1746147214.551188:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3764:x1830967311501696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147214.551222:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:1.0:1746147214.551224:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:1.0:1746147214.551225:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147214.551226:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:1.0:1746147214.551228:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:1.0:1746147214.551241:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3764:x1830967311501696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (507us total) trans 17179875287 rc 0/0 00000100:00100000:1.0:1746147214.551245:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20104 00000004:00080000:1.0:1746147214.551274:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099150a80/2, rc 0, transno 21474842672 00000100:00100000:1.0:1746147214.551277:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311500672:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147214.551282:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800769d9f80/2, rc 0, transno 21474842673 00000100:00100000:1.0:1746147214.551284:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311501184:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147214.551289:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312eca80/2, rc 0, transno 17179875287 00000100:00100000:1.0:1746147214.551292:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311501696:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147214.551296:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099151500/2, rc 0, transno 21474842671 00000100:00100000:1.0:1746147214.551299:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311501056:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147214.551304:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312edf80/2, rc 0, transno 17179875286 00000100:00100000:1.0:1746147214.551306:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311501568:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147214.552029:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311500544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147214.552056:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147214.552105:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311500928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147214.552124:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147214.552136:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311501440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147214.552148:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147214.552156:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1746147214.552160:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311500800:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147214.552171:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147214.552181:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311501312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147214.552192:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147214.552200:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311501824:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147214.552210:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147214.552225:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311500544 00000100:00100000:3.0:1746147214.552228:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311500544 00000100:00100000:3.0:1746147214.552245:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311500928 00000100:00100000:3.0:1746147214.552247:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311500928 00000100:00100000:3.0:1746147214.552258:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311501440 00000100:00100000:3.0:1746147214.552259:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311501440 00000100:00100000:3.0:1746147214.552268:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311500800 00000100:00100000:3.0:1746147214.552269:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311500800 00000100:00100000:3.0:1746147214.552275:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311501312 00000100:00100000:3.0:1746147214.552277:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311501312 00000100:00100000:3.0:1746147214.552282:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311501824 00000100:00100000:3.0:1746147214.552283:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311501824 00000100:00100000:3.0:1746147214.552289:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20105 00000100:00100000:3.0:1746147214.552293:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+11:3765:x1830967311500544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147214.552343:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147214.552345:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147214.552347:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147214.552348:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147214.552350:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746147214.552369:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+12:3765:x1830967311500544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (313us total) trans 17179875288 rc 0/0 00000100:00100000:3.0:1746147214.552374:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20105 00000100:00100000:3.0:1746147214.552383:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20106 00000100:00100000:3.0:1746147214.552386:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+49:3767:x1830967311500928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147214.552443:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+50:3767:x1830967311500928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (317us total) trans 21474842674 rc 0/0 00000100:00100000:3.0:1746147214.552448:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20106 00000100:00100000:3.0:1746147214.552456:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20107 00000100:00100000:3.0:1746147214.552460:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+49:3767:x1830967311501440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147214.552504:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+50:3767:x1830967311501440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (354us total) trans 21474842675 rc 0/0 00000100:00100000:3.0:1746147214.552509:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20107 00000100:00100000:3.0:1746147214.552516:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20108 00000100:00100000:3.0:1746147214.552521:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+49:3767:x1830967311500800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147214.552547:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746147214.552549:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147214.552550:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147214.552551:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147214.552553:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:3.0:1746147214.552566:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+50:3767:x1830967311500800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (394us total) trans 21474842676 rc 0/0 00000100:00100000:3.0:1746147214.552570:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20108 00000100:00100000:3.0:1746147214.552578:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20109 00000100:00100000:3.0:1746147214.552594:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+49:3767:x1830967311501312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147214.552627:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:3.0:1746147214.552629:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147214.552630:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147214.552632:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147214.552633:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:3.0:1746147214.552649:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+50:3767:x1830967311501312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (455us total) trans 21474842677 rc 0/0 00000100:00100000:3.0:1746147214.552653:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20109 00000100:00100000:3.0:1746147214.552662:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20110 00000100:00100000:3.0:1746147214.552666:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+11:3767:x1830967311501824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147214.552708:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+12:3767:x1830967311501824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (497us total) trans 17179875289 rc 0/0 00000100:00100000:3.0:1746147214.552711:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20110 00000004:00080000:3.0:1746147214.552734:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099151880/2, rc 0, transno 21474842676 00000100:00100000:3.0:1746147214.552737:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311500800:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147214.552743:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800769dad80/2, rc 0, transno 21474842677 00000100:00100000:3.0:1746147214.552745:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311501312:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147214.552752:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ec000/2, rc 0, transno 17179875289 00000100:00100000:3.0:1746147214.552754:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311501824:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147214.552760:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099151f80/2, rc 0, transno 21474842674 00000100:00100000:3.0:1746147214.552762:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311500928:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147214.552767:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800769daa00/2, rc 0, transno 21474842675 00000100:00100000:3.0:1746147214.552769:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311501440:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147214.552786:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ec380/2, rc 0, transno 17179875288 00000100:00100000:3.0:1746147214.552789:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311500544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147214.557197:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311501952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147214.557249:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147214.557793:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311501952 00000100:00100000:1.0:1746147214.557800:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311501952 00000100:00100000:1.0:1746147214.557832:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20111 00000100:00100000:1.0:1746147214.557838:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3767:x1830967311501952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147214.557955:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3767:x1830967311501952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (705us total) trans 17179875290 rc 0/0 00000100:00100000:1.0:1746147214.557960:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20111 00000100:00100000:0.0:1746147214.560764:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147214.560825:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310434688 00000100:00100000:3.0:1746147214.560832:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310434688 00000100:00100000:3.0:1746147214.560869:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16494 00000100:00100000:3.0:1746147214.560875:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2948:x1830967310434688:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147214.560894:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147214.560909:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x313993942506314d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f28b expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.560953:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x313993942506314d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f28b expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.560963:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x313993942506314d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f28b expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.560976:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147214.560979:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147214.560982:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b80200, rc 0) 00000100:00100000:3.0:1746147214.561015:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2948:x1830967310434688:12345-192.168.204.25@tcp:101:cat.0 Request processed in 140us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147214.561019:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16494 00000100:00100000:1.0:1746147214.561142:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967310433280:12345-192.168.204.25@tcp:3:cat.0 Request processed in 77011us (78814us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147214.561149:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7389 00002000:00100000:1.0:1746147214.561156:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880099150000 x1830967310433280/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147214.561164:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150000 with x1830967310433280 ext(0->1048575) 00002000:00010000:1.0:1746147214.561168:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099150000 00000004:00080000:3.0:1746147214.562369:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ed180/2, rc 0, transno 17179875290 00000100:00100000:3.0:1746147214.562377:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311501952:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147214.582891:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967310433792:12345-192.168.204.25@tcp:3:cat.0 Request processed in 98360us (99639us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147214.582903:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7390 00002000:00100000:2.0:1746147214.582916:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880099150700 x1830967310433792/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147214.582924:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099150700 with x1830967310433792 ext(1048576->2097151) 00002000:00010000:2.0:1746147214.582930:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099150700 00000100:00100000:3.0:1746147214.588314:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147214.588613:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310434816 00000100:00100000:1.0:1746147214.588622:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310434816 00000100:00100000:1.0:1746147214.588669:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16495 00000100:00100000:1.0:1746147214.588677:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2950:x1830967310434816:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147214.588699:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147214.588718:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b000/0x3139939425063154 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f292 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.588767:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b000/0x3139939425063154 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f292 expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.588778:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b000/0x3139939425063154 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f292 expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.588795:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147214.588799:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147214.588802:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9b000, rc 0) 00000100:00100000:1.0:1746147214.588841:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2950:x1830967310434816:12345-192.168.204.25@tcp:101:cat.0 Request processed in 164us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147214.588847:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16495 00000100:00100000:3.0:1746147214.588973:0:29479:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967310434048:12345-192.168.204.25@tcp:3:cat.0 Request processed in 101000us (101171us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147214.588980:0:29479:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7391 00002000:00100000:3.0:1746147214.588987:0:29479:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099152d80 x1830967310434048/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.588995:0:29479:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152d80 with x1830967310434048 ext(1048576->2097151) 00002000:00010000:3.0:1746147214.588998:0:29479:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099152d80 00000100:00100000:0.0:1746147214.597981:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147214.598082:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310434944 00000100:00100000:1.0:1746147214.598117:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310434944 00000100:00100000:1.0:1746147214.598174:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1004 00000100:00100000:1.0:1746147214.598181:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b404e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967310434944:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147214.598193:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147214.598212:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9b000/0x3139939425063154 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f292 expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.598464:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147214.598468:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147214.599259:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b404e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967310434944:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1075us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147214.599266:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1004 00000100:00100000:0.0:1746147214.619402:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.619440:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.619466:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.619489:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.619502:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.619512:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310435200 00000100:00100000:0.0:1746147214.619525:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.619527:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310435200 00000100:00100000:0.0:1746147214.619553:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310435456 00000100:00100000:0.0:1746147214.619557:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310435456 00002000:00100000:2.0:1746147214.619569:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8800769d8700 x1830967310435200/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147214.619576:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff8800769d9180 x1830967310435456/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147214.619593:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769d8700 with x1830967310435200 ext(1048576->2097151) 00002000:00100000:0.0:1746147214.619593:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769d9180 with x1830967310435456 ext(1048576->2097151) 00002000:00010000:2.0:1746147214.619598:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769d8700 00002000:00010000:0.0:1746147214.619598:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769d9180 00000100:00100000:0.0:1746147214.621719:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310435712 00000100:00100000:0.0:1746147214.621729:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310435712 00002000:00100000:0.0:1746147214.621767:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800769d9500 x1830967310435712/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147214.621776:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769d9500 with x1830967310435712 ext(1048576->2097151) 00002000:00010000:0.0:1746147214.621781:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769d9500 00000100:00100000:2.0:1746147214.621891:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310435968 00000100:00100000:3.0:1746147214.621892:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310436224 00000100:00100000:2.0:1746147214.621896:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310435968 00000100:00100000:3.0:1746147214.621897:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310436224 00002000:00100000:2.0:1746147214.621919:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8800769d8380 x1830967310435968/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.621920:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff8800769db100 x1830967310436224/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147214.621926:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769d8380 with x1830967310435968 ext(1048576->2097151) 00002000:00100000:3.0:1746147214.621927:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769db100 with x1830967310436224 ext(1048576->2097151) 00002000:00010000:3.0:1746147214.621930:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769db100 00002000:00010000:2.0:1746147214.621930:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769d8380 00000100:00100000:2.0:1746147214.621964:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310436480 00000100:00100000:2.0:1746147214.621967:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310436480 00000100:00100000:0.0:1746147214.621976:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7392 00002000:00100000:2.0:1746147214.621978:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800769d9c00 x1830967310436480/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147214.621984:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769d9c00 with x1830967310436480 ext(1048576->2097151) 00000100:00100000:0.0:1746147214.621985:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310435456:12345-192.168.204.25@tcp:3:multiop.0 00002000:00010000:2.0:1746147214.621987:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769d9c00 00000100:00100000:2.0:1746147214.621994:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7393 00000100:00100000:2.0:1746147214.622000:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310435200:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147214.622470:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7394 00000100:00100000:3.0:1746147214.622477:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967310435712:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147214.622655:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7395 00000100:00100000:2.0:1746147214.622660:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2002:x1830967310436224:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147214.623039:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7396 00000100:00100000:3.0:1746147214.623045:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2002:x1830967310435968:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147214.623136:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7397 00000100:00100000:2.0:1746147214.623142:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2002:x1830967310436480:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147214.648984:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.649057:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310436608 00000100:00100000:2.0:1746147214.649066:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310436608 00000100:00100000:3.0:1746147214.649550:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310435200:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 27548us (30155us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147214.649559:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7393 00002000:00100000:3.0:1746147214.649569:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8800769d8700 x1830967310435200/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.649588:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769d8700 with x1830967310435200 ext(1048576->2097151) 00002000:00010000:3.0:1746147214.649593:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769d8700 00000100:00100000:1.0:1746147214.650324:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20112 00000100:00100000:1.0:1746147214.650334:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2944:x1830967310436608:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147214.650348:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147214.650363:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f299 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.650394:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425063020 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1f1 expref: 15 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147214.650402:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e6600/0x313993942506310e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f261 expref: 33 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147214.650409:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a20c00/0x31399394250630c8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f229 expref: 17 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147214.650414:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147214.650416:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147214.650419:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 6/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1839104->2097151] (req 1839104->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 17 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.650442:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a20c00/0x31399394250630c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f229 expref: 17 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147214.650453:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a20c00/0x31399394250630c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f229 expref: 17 pid: 9584 timeout: 852 lvb_type: 1 00000100:00100000:1.0:1746147214.650462:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311502080:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147214.650543:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e6600/0x313993942506310e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f261 expref: 33 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147214.650551:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958e6600/0x313993942506310e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f261 expref: 33 pid: 12201 timeout: 852 lvb_type: 1 00000100:00100000:1.0:1746147214.650559:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311502208:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147214.650593:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425063020 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1f1 expref: 15 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147214.650602:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425063020 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1f1 expref: 15 pid: 9584 timeout: 852 lvb_type: 1 00000100:00100000:1.0:1746147214.650609:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311502336:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147214.650625:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147214.653371:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2003:x1830967310435712:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 30886us (33894us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147214.653383:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7394 00002000:00100000:3.0:1746147214.653392:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800769d9500 x1830967310435712/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.653402:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769d9500 with x1830967310435712 ext(1048576->2097151) 00010000:00010000:3.0:1746147214.653411:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800958e6600/0x313993942506310e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f261 expref: 32 pid: 12201 timeout: 852 lvb_type: 1 00010000:00010000:3.0:1746147214.653427:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800958e6600/0x313993942506310e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f261 expref: 32 pid: 12201 timeout: 852 lvb_type: 1 00002000:00010000:3.0:1746147214.653434:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800769d9500 00000100:00100000:0.0:1746147214.665801:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147214.665812:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311502080:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147214.665822:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311502208:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147214.665829:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311502336:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147214.665835:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310436736 00000100:00100000:0.0:1746147214.665840:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310436736 00010000:00010000:1.0:1746147214.665861:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1839104->2097151] (req 1839104->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 17 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147214.665866:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425063020 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1f1 expref: 16 pid: 9584 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746147214.665875:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9ac00, rc 0) 00000100:00100000:1.0:1746147214.665915:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2944:x1830967310436608:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 15584us (16939us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147214.665923:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20112 00000100:00100000:3.0:1746147214.666243:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2002:x1830967310436224:12345-192.168.204.25@tcp:3:cat.0 Request processed in 43582us (46739us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147214.666251:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7395 00002000:00100000:3.0:1746147214.666258:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff8800769db100 x1830967310436224/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.666266:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769db100 with x1830967310436224 ext(1048576->2097151) 00002000:00010000:3.0:1746147214.666273:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769db100 00000100:00100000:0.0:1746147214.667693:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9135 00000100:00100000:0.0:1746147214.667708:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310436736:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147214.667724:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147214.667741:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425063020 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1f1 expref: 16 pid: 9584 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746147214.667752:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425063020 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1f1 expref: 16 pid: 9584 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746147214.667772:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1200/0x3139939425063020 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1f1 expref: 16 pid: 9584 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746147214.667800:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147214.667839:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310436736:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 137us (2046us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147214.667844:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9135 00000100:00100000:1.0:1746147214.670626:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147214.670794:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2002:x1830967310436480:12345-192.168.204.25@tcp:3:cat.0 Request processed in 47650us (51265us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147214.670808:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7397 00002000:00100000:1.0:1746147214.670821:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800769d9c00 x1830967310436480/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147214.670831:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769d9c00 with x1830967310436480 ext(1048576->2097151) 00010000:00010000:1.0:1746147214.670841:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a20c00/0x31399394250630c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f229 expref: 15 pid: 9584 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746147214.670852:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a20c00/0x31399394250630c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f229 expref: 15 pid: 9584 timeout: 852 lvb_type: 1 00002000:00010000:1.0:1746147214.670859:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800769d9c00 00000100:00100000:2.0:1746147214.671555:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310436864 00000100:00100000:2.0:1746147214.671565:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310436864 00010000:00010000:2.0:1746147214.671605:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e6600/0x313993942506310e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f261 expref: 32 pid: 12201 timeout: 852 lvb_type: 1 00000100:00100000:2.0:1746147214.671629:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9136 00000100:00100000:2.0:1746147214.671636:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967310436864:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147214.671647:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147214.671665:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958e6600/0x313993942506310e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f261 expref: 32 pid: 12201 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746147214.671675:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958e6600/0x313993942506310e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f261 expref: 32 pid: 12201 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746147214.671693:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e6600/0x313993942506310e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f261 expref: 32 pid: 12201 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746147214.671709:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147214.671741:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967310436864:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 105us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.671747:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9136 00000100:00100000:2.0:1746147214.679682:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967310435456:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 57686us (60228us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147214.679693:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7392 00002000:00100000:2.0:1746147214.679704:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff8800769d9180 x1830967310435456/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147214.679717:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769d9180 with x1830967310435456 ext(1048576->2097151) 00002000:00010000:2.0:1746147214.679723:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769d9180 00000100:00100000:0.0:1746147214.680469:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.680530:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.680546:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310437120 00000100:00100000:0.0:1746147214.680553:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310437120 00010000:00010000:0.0:1746147214.680576:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a20c00/0x31399394250630c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f229 expref: 15 pid: 9584 timeout: 852 lvb_type: 1 00000100:00100000:2.0:1746147214.680695:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310436992 00000100:00100000:2.0:1746147214.680700:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310436992 00000100:00100000:2.0:1746147214.680723:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20113 00000100:00100000:2.0:1746147214.680730:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2949:x1830967310436992:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147214.680743:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147214.680756:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425063162 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f2a0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.680779:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425063019 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1e3 expref: 10 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.680787:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f007c00/0x3139939425063100 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f253 expref: 26 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.680793:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f380c00/0x31399394250630ba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f21b expref: 9 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.680798:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.680799:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.680802:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425063162 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [1150976->1544191] (req 1150976->1544191) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a0 expref: 26 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.680824:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f380c00/0x31399394250630ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f21b expref: 9 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.680834:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f380c00/0x31399394250630ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f21b expref: 9 pid: 13712 timeout: 852 lvb_type: 1 00000100:00100000:2.0:1746147214.680849:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311502464:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147214.681466:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f007c00/0x3139939425063100 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f253 expref: 26 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.681474:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f007c00/0x3139939425063100 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f253 expref: 26 pid: 13712 timeout: 852 lvb_type: 1 00000100:00100000:2.0:1746147214.681482:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311502592:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147214.681507:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425063019 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1e3 expref: 10 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.681514:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425063019 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1e3 expref: 10 pid: 17600 timeout: 852 lvb_type: 1 00000100:00100000:2.0:1746147214.681520:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311502720:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147214.681530:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147214.682286:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9137 00000100:00100000:0.0:1746147214.682294:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310437120:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147214.682303:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147214.682319:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a20c00/0x31399394250630c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f229 expref: 15 pid: 9584 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746147214.682330:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a20c00/0x31399394250630c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f229 expref: 15 pid: 9584 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746147214.682347:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a20c00/0x31399394250630c8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f229 expref: 15 pid: 9584 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746147214.682375:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147214.682376:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147214.682382:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147214.682388:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147214.682408:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147214.682801:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311502848:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147214.683901:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147214.685123:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2002:x1830967310435968:12345-192.168.204.25@tcp:3:cat.0 Request processed in 62073us (65627us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147214.685134:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7396 00002000:00100000:3.0:1746147214.685144:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8800769d8380 x1830967310435968/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.685153:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769d8380 with x1830967310435968 ext(1048576->2097151) 00010000:00010000:3.0:1746147214.685162:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f380c00/0x31399394250630ba lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f21b expref: 8 pid: 13712 timeout: 852 lvb_type: 1 00010000:00010000:3.0:1746147214.685174:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f380c00/0x31399394250630ba lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f21b expref: 8 pid: 13712 timeout: 852 lvb_type: 1 00002000:00010000:3.0:1746147214.685180:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800769d8380 00000100:00100000:0.0:1746147214.689866:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147214.689923:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310437504 00000100:00100000:1.0:1746147214.689930:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310437504 00000100:00100000:1.0:1746147214.689967:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20114 00000100:00100000:1.0:1746147214.689972:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2950:x1830967310437504:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147214.689986:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147214.690000:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063169 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f2a7 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.690020:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.690025:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147214.690026:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147214.690028:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063169 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a7 expref: 32 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147214.690133:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311502848:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147214.690150:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147214.690184:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310437120:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7891us (9653us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147214.690192:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9137 00000100:00100000:2.0:1746147214.690404:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311502464:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147214.690414:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311502592:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147214.690421:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311502720:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147214.690441:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425063162 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [1150976->1544191] (req 1150976->1544191) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a0 expref: 26 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.690457:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093730600, rc 0) 00000100:00100000:2.0:1746147214.690475:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2949:x1830967310436992:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 9746us (10008us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.690479:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20113 00010000:00010000:1.0:1746147214.690562:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 13 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.690573:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 13 pid: 1853 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746147214.690592:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311502976:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147214.690654:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147214.693228:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.693263:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.693298:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.693373:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310437760 00000100:00100000:0.0:1746147214.693380:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310437760 00002000:00100000:0.0:1746147214.693418:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1839104->1843199) req@ffff880099010380 x1830967310437760/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147214.693427:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099010380 with x1830967310437760 ext(1839104->1843199) 00010000:00010000:0.0:1746147214.693436:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 14 pid: 1853 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746147214.693448:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 14 pid: 1853 timeout: 852 lvb_type: 0 00002000:00010000:0.0:1746147214.693454:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099010380 00000100:00100000:0.0:1746147214.693470:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1743 00000100:00100000:0.0:1746147214.693478:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310437760:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147214.693601:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310437760:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 123us (300us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147214.693607:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1743 00002000:00100000:0.0:1746147214.693612:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1839104->1843199) req@ffff880099010380 x1830967310437760/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/4536 e 0 to 0 dl 1746147225 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147214.693619:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099010380 with x1830967310437760 ext(1839104->1843199) 00010000:00010000:0.0:1746147214.693623:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 14 pid: 1853 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746147214.693630:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 14 pid: 1853 timeout: 852 lvb_type: 0 00002000:00010000:0.0:1746147214.693635:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099010380 00000100:00100000:2.0:1746147214.693779:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310437248 00000100:00100000:2.0:1746147214.693783:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310437248 00010000:00010000:2.0:1746147214.693800:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f007c00/0x3139939425063100 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f253 expref: 26 pid: 13712 timeout: 852 lvb_type: 1 00000100:00100000:2.0:1746147214.693816:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310437376 00000100:00100000:2.0:1746147214.693818:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310437376 00010000:00010000:2.0:1746147214.693827:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425063019 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1e3 expref: 11 pid: 17600 timeout: 852 lvb_type: 1 00000100:00100000:2.0:1746147214.693837:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9138 00000100:00100000:2.0:1746147214.693841:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310437248:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147214.693849:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147214.693862:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f007c00/0x3139939425063100 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f253 expref: 26 pid: 13712 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746147214.693870:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f007c00/0x3139939425063100 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f253 expref: 26 pid: 13712 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746147214.693888:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f007c00/0x3139939425063100 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f253 expref: 26 pid: 13712 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746147214.693909:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147214.693940:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310437248:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 98us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.693945:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9138 00000100:00100000:2.0:1746147214.693954:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9139 00000100:00100000:2.0:1746147214.693959:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310437376:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147214.693964:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147214.693969:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425063019 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1e3 expref: 11 pid: 17600 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746147214.693977:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425063019 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1e3 expref: 11 pid: 17600 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746147214.693988:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f15f800/0x3139939425063019 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1e3 expref: 11 pid: 17600 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746147214.693996:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147214.694009:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310437376:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 50us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.694014:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9139 00000100:00100000:1.0:1746147214.694337:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311502976:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147214.694359:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063169 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a7 expref: 32 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.694368:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932e2a00, rc 0) 00000100:00100000:1.0:1746147214.694391:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2950:x1830967310437504:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4418us (4534us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147214.694397:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20114 00000100:00100000:0.0:1746147214.703340:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.703788:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310437888 00000100:00100000:2.0:1746147214.703796:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310437888 00010000:00010000:2.0:1746147214.703833:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f380c00/0x31399394250630ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f21b expref: 8 pid: 13712 timeout: 852 lvb_type: 1 00000100:00100000:2.0:1746147214.704456:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9140 00000100:00100000:2.0:1746147214.704465:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310437888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147214.704477:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147214.704495:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f380c00/0x31399394250630ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f21b expref: 8 pid: 13712 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746147214.704505:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f380c00/0x31399394250630ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f21b expref: 8 pid: 13712 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746147214.704524:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f380c00/0x31399394250630ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f21b expref: 8 pid: 13712 timeout: 852 lvb_type: 1 00010000:00010000:2.0:1746147214.704547:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.704549:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.704555:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425063162 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1544191) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a0 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.704562:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425063162 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1544191) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a0 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.704600:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425063162 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1544191) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a0 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147214.704611:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ece00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311503104:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147214.706166:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.706241:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:3.0:1746147214.706300:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310438016 00000100:00100000:3.0:1746147214.706306:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310438016 00000100:00100000:3.0:1746147214.706341:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20115 00000100:00100000:3.0:1746147214.706347:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2948:x1830967310438016:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147214.706362:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147214.706376:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425063170 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f2ae expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.706396:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147214.706400:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425063170 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ae expref: 15 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.706408:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425063170 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ae expref: 15 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.706416:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b81e00, rc 0) 00000100:00100000:3.0:1746147214.706448:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2948:x1830967310438016:12345-192.168.204.25@tcp:101:cat.0 Request processed in 101us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147214.706454:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20115 00000100:00100000:0.0:1746147214.711647:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147214.711705:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310438528 00000100:00100000:1.0:1746147214.711713:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310438528 00002000:00100000:1.0:1746147214.711751:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1150976->1155071) req@ffff880099012300 x1830967310438528/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147214.711761:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099012300 with x1830967310438528 ext(1150976->1155071) 00002000:00010000:1.0:1746147214.711766:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099012300 00000100:00100000:1.0:1746147214.711783:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7398 00000100:00100000:1.0:1746147214.711789:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310438528:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147214.711897:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310438528:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 107us (259us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147214.711902:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7398 00002000:00100000:1.0:1746147214.711907:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1150976->1155071) req@ffff880099012300 x1830967310438528/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/4536 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147214.711913:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099012300 with x1830967310438528 ext(1150976->1155071) 00002000:00010000:1.0:1746147214.711916:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099012300 00000100:00100000:2.0:1746147214.711990:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ece00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311503104:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147214.712006:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147214.712036:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2000:x1830967310437888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7573us (8703us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.712042:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9140 00000100:00100000:0.0:1746147214.715626:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.716673:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.717017:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310438656 00000100:00100000:2.0:1746147214.717025:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310438656 00000100:00100000:0.0:1746147214.717915:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.717997:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20116 00000100:00100000:2.0:1746147214.718006:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2944:x1830967310438656:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147214.718021:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147214.718035:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x3139939425063177 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f2b5 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.718059:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1e00/0x3139939425063027 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1f8 expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.718067:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425063115 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f268 expref: 31 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.718074:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x31399394250630cf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f230 expref: 16 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.718079:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.718081:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.718084:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x3139939425063177 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->2629631] (req 2097152->2629631) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2b5 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.718117:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x31399394250630cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f230 expref: 16 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.718128:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x31399394250630cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f230 expref: 16 pid: 9585 timeout: 852 lvb_type: 1 00000100:00100000:2.0:1746147214.718138:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311503232:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147214.718880:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310438272 00000100:00100000:1.0:1746147214.718886:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310438272 00002000:00100000:1.0:1746147214.718913:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1839104->2097151) req@ffff880099011500 x1830967310438272/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147214.718923:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099011500 with x1830967310438272 ext(1839104->2097151) 00010000:00010000:1.0:1746147214.718930:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 17 pid: 1853 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746147214.718939:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 17 pid: 1853 timeout: 852 lvb_type: 0 00002000:00010000:1.0:1746147214.718946:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099011500 00000100:00100000:1.0:1746147214.718960:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310438912 00000100:00100000:1.0:1746147214.718963:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310438912 00002000:00100000:1.0:1746147214.718974:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1540096->1544191) req@ffff880099011880 x1830967310438912/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147214.718981:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099011880 with x1830967310438912 ext(1540096->1544191) 00002000:00010000:1.0:1746147214.718983:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099011880 00000100:00100000:1.0:1746147214.719287:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1744 00000100:00100000:1.0:1746147214.719294:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310438272:12345-192.168.204.25@tcp:4:multiop.0 00010000:00010000:2.0:1746147214.719455:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425063115 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f268 expref: 31 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.719465:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425063115 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f268 expref: 31 pid: 1853 timeout: 852 lvb_type: 1 00000100:00100000:2.0:1746147214.719474:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311503360:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147214.719661:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7399 00000100:00100000:3.0:1746147214.719669:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967310438912:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147214.719754:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967310438912:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 85us (1839us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147214.719759:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7399 00002000:00100000:3.0:1746147214.719764:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x96:0x0] (1540096->1544191) req@ffff880099011880 x1830967310438912/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/4536 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.719777:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099011880 with x1830967310438912 ext(1540096->1544191) 00002000:00010000:3.0:1746147214.719780:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099011880 00010000:00010000:2.0:1746147214.720278:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800993b1e00/0x3139939425063027 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1f8 expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.720288:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1e00/0x3139939425063027 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1f8 expref: 14 pid: 9585 timeout: 852 lvb_type: 1 00000100:00100000:2.0:1746147214.720298:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311503488:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147214.720321:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147214.722524:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.722623:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311503232:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147214.723130:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310439040 00000100:00100000:3.0:1746147214.723136:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310439040 00010000:00010000:3.0:1746147214.723168:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x31399394250630cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f230 expref: 19 pid: 9585 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746147214.723197:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9141 00000100:00100000:3.0:1746147214.723204:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b404e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2003:x1830967310439040:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147214.723214:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147214.723230:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x31399394250630cf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f230 expref: 19 pid: 9585 timeout: 852 lvb_type: 1 00010000:00010000:3.0:1746147214.723239:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x31399394250630cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f230 expref: 19 pid: 9585 timeout: 852 lvb_type: 1 00010000:00010000:3.0:1746147214.723257:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x31399394250630cf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f230 expref: 19 pid: 9585 timeout: 852 lvb_type: 1 00010000:00010000:3.0:1746147214.723285:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147214.723328:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b404e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310439040:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 124us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147214.723334:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9141 00000100:00100000:3.0:1746147214.725981:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311503488:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147214.727866:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147214.728262:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311503360:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147214.728295:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x3139939425063177 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2629631] (req 2097152->2629631) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2b5 expref: 17 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.728310:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093730a00, rc 0) 00000100:00100000:3.0:1746147214.728359:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2944:x1830967310438656:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 10354us (12739us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147214.728367:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20116 00000100:00100000:0.0:1746147214.728488:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147214.728605:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310439168 00000100:00100000:1.0:1746147214.728611:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310439168 00010000:00010000:1.0:1746147214.728633:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1e00/0x3139939425063027 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1f8 expref: 15 pid: 9585 timeout: 852 lvb_type: 1 00000100:00100000:1.0:1746147214.728649:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310439296 00000100:00100000:1.0:1746147214.728651:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310439296 00010000:00010000:1.0:1746147214.728659:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425063115 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f268 expref: 32 pid: 1853 timeout: 852 lvb_type: 1 00000100:00100000:1.0:1746147214.728672:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9142 00000100:00100000:1.0:1746147214.728678:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310439168:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147214.728687:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147214.728703:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800993b1e00/0x3139939425063027 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1f8 expref: 15 pid: 9585 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746147214.728711:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800993b1e00/0x3139939425063027 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1f8 expref: 15 pid: 9585 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746147214.728729:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1e00/0x3139939425063027 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1f8 expref: 15 pid: 9585 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746147214.728743:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147214.728764:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310439168:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 86us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147214.728772:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9142 00000100:00100000:1.0:1746147214.728783:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9143 00000100:00100000:1.0:1746147214.728788:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310439296:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147214.728793:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147214.728799:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425063115 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f268 expref: 32 pid: 1853 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746147214.728805:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425063115 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f268 expref: 32 pid: 1853 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746147214.728815:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d9b200/0x3139939425063115 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f268 expref: 32 pid: 1853 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746147214.728823:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147214.728825:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147214.728830:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x3139939425063177 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2b5 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.728836:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x3139939425063177 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2b5 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147214.728858:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x3139939425063177 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2b5 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147214.728868:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311503616:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147214.728905:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147214.734931:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310438272:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 15627us (18248us total) trans 21474842678 rc 0/0 00000100:00100000:2.0:1746147214.734944:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1744 00002000:00100000:2.0:1746147214.734955:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1839104->2097151) req@ffff880099011500 x1830967310438272/t21474842678(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/448 e 0 to 0 dl 1746147225 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147214.734964:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099011500 with x1830967310438272 ext(1839104->2097151) 00010000:00010000:2.0:1746147214.734972:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 17 pid: 1853 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746147214.734985:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 17 pid: 1853 timeout: 852 lvb_type: 0 00002000:00010000:2.0:1746147214.734992:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099011500 00000100:00100000:2.0:1746147214.735487:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311503616:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147214.735502:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147214.735521:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967310439296:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6733us (7033us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.735530:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9143 00000100:00100000:0.0:1746147214.742648:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.743045:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.743404:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310439424 00000100:00100000:2.0:1746147214.743412:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310439424 00010000:00010000:2.0:1746147214.743444:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 17 pid: 1853 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746147214.743901:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9144 00000100:00100000:2.0:1746147214.743909:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967310439424:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147214.743920:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147214.743936:0:7227:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147212 -> 1746147214 00002000:00010000:2.0:1746147214.743938:0:7227:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147212 -> 1746147214 00010000:00010000:2.0:1746147214.743943:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 17 pid: 1853 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746147214.743954:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 17 pid: 1853 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746147214.743974:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d9ac00/0x313993942506315b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1839104->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f299 expref: 17 pid: 1853 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746147214.744408:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.744410:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.744417:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063169 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a7 expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.744426:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063169 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a7 expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.744433:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.744434:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.744436:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425063170 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ae expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.744442:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425063170 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ae expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.744468:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425063170 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ae expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147214.744479:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311503744:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147214.744553:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063169 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a7 expref: 30 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147214.744559:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311503872:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147214.744571:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147214.745071:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310439680 00000100:00100000:3.0:1746147214.745077:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310439680 00002000:00100000:3.0:1746147214.745120:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2625536->2629631) req@ffff880099013800 x1830967310439680/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.745128:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099013800 with x1830967310439680 ext(2625536->2629631) 00002000:00010000:3.0:1746147214.745132:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099013800 00000100:00100000:3.0:1746147214.745147:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7400 00000100:00100000:3.0:1746147214.745152:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967310439680:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147214.745247:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967310439680:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 95us (2202us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147214.745254:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7400 00002000:00100000:3.0:1746147214.745258:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2625536->2629631) req@ffff880099013800 x1830967310439680/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/4536 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.745266:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099013800 with x1830967310439680 ext(2625536->2629631) 00002000:00010000:3.0:1746147214.745268:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099013800 00000100:00100000:2.0:1746147214.748560:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311503872:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147214.750241:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311503744:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147214.750263:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147214.750317:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967310439424:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6407us (7676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.750326:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9144 00000100:00100000:0.0:1746147214.750860:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147214.751183:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147214.751256:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310439936 00000100:00100000:2.0:1746147214.751256:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310440192 00000100:00100000:3.0:1746147214.751262:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310439936 00000100:00100000:2.0:1746147214.751262:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310440192 00002000:00100000:2.0:1746147214.751291:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800a5575500 x1830967310440192/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147214.751299:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5575500 with x1830967310440192 ext(1048576->2097151) 00002000:00010000:2.0:1746147214.751304:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5575500 00002000:00100000:3.0:1746147214.751310:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099011180 x1830967310439936/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.751319:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099011180 with x1830967310439936 ext(1048576->2097151) 00002000:00010000:3.0:1746147214.751322:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099011180 00000100:00100000:2.0:1746147214.751623:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7401 00000100:00100000:2.0:1746147214.751633:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967310440192:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147214.751701:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7402 00000100:00100000:3.0:1746147214.751707:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967310439936:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147214.764437:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967310439936:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 12721us (13569us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147214.764448:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7402 00002000:00100000:3.0:1746147214.764458:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099011180 x1830967310439936/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.764467:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099011180 with x1830967310439936 ext(1048576->2097151) 00002000:00010000:3.0:1746147214.764471:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099011180 00000100:00100000:2.0:1746147214.768834:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967310440192:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 17193us (17642us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147214.768846:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7401 00002000:00100000:2.0:1746147214.768857:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800a5575500 x1830967310440192/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147214.768872:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5575500 with x1830967310440192 ext(1048576->2097151) 00002000:00010000:2.0:1746147214.768877:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5575500 00000100:00100000:0.0:1746147214.775176:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147214.775913:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310440320 00000100:00100000:3.0:1746147214.775922:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310440320 00000100:00100000:3.0:1746147214.775971:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20117 00000100:00100000:3.0:1746147214.775978:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967310440320:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147214.775993:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147214.776007:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9fdc00/0x313993942506317e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f2bc expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147214.776050:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311504000:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147214.776159:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147214.788913:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.788980:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310440576 00000100:00100000:2.0:1746147214.788994:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310440576 00002000:00100000:2.0:1746147214.789033:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2629632->4194303) req@ffff880099010700 x1830967310440576/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147214.789042:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099010700 with x1830967310440576 ext(2629632->4194303) 00002000:00010000:2.0:1746147214.789048:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099010700 00000100:00100000:2.0:1746147214.789067:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7403 00000100:00100000:2.0:1746147214.789073:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967310440576:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147214.792017:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147214.792197:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310440832 00000100:00100000:1.0:1746147214.792205:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310440832 00002000:00100000:1.0:1746147214.792241:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff880099011c00 x1830967310440832/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147214.792251:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099011c00 with x1830967310440832 ext(2097152->4194303) 00002000:00010000:1.0:1746147214.792257:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099011c00 00000100:00100000:1.0:1746147214.792278:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7404 00000100:00100000:1.0:1746147214.792284:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2000:x1830967310440832:12345-192.168.204.25@tcp:3:cat.0 00002000:00010000:2.0:1746147214.798221:0:1853:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746147212 -> 1746147214 00002000:00010000:2.0:1746147214.798230:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746147212 -> 1746147214 00002000:00010000:2.0:1746147214.798233:0:1853:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime: 1746147212 -> 1746147214 00000100:00100000:2.0:1746147214.798254:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311504000:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147214.798285:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fdc00/0x313993942506317e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2bc expref: 32 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.798298:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fdc00/0x313993942506317e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2bc expref: 32 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.798324:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fdc00, rc 0) 00000100:00100000:2.0:1746147214.798357:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967310440320:12345-192.168.204.25@tcp:101:cat.0 Request processed in 22378us (23188us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147214.798365:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20117 00000100:00100000:0.0:1746147214.814239:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.815193:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310440960 00000100:00100000:2.0:1746147214.815203:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310440960 00000100:00100000:2.0:1746147214.815265:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20118 00000100:00100000:2.0:1746147214.815274:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2950:x1830967310440960:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147214.815290:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147214.815306:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425063185 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f2c3 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.815330:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x3139939425063177 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2b5 expref: 17 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.815337:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147214.815338:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147214.815341:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425063185 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2c3 expref: 32 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.815366:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x3139939425063177 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2b5 expref: 17 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.815375:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x3139939425063177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2b5 expref: 17 pid: 1853 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746147214.815385:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311504128:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147214.816268:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147214.822128:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147214.826122:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.826148:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310441088 00000100:00100000:0.0:1746147214.826156:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310441088 00002000:00100000:0.0:1746147214.826194:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2629631) req@ffff880099012a00 x1830967310441088/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147214.826203:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099012a00 with x1830967310441088 ext(2097152->2629631) 00010000:00010000:0.0:1746147214.826212:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x3139939425063177 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2b5 expref: 18 pid: 1853 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746147214.826225:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x3139939425063177 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2b5 expref: 18 pid: 1853 timeout: 852 lvb_type: 0 00002000:00010000:0.0:1746147214.826232:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099012a00 00000100:00100000:0.0:1746147214.826264:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1745 00000100:00100000:0.0:1746147214.826271:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310441088:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147214.826457:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2000:x1830967310440832:12345-192.168.204.25@tcp:3:cat.0 Request processed in 34172us (34447us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147214.826464:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7404 00002000:00100000:1.0:1746147214.826469:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff880099011c00 x1830967310440832/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147214.826476:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099011c00 with x1830967310440832 ext(2097152->4194303) 00002000:00010000:1.0:1746147214.826480:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099011c00 00000100:00100000:2.0:1746147214.826487:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311504128:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147214.826510:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425063185 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2c3 expref: 32 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.826530:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093731800, rc 0) 00000100:00100000:2.0:1746147214.826568:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2950:x1830967310440960:12345-192.168.204.25@tcp:101:cat.0 Request processed in 11294us (12336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.826574:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20118 00000100:00100000:2.0:1746147214.831287:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310440576:12345-192.168.204.25@tcp:3:cat.0 Request processed in 42205us (42371us total) trans 0 rc 1564672/1564672 00000100:00100000:2.0:1746147214.831298:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7403 00002000:00100000:2.0:1746147214.831309:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2629632->4194303) req@ffff880099010700 x1830967310440576/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 1564672/1564672 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147214.831318:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099010700 with x1830967310440576 ext(2629632->4194303) 00010000:00010000:2.0:1746147214.831326:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x3139939425063177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2b5 expref: 18 pid: 1853 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746147214.831339:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x3139939425063177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2b5 expref: 18 pid: 1853 timeout: 852 lvb_type: 0 00002000:00010000:2.0:1746147214.831346:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099010700 00000100:00100000:2.0:1746147214.839234:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310441088:12345-192.168.204.25@tcp:4:cat.0 Request processed in 12953us (13108us total) trans 21474842679 rc 0/0 00000100:00100000:2.0:1746147214.839246:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1745 00002000:00100000:2.0:1746147214.839259:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2629631) req@ffff880099012a00 x1830967310441088/t21474842679(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/448 e 0 to 0 dl 1746147225 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147214.839269:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099012a00 with x1830967310441088 ext(2097152->2629631) 00010000:00010000:2.0:1746147214.839280:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x3139939425063177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2b5 expref: 18 pid: 1853 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746147214.839294:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x3139939425063177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2b5 expref: 18 pid: 1853 timeout: 852 lvb_type: 0 00002000:00010000:2.0:1746147214.839301:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099012a00 00000100:00100000:0.0:1746147214.846233:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.846760:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310441344 00000100:00100000:2.0:1746147214.846769:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310441344 00010000:00010000:2.0:1746147214.846805:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x3139939425063177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2b5 expref: 18 pid: 1853 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746147214.846844:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9145 00000100:00100000:2.0:1746147214.846851:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310441344:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147214.846864:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147214.846882:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x3139939425063177 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2b5 expref: 18 pid: 1853 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746147214.846893:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x3139939425063177 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2b5 expref: 18 pid: 1853 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746147214.846912:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x3139939425063177 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2b5 expref: 18 pid: 1853 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746147214.846929:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.846931:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.846937:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425063185 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2c3 expref: 31 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.846949:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425063185 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2c3 expref: 31 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.846978:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425063185 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2c3 expref: 31 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147214.846987:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311504256:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147214.847057:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147214.847398:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.847466:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310441216 00000100:00100000:2.0:1746147214.847470:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310441216 00000100:00100000:2.0:1746147214.847491:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20119 00000100:00100000:2.0:1746147214.847496:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2948:x1830967310441216:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147214.847508:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147214.847523:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942506318c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f2ca expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.847536:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.847538:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147214.847542:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942506318c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ca expref: 19 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.847552:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942506318c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ca expref: 19 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147214.847560:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093731e00, rc 0) 00000100:00100000:2.0:1746147214.847601:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2948:x1830967310441216:12345-192.168.204.25@tcp:101:cat.0 Request processed in 104us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.847607:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20119 00000100:00100000:2.0:1746147214.852216:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311504256:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147214.852236:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147214.852276:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310441344:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5425us (6052us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147214.852286:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9145 00000100:00100000:0.0:1746147214.854434:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.854930:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310441600 00000100:00100000:2.0:1746147214.854937:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310441600 00002000:00100000:2.0:1746147214.854977:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880132124700 x1830967310441600/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147214.854986:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132124700 with x1830967310441600 ext(3145728->4194303) 00002000:00010000:2.0:1746147214.854991:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132124700 00000100:00100000:2.0:1746147214.855026:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7405 00000100:00100000:2.0:1746147214.855033:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310441600:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147214.863177:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.863214:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.863293:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310441984 00000100:00100000:2.0:1746147214.863303:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310441984 00002000:00100000:2.0:1746147214.863347:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff880132124a80 x1830967310441984/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147214.863356:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132124a80 with x1830967310441984 ext(2097152->4194303) 00002000:00010000:2.0:1746147214.863361:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132124a80 00000100:00100000:2.0:1746147214.863391:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7406 00000100:00100000:2.0:1746147214.863398:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310441984:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147214.863772:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310442112 00000100:00100000:1.0:1746147214.863777:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310442112 00002000:00100000:1.0:1746147214.863798:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880132124e00 x1830967310442112/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147214.863805:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132124e00 with x1830967310442112 ext(2097152->4194303) 00002000:00010000:1.0:1746147214.863808:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132124e00 00000100:00100000:1.0:1746147214.863823:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7407 00000100:00100000:1.0:1746147214.863829:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310442112:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147214.870882:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310441600:12345-192.168.204.25@tcp:3:cat.0 Request processed in 15840us (16444us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147214.870893:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7405 00002000:00100000:2.0:1746147214.870903:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880132124700 x1830967310441600/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147214.870911:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132124700 with x1830967310441600 ext(3145728->4194303) 00002000:00010000:2.0:1746147214.870915:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132124700 00000100:00100000:0.0:1746147214.903704:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.903825:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310442240 00000100:00100000:2.0:1746147214.903836:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310442240 00000100:00100000:2.0:1746147214.903875:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20120 00000100:00100000:2.0:1746147214.903882:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2003:x1830967310442240:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147214.903900:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147214.903916:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093731600/0x3139939425063193 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f2d1 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147214.903966:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311504384:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147214.904053:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147214.905622:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310441984:12345-192.168.204.25@tcp:3:cat.0 Request processed in 42218us (42445us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147214.905635:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7406 00002000:00100000:3.0:1746147214.905644:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff880132124a80 x1830967310441984/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.905652:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132124a80 with x1830967310441984 ext(2097152->4194303) 00002000:00010000:3.0:1746147214.905657:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132124a80 00002000:00010000:2.0:1746147214.916146:0:1853:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime: 1746147211 -> 1746147214 00002000:00010000:2.0:1746147214.916153:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime: 1746147210 -> 1746147214 00002000:00010000:2.0:1746147214.916155:0:1853:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime: 1746147211 -> 1746147214 00000100:00100000:2.0:1746147214.916175:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311504384:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147214.916202:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093731600/0x3139939425063193 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2d1 expref: 8 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.916215:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093731600/0x3139939425063193 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2d1 expref: 8 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.917767:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093731600, rc 0) 00000100:00100000:2.0:1746147214.917842:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2003:x1830967310442240:12345-192.168.204.25@tcp:101:cat.0 Request processed in 13958us (14143us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147214.917852:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20120 00000100:00100000:0.0:1746147214.927625:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147214.927693:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310442496 00000100:00100000:3.0:1746147214.927702:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310442496 00002000:00100000:3.0:1746147214.927739:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880132125500 x1830967310442496/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.927748:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132125500 with x1830967310442496 ext(4194304->4890623) 00002000:00010000:3.0:1746147214.927753:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132125500 00000100:00100000:3.0:1746147214.927770:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7408 00000100:00100000:3.0:1746147214.927777:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310442496:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147214.927993:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310442112:12345-192.168.204.25@tcp:3:cat.0 Request processed in 64163us (64777us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147214.928000:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7407 00002000:00100000:1.0:1746147214.928006:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880132124e00 x1830967310442112/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147214.928012:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132124e00 with x1830967310442112 ext(2097152->4194303) 00002000:00010000:1.0:1746147214.928015:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132124e00 00000100:00100000:3.0:1746147214.947412:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310442496:12345-192.168.204.25@tcp:3:cat.0 Request processed in 19627us (19788us total) trans 0 rc 696320/696320 00000100:00100000:3.0:1746147214.947423:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7408 00002000:00100000:3.0:1746147214.947432:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880132125500 x1830967310442496/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147214.947439:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132125500 with x1830967310442496 ext(4194304->4890623) 00002000:00010000:3.0:1746147214.947444:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132125500 00000100:00100000:0.0:1746147214.955069:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147214.956601:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310442752 00000100:00100000:3.0:1746147214.957035:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310442752 00002000:00100000:2.0:1746147214.960390:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880132125880 x1830967310442752/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/0 e 0 to 0 dl 1746147225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147214.960401:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132125880 with x1830967310442752 ext(4194304->4890623) 00002000:00010000:2.0:1746147214.960406:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132125880 00000100:00100000:2.0:1746147214.960452:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7409 00000100:00100000:2.0:1746147214.960460:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967310442752:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147214.963502:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147214.964068:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310442880 00000100:00100000:2.0:1746147214.964079:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310442880 00000100:00100000:2.0:1746147214.964177:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20121 00000100:00100000:2.0:1746147214.964187:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2003:x1830967310442880:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147214.964209:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147214.964233:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x313993942506319a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f2d8 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147214.964300:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311504512:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147214.964417:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147214.966941:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967310442752:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6470us (11874us total) trans 0 rc 696320/696320 00000100:00100000:2.0:1746147214.966955:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7409 00002000:00100000:2.0:1746147214.966968:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880132125880 x1830967310442752/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:590/0 lens 488/440 e 0 to 0 dl 1746147225 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147214.966978:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132125880 with x1830967310442752 ext(4194304->4890623) 00002000:00010000:2.0:1746147214.966983:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132125880 00000100:00100000:2.0:1746147214.971708:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311504512:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147214.971748:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x313993942506319a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2d8 expref: 8 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.971768:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x313993942506319a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2d8 expref: 8 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147214.971800:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093730800, rc 0) 00000100:00100000:2.0:1746147214.971858:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2003:x1830967310442880:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7673us (8367us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147214.971867:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20121 00000100:00100000:0.0:1746147214.976309:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147214.976357:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147214.976400:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310443264 00000100:00100000:1.0:1746147214.976408:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310443264 00000100:00100000:2.0:1746147214.976506:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310443008 00000100:00100000:2.0:1746147214.976510:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310443008 00000100:00100000:2.0:1746147214.976533:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20122 00000100:00100000:2.0:1746147214.976539:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2003:x1830967310443008:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147214.976552:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147214.976567:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093731600/0x31399394250631a1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f2df expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147214.976704:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6172 00000100:00100000:2.0:1746147214.976737:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311504640:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147214.976817:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2950:x1830967310443264:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147214.976832:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147214.977071:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2950:x1830967310443264:12345-192.168.204.25@tcp:35:cat.0 Request processed in 361us (712us total) trans 8589937402 rc 0/0 00000100:00100000:1.0:1746147214.977078:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6172 00000100:00100000:1.0:1746147214.980587:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147214.980738:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310443520 00000100:00100000:3.0:1746147214.980745:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310443520 00000100:00100000:3.0:1746147214.980782:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16496 00000100:00100000:0.0:1746147214.980783:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311504640:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147214.980788:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2954:x1830967310443520:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147214.980806:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147214.980821:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x31399394250631a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f2e6 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147214.980821:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093731600/0x31399394250631a1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2df expref: 8 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147214.980835:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093731600/0x31399394250631a1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2df expref: 8 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147214.980850:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093731600, rc 0) 00010000:00010000:3.0:1746147214.980873:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250631af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.980884:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250631af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.980893:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250631af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147214.980898:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2003:x1830967310443008:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4357us (4595us total) trans 0 rc 301/301 00010000:00010000:3.0:1746147214.980902:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250631b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.980906:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250631b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147214.980907:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20122 00010000:00010000:3.0:1746147214.980911:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250631b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.981453:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x31399394250631bd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.981462:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x31399394250631bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.981468:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x31399394250631bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147214.981474:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147214.981526:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250631af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.981531:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250631af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.981536:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250631af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.981540:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147214.981543:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250631af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.981547:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250631af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.981555:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147214.981557:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147214.981560:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250631af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.981564:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7a00/0x31399394250631af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.981591:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250631b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.981595:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250631b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.981599:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250631b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.981603:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d6800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147214.981605:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250631b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.981609:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250631b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.981614:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b52d6900) 00010000:00010000:3.0:1746147214.981616:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147214.981617:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250631b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.981621:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6800/0x31399394250631b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147214.982647:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x31399394250631a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2e6 expref: 32 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.982660:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x31399394250631bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2e6 expref: 31 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.982666:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147214.982667:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147214.982670:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d6a00, rc 0) 00000100:00100000:3.0:1746147214.982732:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2954:x1830967310443520:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1943us (2164us total) trans 8589937403 rc 0/0 00000100:00100000:3.0:1746147214.982738:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16496 00000100:00100000:2.0:1746147214.987407:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147214.988473:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310444032 00000100:00100000:1.0:1746147214.988484:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310444032 00000100:00100000:1.0:1746147214.988827:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6173 00000100:00100000:0.0:1746147214.988829:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147214.988836:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2954:x1830967310444032:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147214.989033:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310443776 00000100:00100000:3.0:1746147214.989037:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310443776 00000100:00100000:3.0:1746147214.989077:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16497 00000100:00100000:1.0:1746147214.989079:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2954:x1830967310444032:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 243us (1684us total) trans 8589937404 rc 0/0 00000100:00100000:3.0:1746147214.989083:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2956:x1830967310443776:12345-192.168.204.25@tcp:101:multiop.0 00000100:00100000:1.0:1746147214.989086:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6173 00010000:00010000:3.0:1746147214.989107:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147214.989125:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x31399394250631cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f2ed expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.989191:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250631d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147214.989202:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147214.989204:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250631d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.989214:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250631d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.989226:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x31399394250631d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.989231:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x31399394250631d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.989236:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x31399394250631d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:1.0:1746147214.989304:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310444288 00000100:00100000:1.0:1746147214.989307:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310444288 00010000:00010000:3.0:1746147214.989311:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x31399394250631e0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.989320:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x31399394250631e0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00000100:00100000:1.0:1746147214.989322:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6174 00010000:00010000:3.0:1746147214.989326:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x31399394250631e0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:1.0:1746147214.989326:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2948:x1830967310444288:12345-192.168.204.25@tcp:35:cat.0 00000004:00200000:3.0:1746147214.989334:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147214.989380:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250631d2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.989386:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250631d2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00000100:00100000:1.0:1746147214.989391:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2948:x1830967310444288:12345-192.168.204.25@tcp:35:cat.0 Request processed in 64us (188us total) trans 8589937405 rc 0/0 00010000:00010000:3.0:1746147214.989392:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250631d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00000100:00100000:1.0:1746147214.989396:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6174 00010000:00010000:3.0:1746147214.989398:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250631d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.989403:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147214.989407:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250631d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.989414:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250631d2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.989587:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147214.989590:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147214.989595:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250631d2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.989601:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x31399394250631d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.989610:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x31399394250631d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.989615:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x31399394250631d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.989619:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x31399394250631d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.989624:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147214.989626:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x31399394250631d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.989635:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x31399394250631d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.989642:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b52d6100) 00010000:00010000:3.0:1746147214.989644:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147214.989646:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x31399394250631d9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.989650:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x31399394250631d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147214.989681:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x31399394250631cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ed expref: 13 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.989691:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x31399394250631e0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ed expref: 12 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147214.989696:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147214.989698:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746147214.989700:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7800, rc 0) 00000100:00100000:3.0:1746147214.989765:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2956:x1830967310443776:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 681us (934us total) trans 8589937406 rc 0/0 00000100:00100000:3.0:1746147214.989770:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16497 00000100:00100000:0.0:1746147214.992741:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147214.993294:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310444544 00000100:00100000:1.0:1746147214.993307:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310444544 00000100:00100000:1.0:1746147214.993369:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6175 00000100:00100000:1.0:1746147214.993378:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2956:x1830967310444544:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147214.993660:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2956:x1830967310444544:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 281us (935us total) trans 8589937407 rc 0/0 00000100:00100000:1.0:1746147214.993667:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6175 00000100:00100000:0.0:1746147215.008000:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.008138:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310444672 00000100:00100000:2.0:1746147215.008147:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310444672 00000100:00100000:1.0:1746147215.009374:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20123 00000100:00100000:1.0:1746147215.009390:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2954:x1830967310444672:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147215.009413:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.009440:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x31399394250631ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f2f4 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.009478:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063169 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a7 expref: 33 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.009488:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425063170 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ae expref: 17 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.009495:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.009498:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.009501:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x31399394250631ee lrc: 5/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [2011136->2097151] (req 2011136->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2f4 expref: 33 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.009538:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425063170 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ae expref: 17 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.009550:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425063170 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ae expref: 17 pid: 12225 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746147215.009563:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311504768:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147215.016706:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063169 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a7 expref: 33 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.016725:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063169 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a7 expref: 33 pid: 12225 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746147215.016740:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5574700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311504896:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147215.016821:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc840 going to sleep for 11 seconds 00000100:00100000:1.0:1746147215.016851:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311504768:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147215.019365:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5574700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311504896:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147215.019405:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x31399394250631ee lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [2011136->2097151] (req 2011136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2f4 expref: 33 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.019423:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d48600, rc 0) 00000100:00100000:1.0:1746147215.019477:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2954:x1830967310444672:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 10091us (11486us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.019487:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20123 00000100:00100000:1.0:1746147215.026298:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.026350:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.027008:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310444800 00000100:00100000:2.0:1746147215.027019:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310444800 00010000:00010000:2.0:1746147215.027065:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425063170 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ae expref: 18 pid: 12225 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746147215.028025:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310444928 00000100:00100000:2.0:1746147215.028032:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310444928 00010000:00010000:2.0:1746147215.028056:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063169 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a7 expref: 33 pid: 12225 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.028115:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9146 00000100:00100000:2.0:1746147215.028125:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310444800:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.028140:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.028163:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425063170 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ae expref: 18 pid: 12225 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746147215.028177:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425063170 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ae expref: 18 pid: 12225 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746147215.028202:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b81e00/0x3139939425063170 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ae expref: 18 pid: 12225 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746147215.028223:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147215.028276:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310444800:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 154us (1989us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.028286:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9146 00000100:00100000:2.0:1746147215.028302:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9147 00000100:00100000:2.0:1746147215.028307:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967310444928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.028314:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.028321:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063169 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a7 expref: 33 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.028329:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063169 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a7 expref: 33 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.028340:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932e2a00/0x3139939425063169 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a7 expref: 33 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.028349:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.028350:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.028358:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x31399394250631ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2f4 expref: 32 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.028365:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x31399394250631ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2f4 expref: 32 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.028398:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x31399394250631ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2f4 expref: 32 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.028412:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311505024:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147215.028477:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.031763:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311505024:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147215.031785:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147215.031843:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310444928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3534us (5490us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.031853:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9147 00000100:00100000:0.0:1746147215.033532:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.033587:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.033687:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310445184 00000100:00100000:2.0:1746147215.033709:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310445184 00002000:00100000:2.0:1746147215.033755:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (2011136->2015231) req@ffff880132127480 x1830967310445184/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.033765:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132127480 with x1830967310445184 ext(2011136->2015231) 00002000:00010000:2.0:1746147215.033770:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132127480 00000100:00100000:2.0:1746147215.033807:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7410 00000100:00100000:2.0:1746147215.033815:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310445184:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147215.033953:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310445184:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 139us (424us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147215.033957:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7410 00002000:00100000:2.0:1746147215.033962:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (2011136->2015231) req@ffff880132127480 x1830967310445184/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/4536 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.033968:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132127480 with x1830967310445184 ext(2011136->2015231) 00002000:00010000:2.0:1746147215.033971:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132127480 00000100:00100000:3.0:1746147215.034400:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310445312 00000100:00100000:3.0:1746147215.034405:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310445312 00000100:00100000:0.0:1746147215.034559:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.034618:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310445440 00000100:00100000:1.0:1746147215.034622:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310445440 00000100:00100000:3.0:1746147215.034636:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16498 00000100:00100000:3.0:1746147215.034644:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+6:2959:x1830967310445312:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:1.0:1746147215.034649:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20124 00000100:00100000:1.0:1746147215.034654:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2956:x1830967310445440:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147215.034662:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.034662:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.034680:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x31399394250631fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f2fb expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.034680:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x31399394250631f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f302 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.034706:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425063185 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2c3 expref: 31 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.034713:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942506318c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ca expref: 18 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.034720:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.034723:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.034726:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x31399394250631f5 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f302 expref: 18 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.034743:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x3139939425063203 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.034756:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x3139939425063203 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147215.034757:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942506318c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ca expref: 18 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.034769:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942506318c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ca expref: 18 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746147215.034784:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311505152:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.034804:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x3139939425063203 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.034818:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942506320a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.034824:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942506320a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.034830:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942506320a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147215.034863:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425063185 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2c3 expref: 31 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.034871:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425063185 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2c3 expref: 31 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746147215.034879:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311505280:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147215.034895:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc840 going to sleep for 11 seconds 00010000:00010000:3.0:1746147215.035139:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063211 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.035150:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f24c expref: 31 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.035158:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x31399394250630f2 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f23e expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.035164:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063211 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.035183:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x31399394250630f2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f23e expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.035192:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x31399394250630f2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f23e expref: 12 pid: 6215 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.035200:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311505408:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.035260:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f24c expref: 31 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.035268:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f24c expref: 31 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.035276:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311505536:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147215.035782:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.039947:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.039956:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311505152:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.040010:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310445568 00000100:00100000:2.0:1746147215.040018:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310445568 00000100:00100000:0.0:1746147215.040020:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.040046:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.040074:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.040119:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310445824 00000100:00100000:0.0:1746147215.040122:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310445824 00010000:00010000:0.0:1746147215.040158:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f24c expref: 32 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746147215.040195:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310445696 00000100:00100000:0.0:1746147215.040198:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310445696 00000100:00100000:2.0:1746147215.040200:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310445952 00000100:00100000:2.0:1746147215.040203:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310445952 00000100:00080000:3.0:1746147215.040206:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1746147215.040210:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x31399394250630f2 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f23e expref: 13 pid: 6215 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.040215:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425063185 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2c3 expref: 33 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746147215.040225:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9148 00000100:00100000:3.0:1746147215.040231:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311505408:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147215.040232:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b404ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310445824:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147215.040236:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9149 00000100:00100000:3.0:1746147215.040240:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311505536:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.040240:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094710380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310445696:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147215.040244:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.040245:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.040250:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x31399394250630f2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f23e expref: 13 pid: 6215 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.040250:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f24c expref: 32 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.040259:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f24c expref: 32 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.040282:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x31399394250630f2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f23e expref: 13 pid: 6215 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746147215.040328:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311505280:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.040442:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063211 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.040458:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f381a00/0x31399394250630f2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f23e expref: 13 pid: 6215 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.040462:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011db33c00/0x31399394250630eb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f24c expref: 32 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.040474:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9150 00010000:00010000:2.0:1746147215.040476:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147215.040480:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063211 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.040489:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063211 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00000100:00100000:3.0:1746147215.040496:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094710700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2002:x1830967310445952:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.040496:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063211 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147215.040501:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.040504:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147215.040504:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147215.040512:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147215.040525:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425063185 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2c3 expref: 33 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.040533:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425063185 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2c3 expref: 33 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746147215.040542:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b404ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967310445824:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 311us (520us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147215.040548:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093731800/0x3139939425063185 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2c3 expref: 33 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746147215.040549:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9148 00010000:00010000:3.0:1746147215.040563:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147215.040566:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x31399394250631f5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f302 expref: 18 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.040587:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d48e00, rc 0) 00000100:00100000:3.0:1746147215.040692:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094710700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967310445952:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 213us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.040693:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094710380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310445696:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 451us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.040698:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9150 00000100:00100000:2.0:1746147215.040703:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9149 00010000:00010000:3.0:1746147215.040714:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063211 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.040721:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063211 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:2.0:1746147215.040741:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20125 00000100:00100000:2.0:1746147215.040745:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2954:x1830967310445568:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147215.040759:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.040770:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425063218 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f309 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1746147215.040772:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147215.040776:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1746147215.040782:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.040784:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.040787:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425063218 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2273279] (req 2097152->2273279) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f309 expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1746147215.040793:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063211 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.040795:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425063218 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2273279] (req 2097152->2273279) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f309 expref: 32 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.040801:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093731400, rc 0) 00010000:00010000:3.0:1746147215.040803:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063211 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.040814:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x3139939425063203 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:2.0:1746147215.040814:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2954:x1830967310445568:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 69us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.040818:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20125 00010000:00010000:3.0:1746147215.040819:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x3139939425063203 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.040824:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x3139939425063203 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.040829:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x3139939425063203 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.040836:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147215.040840:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x3139939425063203 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.040845:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x3139939425063203 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.040853:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147215.040855:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147215.040859:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x3139939425063203 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.040864:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7200/0x3139939425063203 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.040872:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942506320a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.040876:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942506320a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.040879:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942506320a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.040883:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d7000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147215.040884:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942506320a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00000100:00100000:1.0:1746147215.040887:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2956:x1830967310445440:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6232us (6328us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147215.040888:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942506320a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00000100:00100000:1.0:1746147215.040892:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20124 00010000:00010000:3.0:1746147215.040893:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b52d6100) 00010000:00010000:3.0:1746147215.040895:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147215.040897:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942506320a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.040901:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7000/0x313993942506320a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147215.040903:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147215.040929:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7c00/0x31399394250631fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2fb expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.040938:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063211 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2fb expref: 7 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.040943:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.040945:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147215.040947:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d6c00, rc 0) 00000100:00100000:3.0:1746147215.040969:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2959:x1830967310445312:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 6326us (7383us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.040976:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16498 00000100:00100000:2.0:1746147215.041086:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310446080 00000100:00100000:2.0:1746147215.041112:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310446080 00010000:00010000:2.0:1746147215.041124:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942506318c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ca expref: 18 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.041144:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9151 00000100:00100000:2.0:1746147215.041148:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094710a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310446080:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.041154:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.041162:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942506318c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ca expref: 18 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.041175:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942506318c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ca expref: 18 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.041188:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093731e00/0x313993942506318c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ca expref: 18 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.041196:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.041197:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.041202:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x31399394250631f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2359296->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f302 expref: 17 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.041208:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x31399394250631f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2359296->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f302 expref: 17 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.041214:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.041215:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.041218:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425063218 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2359295] (req 2097152->2273279) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f309 expref: 31 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.041224:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425063218 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2359295] (req 2097152->2273279) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f309 expref: 31 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.041246:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425063218 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2359295] (req 2097152->2273279) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f309 expref: 31 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.041258:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311505664:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147215.041331:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x31399394250631f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2359296->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f302 expref: 17 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.041339:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ece00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311505792:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147215.041357:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.044184:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.044210:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.044337:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.044354:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.044416:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.044479:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310446208 00000100:00100000:2.0:1746147215.044486:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310446208 00000100:00100000:2.0:1746147215.044526:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310446464 00000100:00100000:2.0:1746147215.044529:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310446464 00000100:00100000:2.0:1746147215.044541:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310446720 00000100:00100000:2.0:1746147215.044542:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310446720 00000100:00100000:2.0:1746147215.044555:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20126 00000100:00100000:2.0:1746147215.044562:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2003:x1830967310446208:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147215.044589:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.044606:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093731600/0x313993942506321f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f310 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.044660:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311505920:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147215.044744:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.044783:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311505664:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147215.044792:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ece00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311505792:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147215.044808:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147215.044830:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094710a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967310446080:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3681us (3926us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.044839:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9151 00000100:00100000:2.0:1746147215.044865:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310446592 00000100:00100000:2.0:1746147215.044868:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310446592 00002000:00100000:2.0:1746147215.044891:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2269184->2273279) req@ffff880094711500 x1830967310446592/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.044901:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094711500 with x1830967310446592 ext(2269184->2273279) 00002000:00010000:2.0:1746147215.044905:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094711500 00000100:00100000:2.0:1746147215.044923:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310446976 00000100:00100000:2.0:1746147215.044925:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310446976 00002000:00100000:2.0:1746147215.044938:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (3014656->3018751) req@ffff880094711c00 x1830967310446976/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.044945:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094711c00 with x1830967310446976 ext(3014656->3018751) 00002000:00010000:2.0:1746147215.044948:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094711c00 00000100:00100000:2.0:1746147215.044965:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7411 00000100:00100000:2.0:1746147215.044971:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967310446592:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147215.045003:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7412 00000100:00100000:1.0:1746147215.045011:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2002:x1830967310446976:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147215.045078:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2002:x1830967310446976:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 69us (661us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147215.045105:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7412 00002000:00100000:1.0:1746147215.045111:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3014656->3018751) req@ffff880094711c00 x1830967310446976/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/4536 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.045118:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094711c00 with x1830967310446976 ext(3014656->3018751) 00002000:00010000:1.0:1746147215.045121:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094711c00 00000100:00100000:3.0:1746147215.045135:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20127 00000100:00100000:1.0:1746147215.045140:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20128 00000100:00100000:3.0:1746147215.045142:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2002:x1830967310446464:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:1.0:1746147215.045145:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2003:x1830967310446720:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147215.045152:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.045153:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.045162:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e000/0x3139939425063226 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f317 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.045162:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d49600/0x313993942506322d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f31e expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.045177:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2000:x1830967310446592:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 206us (840us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147215.045183:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7411 00000100:00100000:1.0:1746147215.045186:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311506048:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147215.045187:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311506176:192.168.204.25@tcp:106: 00002000:00100000:2.0:1746147215.045187:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2269184->2273279) req@ffff880094711500 x1830967310446592/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/4536 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.045194:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094711500 with x1830967310446592 ext(2269184->2273279) 00002000:00010000:2.0:1746147215.045196:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094711500 00000100:00100000:1.0:1746147215.045221:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1ccf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147215.045357:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.046823:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311505920:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147215.046850:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093731600/0x313993942506321f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f310 expref: 11 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.046863:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093731600/0x313993942506321f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f310 expref: 11 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.046885:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093731600, rc 0) 00000100:00100000:0.0:1746147215.046918:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2003:x1830967310446208:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2356us (2745us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147215.046925:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20126 00002000:00010000:3.0:1746147215.046960:0:17600:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746147213 -> 1746147214 00000100:00100000:3.0:1746147215.046972:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311506176:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147215.046990:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e000/0x3139939425063226 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f317 expref: 17 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.046999:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e000/0x3139939425063226 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f317 expref: 17 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.047017:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8e000, rc 0) 00000100:00100000:1.0:1746147215.047017:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311506048:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147215.047035:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d49600/0x313993942506322d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f31e expref: 16 pid: 12225 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147215.047036:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2002:x1830967310446464:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1894us (2824us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147215.047041:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20127 00010000:00010000:1.0:1746147215.047366:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d49600/0x313993942506322d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f31e expref: 15 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.047390:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49600, rc 0) 00000100:00100000:1.0:1746147215.047640:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2003:x1830967310446720:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2493us (3283us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147215.047647:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20128 00000100:00100000:0.0:1746147215.048905:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.048962:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310447232 00000100:00100000:3.0:1746147215.048971:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310447232 00000100:00100000:3.0:1746147215.049029:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6176 00000100:00100000:3.0:1746147215.049036:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f8b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2954:x1830967310447232:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147215.049257:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f8b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2954:x1830967310447232:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 220us (356us total) trans 8589937408 rc 0/0 00000100:00100000:3.0:1746147215.049263:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6176 00000100:00100000:0.0:1746147215.050423:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.050552:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.050714:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310447616 00000100:00100000:3.0:1746147215.050718:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310447616 00000100:00100000:3.0:1746147215.050751:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16499 00000100:00100000:3.0:1746147215.050758:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2959:x1830967310447616:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147215.050771:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.050790:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8e200/0x3139939425063234 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f32c expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.050884:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ee00/0x313993942506323b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.050898:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063211 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2fb expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.050906:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ee00/0x313993942506323b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.050937:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063211 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2fb expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.050948:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063211 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2fb expref: 8 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.050960:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311506304:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147215.051015:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147215.051261:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310447360 00000100:00100000:1.0:1746147215.051267:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310447360 00000100:00100000:1.0:1746147215.051307:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20129 00000100:00100000:1.0:1746147215.051313:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2956:x1830967310447360:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147215.051321:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.051332:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d48800/0x3139939425063242 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f325 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.051351:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x313993942506302e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ff expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.051359:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096b81400/0x313993942506311c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f26f expref: 24 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.051366:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x31399394250630d6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f237 expref: 8 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.051371:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.051373:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.051375:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d48800/0x3139939425063242 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->2473983] (req 2097152->2473983) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f325 expref: 8 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.051392:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x31399394250630d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f237 expref: 8 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.051399:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x31399394250630d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f237 expref: 8 pid: 9585 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.051417:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311506432:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147215.051629:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096b81400/0x313993942506311c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f26f expref: 24 pid: 13695 timeout: 0 lvb_type: 1 00000100:00080000:3.0:1746147215.051720:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746147215.051770:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096b81400/0x313993942506311c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f26f expref: 24 pid: 13695 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.051780:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311506560:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147215.051823:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x313993942506302e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ff expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.051832:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x313993942506302e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ff expref: 9 pid: 9585 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.051840:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311506688:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147215.051860:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1ccf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.055590:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.055635:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310447744 00000100:00100000:0.0:1746147215.055643:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.055644:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310447744 00000100:00100000:0.0:1746147215.055661:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310447872 00000100:00100000:0.0:1746147215.055664:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310447872 00010000:00010000:2.0:1746147215.055682:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063211 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2fb expref: 9 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.055682:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x31399394250630d6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f237 expref: 9 pid: 9585 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746147215.055720:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9152 00000100:00100000:0.0:1746147215.055727:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310447872:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147215.055739:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147215.055761:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x31399394250630d6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f237 expref: 9 pid: 9585 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746147215.055773:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x31399394250630d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f237 expref: 9 pid: 9585 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746147215.055805:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147215.055850:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310447872:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 123us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.055857:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9152 00000100:00100000:0.0:1746147215.055872:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9153 00000100:00100000:0.0:1746147215.055877:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094712300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310447744:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147215.055885:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147215.055890:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063211 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2fb expref: 9 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.055898:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063211 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2fb expref: 9 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.055913:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147215.055918:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ee00/0x313993942506323b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147215.055928:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ee00/0x313993942506323b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147215.055935:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ee00/0x313993942506323b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147215.055952:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147215.055967:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094712300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310447744:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 90us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.055972:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9153 00010000:00010000:3.0:1746147215.056015:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063211 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2fb expref: 8 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.056032:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311506304:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.056050:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ee00/0x313993942506323b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.056058:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ee00/0x313993942506323b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.056063:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ee00/0x313993942506323b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147215.056081:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147215.056247:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8e200/0x3139939425063234 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f32c expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.056259:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ee00/0x313993942506323b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f32c expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.056265:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.056268:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147215.056270:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8ee00, rc 0) 00000100:00100000:3.0:1746147215.056295:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2959:x1830967310447616:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5539us (5744us total) trans 8589937409 rc 0/0 00000100:00100000:3.0:1746147215.056301:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16499 00010000:00010000:1.0:1746147215.057284:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x31399394250630d6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f237 expref: 8 pid: 9585 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.057302:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311506432:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.059567:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311506560:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.059590:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:12225:1830967311506688:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.059625:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d48800/0x3139939425063242 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->2473983] (req 2097152->2473983) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f325 expref: 7 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.059642:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d48800, rc 0) 00000100:00100000:2.0:1746147215.059680:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2956:x1830967310447360:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8367us (9259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.059688:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20129 00000100:00100000:1.0:1746147215.059743:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.059916:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310448000 00000100:00100000:3.0:1746147215.059922:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310448000 00010000:00010000:3.0:1746147215.059946:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x313993942506302e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ff expref: 10 pid: 9585 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746147215.059966:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9154 00000100:00100000:3.0:1746147215.059972:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310448000:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.059982:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147215.060000:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x313993942506302e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ff expref: 10 pid: 9585 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.060010:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x313993942506302e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ff expref: 10 pid: 9585 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.060031:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b1a00/0x313993942506302e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ff expref: 10 pid: 9585 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.060046:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147215.060063:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310448000:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 91us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.060068:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9154 00000100:00100000:0.0:1746147215.060972:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.061332:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310448128 00000100:00100000:3.0:1746147215.061337:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310448128 00000100:00100000:3.0:1746147215.061376:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16500 00000100:00100000:3.0:1746147215.061382:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2959:x1830967310448128:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147215.061404:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.061418:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f000/0x3139939425063250 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f333 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.061502:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f200/0x3139939425063257 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.061515:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ee00/0x313993942506323b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f32c expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.061521:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f200/0x3139939425063257 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.061549:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ee00/0x313993942506323b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f32c expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.061560:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ee00/0x313993942506323b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f32c expref: 9 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.061582:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311506816:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147215.061660:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.063224:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.063258:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.063328:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310448256 00000100:00100000:3.0:1746147215.063333:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310448256 00010000:00010000:3.0:1746147215.063361:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096b81400/0x313993942506311c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f26f expref: 25 pid: 13695 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746147215.063383:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310448384 00000100:00100000:3.0:1746147215.063385:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310448384 00000100:00100000:2.0:1746147215.063387:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9155 00010000:00010000:3.0:1746147215.063394:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ee00/0x313993942506323b lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f32c expref: 10 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.063395:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b404c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310448256:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.063406:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147215.063421:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9156 00010000:00010000:2.0:1746147215.063425:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096b81400/0x313993942506311c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f26f expref: 25 pid: 13695 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746147215.063426:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094712d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310448384:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.063433:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.063435:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096b81400/0x313993942506311c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f26f expref: 25 pid: 13695 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.063437:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ee00/0x313993942506323b lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f32c expref: 10 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.063445:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ee00/0x313993942506323b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f32c expref: 10 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.063453:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096b81400/0x313993942506311c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f26f expref: 25 pid: 13695 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.063457:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.063460:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f200/0x3139939425063257 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.063469:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f200/0x3139939425063257 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.063469:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.063471:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.063475:0:7226:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f200/0x3139939425063257 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.063476:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d48800/0x3139939425063242 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2473983) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f325 expref: 6 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.063484:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d48800/0x3139939425063242 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2473983) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f325 expref: 6 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.063492:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147215.063505:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d48800/0x3139939425063242 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2473983) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f325 expref: 6 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.063514:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311506944:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147215.063517:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094712d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310448384:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 91us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.063523:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9156 00000100:00100000:2.0:1746147215.063551:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a000 going to sleep for 11 seconds 00010000:00010000:3.0:1746147215.063555:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ee00/0x313993942506323b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f32c expref: 9 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.063565:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311506816:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.063586:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f200/0x3139939425063257 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.063594:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f200/0x3139939425063257 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.063599:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f200/0x3139939425063257 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147215.063744:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147215.063749:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147215.063771:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f200/0x3139939425063257 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.063796:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f000/0x3139939425063250 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f333 expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.063807:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f200/0x3139939425063257 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f333 expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.063813:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.063816:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147215.063819:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8f200, rc 0) 00000100:00100000:3.0:1746147215.063850:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2959:x1830967310448128:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2468us (2879us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.063856:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16500 00000100:00100000:0.0:1746147215.068518:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.068712:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.068862:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311506944:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147215.068884:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147215.068927:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b404c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310448256:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5532us (5706us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.068938:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9155 00000100:00100000:3.0:1746147215.069020:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310448896 00000100:00100000:3.0:1746147215.069026:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310448896 00000100:00100000:3.0:1746147215.069064:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20130 00000100:00100000:3.0:1746147215.069072:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310448896:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147215.069114:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147215.069117:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310448640 00000100:00100000:2.0:1746147215.069121:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310448640 00010000:00010000:3.0:1746147215.069134:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fe00/0x313993942506325e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f341 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746147215.069154:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2469888->2473983) req@ffff880094713100 x1830967310448640/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.069163:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094713100 with x1830967310448640 ext(2469888->2473983) 00002000:00010000:2.0:1746147215.069167:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094713100 00000100:00100000:3.0:1746147215.069184:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311507072:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147215.069186:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7413 00000100:00100000:2.0:1746147215.069191:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2001:x1830967310448640:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147215.069242:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.069303:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2001:x1830967310448640:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 112us (799us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147215.069308:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7413 00002000:00100000:2.0:1746147215.069312:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (2469888->2473983) req@ffff880094713100 x1830967310448640/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/4536 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.069319:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094713100 with x1830967310448640 ext(2469888->2473983) 00002000:00010000:2.0:1746147215.069321:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094713100 00000100:00100000:0.0:1746147215.071774:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.071866:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.071909:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.072149:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310449152 00000100:00100000:1.0:1746147215.072157:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310449152 00000100:00100000:1.0:1746147215.072192:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310448768 00000100:00100000:1.0:1746147215.072194:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310448768 00000100:00100000:1.0:1746147215.072203:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310449024 00000100:00100000:1.0:1746147215.072204:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310449024 00000100:00100000:1.0:1746147215.072220:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20131 00000100:00100000:1.0:1746147215.072226:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310449152:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147215.072242:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.072260:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x3139939425063265 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f34f expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.072287:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20132 00000100:00100000:2.0:1746147215.072295:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310448768:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147215.072302:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147215.072305:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311507200:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147215.072310:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f12da00/0x313993942506326c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f33a expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.072337:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311507328:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147215.072372:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.072373:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.073448:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20133 00000100:00100000:0.0:1746147215.073459:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310449024:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147215.073468:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147215.073480:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0800/0x3139939425063273 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f348 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.073517:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094710380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311507456:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147215.073568:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147215.074875:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311507072:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147215.074907:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fe00/0x313993942506325e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f341 expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.074920:0:12225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8fe00/0x313993942506325e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f341 expref: 17 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.074951:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8fe00, rc 0) 00000100:00100000:3.0:1746147215.074999:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310448896:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5926us (6285us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147215.075007:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20130 00000100:00100000:0.0:1746147215.077021:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.077173:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311507328:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147215.077205:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f12da00/0x313993942506326c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f33a expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.077218:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f12da00/0x313993942506326c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f33a expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147215.077218:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094710380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311507456:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147215.077232:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12da00, rc 0) 00010000:00010000:0.0:1746147215.077236:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0800/0x3139939425063273 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f348 expref: 15 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.077244:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbe0800/0x3139939425063273 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f348 expref: 15 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.077258:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbe0800, rc 0) 00000100:00100000:2.0:1746147215.077272:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310448768:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4978us (5405us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147215.077278:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310449024:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3822us (5368us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147215.077280:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20132 00000100:00100000:0.0:1746147215.077286:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20133 00002000:00010000:1.0:1746147215.077424:0:1136:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime: 1746147212 -> 1746147214 00002000:00010000:1.0:1746147215.077431:0:1136:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime: 1746147212 -> 1746147214 00002000:00010000:1.0:1746147215.077433:0:1136:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime: 1746147212 -> 1746147214 00000100:00100000:1.0:1746147215.077441:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311507200:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147215.077462:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x3139939425063265 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f34f expref: 10 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.077470:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e04a00/0x3139939425063265 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f34f expref: 10 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.077486:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e04a00, rc 0) 00000100:00100000:1.0:1746147215.077502:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310449152:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5277us (5739us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147215.077508:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20131 00000100:00100000:3.0:1746147215.077804:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310449408 00000100:00100000:3.0:1746147215.077812:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310449408 00000100:00100000:3.0:1746147215.077847:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6177 00000100:00100000:3.0:1746147215.077852:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2956:x1830967310449408:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147215.078009:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2956:x1830967310449408:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 156us (997us total) trans 8589937410 rc 0/0 00000100:00100000:3.0:1746147215.078014:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6177 00000100:00100000:0.0:1746147215.082085:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.082313:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310449664 00000100:00100000:3.0:1746147215.082323:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310449664 00000100:00100000:3.0:1746147215.082391:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16501 00000100:00100000:3.0:1746147215.082399:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2959:x1830967310449664:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147215.082418:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.082438:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8e400/0x313993942506327a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f356 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.082539:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f400/0x3139939425063281 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.082553:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f400/0x3139939425063281 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.082562:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f400/0x3139939425063281 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147215.082581:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147215.082668:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8e400/0x313993942506327a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f356 expref: 11 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.082681:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f400/0x3139939425063281 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f356 expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.082688:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.082691:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147215.082694:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8f400, rc 0) 00000100:00100000:3.0:1746147215.082749:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2959:x1830967310449664:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 350us (675us total) trans 8589937411 rc 0/0 00000100:00100000:3.0:1746147215.082754:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16501 00000100:00100000:0.0:1746147215.088057:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.089398:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.089437:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310449792 00000100:00100000:1.0:1746147215.089448:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310449792 00000100:00100000:1.0:1746147215.089501:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20134 00000100:00100000:1.0:1746147215.089509:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310449792:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1746147215.089552:0:1136:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096e05600/0x313993942506328f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.089579:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800993b0800/0x313993942506300b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1dc expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.089588:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e6a00/0x31399394250630f9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f245 expref: 31 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.089595:0:1136:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958e6800/0x31399394250630b3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f214 expref: 16 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.089600:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.089602:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.089605:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e05600/0x313993942506328f lrc: 6/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.089633:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e6800/0x31399394250630b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f214 expref: 16 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.089644:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958e6800/0x31399394250630b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f214 expref: 16 pid: 12201 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.089656:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311507584:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147215.089744:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958e6a00/0x31399394250630f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f245 expref: 31 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.089752:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958e6a00/0x31399394250630f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f245 expref: 31 pid: 12201 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.089759:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311507712:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147215.089780:0:1136:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800993b0800/0x313993942506300b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1dc expref: 14 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.089787:0:1136:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800993b0800/0x313993942506300b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1dc expref: 14 pid: 9584 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.089793:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5574700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311507840:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147215.089806:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.089961:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.089975:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.089988:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.090013:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.090054:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310450048 00000100:00100000:2.0:1746147215.090058:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310450048 00000100:00100000:2.0:1746147215.090085:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310450304 00000100:00100000:2.0:1746147215.090100:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310450304 00000100:00100000:2.0:1746147215.090111:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310449920 00000100:00100000:2.0:1746147215.090113:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310449920 00000100:00100000:2.0:1746147215.090122:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310450176 00000100:00100000:2.0:1746147215.090123:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310450176 00000100:00100000:2.0:1746147215.090132:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310450432 00000100:00100000:2.0:1746147215.090133:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310450432 00000100:00100000:2.0:1746147215.090145:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20135 00000100:00100000:2.0:1746147215.090150:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310450048:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147215.090168:0:17600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f12d600/0x3139939425063296 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.090178:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993b0000/0x3139939425063012 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ea expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.090185:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x3139939425063107 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f25a expref: 23 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.090191:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x31399394250630c1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f222 expref: 6 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.090195:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.090196:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.090198:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f12d600/0x3139939425063296 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.090212:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x31399394250630c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f222 expref: 6 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.090219:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x31399394250630c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f222 expref: 6 pid: 13712 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746147215.090227:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311507968:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.090261:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x3139939425063107 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f25a expref: 23 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.090268:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x3139939425063107 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f25a expref: 23 pid: 9584 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746147215.090274:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311508096:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.090292:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800993b0000/0x3139939425063012 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ea expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.090298:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800993b0000/0x3139939425063012 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ea expref: 11 pid: 9584 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746147215.090305:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311508224:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.090315:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.090334:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20136 00000100:00100000:2.0:1746147215.090338:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310450304:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147215.090353:0:1398:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x313993942506329d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.090362:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425063218 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2359295] (req 2097152->2273279) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f309 expref: 31 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.090368:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x31399394250631f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2359296->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f302 expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.090377:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147215.090378:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746147215.090380:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x313993942506329d lrc: 5/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.090392:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x31399394250631f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2359296->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f302 expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.090398:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x31399394250631f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2359296->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f302 expref: 16 pid: 12225 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.090404:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311508352:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.090422:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425063218 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2359295] (req 2097152->2273279) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f309 expref: 31 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.090429:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425063218 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2359295] (req 2097152->2273279) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f309 expref: 31 pid: 1136 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.090435:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311508480:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.090446:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.090462:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20137 00000100:00100000:2.0:1746147215.090466:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310449920:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147215.090477:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093731000/0x31399394250632a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.090489:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425063162 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1544191) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a0 expref: 23 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.090494:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147215.090495:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147215.090497:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093731000/0x31399394250632a4 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.090507:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425063162 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1544191) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a0 expref: 23 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.090513:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425063162 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1544191) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a0 expref: 23 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.090520:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311508608:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.090536:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.090550:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20138 00000100:00100000:2.0:1746147215.090554:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310450176:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147215.090568:0:12201:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091e31600/0x31399394250632ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.090588:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x31399394250631ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2f4 expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.090593:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147215.090594:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147215.090597:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091e31600/0x31399394250632ab lrc: 4/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.090609:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x31399394250631ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2f4 expref: 31 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.090616:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x31399394250631ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2f4 expref: 31 pid: 12225 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.090623:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311508736:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.090639:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.090689:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20139 00000100:00100000:0.0:1746147215.090694:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310450432:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:0.0:1746147215.090709:0:10340:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250632b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.090719:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d48800/0x3139939425063242 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2473983) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f325 expref: 6 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.090724:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147215.090725:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147215.090727:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250632b2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.090740:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d48800/0x3139939425063242 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2473983) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f325 expref: 6 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.090747:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d48800/0x3139939425063242 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2473983) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f325 expref: 6 pid: 12225 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746147215.090759:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132126a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311508864:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147215.090786:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147215.096978:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.097034:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.097058:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310450560 00000100:00100000:1.0:1746147215.097066:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310450560 00010000:00010000:1.0:1746147215.097121:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e6800/0x31399394250630b3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f214 expref: 17 pid: 12201 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.097147:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310450688 00000100:00100000:1.0:1746147215.097149:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310450688 00010000:00010000:1.0:1746147215.097158:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958e6a00/0x31399394250630f9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f245 expref: 32 pid: 12201 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.097172:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9157 00000100:00100000:1.0:1746147215.097179:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967310450560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147215.097194:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147215.097219:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958e6800/0x31399394250630b3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f214 expref: 17 pid: 12201 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.097234:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958e6800/0x31399394250630b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f214 expref: 17 pid: 12201 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.097264:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147215.097302:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967310450560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 123us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.097308:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9157 00000100:00100000:1.0:1746147215.097321:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9158 00000100:00100000:1.0:1746147215.097325:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967310450688:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147215.097332:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147215.097337:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958e6a00/0x31399394250630f9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f245 expref: 32 pid: 12201 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.097345:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958e6a00/0x31399394250630f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f245 expref: 32 pid: 12201 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.097353:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147215.097363:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2002:x1830967310450688:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 38us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.097367:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9158 00000100:00100000:1.0:1746147215.097388:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.097399:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310450816 00000100:00100000:1.0:1746147215.097402:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310450816 00010000:00010000:1.0:1746147215.097410:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b0800/0x313993942506300b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1dc expref: 17 pid: 9584 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.097422:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9159 00000100:00100000:1.0:1746147215.097426:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2002:x1830967310450816:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147215.097431:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147215.097435:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800993b0800/0x313993942506300b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1dc expref: 17 pid: 9584 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.097443:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800993b0800/0x313993942506300b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1dc expref: 17 pid: 9584 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.097453:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.097454:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.097459:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e05600/0x313993942506328f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.097467:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e05600/0x313993942506328f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.097485:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147215.097496:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098823800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2002:x1830967310450816:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 70us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.097500:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9159 00000100:00100000:2.0:1746147215.097693:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311508352:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.097719:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311507968:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147215.097874:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e6800/0x31399394250630b3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f214 expref: 16 pid: 12201 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746147215.097888:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311507584:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147215.097896:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e6a00/0x31399394250630f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f245 expref: 31 pid: 12201 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746147215.097903:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311507712:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147215.097910:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b0800/0x313993942506300b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1dc expref: 16 pid: 9584 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746147215.097916:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5574700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311507840:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147215.097937:0:1136:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096e05600/0x313993942506328f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.097945:0:1136:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096e05600/0x313993942506328f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.097950:0:1136:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e05600/0x313993942506328f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.097964:0:1136:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096e05600/0x313993942506328f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.097975:0:1136:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096e05600/0x313993942506328f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.097982:0:1136:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096e05600/0x313993942506328f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.097987:0:1136:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096e05600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147215.097991:0:1136:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096e05600/0x313993942506328f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.097997:0:1136:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096e05600/0x313993942506328f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.098005:0:1136:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096e05600/0x313993942506328f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.098009:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e05600/0x313993942506328f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.098045:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310449792:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 8537us (9998us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.098052:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20134 00000100:00100000:0.0:1746147215.098198:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132126a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311508864:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147215.098209:0:10340:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250632b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.098236:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.098251:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.098259:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310451200 00000100:00100000:0.0:1746147215.098262:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310451200 00010000:00010000:0.0:1746147215.098274:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800993b0000/0x3139939425063012 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ea expref: 12 pid: 9584 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746147215.098288:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9160 00000100:00100000:0.0:1746147215.098292:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310451200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147215.098299:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147215.098310:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800993b0000/0x3139939425063012 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ea expref: 12 pid: 9584 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746147215.098319:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800993b0000/0x3139939425063012 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ea expref: 12 pid: 9584 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746147215.098331:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147215.098342:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310451200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 50us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.098346:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9160 00000100:00100000:0.0:1746147215.098361:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310451072 00000100:00100000:0.0:1746147215.098363:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310451072 00002000:00100000:0.0:1746147215.098386:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3014656->3145727) req@ffff880132126a00 x1830967310451072/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147215.098395:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132126a00 with x1830967310451072 ext(3014656->3145727) 00010000:00010000:0.0:1746147215.098401:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x31399394250631f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2359296->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f302 expref: 16 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.098409:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x31399394250631f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2359296->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f302 expref: 16 pid: 12225 timeout: 853 lvb_type: 0 00002000:00010000:0.0:1746147215.098414:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880132126a00 00000100:00100000:0.0:1746147215.098431:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1746 00000100:00100000:0.0:1746147215.098435:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2003:x1830967310451072:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:3.0:1746147215.098997:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311508608:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.099013:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093731000/0x31399394250632a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.099031:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311508736:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.099039:0:12201:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091e31600/0x31399394250632ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.099106:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311508096:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.099116:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993b0000/0x3139939425063012 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f1ea expref: 11 pid: 9584 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746147215.099134:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311508224:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.099150:0:17600:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f12d600/0x3139939425063296 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147215.101138:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.102852:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.103212:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310451328 00000100:00100000:0.0:1746147215.103221:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310451328 00002000:00100000:0.0:1746147215.103281:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1150976->1544191) req@ffff880098820e00 x1830967310451328/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147215.103292:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820e00 with x1830967310451328 ext(1150976->1544191) 00010000:00010000:0.0:1746147215.103302:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425063162 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1544191) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a0 expref: 24 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.103315:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425063162 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1544191) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a0 expref: 24 pid: 1853 timeout: 853 lvb_type: 0 00002000:00010000:0.0:1746147215.103322:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098820e00 00000100:00100000:0.0:1746147215.103343:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310451456 00000100:00100000:0.0:1746147215.103346:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310451456 00002000:00100000:0.0:1746147215.103358:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (2011136->2097151) req@ffff880099153800 x1830967310451456/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147215.103365:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099153800 with x1830967310451456 ext(2011136->2097151) 00010000:00010000:0.0:1746147215.103372:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x31399394250631ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2f4 expref: 31 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.103379:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x31399394250631ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2f4 expref: 31 pid: 12225 timeout: 853 lvb_type: 0 00002000:00010000:0.0:1746147215.103385:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099153800 00000100:00100000:1.0:1746147215.103418:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1747 00000100:00100000:1.0:1746147215.103427:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967310451328:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:1.0:1746147215.103582:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.104501:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310451584 00000100:00100000:0.0:1746147215.104505:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310451584 00002000:00100000:0.0:1746147215.104528:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->2473983) req@ffff880099152680 x1830967310451584/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147215.104536:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152680 with x1830967310451584 ext(2097152->2473983) 00010000:00010000:0.0:1746147215.104543:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d48800/0x3139939425063242 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2473983) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f325 expref: 7 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.104552:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d48800/0x3139939425063242 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2473983) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f325 expref: 7 pid: 12225 timeout: 853 lvb_type: 0 00002000:00010000:0.0:1746147215.104557:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099152680 00000100:00100000:0.0:1746147215.104569:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1748 00000100:00100000:0.0:1746147215.104584:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2002:x1830967310451456:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147215.104676:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.104706:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.104718:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310451712 00000100:00100000:0.0:1746147215.104720:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310451712 00002000:00100000:0.0:1746147215.104732:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2273279) req@ffff8800a5574700 x1830967310451712/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147215.104744:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5574700 with x1830967310451712 ext(2097152->2273279) 00010000:00010000:0.0:1746147215.104750:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425063218 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2359295] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f309 expref: 33 pid: 1136 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.104758:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425063218 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2359295] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f309 expref: 33 pid: 1136 timeout: 853 lvb_type: 0 00002000:00010000:0.0:1746147215.104764:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5574700 00000100:00100000:0.0:1746147215.104776:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1749 00000100:00100000:0.0:1746147215.104781:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2000:x1830967310451584:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147215.104862:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1750 00000100:00100000:0.0:1746147215.104867:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2002:x1830967310451712:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147215.104947:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.105445:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310450944 00000100:00100000:3.0:1746147215.105450:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310450944 00010000:00010000:3.0:1746147215.105468:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x31399394250630c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f222 expref: 9 pid: 13712 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746147215.105495:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310451840 00000100:00100000:3.0:1746147215.105497:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310451840 00010000:00010000:3.0:1746147215.105509:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x3139939425063107 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f25a expref: 26 pid: 9584 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746147215.105534:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9161 00000100:00100000:3.0:1746147215.105540:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310450944:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.105550:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147215.105566:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x31399394250630c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f222 expref: 9 pid: 13712 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.105585:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x31399394250630c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f222 expref: 9 pid: 13712 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.105607:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f381e00/0x31399394250630c1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f222 expref: 9 pid: 13712 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.105626:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147215.105656:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310450944:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 116us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.105662:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9161 00000100:00100000:3.0:1746147215.105677:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9162 00000100:00100000:3.0:1746147215.105681:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310451840:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.105688:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147215.105696:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x3139939425063107 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f25a expref: 26 pid: 9584 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.105704:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x3139939425063107 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f25a expref: 26 pid: 9584 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.105716:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a21400/0x3139939425063107 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f25a expref: 26 pid: 9584 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.105723:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.105725:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.105730:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f12d600/0x3139939425063296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.105738:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f12d600/0x3139939425063296 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.105758:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147215.105773:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310451840:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 91us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.105779:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9162 00010000:00010000:3.0:1746147215.105833:0:17600:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f12d600/0x3139939425063296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.105841:0:17600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f12d600/0x3139939425063296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.105858:0:17600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f12d600/0x3139939425063296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.105865:0:17600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f12d600/0x3139939425063296 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.105872:0:17600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f12d600/0x3139939425063296 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.105878:0:17600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f12d600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147215.105882:0:17600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f12d600/0x3139939425063296 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.105888:0:17600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f12d600/0x3139939425063296 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.105897:0:17600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f12d600/0x3139939425063296 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.105902:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f12d600/0x3139939425063296 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.105941:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310450048:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 15790us (16545us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.105948:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20135 00000100:00100000:3.0:1746147215.106002:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311508480:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.106024:0:1398:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x313993942506329d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147215.120419:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.120619:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310452096 00000100:00100000:2.0:1746147215.120629:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310452096 00000100:00100000:3.0:1746147215.123443:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16502 00000100:00100000:3.0:1746147215.123463:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2964:x1830967310452096:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147215.123495:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.123517:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8e400/0x31399394250632b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f35d expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.123608:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ec00/0x31399394250632c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123621:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ec00/0x31399394250632c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123631:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ec00/0x31399394250632c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123643:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8fe00/0x31399394250632c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123649:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8fe00/0x31399394250632c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123654:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8fe00/0x31399394250632c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123751:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f000/0x31399394250632ce lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123760:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f000/0x31399394250632ce lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123765:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f000/0x31399394250632ce lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147215.123775:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147215.123858:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f000/0x31399394250632ce lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123865:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f000/0x31399394250632ce lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123869:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f000/0x31399394250632ce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123875:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fc8f000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147215.123878:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f000/0x31399394250632ce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123884:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f000/0x31399394250632ce lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123894:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.123897:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147215.123900:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f000/0x31399394250632ce lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123905:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f000/0x31399394250632ce lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123922:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ec00/0x31399394250632c0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123926:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ec00/0x31399394250632c0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123930:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ec00/0x31399394250632c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123938:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ec00/0x31399394250632c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123942:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fc8ec00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147215.123944:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ec00/0x31399394250632c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123948:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ec00/0x31399394250632c0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123954:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147215.123956:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147215.123958:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ec00/0x31399394250632c0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123962:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8ec00/0x31399394250632c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123969:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8fe00/0x31399394250632c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123973:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8fe00/0x31399394250632c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123978:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8fe00/0x31399394250632c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123982:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fc8fe00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147215.123984:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8fe00/0x31399394250632c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123989:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8fe00/0x31399394250632c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.123997:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b52d6100) 00010000:00010000:3.0:1746147215.123999:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147215.124002:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8fe00/0x31399394250632c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.124005:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8fe00/0x31399394250632c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.124040:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8e400/0x31399394250632b9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f35d expref: 34 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.124047:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8e400/0x31399394250632b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f35d expref: 34 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.124053:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8e400, rc 0) 00000100:00100000:3.0:1746147215.124131:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2964:x1830967310452096:12345-192.168.204.25@tcp:101:cat.0 Request processed in 677us (3723us total) trans 8589937412 rc 301/301 00000100:00100000:3.0:1746147215.124138:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16502 00000100:00100000:3.0:1746147215.130351:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967310451456:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 25754us (27492us total) trans 21474842681 rc 0/0 00000100:00100000:3.0:1746147215.130364:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1748 00002000:00100000:3.0:1746147215.130376:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (2011136->2097151) req@ffff880099153800 x1830967310451456/t21474842681(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/448 e 0 to 0 dl 1746147226 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.130385:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099153800 with x1830967310451456 ext(2011136->2097151) 00010000:00010000:3.0:1746147215.130395:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x31399394250631ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2f4 expref: 35 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.130412:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x31399394250631ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2f4 expref: 35 pid: 12225 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746147215.130419:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099153800 00000100:00100000:3.0:1746147215.130485:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.130511:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310452224 00000100:00100000:3.0:1746147215.130518:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310452224 00000100:00100000:3.0:1746147215.130548:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20140 00000100:00100000:3.0:1746147215.130555:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967310452224:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147215.130580:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.130599:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e400/0x31399394250632dc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f364 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147215.130627:0:17600:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x93:0x0] initial LVB size: 1048576, mtime: 0x6814178a, atime: 0x6814178a, ctime: 0x6814178b, blocks: 0x7e8 00010000:00010000:3.0:1746147215.130645:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.130648:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.130656:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e400/0x31399394250632dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f364 expref: 36 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.130671:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e400/0x31399394250632dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f364 expref: 36 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.130682:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fc8e400, rc 0) 00000100:00100000:3.0:1746147215.130698:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310452224:12345-192.168.204.25@tcp:101:cat.0 Request processed in 144us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.130703:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20140 00000100:00100000:3.0:1746147215.131358:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.131368:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310452352 00000100:00100000:3.0:1746147215.131371:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310452352 00000100:00100000:3.0:1746147215.131396:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20141 00000100:00100000:3.0:1746147215.131401:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310452352:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147215.131410:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.131420:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x31399394250632e3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f36b expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.131457:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311508992:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147215.131515:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1c4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147215.131542:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.131551:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310452480 00000100:00100000:3.0:1746147215.131554:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310452480 00000100:00100000:3.0:1746147215.131567:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20142 00000100:00100000:3.0:1746147215.131582:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310452480:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147215.131588:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.131596:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093730c00/0x31399394250632ea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f372 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147215.131609:0:1136:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x97:0x0] initial LVB size: 2097152, mtime: 0x6814178c, atime: 0x6814178d, ctime: 0x6814178c, blocks: 0x800 00010000:00010000:3.0:1746147215.131617:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.131618:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.131622:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093730c00/0x31399394250632ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f372 expref: 30 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.131631:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093730c00/0x31399394250632ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f372 expref: 30 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.131639:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093730c00, rc 0) 00000100:00100000:3.0:1746147215.131771:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310452480:12345-192.168.204.25@tcp:101:cat.0 Request processed in 197us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.131775:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20142 00000100:00100000:3.0:1746147215.131813:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.131823:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310452608 00000100:00100000:3.0:1746147215.131825:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310452608 00000100:00100000:3.0:1746147215.131841:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20143 00000100:00100000:3.0:1746147215.131845:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310452608:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:0.0:1746147215.131847:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147215.131851:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.131859:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093731a00/0x31399394250632f1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f379 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.131866:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.131887:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094712d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311509120:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147215.131932:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147215.131948:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310452736 00000100:00100000:3.0:1746147215.131951:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310452736 00000100:00100000:3.0:1746147215.131966:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310452864 00000100:00100000:3.0:1746147215.131968:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310452864 00000100:00100000:3.0:1746147215.131983:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20144 00000100:00100000:3.0:1746147215.131987:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967310452736:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147215.131994:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.132002:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d6c00/0x31399394250632f8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f380 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.132031:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098823800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311509248:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147215.132049:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147215.132063:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20145 00000100:00100000:3.0:1746147215.132068:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310452864:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147215.132074:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.132080:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d7200/0x31399394250632ff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f387 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.132125:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311509376:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147215.132160:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.132243:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310451072:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 33805us (34004us total) trans 21474842680 rc 0/0 00000100:00100000:2.0:1746147215.132255:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1746 00002000:00100000:2.0:1746147215.132262:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3014656->3145727) req@ffff880132126a00 x1830967310451072/t21474842680(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/448 e 0 to 0 dl 1746147226 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.132271:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132126a00 with x1830967310451072 ext(3014656->3145727) 00010000:00010000:2.0:1746147215.132278:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x31399394250631f5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2359296->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f302 expref: 18 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.132289:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x31399394250631f5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2359296->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f302 expref: 18 pid: 12225 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746147215.132295:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880132126a00 00000100:00100000:1.0:1746147215.132508:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967310451328:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 29082us (31376us total) trans 17179875291 rc 0/0 00000100:00100000:1.0:1746147215.132515:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1747 00002000:00100000:1.0:1746147215.132521:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x96:0x0] (1150976->1544191) req@ffff880098820e00 x1830967310451328/t17179875291(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/448 e 0 to 0 dl 1746147226 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.132526:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098820e00 with x1830967310451328 ext(1150976->1544191) 00010000:00010000:1.0:1746147215.132531:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425063162 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1150976->1544191) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a0 expref: 30 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.132538:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425063162 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1150976->1544191) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a0 expref: 30 pid: 1853 timeout: 853 lvb_type: 0 00002000:00010000:1.0:1746147215.132543:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098820e00 00000100:00100000:0.0:1746147215.132968:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2002:x1830967310451712:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 28099us (28259us total) trans 21474842682 rc 0/0 00000100:00100000:0.0:1746147215.132975:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1750 00002000:00100000:0.0:1746147215.132981:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2273279) req@ffff8800a5574700 x1830967310451712/t21474842682(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/448 e 0 to 0 dl 1746147226 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147215.132989:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5574700 with x1830967310451712 ext(2097152->2273279) 00010000:00010000:0.0:1746147215.132994:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425063218 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->2359295] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f309 expref: 40 pid: 1136 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.133006:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425063218 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->2359295] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f309 expref: 40 pid: 1136 timeout: 853 lvb_type: 0 00002000:00010000:0.0:1746147215.133011:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5574700 00000100:00100000:3.0:1746147215.133393:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310451584:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 28611us (29810us total) trans 17179875292 rc 0/0 00000100:00100000:3.0:1746147215.133399:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1749 00002000:00100000:3.0:1746147215.133405:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->2473983) req@ffff880099152680 x1830967310451584/t17179875292(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/448 e 0 to 0 dl 1746147226 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.133413:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099152680 with x1830967310451584 ext(2097152->2473983) 00010000:00010000:3.0:1746147215.133418:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d48800/0x3139939425063242 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2473983) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f325 expref: 8 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.133425:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d48800/0x3139939425063242 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2473983) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f325 expref: 8 pid: 12225 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746147215.133431:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099152680 00000100:00100000:3.0:1746147215.134154:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311508992:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147215.134154:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094712d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1136:1830967311509120:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147215.134181:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x31399394250632e3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f36b expref: 29 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.134181:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093731a00/0x31399394250632f1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f379 expref: 39 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.134191:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093730800/0x31399394250632e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f36b expref: 29 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.134191:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093731a00/0x31399394250632f1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f379 expref: 39 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.134204:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093730800, rc 0) 00010000:00010000:2.0:1746147215.134206:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093731a00, rc 0) 00000100:00100000:3.0:1746147215.134228:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310452352:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2826us (2871us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147215.134228:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310452608:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2382us (2414us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147215.134236:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20141 00000100:00100000:2.0:1746147215.134242:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20143 00000100:00100000:2.0:1746147215.134647:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.134655:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098823800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311509248:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147215.134664:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310452992 00000100:00100000:2.0:1746147215.134669:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310452992 00010000:00010000:0.0:1746147215.134671:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800932d6c00/0x31399394250632f8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f380 expref: 37 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.134680:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d6c00/0x31399394250632f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f380 expref: 38 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.134692:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x31399394250631ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2f4 expref: 37 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.134702:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d6c00, rc 0) 00000100:00100000:0.0:1746147215.134722:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310452736:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2735us (2876us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147215.134728:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20144 00000100:00100000:2.0:1746147215.134784:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9163 00000100:00100000:2.0:1746147215.134790:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967310452992:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.134801:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.134809:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x31399394250631ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2f4 expref: 36 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.134818:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x31399394250631ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2f4 expref: 36 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.134834:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d48600/0x31399394250631ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2f4 expref: 36 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.134853:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.134855:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.134860:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091e31600/0x31399394250632ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.134868:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091e31600/0x31399394250632ab lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.134887:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147215.134903:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967310452992:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 114us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.134909:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9163 00010000:00010000:3.0:1746147215.135640:0:12201:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091e31600/0x31399394250632ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.135649:0:12201:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091e31600/0x31399394250632ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.135665:0:12201:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091e31600/0x31399394250632ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.135671:0:12201:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091e31600/0x31399394250632ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.135678:0:12201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091e31600/0x31399394250632ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.135684:0:12201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091e31600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147215.135688:0:12201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091e31600/0x31399394250632ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.135695:0:12201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091e31600/0x31399394250632ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.135704:0:12201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091e31600/0x31399394250632ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.135709:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091e31600/0x31399394250632ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.135760:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.135801:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310453120 00000100:00100000:1.0:1746147215.135806:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310453120 00010000:00010000:1.0:1746147215.135821:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425063218 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2359295] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f309 expref: 35 pid: 1136 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.137402:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310450176:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 46840us (47406us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.137413:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20138 00000100:00100000:3.0:1746147215.137485:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311509376:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147215.137510:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7200/0x31399394250632ff lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f387 expref: 27 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.137521:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7200/0x31399394250632ff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f387 expref: 27 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.137530:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7200, rc 0) 00000100:00100000:3.0:1746147215.137555:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310452864:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5487us (5688us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147215.137560:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20145 00000100:00100000:1.0:1746147215.137717:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9164 00000100:00100000:1.0:1746147215.137726:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967310453120:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147215.137738:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147215.137751:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425063218 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->2359295] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f309 expref: 35 pid: 1136 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.137761:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425063218 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->2359295] (req 2097152->2273279) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f309 expref: 35 pid: 1136 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.137777:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093731400/0x3139939425063218 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->2359295] (req 2097152->2273279) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f309 expref: 35 pid: 1136 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.137793:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147215.137810:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967310453120:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 86us (2524us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.137816:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9164 00000100:00100000:1.0:1746147215.138121:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.138139:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.138164:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.138208:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310453376 00000100:00100000:2.0:1746147215.138213:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310453376 00000100:00100000:0.0:1746147215.138219:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310453248 00000100:00100000:0.0:1746147215.138223:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310453248 00010000:00010000:2.0:1746147215.138232:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x31399394250631f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2359296->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f302 expref: 18 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.138239:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425063162 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1544191) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a0 expref: 26 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.138250:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310453504 00000100:00100000:2.0:1746147215.138252:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310453504 00000100:00100000:0.0:1746147215.138255:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9165 00000100:00100000:0.0:1746147215.138260:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310453376:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.138262:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d48800/0x3139939425063242 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2473983) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f325 expref: 8 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.138267:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147215.138275:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x31399394250631f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2359296->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f302 expref: 18 pid: 12225 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.138277:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9166 00000100:00100000:2.0:1746147215.138283:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967310453248:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147215.138283:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x31399394250631f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2359296->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f302 expref: 18 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.138290:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147215.138294:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d48e00/0x31399394250631f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2359296->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f302 expref: 18 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.138299:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425063162 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1150976->1544191) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a0 expref: 26 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.138304:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.138306:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.138307:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425063162 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1150976->1544191) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a0 expref: 26 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.138310:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x313993942506329d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.138318:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x313993942506329d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.138319:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093730600/0x3139939425063162 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1150976->1544191) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2a0 expref: 26 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.138329:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.138331:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.138334:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093731000/0x31399394250632a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.138337:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147215.138339:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093731000/0x31399394250632a4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.138354:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147215.138356:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2002:x1830967310453376:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 96us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.138362:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9165 00010000:00010000:2.0:1746147215.138366:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093731000/0x31399394250632a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.138372:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9167 00010000:00010000:2.0:1746147215.138373:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093731000/0x31399394250632a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.138377:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2001:x1830967310453504:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147215.138383:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.138386:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093731000/0x31399394250632a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.138391:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d48800/0x3139939425063242 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2473983) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f325 expref: 8 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.138394:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093731000/0x31399394250632a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.138399:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d48800/0x3139939425063242 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2473983) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f325 expref: 8 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.138400:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093731000/0x31399394250632a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.138405:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093731000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147215.138408:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093731000/0x31399394250632a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.138411:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d48800/0x3139939425063242 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2473983) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f325 expref: 8 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.138415:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093731000/0x31399394250632a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.138418:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.138420:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.138422:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250632b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.138423:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093731000/0x31399394250632a4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.138427:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250632b2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.138428:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093731000/0x31399394250632a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.138438:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147215.138451:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2001:x1830967310453504:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 74us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.138456:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9167 00000100:00100000:2.0:1746147215.138468:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310449920:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 48000us (48490us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.138474:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20137 00010000:00010000:0.0:1746147215.138475:0:10340:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250632b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.138482:0:10340:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250632b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.138493:0:10340:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250632b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.138498:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310453248:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 215us (357us total) trans 0 rc 0/0 00010000:00010000:0.0:1746147215.138499:0:10340:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250632b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.138503:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9166 00010000:00010000:0.0:1746147215.138510:0:10340:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250632b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.138515:0:10340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbe0400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147215.138517:0:10340:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250632b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.138523:0:10340:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250632b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.138531:0:10340:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250632b2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.138536:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbe0400/0x31399394250632b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.138566:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2000:x1830967310450432:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 47871us (48551us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.138583:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20139 00010000:00010000:3.0:1746147215.138855:0:1398:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x313993942506329d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.138863:0:1398:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x313993942506329d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.138874:0:1398:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x313993942506329d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.138879:0:1398:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x313993942506329d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.138885:0:1398:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x313993942506329d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.138889:0:1398:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093730a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147215.138891:0:1398:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x313993942506329d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.138896:0:1398:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x313993942506329d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.138903:0:1398:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x313993942506329d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.138908:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093730a00/0x313993942506329d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.138940:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310450304:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 48602us (48979us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.138947:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20136 00000100:00100000:1.0:1746147215.142204:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.143831:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.143867:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.144862:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.145139:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310453632 00000100:00100000:0.0:1746147215.145149:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310453632 00000100:00100000:0.0:1746147215.145187:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310453760 00000100:00100000:0.0:1746147215.145189:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310453760 00000100:00100000:0.0:1746147215.145203:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310453888 00000100:00100000:0.0:1746147215.145205:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310453888 00000100:00100000:0.0:1746147215.145214:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310454016 00000100:00100000:0.0:1746147215.145216:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310454016 00000100:00100000:0.0:1746147215.145231:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20146 00000100:00100000:1.0:1746147215.145238:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20147 00000100:00100000:0.0:1746147215.145238:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967310453632:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147215.145246:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967310453760:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147215.145256:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.145259:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.145275:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x313993942506330d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f395 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.145275:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093731600/0x3139939425063306 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f38e expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147215.145297:0:9584:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6814178e, atime: 0x6814178d, ctime: 0x6814178e, blocks: 0x808 00002000:00010000:0.0:1746147215.145297:0:10340:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x96:0x0] initial LVB size: 2097152, mtime: 0x6814178e, atime: 0x6814178a, ctime: 0x6814178e, blocks: 0x808 00010000:00010000:1.0:1746147215.145314:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.145314:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.145316:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.145316:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.145323:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093731600/0x3139939425063306 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f38e expref: 27 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.145327:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x313993942506330d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f395 expref: 36 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.145338:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093731600/0x3139939425063306 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f38e expref: 27 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.145339:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x313993942506330d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f395 expref: 36 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.145347:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05200, rc 0) 00010000:00010000:0.0:1746147215.145347:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093731600, rc 0) 00000100:00100000:1.0:1746147215.145393:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967310453760:12345-192.168.204.25@tcp:101:cat.0 Request processed in 145us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.145399:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20147 00000100:00100000:2.0:1746147215.145492:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20148 00000100:00100000:1.0:1746147215.145498:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20149 00000100:00100000:2.0:1746147215.145501:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967310453888:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147215.145504:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967310454016:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.145508:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.145512:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.145520:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x3139939425063314 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f3a3 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.145521:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x313993942506331b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f39c expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147215.145530:0:9584:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x98:0x0] initial LVB size: 4194304, mtime: 0x6814178e, atime: 0x6814178c, ctime: 0x6814178e, blocks: 0x1008 00002000:00010000:2.0:1746147215.145533:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4886560, mtime: 0x6814178e, atime: 0x6814178e, ctime: 0x6814178e, blocks: 0x1558 00010000:00010000:1.0:1746147215.145538:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.145539:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.145540:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.145541:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.145542:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x3139939425063314 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3a3 expref: 28 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.145546:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x313993942506331b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f39c expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.145551:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x3139939425063314 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3a3 expref: 28 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.145555:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x313993942506331b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f39c expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.145557:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05000, rc 0) 00010000:00010000:2.0:1746147215.145561:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091e31c00, rc 0) 00000100:00100000:0.0:1746147215.146163:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967310453632:12345-192.168.204.25@tcp:101:cat.0 Request processed in 923us (3965us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.146165:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967310454016:12345-192.168.204.25@tcp:101:cat.0 Request processed in 661us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.146169:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20146 00000100:00100000:1.0:1746147215.146172:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20149 00000100:00100000:2.0:1746147215.146226:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967310453888:12345-192.168.204.25@tcp:101:cat.0 Request processed in 726us (2357us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.146231:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20148 00000100:00100000:3.0:1746147215.146360:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.146421:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310454272 00000100:00100000:2.0:1746147215.146426:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310454272 00000100:00100000:2.0:1746147215.146455:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16503 00000100:00100000:2.0:1746147215.146459:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2959:x1830967310454272:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:2.0:1746147215.146498:0:6215:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.146520:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f200/0x3139939425063257 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f333 expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.146533:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147215.146537:0:6215:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147215.146561:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.146581:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x31399394250631bd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2e6 expref: 32 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.146589:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x31399394250631e0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ed expref: 12 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.146594:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425063146 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f284 expref: 32 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.146601:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x313993942506314d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f28b expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.146606:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.146634:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x313993942506314d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f28b expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.146650:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x313993942506314d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f28b expref: 12 pid: 6215 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.146663:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311509504:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.146738:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425063146 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f284 expref: 32 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.146746:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425063146 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f284 expref: 32 pid: 6215 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.146753:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311509632:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.146776:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x31399394250631e0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ed expref: 12 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.146782:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x31399394250631e0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ed expref: 12 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.146789:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311509760:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.146809:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x31399394250631bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2e6 expref: 32 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.146816:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x31399394250631bd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2e6 expref: 32 pid: 6215 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.146823:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311509888:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.146838:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.150768:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.150807:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.150849:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311509504:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147215.150907:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310454400 00000100:00100000:3.0:1746147215.150914:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310454400 00010000:00010000:3.0:1746147215.150949:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x313993942506314d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f28b expref: 13 pid: 6215 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.150986:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310454656 00000100:00100000:3.0:1746147215.150989:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310454656 00010000:00010000:3.0:1746147215.150998:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x31399394250631e0 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ed expref: 14 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.151016:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9168 00000100:00100000:3.0:1746147215.151022:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310454400:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.151036:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147215.151041:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x313993942506314d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f28b expref: 14 pid: 6215 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.151053:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x313993942506314d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f28b expref: 14 pid: 6215 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.151075:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096b80200/0x313993942506314d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f28b expref: 14 pid: 6215 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.151115:0:7226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.151120:0:7226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.151132:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147215.151192:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9169 00000100:00100000:1.0:1746147215.151200:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2001:x1830967310454656:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147215.151212:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147215.151216:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x31399394250631e0 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ed expref: 13 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.151223:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x31399394250631e0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ed expref: 13 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.151232:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147215.151235:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147215.151240:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147215.151286:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311509632:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147215.151289:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147215.151296:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d7800/0x31399394250631e0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2ed expref: 13 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746147215.151305:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310454528 00000100:00100000:2.0:1746147215.151307:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311509760:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147215.151307:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310454528 00000100:00100000:2.0:1746147215.151314:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311509888:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147215.151322:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425063146 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f284 expref: 33 pid: 6215 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746147215.151337:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9170 00010000:00010000:2.0:1746147215.151340:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147215.151343:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967310454528:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147215.151349:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147215.151352:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425063146 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f284 expref: 33 pid: 6215 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.151359:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425063146 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f284 expref: 33 pid: 6215 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.151370:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ff4200/0x3139939425063146 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f284 expref: 33 pid: 6215 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.151379:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147215.151381:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147215.151387:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147215.151431:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310454528:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 86us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.151437:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9170 00000100:00100000:0.0:1746147215.151473:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.151489:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310454784 00000100:00100000:0.0:1746147215.151492:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310454784 00010000:00010000:0.0:1746147215.151502:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x31399394250631bd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2e6 expref: 32 pid: 6215 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746147215.151516:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9171 00000100:00100000:0.0:1746147215.151520:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5577480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310454784:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147215.151527:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147215.151528:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147215.151531:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x31399394250631bd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2e6 expref: 32 pid: 6215 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.151539:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x31399394250631bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2e6 expref: 32 pid: 6215 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.151549:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6a00/0x31399394250631bd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f2e6 expref: 32 pid: 6215 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.151558:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147215.151561:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:3.0:1746147215.151603:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310454400:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 576us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.151609:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9168 00000100:00100000:3.0:1746147215.151627:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310454912 00000100:00100000:3.0:1746147215.151629:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310454912 00000100:00100000:3.0:1746147215.151647:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16504 00000100:00100000:3.0:1746147215.151652:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2964:x1830967310454912:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147215.151673:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.151684:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063329 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f3aa expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147215.151753:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310454656:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 554us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.151759:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9169 00010000:00010000:0.0:1746147215.151780:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147215.151787:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.151915:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.151923:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063329 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3aa expref: 33 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.151937:0:7238:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 5/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:0.0:1746147215.151945:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147215.151946:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063329 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3aa expref: 33 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.151956:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.151958:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746147215.151960:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5577480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967310454784:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 439us (486us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147215.151961:0:7238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063329 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3aa expref: 33 pid: 7238 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.151966:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9171 00010000:00010000:3.0:1746147215.151971:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d6c00, rc 0) 00000100:00100000:3.0:1746147215.151986:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2964:x1830967310454912:12345-192.168.204.25@tcp:101:cat.0 Request processed in 334us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.151990:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16504 00010000:00010000:2.0:1746147215.152059:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.152065:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00000040:00080000:2.0:1746147215.152913:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1309, 88 off123056 00000004:00080000:2.0:1746147215.152921:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753142831120ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147215.152956:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1302, 88 off122432 00000004:00080000:2.0:1746147215.152961:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753142871631ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147215.153004:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1303, 88 off122520 00000004:00080000:2.0:1746147215.153007:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753142917372ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147215.153020:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1310, 88 off123144 00000004:00080000:2.0:1746147215.153148:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753143058181ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147215.153284:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1311, 88 off123232 00000004:00080000:2.0:1746147215.153288:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753143199079ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147215.153297:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1304, 88 off122608 00000004:00080000:2.0:1746147215.153300:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753143210275ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147215.154009:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1305, 88 off122696 00000004:00080000:2.0:1746147215.154014:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753143924620ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147215.154024:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1306, 88 off122784 00000004:00080000:2.0:1746147215.154027:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753143937455ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147215.154037:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1312, 88 off123320 00000004:00080000:2.0:1746147215.154039:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753143950042ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147215.154192:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1308, 88 off122968 00000004:00080000:2.0:1746147215.154196:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753144106962ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147215.154210:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1313, 88 off123408 00000004:00080000:2.0:1746147215.154212:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753144122909ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147215.154223:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1309, 88 off123056 00000004:00080000:2.0:1746147215.154226:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753144136576ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147215.154234:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1314, 88 off123496 00000004:00080000:2.0:1746147215.154236:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753144146951ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147215.154245:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1315, 88 off123584 00000004:00080000:2.0:1746147215.154248:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753144158600ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147215.154257:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1316, 88 off123672 00000004:00080000:2.0:1746147215.154259:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753144170049ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147215.154273:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1317, 88 off123760 00000004:00080000:2.0:1746147215.154276:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753144186819ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147215.154596:0:6215:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1310, 88 off123144 00000004:00080000:2.0:1746147215.154601:0:6215:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753144511400ns, next at 694367916532ns, rc = 0 00000001:00080000:3.0:1746147215.156553:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937413 is committed 00000004:00080000:3.0:1746147215.156563:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1286 committed 00000004:00080000:3.0:1746147215.156581:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1296 committed 00000004:00080000:3.0:1746147215.156597:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1295 committed 00000004:00080000:3.0:1746147215.156599:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1294 committed 00000004:00080000:3.0:1746147215.156601:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1293 committed 00000004:00080000:3.0:1746147215.156602:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1285 committed 00000004:00080000:3.0:1746147215.156604:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1292 committed 00000004:00080000:3.0:1746147215.156605:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1284 committed 00000004:00080000:3.0:1746147215.156606:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1291 committed 00000004:00080000:3.0:1746147215.156608:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1283 committed 00000004:00080000:3.0:1746147215.156609:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1282 committed 00000004:00080000:3.0:1746147215.156611:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1281 committed 00000004:00080000:3.0:1746147215.156612:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1290 committed 00000004:00080000:3.0:1746147215.156613:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1289 committed 00000004:00080000:3.0:1746147215.156614:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1280 committed 00000004:00080000:3.0:1746147215.156615:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1279 committed 00000004:00080000:3.0:1746147215.156616:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1288 committed 00000001:00080000:3.0:1746147215.156620:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937412 is committed 00000001:00080000:3.0:1746147215.156626:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937410 is committed 00000100:00100000:2.0:1746147215.156737:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746147215.156757:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311510016:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147215.156821:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147215.156854:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311510144:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147215.156869:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311510528:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147215.156871:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147215.156883:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311510656:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147215.156889:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147215.156903:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311511040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147215.156906:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311510016 00000100:00100000:2.0:1746147215.156912:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311510016 00000100:00100000:1.0:1746147215.156916:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147215.156937:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311510144 00000100:00100000:1.0:1746147215.156939:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311510144 00000100:00100000:2.0:1746147215.156955:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311510528 00000100:00100000:2.0:1746147215.156957:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311510528 00000100:00100000:1.0:1746147215.156958:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311511040 00000100:00100000:1.0:1746147215.156960:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311511040 00000100:00100000:2.0:1746147215.156970:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20150 00000100:00100000:2.0:1746147215.156977:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3765:x1830967311510016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147215.157190:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20151 00000100:00100000:1.0:1746147215.157197:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:3765:x1830967311510144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.157261:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311510272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.157285:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.157301:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311510784:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.157317:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.157328:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311511296:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.157341:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.157351:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311511808:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.157365:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.157378:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746147215.157381:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311510400:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.157395:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.157404:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311510912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.157418:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.157423:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311511424:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.157435:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.157440:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311511936:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.157451:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746147215.157453:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147215.157456:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147210 -> 1746147210 00002000:00010000:1.0:1746147215.157458:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:1.0:1746147215.157460:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147211 -> 1746147211 00002000:00010000:1.0:1746147215.157462:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00080000:3.0:1746147215.157467:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746147215.157470:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147215.157480:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311510272 00000100:00100000:3.0:1746147215.157482:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311510272 00000100:00100000:1.0:1746147215.157486:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:3765:x1830967311510144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 290us (613us total) trans 21474842683 rc 0/0 00000100:00100000:1.0:1746147215.157492:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20151 00000100:00100000:1.0:1746147215.157503:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311510784 00000100:00100000:1.0:1746147215.157505:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311510784 00000100:00100000:1.0:1746147215.157512:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311511296 00000100:00100000:1.0:1746147215.157513:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311511296 00000100:00100000:1.0:1746147215.157520:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311511808 00000100:00100000:1.0:1746147215.157522:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311511808 00000100:00100000:3.0:1746147215.157527:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311510400 00000100:00100000:1.0:1746147215.157527:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311510912 00000100:00100000:1.0:1746147215.157528:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311510912 00000100:00100000:3.0:1746147215.157529:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311510400 00000100:00100000:1.0:1746147215.157534:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311511424 00000100:00100000:3.0:1746147215.157535:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311511936 00000100:00100000:1.0:1746147215.157535:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311511424 00000100:00100000:3.0:1746147215.157536:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311511936 00000100:00100000:3.0:1746147215.157544:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20152 00000100:00100000:1.0:1746147215.157546:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20153 00000100:00100000:3.0:1746147215.157548:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3764:x1830967311510528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147215.157550:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3764:x1830967311511040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.157602:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20154 00002000:00010000:1.0:1746147215.157606:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00000100:00100000:3.0:1746147215.157607:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3766:x1830967311510784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147215.157608:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147215.157610:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147215.157612:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147215.157614:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:1.0:1746147215.157632:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3764:x1830967311511040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (714us total) trans 21474842684 rc 0/0 00000100:00100000:1.0:1746147215.157637:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20153 00000100:00100000:1.0:1746147215.157646:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20155 00000100:00100000:1.0:1746147215.157650:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3766:x1830967311511296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.157663:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3766:x1830967311510784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (344us total) trans 21474842686 rc 0/0 00000100:00100000:3.0:1746147215.157668:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20154 00000100:00100000:3.0:1746147215.157676:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20156 00000100:00100000:3.0:1746147215.157680:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3766:x1830967311510272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147215.157694:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147215.157696:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147214 -> 1746147214 00002000:00010000:1.0:1746147215.157698:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147212 -> 1746147212 00002000:00010000:1.0:1746147215.157700:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147214 -> 1746147214 00002000:00010000:1.0:1746147215.157701:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00002000:00010000:3.0:1746147215.157714:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147215.157716:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147214 -> 1746147214 00002000:00010000:3.0:1746147215.157717:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147213 -> 1746147213 00000100:00100000:1.0:1746147215.157718:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3766:x1830967311511296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (376us total) trans 17179875293 rc 0/0 00002000:00010000:3.0:1746147215.157719:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147214 -> 1746147214 00002000:00010000:3.0:1746147215.157721:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147215.157723:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20155 00000100:00100000:1.0:1746147215.157731:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20157 00000100:00100000:3.0:1746147215.157735:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3766:x1830967311510272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (449us total) trans 21474842687 rc 0/0 00000100:00100000:1.0:1746147215.157735:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3766:x1830967311511808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.157739:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20156 00000100:00100000:3.0:1746147215.157747:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20158 00000100:00100000:3.0:1746147215.157750:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3766:x1830967311510912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147215.157780:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147215.157782:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00000100:00100000:1.0:1746147215.157782:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3766:x1830967311511808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (415us total) trans 17179875294 rc 0/0 00002000:00010000:3.0:1746147215.157784:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147215.157785:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00000100:00100000:1.0:1746147215.157786:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20157 00002000:00010000:3.0:1746147215.157787:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:1.0:1746147215.157794:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20159 00000100:00100000:1.0:1746147215.157799:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3766:x1830967311510400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.157800:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3766:x1830967311510912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (381us total) trans 21474842688 rc 0/0 00000100:00100000:3.0:1746147215.157805:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20158 00000100:00100000:3.0:1746147215.157812:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20160 00000100:00100000:3.0:1746147215.157815:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3766:x1830967311511424:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147215.157832:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:1.0:1746147215.157834:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147214 -> 1746147214 00002000:00010000:1.0:1746147215.157836:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147214 -> 1746147214 00002000:00010000:1.0:1746147215.157837:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147214 -> 1746147214 00002000:00010000:1.0:1746147215.157839:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00002000:00010000:3.0:1746147215.157846:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147215.157848:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147215.157850:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147215.157852:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147215.157854:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746147215.157854:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3766:x1830967311510400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (459us total) trans 21474842689 rc 0/0 00000100:00100000:1.0:1746147215.157859:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20159 00000100:00100000:3.0:1746147215.157866:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3766:x1830967311511424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (430us total) trans 17179875295 rc 0/0 00000100:00100000:1.0:1746147215.157868:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20161 00000100:00100000:3.0:1746147215.157871:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20160 00000100:00100000:1.0:1746147215.157872:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3766:x1830967311511936:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147215.157905:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947e6300/2, rc 0, transno 21474842689 00000100:00100000:3.0:1746147215.157914:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311510400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147215.157920:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3766:x1830967311511936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (468us total) trans 17179875296 rc 0/0 00000004:00080000:3.0:1746147215.157922:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947e7b80/2, rc 0, transno 21474842688 00000100:00100000:3.0:1746147215.157924:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311510912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147215.157925:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20161 00000004:00080000:3.0:1746147215.157931:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5575f80/2, rc 0, transno 17179875295 00000100:00100000:3.0:1746147215.157934:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311511424:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147215.157940:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4396300/2, rc 0, transno 17179875296 00000100:00100000:3.0:1746147215.157942:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311511936:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147215.157947:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947e5f80/2, rc 0, transno 21474842687 00000100:00100000:3.0:1746147215.157949:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311510272:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147215.157954:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947e4700/2, rc 0, transno 21474842686 00002000:00010000:1.0:1746147215.157954:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00000100:00100000:3.0:1746147215.157956:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311510784:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147215.157957:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147215.157958:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147215.157960:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00000004:00080000:3.0:1746147215.157961:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5576680/2, rc 0, transno 17179875293 00002000:00010000:1.0:1746147215.157962:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:3.0:1746147215.157964:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311511296:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147215.157969:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4396d80/2, rc 0, transno 17179875294 00000100:00100000:3.0:1746147215.157971:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311511808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147215.157976:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3764:x1830967311510528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 428us (1086us total) trans 21474842685 rc 0/0 00000100:00100000:1.0:1746147215.157979:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20152 00000100:00100000:1.0:1746147215.157991:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311511552:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147215.158007:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.158016:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311511552 00000100:00100000:3.0:1746147215.158018:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311511552 00000004:00080000:1.0:1746147215.158022:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947e5c00/2, rc 0, transno 21474842685 00000100:00100000:1.0:1746147215.158024:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311510528:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147215.158031:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947e6680/2, rc 0, transno 21474842684 00000100:00100000:3.0:1746147215.158032:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20162 00000100:00100000:1.0:1746147215.158033:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311511040:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.158036:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3764:x1830967311511552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147215.158039:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311512064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147215.158054:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147215.158064:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746147215.158069:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311511168:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147215.158082:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.158086:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3764:x1830967311511552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (78us total) trans 17179875297 rc 0/0 00000100:00100000:1.0:1746147215.158107:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311511680:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.158108:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20162 00000100:00100000:3.0:1746147215.158116:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311512064 00000100:00100000:3.0:1746147215.158118:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311512064 00000100:00100000:1.0:1746147215.158122:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.158133:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311511168 00000100:00100000:3.0:1746147215.158135:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311511168 00000004:00080000:1.0:1746147215.158135:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098823800/2, rc 0, transno 17179875297 00000100:00100000:1.0:1746147215.158137:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311511552:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.158147:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311511680 00000100:00100000:3.0:1746147215.158148:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311511680 00000100:00100000:1.0:1746147215.158149:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20163 00000100:00100000:1.0:1746147215.158154:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+57:3764:x1830967311512064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.158157:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20164 00000100:00100000:3.0:1746147215.158160:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3764:x1830967311511168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147215.158194:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147215.158196:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147212 -> 1746147212 00002000:00010000:3.0:1746147215.158197:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147213 -> 1746147213 00002000:00010000:3.0:1746147215.158199:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147212 -> 1746147212 00002000:00010000:3.0:1746147215.158201:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746147215.158206:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+58:3764:x1830967311512064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (151us total) trans 21474842690 rc 0/0 00000100:00100000:1.0:1746147215.158211:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20163 00000100:00100000:3.0:1746147215.158214:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3764:x1830967311511168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (131us total) trans 17179875298 rc 0/0 00000100:00100000:3.0:1746147215.158219:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20164 00000100:00100000:3.0:1746147215.158233:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20165 00000100:00100000:3.0:1746147215.158237:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3764:x1830967311511680:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147215.158247:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5576d80/2, rc 0, transno 17179875298 00000100:00100000:1.0:1746147215.158250:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311511168:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147215.158257:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099010000/2, rc 0, transno 21474842690 00000100:00100000:1.0:1746147215.158259:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311512064:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147215.158272:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:3.0:1746147215.158275:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147215.158277:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147215.158278:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147215.158280:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:3.0:1746147215.158313:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3764:x1830967311511680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (191us total) trans 17179875299 rc 0/0 00000100:00100000:3.0:1746147215.158318:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20165 00002000:00010000:2.0:1746147215.158405:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147215.158407:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147214 -> 1746147214 00002000:00010000:2.0:1746147215.158409:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:2.0:1746147215.158410:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147214 -> 1746147214 00002000:00010000:2.0:1746147215.158412:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746147215.158435:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3765:x1830967311510016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1458us (1614us total) trans 17179875300 rc 0/0 00000100:00100000:2.0:1746147215.158440:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20150 00000100:00100000:2.0:1746147215.158456:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746147215.158474:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5576300/2, rc 0, transno 17179875300 00000100:00100000:2.0:1746147215.158477:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311510016:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147215.158485:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947e4000/2, rc 0, transno 21474842683 00000100:00100000:2.0:1746147215.158487:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311510144:0@lo:2:osp-syn-0-0.0 00000004:00010000:2.0:1746147215.158523:0:6215:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800933f4000 reply state ffff8800984dbc00 transno 8589937413 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.158545:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.158554:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147215.158556:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147215.158563:0:6215:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063329 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3aa expref: 26 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.158581:0:6215:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063329 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3aa expref: 26 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.158587:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063329 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3aa expref: 26 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.158611:0:6215:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063329 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3aa expref: 26 pid: 7238 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.158621:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311512192:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147215.158678:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.158954:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311510656 00000100:00100000:0.0:1746147215.158959:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311510656 00000100:00100000:0.0:1746147215.158981:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20166 00000100:00100000:0.0:1746147215.158987:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3765:x1830967311510656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147215.159056:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3765:x1830967311510656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (599us total) trans 21474842691 rc 0/0 00000100:00100000:0.0:1746147215.159061:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20166 00000004:00080000:2.0:1746147215.159131:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947e4380/2, rc 0, transno 21474842691 00000100:00100000:2.0:1746147215.159135:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311510656:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147215.160870:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4397100/2, rc 0, transno 17179875299 00000100:00100000:1.0:1746147215.160879:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311511680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147215.163736:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311512192:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147215.163763:0:6215:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746147215.163870:0:6215:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746147215.163883:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2959:x1830967310454272:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 17422us (17522us total) trans 8589937413 rc 0/0 00000100:00100000:2.0:1746147215.163892:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16503 00010000:00010000:1.0:1746147215.164457:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00000100:00100000:0.0:1746147215.164466:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147215.164468:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147215.164475:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147215.164481:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d49600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147215.164490:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147215.164497:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00000100:00100000:2.0:1746147215.164512:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310455040 00010000:00010000:1.0:1746147215.164513:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147215.164515:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746147215.164518:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310455040 00010000:00010000:1.0:1746147215.164519:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:1.0:1746147215.164523:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x3139939425063322 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00000100:00100000:2.0:1746147215.165427:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6178 00000100:00100000:2.0:1746147215.165437:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2964:x1830967310455040:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:2.0:1746147215.165535:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2964:x1830967310455040:12345-192.168.204.25@tcp:49:cat.0 Request processed in 99us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.165540:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6178 00000100:00100000:0.0:1746147215.166591:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.166745:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310455168 00000100:00100000:2.0:1746147215.166752:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310455168 00000100:00100000:2.0:1746147215.166805:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16505 00000100:00100000:2.0:1746147215.166812:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2959:x1830967310455168:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147215.166828:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.166846:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x3139939425063330 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f3b1 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.166988:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x3139939425063330 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3b1 expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.167068:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x3139939425063330 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3b1 expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.167085:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147215.167210:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147215.167214:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12c400, rc 0) 00000100:00100000:2.0:1746147215.167472:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2959:x1830967310455168:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 660us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.167477:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16505 00000100:00100000:0.0:1746147215.172043:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.172340:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310455296 00000100:00100000:2.0:1746147215.172350:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310455296 00000100:00100000:2.0:1746147215.172408:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16506 00000100:00100000:2.0:1746147215.172416:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2959:x1830967310455296:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147215.172437:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.172456:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x3139939425063337 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f3b8 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.172544:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x313993942506333e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.172558:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x313993942506333e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.172579:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x313993942506333e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147215.172610:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:2.0:1746147215.172614:0:6215:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147215.172630:0:6215:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x313993942506333e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.172652:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x3139939425063337 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3b8 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.172671:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x313993942506333e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3b8 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.172679:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147215.172681:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147215.172684:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12d800, rc 0) 00000100:00100000:2.0:1746147215.172747:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2959:x1830967310455296:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 331us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.174966:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16506 00000100:00100000:0.0:1746147215.179477:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.179559:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310455424 00000100:00100000:3.0:1746147215.179577:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310455424 00000100:00100000:3.0:1746147215.179637:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20167 00000100:00100000:3.0:1746147215.179646:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310455424:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147215.179664:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.179683:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984efc00/0x3139939425063345 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f3bf expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.179698:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147215.179706:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.179709:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.179718:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984efc00/0x3139939425063345 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3bf expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.179733:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984efc00/0x3139939425063345 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3bf expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147215.179738:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147215.179745:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984efc00, rc 0) 00000100:00100000:0.0:1746147215.179755:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310455552 00000100:00100000:0.0:1746147215.179758:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310455552 00000100:00100000:0.0:1746147215.179780:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310455680 00000100:00100000:0.0:1746147215.179782:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310455680 00000100:00100000:3.0:1746147215.179794:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310455424:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 149us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.179795:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20168 00000100:00100000:3.0:1746147215.179800:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20167 00000100:00100000:0.0:1746147215.179801:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310455552:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147215.179809:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147215.179817:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20169 00010000:00010000:0.0:1746147215.179821:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cd3000/0x313993942506334c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f3c6 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.179822:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2000:x1830967310455680:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147215.179828:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147215.179833:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.179835:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425063353 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f3cd expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.179835:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.179840:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cd3000/0x313993942506334c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3c6 expref: 10 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.179844:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.179845:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.179849:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425063353 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3cd expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.179850:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cd3000/0x313993942506334c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3c6 expref: 11 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.179856:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cd3000, rc 0) 00010000:00010000:3.0:1746147215.179858:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425063353 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3cd expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.179865:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ef800, rc 0) 00000100:00100000:0.0:1746147215.179872:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310455552:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 72us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.179877:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20168 00000100:00100000:3.0:1746147215.179881:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310455680:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 59us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.179887:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20169 00000100:00100000:0.0:1746147215.179906:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.179923:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310455808 00000100:00100000:3.0:1746147215.179926:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310455808 00000100:00100000:3.0:1746147215.179942:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20170 00000100:00100000:3.0:1746147215.179947:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310455808:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:0.0:1746147215.179951:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147215.179953:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.179960:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x313993942506335a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f3d4 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.179972:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.179973:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.179978:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x313993942506335a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3d4 expref: 15 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.179987:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x313993942506335a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3d4 expref: 15 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.179994:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984eee00, rc 0) 00000100:00100000:3.0:1746147215.180010:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310455808:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 63us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.180015:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20170 00000100:00100000:3.0:1746147215.180023:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310455936 00000100:00100000:0.0:1746147215.180023:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.180025:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310455936 00000100:00100000:0.0:1746147215.180039:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310456064 00000100:00100000:0.0:1746147215.180041:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310456064 00000100:00100000:3.0:1746147215.180046:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20171 00000100:00100000:3.0:1746147215.180051:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310455936:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147215.180056:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147215.180058:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20172 00000100:00100000:0.0:1746147215.180062:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2000:x1830967310456064:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147215.180074:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147215.180081:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425063361 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f3e2 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.180109:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.180111:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.180115:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425063361 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3e2 expref: 11 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.180268:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984efe00/0x3139939425063368 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f3db expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.180279:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.180281:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.180285:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984efe00/0x3139939425063368 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3db expref: 16 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.180294:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984efe00/0x3139939425063368 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3db expref: 16 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.180301:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984efe00, rc 0) 00000100:00100000:3.0:1746147215.180318:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310455936:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 267us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.180326:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20171 00010000:00010000:0.0:1746147215.180772:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425063361 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3e2 expref: 11 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.180781:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093731e00, rc 0) 00000100:00100000:0.0:1746147215.180797:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310456064:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 734us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.180802:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20172 00000100:00100000:0.0:1746147215.186654:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.186727:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310456576 00000100:00100000:3.0:1746147215.186736:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310456576 00002000:00100000:3.0:1746147215.186785:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff8800769ad880 x1830967310456576/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.186795:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ad880 with x1830967310456576 ext(1048576->2097151) 00002000:00010000:3.0:1746147215.186801:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769ad880 00000100:00100000:3.0:1746147215.186829:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7414 00000100:00100000:3.0:1746147215.186837:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310456576:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147215.187065:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.187129:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.187146:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310456448 00000100:00100000:1.0:1746147215.187149:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310456448 00002000:00100000:1.0:1746147215.187167:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880129f57b80 x1830967310456448/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.187207:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f57b80 with x1830967310456448 ext(1048576->2097151) 00002000:00010000:1.0:1746147215.187211:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f57b80 00000100:00100000:1.0:1746147215.187236:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310456832 00000100:00100000:1.0:1746147215.187239:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310456832 00002000:00100000:1.0:1746147215.187255:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88012bab4e00 x1830967310456832/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.187262:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab4e00 with x1830967310456832 ext(0->1048575) 00002000:00010000:1.0:1746147215.187265:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bab4e00 00000100:00100000:2.0:1746147215.187270:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7415 00000100:00100000:2.0:1746147215.187284:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310456448:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147215.187289:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7416 00000100:00100000:1.0:1746147215.187294:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310456832:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147215.192113:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.193451:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310456960 00000100:00100000:3.0:1746147215.193464:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310456960 00002000:00100000:3.0:1746147215.193517:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88012f3ce300 x1830967310456960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.193528:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3ce300 with x1830967310456960 ext(1048576->2097151) 00002000:00010000:3.0:1746147215.193534:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3ce300 00000100:00100000:3.0:1746147215.193579:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7417 00000100:00100000:3.0:1746147215.193588:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310456960:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147215.199466:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.199508:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.199536:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.199550:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.199563:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.199624:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.199664:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310457216 00000100:00100000:2.0:1746147215.199673:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310457216 00000100:00100000:2.0:1746147215.200589:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310457344 00000100:00100000:2.0:1746147215.200593:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310457344 00000100:00100000:0.0:1746147215.200647:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310457472 00000100:00100000:0.0:1746147215.200651:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310457472 00000100:00100000:0.0:1746147215.200671:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310457600 00000100:00100000:0.0:1746147215.200674:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310457600 00000100:00100000:0.0:1746147215.200687:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310457728 00000100:00100000:0.0:1746147215.200690:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310457728 00000100:00100000:0.0:1746147215.200699:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310457856 00000100:00100000:0.0:1746147215.200701:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310457856 00000100:00100000:0.0:1746147215.200718:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20173 00000100:00100000:0.0:1746147215.200727:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310457216:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147215.200841:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310457216:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 116us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.200848:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20173 00000100:00100000:0.0:1746147215.200863:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20174 00000100:00100000:0.0:1746147215.200868:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310457344:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147215.200903:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310457344:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 35us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.200908:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20174 00000100:00100000:0.0:1746147215.200916:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20175 00000100:00100000:0.0:1746147215.200920:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310457472:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147215.200947:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310457472:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 26us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.200952:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20175 00000100:00100000:0.0:1746147215.200962:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20176 00000100:00100000:0.0:1746147215.200966:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310457600:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147215.200995:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310457600:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 29us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.201000:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20176 00000100:00100000:0.0:1746147215.201008:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20177 00000100:00100000:0.0:1746147215.201013:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310457728:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147215.201107:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310457728:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 93us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.201112:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20177 00000100:00100000:0.0:1746147215.201121:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20178 00000100:00100000:0.0:1746147215.201125:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310457856:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147215.201155:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310457856:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 30us (1532us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.201160:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20178 00000100:00100000:0.0:1746147215.215719:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.215758:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.215784:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.215798:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.215819:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.215834:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.215979:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310456832:12345-192.168.204.25@tcp:3:cat.0 Request processed in 28683us (28848us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147215.215991:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7416 00002000:00100000:0.0:1746147215.216001:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff88012bab4e00 x1830967310456832/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147215.216011:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab4e00 with x1830967310456832 ext(0->1048575) 00002000:00010000:0.0:1746147215.216016:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bab4e00 00000100:00100000:0.0:1746147215.216052:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310457984 00000100:00100000:0.0:1746147215.216059:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310457984 00000100:00100000:0.0:1746147215.216084:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310458112 00000100:00100000:0.0:1746147215.216087:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310458112 00000100:00100000:0.0:1746147215.216121:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310458240 00000100:00100000:0.0:1746147215.216123:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310458240 00000100:00100000:0.0:1746147215.216131:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310458368 00000100:00100000:0.0:1746147215.216132:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310458368 00000100:00100000:0.0:1746147215.216140:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310458496 00000100:00100000:0.0:1746147215.216141:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310458496 00000100:00100000:0.0:1746147215.216149:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310458624 00000100:00100000:0.0:1746147215.216150:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310458624 00000100:00100000:0.0:1746147215.216161:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20179 00000100:00100000:0.0:1746147215.216166:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310457984:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147215.216235:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310457984:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 69us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.216240:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20179 00000100:00100000:0.0:1746147215.216248:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20180 00000100:00100000:0.0:1746147215.216252:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310458112:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147215.216279:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310458112:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 27us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.216284:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20180 00000100:00100000:0.0:1746147215.216290:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20181 00000100:00100000:0.0:1746147215.216299:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310458240:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147215.216319:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310458240:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 20us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.216323:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20181 00000100:00100000:0.0:1746147215.216434:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20182 00000100:00100000:0.0:1746147215.216437:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310458368:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147215.216462:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310458368:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 24us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.216466:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20182 00000100:00100000:0.0:1746147215.216473:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20183 00000100:00100000:0.0:1746147215.216476:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310458496:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147215.216497:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310458496:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 20us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.216501:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20183 00000100:00100000:0.0:1746147215.216507:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20184 00000100:00100000:0.0:1746147215.216510:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310458624:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147215.216532:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310458624:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 21us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.216536:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20184 00000100:00100000:0.0:1746147215.217765:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.221960:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310458880 00000100:00100000:2.0:1746147215.221973:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310458880 00000100:00100000:2.0:1746147215.223875:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16507 00000100:00100000:2.0:1746147215.223893:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2966:x1830967310458880:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147215.223923:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.223945:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x313993942506336f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f3e9 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.224023:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063376 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.224037:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063376 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.224049:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063376 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.224061:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x313993942506337d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.224066:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x313993942506337d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.224071:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x313993942506337d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.224178:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425063384 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.224187:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f400/0x3139939425063281 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f356 expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.224194:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425063384 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.224224:0:6215:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f400/0x3139939425063281 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f356 expref: 8 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.224235:0:6215:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f400/0x3139939425063281 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f356 expref: 8 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.224246:0:6215:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094713480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311512320:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147215.225155:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.225654:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310456448:12345-192.168.204.25@tcp:3:cat.0 Request processed in 38374us (38586us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147215.225665:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7415 00002000:00100000:3.0:1746147215.225675:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880129f57b80 x1830967310456448/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.225683:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f57b80 with x1830967310456448 ext(1048576->2097151) 00002000:00010000:3.0:1746147215.225690:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f57b80 00000100:00100000:2.0:1746147215.225825:0:6215:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147215.225892:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310459008 00000100:00100000:1.0:1746147215.225900:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310459008 00000100:00100000:1.0:1746147215.225933:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20185 00000100:00100000:1.0:1746147215.225939:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2002:x1830967310459008:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:1.0:1746147215.226124:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147215.226128:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147215.226129:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147215.226132:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147215.226133:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746147215.226157:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2002:x1830967310459008:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 217us (1006us total) trans 17179875301 rc 0/0 00000100:00100000:1.0:1746147215.226163:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20185 00000100:00100000:2.0:1746147215.230026:0:6215:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094713480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6215:1830967311512320:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147215.230026:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147215.230064:0:6215:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425063384 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000100:00100000:2.0:1746147215.230137:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310459136 00000100:00100000:2.0:1746147215.230144:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310459136 00010000:00010000:2.0:1746147215.230175:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f400/0x3139939425063281 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f356 expref: 9 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.230209:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9172 00000100:00100000:2.0:1746147215.230217:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2002:x1830967310459136:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.230230:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.230235:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f400/0x3139939425063281 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f356 expref: 9 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.230247:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f400/0x3139939425063281 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f356 expref: 9 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.230270:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fc8f400/0x3139939425063281 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f356 expref: 9 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.230286:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147215.230291:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425063384 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230300:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425063384 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230307:0:7227:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425063384 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230329:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147215.230366:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2002:x1830967310459136:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 150us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.230373:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9172 00010000:00010000:2.0:1746147215.230390:0:6215:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425063384 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230396:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425063384 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147215.230410:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147215.230506:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425063384 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230514:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425063384 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230520:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425063384 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230525:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f12cc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147215.230529:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425063384 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230535:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425063384 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230541:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147215.230543:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147215.230545:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425063384 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230549:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12cc00/0x3139939425063384 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230560:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063376 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230566:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063376 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230582:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063376 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230586:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f12d600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147215.230588:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063376 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230593:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063376 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230599:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147215.230600:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147215.230603:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063376 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230607:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063376 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230614:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x313993942506337d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230619:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x313993942506337d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230624:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x313993942506337d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230627:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f12d200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147215.230629:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x313993942506337d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230637:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x313993942506337d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230642:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f027900) 00010000:00010000:2.0:1746147215.230644:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147215.230645:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x313993942506337d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230649:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x313993942506337d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.230689:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x313993942506336f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3e9 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.230696:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x313993942506336f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3e9 expref: 9 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.230702:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12da00, rc 0) 00000100:00100000:2.0:1746147215.230733:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2966:x1830967310458880:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6847us (12973us total) trans 8589937414 rc 301/301 00000100:00100000:2.0:1746147215.230739:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16507 00000100:00100000:3.0:1746147215.231312:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310456576:12345-192.168.204.25@tcp:3:cat.0 Request processed in 44474us (44667us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147215.231320:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7414 00002000:00100000:3.0:1746147215.231329:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff8800769ad880 x1830967310456576/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.231338:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ad880 with x1830967310456576 ext(1048576->2097151) 00002000:00010000:3.0:1746147215.231343:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769ad880 00000100:00100000:0.0:1746147215.232945:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.234447:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310459264 00000100:00100000:3.0:1746147215.234458:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310459264 00000100:00100000:3.0:1746147215.234515:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20186 00000100:00100000:3.0:1746147215.234523:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2002:x1830967310459264:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:3.0:1746147215.234776:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147215.234779:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147215.234781:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147215.234783:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147215.234785:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:3.0:1746147215.234829:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2002:x1830967310459264:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 306us (1888us total) trans 21474842692 rc 0/0 00000100:00100000:3.0:1746147215.234835:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20186 00000100:00100000:3.0:1746147215.237767:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310456960:12345-192.168.204.25@tcp:3:cat.0 Request processed in 44171us (45681us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147215.237779:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7417 00002000:00100000:3.0:1746147215.237790:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88012f3ce300 x1830967310456960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.237909:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3ce300 with x1830967310456960 ext(1048576->2097151) 00002000:00010000:3.0:1746147215.237915:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3ce300 00000100:00100000:0.0:1746147215.238487:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.238831:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310459520 00000100:00100000:3.0:1746147215.238839:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310459520 00000100:00100000:3.0:1746147215.238900:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7418 00000100:00100000:3.0:1746147215.238907:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967310459520:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147215.238947:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800984ef200/0x3139939425063392 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.238961:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.238962:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.238968:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ef200/0x3139939425063392 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.238981:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984ef200/0x3139939425063392 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.241174:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.241217:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.241236:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310460160 00000100:00100000:0.0:1746147215.241243:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310460160 00000100:00100000:0.0:1746147215.241302:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7419 00000100:00100000:0.0:1746147215.241310:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2002:x1830967310460160:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147215.241345:0:29474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x3139939425063399 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.241360:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.241362:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.241366:0:29474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x3139939425063399 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.241378:0:29474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x3139939425063399 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147215.241394:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.241421:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310460032 00000100:00100000:0.0:1746147215.241423:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310460032 00000100:00100000:2.0:1746147215.241586:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310459776 00000100:00100000:2.0:1746147215.241590:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310459776 00000100:00100000:2.0:1746147215.241621:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16508 00000100:00100000:2.0:1746147215.241626:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2969:x1830967310459776:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.241642:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.241659:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x31399394250633a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f3f0 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.241736:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x31399394250633a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.241746:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x31399394250633a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.241754:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x31399394250633a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.241766:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49800/0x31399394250633ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.241772:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49800/0x31399394250633ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.241777:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49800/0x31399394250633ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.241870:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250633b5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.241878:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250633b5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.241884:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250633b5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:2.0:1746147215.241892:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147215.241965:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250633b5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.241971:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250633b5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.241981:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250633b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.241986:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d49400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147215.241990:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250633b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.241996:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250633b5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.242007:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147215.242009:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147215.242013:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250633b5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.242018:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49400/0x31399394250633b5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.242031:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x31399394250633a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.242036:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x31399394250633a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.242040:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x31399394250633a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.242044:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d49600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147215.242046:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x31399394250633a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.242051:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x31399394250633a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.242059:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147215.242061:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147215.242063:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x31399394250633a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.242067:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49600/0x31399394250633a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.242073:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49800/0x31399394250633ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.242077:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49800/0x31399394250633ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.242080:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49800/0x31399394250633ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.242084:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d49800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147215.242086:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49800/0x31399394250633ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.242125:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49800/0x31399394250633ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.242131:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f027c00) 00010000:00010000:2.0:1746147215.242133:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147215.242135:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49800/0x31399394250633ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.242139:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d49800/0x31399394250633ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:2.0:1746147215.242177:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x31399394250633a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3f0 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.242185:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x31399394250633a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3f0 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.242194:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12d000, rc 0) 00000100:00100000:2.0:1746147215.242233:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2969:x1830967310459776:12345-192.168.204.25@tcp:101:cat.0 Request processed in 606us (1069us total) trans 8589937415 rc 301/301 00000100:00100000:0.0:1746147215.243864:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7420 00000100:00100000:0.0:1746147215.243885:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2002:x1830967310460032:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147215.243919:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250633c3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.243930:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.243931:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.243935:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250633c3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.243946:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250633c3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.244002:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16508 00000100:00100000:0.0:1746147215.251432:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.251473:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.251499:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.251537:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.251660:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310460544 00000100:00100000:3.0:1746147215.251674:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310460544 00000100:00100000:3.0:1746147215.251728:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310460672 00000100:00100000:3.0:1746147215.251730:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310460672 00000100:00100000:3.0:1746147215.251743:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310460928 00000100:00100000:3.0:1746147215.251745:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310460928 00000100:00100000:3.0:1746147215.251772:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310461184 00000100:00100000:3.0:1746147215.251774:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310461184 00000100:00100000:3.0:1746147215.251800:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7421 00000100:00100000:3.0:1746147215.251807:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2003:x1830967310460544:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147215.251840:0:13334:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6c00/0x31399394250633ca lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.251854:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.251856:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.251860:0:13334:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6c00/0x31399394250633ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.251872:0:13334:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6c00/0x31399394250633ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.252319:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7422 00000100:00100000:0.0:1746147215.252328:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7423 00000100:00100000:2.0:1746147215.252333:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2003:x1830967310460672:12345-192.168.204.25@tcp:3:lfs.0 00000100:00100000:0.0:1746147215.252336:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2003:x1830967310460928:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147215.252352:0:29476:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x31399394250633d1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.252358:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.252360:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.252362:0:29476:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x31399394250633d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.252366:0:9589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880096d48000/0x31399394250633d8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.252370:0:29476:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x31399394250633d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.252377:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.252379:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.252383:0:9589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d48000/0x31399394250633d8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.252394:0:9589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d48000/0x31399394250633d8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.252989:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7424 00000100:00100000:3.0:1746147215.252999:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2003:x1830967310461184:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147215.253016:0:29478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7c00/0x31399394250633df lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.253023:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.253024:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.253026:0:29478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7c00/0x31399394250633df lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.253034:0:29478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7c00/0x31399394250633df lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.258022:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800984ef200/0x3139939425063392 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.258039:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ef200/0x3139939425063392 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.258047:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800984ef200/0x3139939425063392 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.258053:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984ef200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147215.258057:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984ef200/0x3139939425063392 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.258063:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800984ef200/0x3139939425063392 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.258083:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800984ef200/0x3139939425063392 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.258124:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984ef200/0x3139939425063392 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.259914:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2003:x1830967310459520:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 19304us (19725us total) trans 0 rc 1032192/1032192 00000100:00100000:3.0:1746147215.259935:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7418 00000100:00100000:2.0:1746147215.260460:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.260837:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310461440 00000100:00100000:3.0:1746147215.260847:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310461440 00000100:00100000:3.0:1746147215.260896:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16509 00000100:00100000:3.0:1746147215.260904:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2969:x1830967310461440:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147215.260928:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.260947:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6200/0x31399394250633e6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f3f7 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.260964:0:29477:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250633c3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.260973:0:29477:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250633c3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.260980:0:29477:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250633c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.260985:0:29477:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fc8e000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147215.260988:0:29477:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250633c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.260995:0:29477:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250633c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.261012:0:29477:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250633c3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.261017:0:29477:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8e000/0x31399394250633c3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.261035:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7000/0x31399394250633ed lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.261050:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7000/0x31399394250633ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.261059:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7000/0x31399394250633ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147215.261083:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147215.261109:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147215.261125:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7000/0x31399394250633ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.261147:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6200/0x31399394250633e6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3f7 expref: 11 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.261158:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7000/0x31399394250633ed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3f7 expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.261165:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.261167:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147215.261170:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e5c7000, rc 0) 00000100:00100000:1.0:1746147215.262368:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2002:x1830967310460032:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 18483us (20968us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147215.262379:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7420 00000100:00100000:3.0:1746147215.262475:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2969:x1830967310461440:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1570us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.262482:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16509 00000100:00100000:1.0:1746147215.269811:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.269858:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.269889:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310461696 00000100:00100000:2.0:1746147215.269899:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310461696 00002000:00100000:2.0:1746147215.269946:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88012bab7b80 x1830967310461696/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.269957:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab7b80 with x1830967310461696 ext(2097152->4194303) 00002000:00010000:2.0:1746147215.269964:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bab7b80 00000100:00100000:2.0:1746147215.269982:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310461952 00000100:00100000:2.0:1746147215.269984:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310461952 00002000:00100000:2.0:1746147215.269997:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff880096cf9180 x1830967310461952/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.270003:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9180 with x1830967310461952 ext(2097152->4194303) 00002000:00010000:2.0:1746147215.270006:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096cf9180 00000100:00100000:2.0:1746147215.270018:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7425 00000100:00100000:3.0:1746147215.270024:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7426 00000100:00100000:2.0:1746147215.270025:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310461696:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:0.0:1746147215.270025:0:29474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x3139939425063399 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.270029:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310461952:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:0.0:1746147215.270036:0:29474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x3139939425063399 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.270044:0:29474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x3139939425063399 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.270051:0:29474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fc8fc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147215.270055:0:29474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x3139939425063399 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.270063:0:29474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x3139939425063399 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.270105:0:29474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x3139939425063399 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.270112:0:29474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc8fc00/0x3139939425063399 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.270186:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2002:x1830967310460160:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 28875us (28966us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147215.270193:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7419 00010000:00010000:3.0:1746147215.274825:0:13334:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6c00/0x31399394250633ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.274845:0:13334:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6c00/0x31399394250633ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.274854:0:13334:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6c00/0x31399394250633ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.274861:0:13334:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e5c6c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147215.274865:0:13334:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6c00/0x31399394250633ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.274874:0:13334:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6c00/0x31399394250633ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.274893:0:13334:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6c00/0x31399394250633ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.274900:0:13334:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e5c6c00/0x31399394250633ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.274977:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2003:x1830967310460544:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 23163us (23548us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147215.274988:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7421 00000100:00100000:0.0:1746147215.281432:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147215.282509:0:29476:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x31399394250633d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.282522:0:29476:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x31399394250633d1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.282530:0:29476:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x31399394250633d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.282537:0:29476:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fc8ee00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147215.282542:0:29476:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x31399394250633d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.282551:0:29476:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x31399394250633d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.282586:0:29476:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x31399394250633d1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.282593:0:29476:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8ee00/0x31399394250633d1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147215.282677:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2003:x1830967310460928:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 30339us (31173us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147215.282688:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7423 00000100:00100000:3.0:1746147215.283621:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310462080 00000100:00100000:3.0:1746147215.283632:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310462080 00000100:00100000:3.0:1746147215.283686:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16510 00000100:00100000:3.0:1746147215.283693:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2966:x1830967310462080:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147215.283714:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.283734:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6e00/0x31399394250633f4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f3fe expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.283796:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6e00/0x31399394250633f4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3fe expref: 11 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.283808:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6e00/0x31399394250633f4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3fe expref: 11 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.283824:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.283827:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147215.283830:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e5c6e00, rc 0) 00000100:00100000:3.0:1746147215.283857:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2966:x1830967310462080:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 165us (2436us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.283863:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16510 00010000:00010000:3.0:1746147215.288278:0:9589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880096d48000/0x31399394250633d8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.288297:0:9589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096d48000/0x31399394250633d8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.288305:0:9589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096d48000/0x31399394250633d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.288312:0:9589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d48000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147215.288316:0:9589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d48000/0x31399394250633d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.288324:0:9589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d48000/0x31399394250633d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.288349:0:9589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096d48000/0x31399394250633d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.288359:0:9589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d48000/0x31399394250633d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.288455:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2003:x1830967310460672:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 36122us (36976us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147215.288465:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7422 00000100:00100000:0.0:1746147215.291801:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.291849:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310462336 00000100:00100000:3.0:1746147215.291859:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310462336 00000100:00100000:3.0:1746147215.291918:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16511 00000100:00100000:3.0:1746147215.291926:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2971:x1830967310462336:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147215.291946:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.291963:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7200/0x31399394250633fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f405 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.292049:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x3139939425063402 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292063:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x3139939425063402 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292075:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x3139939425063402 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292106:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6600/0x3139939425063409 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292116:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6600/0x3139939425063409 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292120:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6600/0x3139939425063409 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292221:0:6215:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6c00/0x3139939425063410 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292231:0:6215:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6c00/0x3139939425063410 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292237:0:6215:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6c00/0x3139939425063410 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6215 initiator: MDT0 00000004:00200000:3.0:1746147215.292245:0:6215:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147215.292325:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6c00/0x3139939425063410 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292331:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6c00/0x3139939425063410 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292337:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6c00/0x3139939425063410 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292343:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e5c6c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147215.292347:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6c00/0x3139939425063410 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292353:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6c00/0x3139939425063410 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292364:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.292367:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147215.292371:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6c00/0x3139939425063410 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292376:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6c00/0x3139939425063410 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292389:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x3139939425063402 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292393:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x3139939425063402 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292397:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x3139939425063402 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292401:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e5c7e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147215.292402:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x3139939425063402 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292406:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x3139939425063402 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292411:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147215.292413:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147215.292415:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x3139939425063402 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292419:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7e00/0x3139939425063402 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292425:0:6215:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6600/0x3139939425063409 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292429:0:6215:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6600/0x3139939425063409 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292434:0:6215:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6600/0x3139939425063409 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292437:0:6215:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e5c6600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147215.292439:0:6215:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6600/0x3139939425063409 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292443:0:6215:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6600/0x3139939425063409 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292448:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009823a600) 00010000:00010000:3.0:1746147215.292450:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147215.292452:0:6215:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6600/0x3139939425063409 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292456:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6600/0x3139939425063409 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6215 initiator: MDT0 00010000:00010000:3.0:1746147215.292491:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7200/0x31399394250633fb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f405 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.292498:0:6215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7200/0x31399394250633fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f405 expref: 29 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.292505:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e5c7200, rc 0) 00000100:00100000:3.0:1746147215.292546:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2971:x1830967310462336:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 622us (757us total) trans 8589937416 rc 301/301 00000100:00100000:3.0:1746147215.292552:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16511 00000100:00100000:0.0:1746147215.301189:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.301224:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.301255:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147215.301264:0:29478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7c00/0x31399394250633df lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.301271:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147215.301290:0:29478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7c00/0x31399394250633df lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.301293:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310462464 00010000:00010000:3.0:1746147215.301298:0:29478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7c00/0x31399394250633df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.301302:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310462464 00010000:00010000:3.0:1746147215.301304:0:29478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e5c7c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147215.301307:0:29478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7c00/0x31399394250633df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.301314:0:29478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7c00/0x31399394250633df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.301331:0:29478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7c00/0x31399394250633df lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.301331:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310462720 00010000:00010000:3.0:1746147215.301336:0:29478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7c00/0x31399394250633df lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.301336:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310462720 00000100:00100000:0.0:1746147215.301352:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310462976 00000100:00100000:0.0:1746147215.301355:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310462976 00000100:00100000:2.0:1746147215.301360:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310462592 00000100:00100000:2.0:1746147215.301362:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310462592 00000100:00100000:0.0:1746147215.301373:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20187 00000100:00100000:2.0:1746147215.301380:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20188 00000100:00100000:0.0:1746147215.301382:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310462464:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147215.301385:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2001:x1830967310462720:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.301401:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147215.301401:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.301419:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009844aa00/0x313993942506341e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f41a expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.301419:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425063425 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f40c expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.301423:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310461184:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 48422us (49880us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147215.301433:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7424 00010000:00010000:2.0:1746147215.301440:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.301440:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.301442:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.301443:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.301451:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009844aa00/0x313993942506341e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f41a expref: 9 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.301451:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425063425 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f40c expref: 19 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.301466:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009844aa00/0x313993942506341e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f41a expref: 9 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.301466:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425063425 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f40c expref: 19 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.301478:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49c5200, rc 0) 00010000:00010000:2.0:1746147215.301479:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844aa00, rc 0) 00000100:00100000:3.0:1746147215.301496:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.301510:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310462464:12345-192.168.204.25@tcp:101:cat.0 Request processed in 129us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.301516:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310462720:12345-192.168.204.25@tcp:101:cat.0 Request processed in 130us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.301516:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20187 00000100:00100000:2.0:1746147215.301522:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20188 00000100:00100000:2.0:1746147215.301674:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20189 00000100:00100000:2.0:1746147215.301681:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310462976:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147215.301681:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20190 00010000:00010000:2.0:1746147215.301688:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147215.301692:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2001:x1830967310462592:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.301695:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x313993942506342c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f428 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.301705:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.301706:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.301706:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.301710:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x313993942506342c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f428 expref: 19 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.301718:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425063433 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f413 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.301720:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x313993942506342c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f428 expref: 19 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.301727:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844b600, rc 0) 00010000:00010000:1.0:1746147215.301732:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147215.301732:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310462848 00010000:00010000:1.0:1746147215.301734:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746147215.301735:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.301736:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310462848 00010000:00010000:1.0:1746147215.301740:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425063433 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f413 expref: 9 pid: 12225 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147215.301747:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310462976:12345-192.168.204.25@tcp:101:cat.0 Request processed in 66us (491us total) trans 0 rc 0/0 00010000:00010000:1.0:1746147215.301752:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425063433 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f413 expref: 9 pid: 12225 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147215.301753:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20189 00000100:00100000:0.0:1746147215.301754:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310463104 00000100:00100000:0.0:1746147215.301756:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310463104 00000100:00100000:3.0:1746147215.301758:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20191 00010000:00010000:1.0:1746147215.301760:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098887800, rc 0) 00000100:00100000:3.0:1746147215.301765:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310462848:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147215.301770:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20192 00010000:00010000:3.0:1746147215.301773:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147215.301777:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310463104:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147215.301777:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310462592:12345-192.168.204.25@tcp:101:cat.0 Request processed in 88us (505us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147215.301781:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x313993942506343a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f421 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147215.301785:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20190 00010000:00010000:2.0:1746147215.301786:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.301790:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.301791:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.301792:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x3139939425063441 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f42f expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.301795:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x313993942506343a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f421 expref: 20 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.301802:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.301803:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.301805:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x313993942506343a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f421 expref: 20 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.301807:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x3139939425063441 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f42f expref: 10 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.301810:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e5c7800, rc 0) 00010000:00010000:2.0:1746147215.301817:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x3139939425063441 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f42f expref: 10 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.301824:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844b000, rc 0) 00000100:00100000:3.0:1746147215.301825:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310462848:12345-192.168.204.25@tcp:101:cat.0 Request processed in 61us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.301829:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20191 00000100:00100000:2.0:1746147215.301837:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310463104:12345-192.168.204.25@tcp:101:cat.0 Request processed in 62us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.301843:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20192 00000100:00100000:0.0:1746147215.308957:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.309064:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310463360 00000100:00100000:2.0:1746147215.309073:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310463360 00000100:00100000:2.0:1746147215.309145:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16512 00000100:00100000:2.0:1746147215.309154:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2959:x1830967310463360:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:2.0:1746147215.309211:0:7238:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.309244:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x313993942506333e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3b8 expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.309264:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147215.309269:0:7238:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147215.309314:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425063448 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.309327:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7000/0x31399394250633ed lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3f7 expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.309334:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425063448 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.309366:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7000/0x31399394250633ed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3f7 expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.309378:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7000/0x31399394250633ed lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3f7 expref: 10 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.309392:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094713b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311512448:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.310814:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147215.311638:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310461952:12345-192.168.204.25@tcp:3:cat.0 Request processed in 41595us (41766us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147215.311650:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7426 00002000:00100000:3.0:1746147215.311661:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff880096cf9180 x1830967310461952/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.311670:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9180 with x1830967310461952 ext(2097152->4194303) 00002000:00010000:3.0:1746147215.311675:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096cf9180 00000100:00100000:0.0:1746147215.315174:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.315250:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310463488 00000100:00100000:3.0:1746147215.315258:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310463488 00010000:00010000:3.0:1746147215.315292:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7000/0x31399394250633ed lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3f7 expref: 11 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.315304:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094713b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311512448:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147215.315331:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9173 00010000:00010000:2.0:1746147215.315331:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425063448 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:3.0:1746147215.315337:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2002:x1830967310463488:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.315348:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147215.315353:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7000/0x31399394250633ed lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3f7 expref: 11 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.315362:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7000/0x31399394250633ed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3f7 expref: 11 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.315379:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7000/0x31399394250633ed lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3f7 expref: 11 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.315406:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.315411:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425063448 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.315419:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425063448 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.315424:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425063448 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.315440:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147215.315480:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2002:x1830967310463488:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 143us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.315486:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9173 00010000:00010000:2.0:1746147215.315675:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425063448 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.315682:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425063448 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00010000:2.0:1746147215.315819:0:7238:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800933f7b80 reply state ffff880098eef000 transno 8589937417 ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425063448 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.315832:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425063448 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.315841:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147215.315844:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746147215.315847:0:7238:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746147215.315923:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2959:x1830967310463360:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 6770us (6975us total) trans 8589937417 rc 0/0 00000100:00100000:2.0:1746147215.315930:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16512 00000100:00100000:0.0:1746147215.322018:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.322694:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310463616 00000100:00100000:2.0:1746147215.322704:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310463616 00000100:00100000:2.0:1746147215.322917:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20193 00000100:00100000:2.0:1746147215.322927:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2959:x1830967310463616:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147215.322948:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.322970:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009844ae00/0x313993942506344f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f436 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.323001:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e400/0x31399394250632dc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f364 expref: 37 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.323010:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425063425 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f40c expref: 19 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.323017:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984efc00/0x3139939425063345 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3bf expref: 18 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.323024:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.323026:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.323030:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009844ae00/0x313993942506344f lrc: 6/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f436 expref: 18 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.323650:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984efc00/0x3139939425063345 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3bf expref: 18 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.323664:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984efc00/0x3139939425063345 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3bf expref: 18 pid: 9586 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746147215.323679:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094713b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311512576:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.324133:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425063425 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f40c expref: 19 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.324143:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425063425 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f40c expref: 19 pid: 1854 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746147215.324152:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094710700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311512704:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.324181:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e400/0x31399394250632dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f364 expref: 37 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.324189:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e400/0x31399394250632dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f364 expref: 37 pid: 17600 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746147215.324196:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094713800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311512832:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.324211:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147215.325067:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.325085:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.325247:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310461696:12345-192.168.204.25@tcp:3:cat.0 Request processed in 55221us (55447us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147215.325263:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7425 00002000:00100000:3.0:1746147215.325272:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88012bab7b80 x1830967310461696/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.325281:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bab7b80 with x1830967310461696 ext(2097152->4194303) 00002000:00010000:3.0:1746147215.325287:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bab7b80 00000100:00100000:1.0:1746147215.325402:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.325428:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.325443:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310464512 00000100:00100000:1.0:1746147215.325453:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310464512 00002000:00100000:1.0:1746147215.325489:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880096cf9880 x1830967310464512/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.325496:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9880 with x1830967310464512 ext(0->1048575) 00010000:00010000:1.0:1746147215.325502:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425063425 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f40c expref: 20 pid: 1854 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.325514:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425063425 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f40c expref: 20 pid: 1854 timeout: 853 lvb_type: 1 00002000:00010000:1.0:1746147215.325520:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096cf9880 00000100:00100000:1.0:1746147215.325539:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310464640 00000100:00100000:1.0:1746147215.325541:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310464640 00002000:00100000:1.0:1746147215.325554:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880096cf8000 x1830967310464640/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.325560:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf8000 with x1830967310464640 ext(1048576->2097151) 00002000:00010000:1.0:1746147215.325562:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096cf8000 00000100:00100000:1.0:1746147215.325584:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1751 00000100:00100000:1.0:1746147215.325590:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310464512:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147215.325842:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.325883:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.325901:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310464768 00000100:00100000:2.0:1746147215.325904:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310464768 00002000:00100000:2.0:1746147215.325922:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880094712680 x1830967310464768/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.325929:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094712680 with x1830967310464768 ext(1048576->2097151) 00002000:00010000:2.0:1746147215.325933:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094712680 00000100:00100000:2.0:1746147215.325943:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310465152 00000100:00100000:2.0:1746147215.325945:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310465152 00002000:00100000:2.0:1746147215.325955:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880094712300 x1830967310465152/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.325961:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094712300 with x1830967310465152 ext(1048576->2097151) 00002000:00010000:2.0:1746147215.325963:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094712300 00000100:00100000:2.0:1746147215.325980:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7427 00000100:00100000:2.0:1746147215.325985:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310464640:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147215.326336:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7428 00000100:00100000:1.0:1746147215.326342:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310464768:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147215.326724:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7429 00000100:00100000:2.0:1746147215.326730:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310465152:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147215.327423:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310463872 00000100:00100000:3.0:1746147215.327430:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310463872 00000100:00100000:3.0:1746147215.327471:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310464128 00000100:00100000:3.0:1746147215.327474:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310464128 00000100:00100000:3.0:1746147215.327499:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16513 00000100:00100000:3.0:1746147215.327505:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2971:x1830967310463872:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147215.327521:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.327525:0:7238:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:0.0:1746147215.327545:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16514 00010000:00010000:3.0:1746147215.327552:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d6c00/0x3139939425063329 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3aa expref: 28 pid: 7238 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.327553:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2966:x1830967310464128:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147215.327561:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147215.327563:0:7237:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746147215.327582:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6e00/0x31399394250633f4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3fe expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.327583:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.327588:0:7238:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147215.327597:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.327599:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6400/0x3139939425063456 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f43d expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.327599:0:7237:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147215.327605:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4000/0x313993942506345d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f444 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.327639:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147215.327639:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147215.327652:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x3139939425063330 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3b1 expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.327663:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 4/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147215.328545:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 4/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147215.328554:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147215.328612:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x3139939425063330 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3b1 expref: 8 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.328624:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x3139939425063330 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3b1 expref: 8 pid: 6215 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.328635:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099012d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311512960:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147215.328725:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b900 going to sleep for 11 seconds 00010000:00010000:0.0:1746147215.328786:0:7237:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 4/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147215.328796:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:2.0:1746147215.337280:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099012d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311512960:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.337307:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7238 initiator: MDT0 00000100:00100000:1.0:1746147215.337375:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310464512:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11781us (11969us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147215.337388:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094713b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311512576:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147215.337388:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1751 00000100:00100000:3.0:1746147215.337396:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094710700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311512704:192.168.204.25@tcp:104: 00002000:00100000:1.0:1746147215.337401:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880096cf9880 x1830967310464512/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746147215.337402:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094713800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311512832:192.168.204.25@tcp:104: 00002000:00100000:1.0:1746147215.337410:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf9880 with x1830967310464512 ext(0->1048575) 00010000:00010000:1.0:1746147215.337420:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425063425 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f40c expref: 22 pid: 1854 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.337422:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009844ae00/0x313993942506344f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f436 expref: 18 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.337432:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425063425 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f40c expref: 22 pid: 1854 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.337437:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009844ae00, rc 0) 00002000:00010000:1.0:1746147215.337439:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096cf9880 00000100:00100000:3.0:1746147215.337457:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2959:x1830967310463616:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 14533us (15449us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.337464:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20193 00000100:00100000:0.0:1746147215.341471:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.341728:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.341925:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.342363:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310465280 00000100:00100000:3.0:1746147215.342373:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310465280 00010000:00010000:3.0:1746147215.342411:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984efc00/0x3139939425063345 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3bf expref: 18 pid: 9586 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746147215.342447:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310465536 00000100:00100000:3.0:1746147215.342450:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310465536 00010000:00010000:3.0:1746147215.342461:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e400/0x31399394250632dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f364 expref: 36 pid: 17600 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746147215.342475:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310465408 00000100:00100000:3.0:1746147215.342477:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310465408 00010000:00010000:3.0:1746147215.342487:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x3139939425063330 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3b1 expref: 9 pid: 6215 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.342503:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9174 00000100:00100000:3.0:1746147215.342510:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310465280:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.342524:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147215.342545:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984efc00/0x3139939425063345 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3bf expref: 18 pid: 9586 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.342556:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984efc00/0x3139939425063345 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3bf expref: 18 pid: 9586 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.342592:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984efc00/0x3139939425063345 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3bf expref: 18 pid: 9586 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.342612:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147215.342655:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310465280:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 145us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.342662:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9174 00000100:00100000:3.0:1746147215.342677:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9175 00000100:00100000:3.0:1746147215.342682:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310465536:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.342689:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147215.342695:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e400/0x31399394250632dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f364 expref: 36 pid: 17600 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.342703:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e400/0x31399394250632dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f364 expref: 36 pid: 17600 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.342714:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fc8e400/0x31399394250632dc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f364 expref: 36 pid: 17600 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.342721:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147215.342734:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967310465536:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 53us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.342739:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9175 00000100:00100000:3.0:1746147215.342748:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9176 00000100:00100000:3.0:1746147215.342752:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310465408:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.342760:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147215.342764:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x3139939425063330 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3b1 expref: 9 pid: 6215 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.342772:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x3139939425063330 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3b1 expref: 9 pid: 6215 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.342783:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c400/0x3139939425063330 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3b1 expref: 9 pid: 6215 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.342798:0:7225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.342803:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.342813:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.342819:0:7225:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.342826:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147215.342830:0:7225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147215.342847:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147215.342860:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2001:x1830967310465408:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 107us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.342864:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9176 00010000:00010000:3.0:1746147215.342920:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.342926:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7238 initiator: MDT0 00000040:00080000:3.0:1746147215.343195:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1318, 88 off123848 00000004:00080000:3.0:1746147215.343201:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753333111242ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147215.343248:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1311, 88 off123232 00000004:00080000:3.0:1746147215.343251:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753333162020ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147215.343278:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1312, 88 off123320 00000004:00080000:3.0:1746147215.343281:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753333191719ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147215.343294:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1319, 88 off123936 00000004:00080000:3.0:1746147215.343296:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753333206785ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147215.343307:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1320, 88 off124024 00000004:00080000:3.0:1746147215.343310:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753333220491ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147215.343320:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1313, 88 off123408 00000004:00080000:3.0:1746147215.343323:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753333233185ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147215.343333:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1314, 88 off123496 00000004:00080000:3.0:1746147215.343335:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753333245809ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147215.343345:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1315, 88 off123584 00000004:00080000:3.0:1746147215.343348:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753333258391ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147215.343358:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1321, 88 off124112 00000004:00080000:3.0:1746147215.343361:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753333271184ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147215.343371:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1316, 88 off123672 00000004:00080000:3.0:1746147215.343373:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753333283352ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147215.343383:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1322, 88 off124200 00000004:00080000:3.0:1746147215.343386:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753333296316ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147215.343396:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1317, 88 off123760 00000004:00080000:3.0:1746147215.343399:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753333309206ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147215.343408:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1323, 88 off124288 00000004:00080000:3.0:1746147215.343411:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753333321395ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147215.343420:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1324, 88 off124376 00000004:00080000:3.0:1746147215.343422:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753333332965ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147215.343432:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1325, 88 off124464 00000004:00080000:3.0:1746147215.343434:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753333344814ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147215.343443:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1326, 88 off124552 00000004:00080000:3.0:1746147215.343446:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753333356835ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147215.343457:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1318, 88 off123848 00000004:00080000:3.0:1746147215.343460:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753333370512ns, next at 694367916532ns, rc = 0 00000100:00100000:3.0:1746147215.344521:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.347323:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310465664 00000100:00100000:2.0:1746147215.347337:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310465664 00000100:00100000:2.0:1746147215.348180:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16515 00000100:00100000:2.0:1746147215.348189:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2964:x1830967310465664:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.348208:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.348229:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x3139939425063472 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f44b expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.348284:0:6215:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147215.348292:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x3139939425063472 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f44b expref: 31 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.348309:0:6215:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147215.348319:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x3139939425063472 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f44b expref: 31 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.348332:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147215.348335:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147215.348337:0:6215:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147215.348343:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12d200, rc 0) 00000100:00100000:2.0:1746147215.349486:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2964:x1830967310465664:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1294us (4965us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.349495:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16515 00000100:00100000:0.0:1746147215.349916:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310464640:12345-192.168.204.25@tcp:3:cat.0 Request processed in 23927us (24484us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147215.349926:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7427 00002000:00100000:0.0:1746147215.349937:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880096cf8000 x1830967310464640/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147215.349946:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cf8000 with x1830967310464640 ext(1048576->2097151) 00002000:00010000:0.0:1746147215.349952:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096cf8000 00000100:00100000:1.0:1746147215.350045:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310464768:12345-192.168.204.25@tcp:3:cat.0 Request processed in 23701us (24202us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147215.350053:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7428 00002000:00100000:1.0:1746147215.350059:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880094712680 x1830967310464768/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.350066:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094712680 with x1830967310464768 ext(1048576->2097151) 00002000:00010000:1.0:1746147215.350070:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094712680 00000100:00100000:1.0:1746147215.350281:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.350341:0:6215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310465792 00000100:00100000:2.0:1746147215.350348:0:6215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310465792 00000100:00100000:2.0:1746147215.350376:0:6215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16516 00000100:00100000:2.0:1746147215.350382:0:6215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2969:x1830967310465792:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.350394:0:6215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.350411:0:6215:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063479 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f452 expref: -99 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.350460:0:6215:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063479 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f452 expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.350470:0:6215:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063479 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f452 expref: 12 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.350481:0:6215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147215.350483:0:6215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147215.350486:0:6215:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147215.350491:0:6215:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12d600, rc 0) 00000100:00100000:2.0:1746147215.350513:0:6215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2969:x1830967310465792:12345-192.168.204.25@tcp:101:cat.0 Request processed in 132us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.350519:0:6215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16516 00000001:00080000:0.0:1746147215.351801:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937418 is committed 00000004:00080000:0.0:1746147215.351810:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1294 committed 00000004:00080000:0.0:1746147215.351830:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1305 committed 00000004:00080000:0.0:1746147215.351845:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1304 committed 00000004:00080000:0.0:1746147215.351847:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1303 committed 00000004:00080000:0.0:1746147215.351849:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1302 committed 00000004:00080000:0.0:1746147215.351850:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1293 committed 00000004:00080000:0.0:1746147215.351852:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1301 committed 00000004:00080000:0.0:1746147215.351854:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1292 committed 00000004:00080000:0.0:1746147215.351855:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1300 committed 00000004:00080000:0.0:1746147215.351857:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1291 committed 00000004:00080000:0.0:1746147215.351859:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1290 committed 00000004:00080000:0.0:1746147215.351860:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1289 committed 00000004:00080000:0.0:1746147215.351862:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1299 committed 00000004:00080000:0.0:1746147215.351863:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1298 committed 00000004:00080000:0.0:1746147215.351865:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1288 committed 00000004:00080000:0.0:1746147215.351867:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1287 committed 00000004:00080000:0.0:1746147215.351869:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1297 committed 00000001:00080000:0.0:1746147215.351880:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937417 is committed 00000001:00080000:0.0:1746147215.351886:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937415 is committed 00010000:00010000:1.0:1746147215.351954:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425063448 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147215.351964:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425063448 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147215.351970:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425063448 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147215.351976:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009844bc00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147215.351981:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425063448 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147215.351987:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425063448 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147215.352003:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147215.352006:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147215.352008:0:3751:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147215.352015:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425063448 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:1.0:1746147215.352020:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009844bc00/0x3139939425063448 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00000100:00100000:1.0:1746147215.352077:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.352305:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311513088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147215.352307:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311513344:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.352351:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147215.352373:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.352392:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311513600:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147215.352455:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311513856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147215.352653:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310465920 00000100:00100000:0.0:1746147215.352659:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310465920 00010000:00010000:0.0:1746147215.352690:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425063425 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f40c expref: 22 pid: 1854 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.352736:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311513472:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.352778:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147215.352792:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311513088 00000100:00100000:2.0:1746147215.352796:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311513088 00000100:00100000:3.0:1746147215.352797:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311514112:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.352811:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147215.352818:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311513344 00000100:00100000:2.0:1746147215.352819:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311513344 00000100:00100000:3.0:1746147215.352822:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311514752:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147215.352830:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311513600 00000100:00100000:2.0:1746147215.352832:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311513600 00000100:00100000:3.0:1746147215.352834:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147215.352843:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311514112 00000100:00100000:2.0:1746147215.352845:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311514112 00000100:00100000:3.0:1746147215.352854:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311513216:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147215.352854:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311514752 00000100:00100000:2.0:1746147215.352855:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311514752 00000100:00100000:3.0:1746147215.352868:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147215.352869:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20194 00000100:00100000:2.0:1746147215.352875:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3765:x1830967311513088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.352880:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311513728:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.352892:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.352902:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311514240:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.352915:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.352924:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311514880:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.352937:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.352953:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311513216 00000100:00100000:3.0:1746147215.352955:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311513216 00000100:00100000:3.0:1746147215.352967:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311513728 00000100:00100000:3.0:1746147215.352969:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311513728 00000100:00100000:3.0:1746147215.352975:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311514240 00000100:00100000:3.0:1746147215.352976:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311514240 00000100:00100000:3.0:1746147215.352982:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311514880 00000100:00100000:3.0:1746147215.352984:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311514880 00000100:00100000:3.0:1746147215.352991:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20195 00000100:00100000:3.0:1746147215.352996:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3767:x1830967311513344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147215.353000:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147215.353004:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147214 -> 1746147214 00002000:00010000:2.0:1746147215.353006:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:2.0:1746147215.353007:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147214 -> 1746147214 00002000:00010000:2.0:1746147215.353009:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746147215.353037:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3765:x1830967311513088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 162us (685us total) trans 17179875302 rc 0/0 00000100:00100000:2.0:1746147215.353043:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20194 00002000:00010000:3.0:1746147215.353051:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147215.353053:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147212 -> 1746147212 00000100:00100000:2.0:1746147215.353053:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20196 00002000:00010000:3.0:1746147215.353055:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147213 -> 1746147213 00002000:00010000:3.0:1746147215.353057:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147212 -> 1746147212 00000100:00100000:2.0:1746147215.353057:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3765:x1830967311513600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147215.353058:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746147215.353077:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3767:x1830967311513344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (704us total) trans 17179875303 rc 0/0 00000100:00100000:3.0:1746147215.353083:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20195 00000100:00100000:3.0:1746147215.353112:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20197 00002000:00010000:2.0:1746147215.353113:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147215.353115:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147214 -> 1746147214 00000100:00100000:3.0:1746147215.353117:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3765:x1830967311514112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147215.353117:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147212 -> 1746147212 00002000:00010000:2.0:1746147215.353119:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147214 -> 1746147214 00002000:00010000:2.0:1746147215.353121:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746147215.353140:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3765:x1830967311513600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (361us total) trans 17179875304 rc 0/0 00000100:00100000:2.0:1746147215.353145:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20196 00000100:00100000:2.0:1746147215.353155:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20198 00000100:00100000:2.0:1746147215.353159:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3765:x1830967311514752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.353170:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3765:x1830967311514112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (356us total) trans 17179875305 rc 0/0 00000100:00100000:3.0:1746147215.353176:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20197 00000100:00100000:3.0:1746147215.353185:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20199 00000100:00100000:3.0:1746147215.353190:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+62:3766:x1830967311513216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147215.353211:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3765:x1830967311514752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (375us total) trans 17179875306 rc 0/0 00000100:00100000:2.0:1746147215.353216:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20198 00000100:00100000:2.0:1746147215.353226:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20200 00000100:00100000:2.0:1746147215.353230:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+62:3766:x1830967311513728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147215.353243:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20201 00000100:00100000:2.0:1746147215.353246:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+63:3766:x1830967311514240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147215.353252:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147215.353255:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147210 -> 1746147210 00002000:00010000:3.0:1746147215.353257:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:3.0:1746147215.353259:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147211 -> 1746147211 00002000:00010000:3.0:1746147215.353260:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:3.0:1746147215.353281:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:3766:x1830967311513216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (412us total) trans 21474842693 rc 0/0 00000100:00100000:3.0:1746147215.353286:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20199 00000100:00100000:3.0:1746147215.353297:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20202 00000100:00100000:3.0:1746147215.353301:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+63:3766:x1830967311514880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147215.353301:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+63:3766:x1830967311514240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (385us total) trans 21474842694 rc 0/0 00000100:00100000:2.0:1746147215.353307:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20201 00002000:00010000:3.0:1746147215.353343:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:3.0:1746147215.353345:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147215.353347:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147215.353348:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147215.353350:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00002000:00010000:2.0:1746147215.353352:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:2.0:1746147215.353354:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147214 -> 1746147214 00002000:00010000:2.0:1746147215.353356:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147214 -> 1746147214 00002000:00010000:2.0:1746147215.353357:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147214 -> 1746147214 00002000:00010000:2.0:1746147215.353359:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:3.0:1746147215.353368:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:3766:x1830967311514880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (430us total) trans 21474842695 rc 0/0 00000100:00100000:3.0:1746147215.353373:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20202 00000100:00100000:2.0:1746147215.353376:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+64:3766:x1830967311513728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 145us (482us total) trans 21474842696 rc 0/0 00000100:00100000:2.0:1746147215.353381:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20200 00000100:00100000:2.0:1746147215.353395:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147215.353409:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094712d80/2, rc 0, transno 21474842693 00000100:00100000:2.0:1746147215.353413:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311514496:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.353417:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311513216:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147215.353424:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094710700/2, rc 0, transno 21474842696 00000100:00100000:3.0:1746147215.353426:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311513728:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147215.353431:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094710000/2, rc 0, transno 21474842694 00000100:00100000:2.0:1746147215.353433:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.353434:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311514240:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147215.353439:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094711880/2, rc 0, transno 21474842695 00000100:00100000:3.0:1746147215.353441:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311514880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147215.353444:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311514368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.353452:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311513856 00000100:00100000:3.0:1746147215.353454:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311513856 00000100:00100000:2.0:1746147215.353456:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147215.353465:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311515008:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.353467:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311514496 00000100:00100000:3.0:1746147215.353468:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311514496 00000100:00100000:3.0:1746147215.353476:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311514368 00000100:00100000:2.0:1746147215.353476:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.353477:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311514368 00000100:00100000:3.0:1746147215.353486:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311515008 00000100:00100000:3.0:1746147215.353487:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311515008 00000004:00080000:2.0:1746147215.353493:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099013b80/2, rc 0, transno 17179875303 00000100:00100000:3.0:1746147215.353495:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20203 00000100:00100000:2.0:1746147215.353497:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311513344:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.353500:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3767:x1830967311513856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147215.353510:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20204 00000100:00100000:2.0:1746147215.353516:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+63:3767:x1830967311514496:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147215.353544:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147215.353546:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147215.353548:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147215.353550:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147215.353552:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746147215.353584:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3767:x1830967311513856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (187us total) trans 17179875307 rc 0/0 00000100:00100000:3.0:1746147215.353589:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20203 00000100:00100000:2.0:1746147215.353592:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+64:3767:x1830967311514496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (157us total) trans 21474842697 rc 0/0 00000100:00100000:2.0:1746147215.353597:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20204 00000100:00100000:3.0:1746147215.353600:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20205 00000100:00100000:3.0:1746147215.353604:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3767:x1830967311514368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147215.353608:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20206 00000100:00100000:2.0:1746147215.353612:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3767:x1830967311515008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147215.353642:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:3.0:1746147215.353644:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147215.353646:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147215.353648:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147215.353649:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:3.0:1746147215.353667:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3767:x1830967311514368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (210us total) trans 17179875308 rc 0/0 00000100:00100000:3.0:1746147215.353672:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20205 00000100:00100000:2.0:1746147215.353677:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3767:x1830967311515008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (198us total) trans 17179875309 rc 0/0 00000100:00100000:2.0:1746147215.353682:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20206 00000004:00080000:2.0:1746147215.353724:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099010e00/2, rc 0, transno 17179875302 00010000:00010000:3.0:1746147215.353726:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f43d expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.353727:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311513088:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147215.353734:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099012d80/2, rc 0, transno 17179875304 00000100:00100000:2.0:1746147215.353736:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311513600:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147215.353737:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.353740:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746147215.353742:0:7238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00000004:00080000:2.0:1746147215.353742:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5577480/2, rc 0, transno 17179875305 00000100:00100000:2.0:1746147215.353744:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311514112:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147215.353750:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800933f7480/2, rc 0, transno 17179875306 00000100:00100000:2.0:1746147215.353752:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311514752:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147215.353753:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f43d expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.353758:0:7238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00000100:00100000:2.0:1746147215.353758:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746147215.353762:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094184700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311515136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147215.353780:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746147215.353781:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f43d expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.353791:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f43d expref: 29 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.353796:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311515136 00000100:00100000:2.0:1746147215.353799:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311515136 00000100:00100000:3.0:1746147215.353801:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311515264:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.353813:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20207 00000100:00100000:2.0:1746147215.353817:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+64:3765:x1830967311515136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.353843:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.353998:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9177 00000100:00100000:0.0:1746147215.354007:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2002:x1830967310465920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147215.354017:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147215.354025:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425063425 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f40c expref: 22 pid: 1854 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746147215.354034:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425063425 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f40c expref: 22 pid: 1854 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746147215.354050:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a49c5200/0x3139939425063425 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f40c expref: 22 pid: 1854 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746147215.354065:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.354067:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.354073:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009844ae00/0x313993942506344f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f436 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.354079:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009844ae00/0x313993942506344f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f436 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.354111:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009844ae00/0x313993942506344f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f436 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.354120:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311515392:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147215.355932:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.355936:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+65:3765:x1830967311515136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2111us (2148us total) trans 21474842698 rc 0/0 00000100:00100000:2.0:1746147215.355945:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20207 00000004:00080000:2.0:1746147215.355987:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5574a80/2, rc 0, transno 17179875307 00000100:00100000:3.0:1746147215.355989:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311515264:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.355991:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311513856:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147215.356001:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094710e00/2, rc 0, transno 21474842697 00000100:00100000:2.0:1746147215.356004:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311514496:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147215.356011:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800975a6300/2, rc 0, transno 17179875308 00000100:00100000:2.0:1746147215.356014:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311514368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147215.356014:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746147215.356019:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c6400/0x3139939425063456 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f43d expref: 29 pid: 7238 timeout: 0 lvb_type: 3 00000004:00080000:2.0:1746147215.356020:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800769dbb80/2, rc 0, transno 17179875309 00000100:00100000:2.0:1746147215.356022:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311515008:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147215.356033:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311513472 00000100:00100000:2.0:1746147215.356036:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311513472 00000100:00100000:1.0:1746147215.356036:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311513984:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746147215.356039:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f43d expref: 28 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.356046:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f43d expref: 28 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.356054:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20208 00000100:00100000:2.0:1746147215.356059:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+65:3764:x1830967311513472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147215.356060:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147215.356070:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311514624:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746147215.356076:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e5c7c00, rc 0) 00000100:00100000:1.0:1746147215.356101:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.356113:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2971:x1830967310463872:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 28608us (31048us total) trans 8589937418 rc 0/0 00000100:00100000:3.0:1746147215.356123:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16513 00000100:00100000:1.0:1746147215.356129:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311513984 00000100:00100000:1.0:1746147215.356132:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311513984 00000100:00100000:1.0:1746147215.356147:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311514624 00000100:00100000:1.0:1746147215.356148:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311514624 00002000:00010000:2.0:1746147215.356157:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746147215.356159:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20209 00002000:00010000:2.0:1746147215.356161:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147214 -> 1746147214 00002000:00010000:2.0:1746147215.356163:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147213 -> 1746147213 00000100:00100000:1.0:1746147215.356164:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3764:x1830967311513984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147215.356165:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147214 -> 1746147214 00002000:00010000:2.0:1746147215.356166:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746147215.356190:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3764:x1830967311513472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 131us (176us total) trans 21474842699 rc 0/0 00000100:00100000:2.0:1746147215.356196:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20208 00000100:00100000:2.0:1746147215.356206:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20210 00000100:00100000:2.0:1746147215.356211:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3764:x1830967311514624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147215.356213:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746147215.356215:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147215.356217:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147215.356219:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147215.356220:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:1.0:1746147215.356240:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+69:3764:x1830967311513984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (180us total) trans 21474842700 rc 0/0 00000100:00100000:3.0:1746147215.356245:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310465152:12345-192.168.204.25@tcp:3:cat.0 Request processed in 29516us (30361us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147215.356246:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20209 00002000:00010000:2.0:1746147215.356249:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147215.356251:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00000100:00100000:3.0:1746147215.356253:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7429 00002000:00010000:2.0:1746147215.356253:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147215.356255:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147215.356256:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00002000:00100000:3.0:1746147215.356261:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880094712300 x1830967310465152/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.356270:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094712300 with x1830967310465152 ext(1048576->2097151) 00002000:00010000:3.0:1746147215.356274:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094712300 00000100:00100000:2.0:1746147215.356275:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3764:x1830967311514624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (186us total) trans 21474842701 rc 0/0 00000100:00100000:2.0:1746147215.356280:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20210 00000004:00080000:3.0:1746147215.356300:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094184700/2, rc 0, transno 21474842698 00000004:00080000:2.0:1746147215.356303:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094713800/2, rc 0, transno 21474842699 00000100:00100000:3.0:1746147215.356304:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094184700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311515136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147215.356306:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311513472:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147215.356312:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094713b80/2, rc 0, transno 21474842700 00000100:00100000:2.0:1746147215.356314:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311513984:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147215.356319:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094711180/2, rc 0, transno 21474842701 00000100:00100000:2.0:1746147215.356321:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311514624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147215.358956:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311515392:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147215.358959:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147215.358977:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147215.359001:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310466048 00000100:00100000:0.0:1746147215.359006:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310466048 00000100:00100000:1.0:1746147215.359044:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.359061:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310466176 00000100:00100000:1.0:1746147215.359064:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310466176 00010000:00010000:1.0:1746147215.359084:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f43d expref: 28 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746147215.359132:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9178 00000100:00100000:1.0:1746147215.359138:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967310466176:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147215.359150:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147215.359155:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f43d expref: 28 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.359172:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f43d expref: 28 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.359193:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e5c7c00/0x313993942506346b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f43d expref: 28 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.359206:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147215.359211:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147215.359217:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20211 00010000:00010000:1.0:1746147215.359221:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147215.359223:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2959:x1830967310466048:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147215.359227:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147215.359234:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x3139939425063472 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f44b expref: 27 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.359235:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147215.359250:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425063480 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f459 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.359254:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147215.359276:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093731600/0x3139939425063306 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f38e expref: 26 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.359284:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425063433 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f413 expref: 9 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.359290:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cd3000/0x313993942506334c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3c6 expref: 13 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.359296:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.359298:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.359302:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425063480 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f459 expref: 13 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.359324:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097cd3000/0x313993942506334c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3c6 expref: 13 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.359334:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097cd3000/0x313993942506334c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3c6 expref: 13 pid: 1136 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746147215.359346:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311515520:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147215.359423:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425063433 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f413 expref: 9 pid: 12225 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.359431:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425063433 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f413 expref: 9 pid: 12225 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746147215.359440:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311515648:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147215.359464:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093731600/0x3139939425063306 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f38e expref: 26 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.359472:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093731600/0x3139939425063306 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f38e expref: 26 pid: 10340 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746147215.359479:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311515776:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147215.359493:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098489a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746147215.359506:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147215.359513:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7237 initiator: MDT0 00000100:00100000:1.0:1746147215.359562:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967310466176:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 424us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.359577:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9178 00000040:00080000:0.0:1746147215.359917:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1327, 88 off124640 00000004:00080000:0.0:1746147215.359923:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753349833036ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147215.359956:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1319, 88 off123936 00000004:00080000:0.0:1746147215.359959:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753349869512ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147215.359977:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1320, 88 off124024 00000004:00080000:0.0:1746147215.359979:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753349889846ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147215.359987:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1328, 88 off124728 00000004:00080000:0.0:1746147215.359990:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753349900586ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147215.359997:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1329, 88 off124816 00000004:00080000:0.0:1746147215.360000:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753349910435ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147215.360022:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1321, 88 off124112 00000004:00080000:3.0:1746147215.360027:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753349937950ns, next at 694367916532ns, rc = 0 00000100:00100000:0.0:1746147215.360029:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2002:x1830967310465920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6023us (7954us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.360036:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9177 00000040:00080000:3.0:1746147215.360038:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1322, 88 off124200 00000004:00080000:3.0:1746147215.360040:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753349950656ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147215.360046:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1323, 88 off124288 00000004:00080000:3.0:1746147215.360049:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753349959601ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147215.360060:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1330, 88 off124904 00000004:00080000:3.0:1746147215.360063:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753349973381ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147215.360070:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1324, 88 off124376 00000004:00080000:3.0:1746147215.360072:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753349982986ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147215.360079:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1331, 88 off124992 00000004:00080000:3.0:1746147215.360082:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753349992464ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147215.360111:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1325, 88 off124464 00000004:00080000:3.0:1746147215.360114:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753350024720ns, next at 694367916532ns, rc = 0 00000040:00080000:3.0:1746147215.360123:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1332, 88 off125080 00000004:00080000:3.0:1746147215.360126:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753350036195ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147215.360134:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1333, 88 off125168 00000004:00080000:3.0:1746147215.360137:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753350047775ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147215.360144:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1334, 88 off125256 00000004:00080000:3.0:1746147215.360146:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753350056686ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147215.360153:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1335, 88 off125344 00000004:00080000:3.0:1746147215.360155:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753350065706ns, next at 694367945074ns, rc = 0 00000040:00080000:3.0:1746147215.360162:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1326, 88 off124552 00000004:00080000:3.0:1746147215.360165:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753350075389ns, next at 694367916532ns, rc = 0 00000100:00100000:1.0:1746147215.361276:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311515648:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.361366:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311515520:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.361374:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311515776:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.361398:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425063480 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f459 expref: 13 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.361412:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095052400, rc 0) 00000100:00100000:2.0:1746147215.361474:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2959:x1830967310466048:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2249us (2515us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.361481:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20211 00000100:00100000:0.0:1746147215.362793:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.362827:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.362886:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.362951:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310466304 00000100:00100000:1.0:1746147215.362958:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310466304 00010000:00010000:1.0:1746147215.362987:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425063433 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f413 expref: 10 pid: 12225 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.363025:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310466432 00000100:00100000:1.0:1746147215.363028:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310466432 00010000:00010000:1.0:1746147215.363039:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097cd3000/0x313993942506334c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3c6 expref: 13 pid: 1136 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.363051:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310466560 00000100:00100000:1.0:1746147215.363053:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310466560 00010000:00010000:1.0:1746147215.363063:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093731600/0x3139939425063306 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f38e expref: 27 pid: 10340 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.363083:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9179 00000100:00100000:1.0:1746147215.363119:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2002:x1830967310466304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147215.363132:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147215.363151:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425063433 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f413 expref: 10 pid: 12225 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.363160:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425063433 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f413 expref: 10 pid: 12225 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.363180:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098887800/0x3139939425063433 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f413 expref: 10 pid: 12225 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.363191:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147215.363215:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2002:x1830967310466304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 126us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.363221:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9179 00000100:00100000:0.0:1746147215.363226:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9180 00000100:00100000:0.0:1746147215.363232:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2003:x1830967310466432:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147215.363233:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9181 00000100:00100000:1.0:1746147215.363237:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310466560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147215.363239:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147215.363245:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147215.363247:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cd3000/0x313993942506334c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3c6 expref: 13 pid: 1136 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.363249:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093731600/0x3139939425063306 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f38e expref: 27 pid: 10340 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746147215.363255:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cd3000/0x313993942506334c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3c6 expref: 13 pid: 1136 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.363539:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093731600/0x3139939425063306 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f38e expref: 27 pid: 10340 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746147215.363553:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cd3000/0x313993942506334c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3c6 expref: 13 pid: 1136 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.363557:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093731600/0x3139939425063306 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f38e expref: 27 pid: 10340 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746147215.363562:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.363564:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.363581:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425063480 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f459 expref: 12 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.363589:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425063480 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f459 expref: 12 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.363595:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147215.363611:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310466560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 374us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.363616:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9181 00010000:00010000:0.0:1746147215.363617:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425063480 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f459 expref: 12 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.363634:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311515904:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147215.363691:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.365015:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.365108:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311515904:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147215.365127:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147215.365153:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310466432:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1920us (2324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.365161:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9180 00000100:00100000:3.0:1746147215.365219:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310466688 00000100:00100000:3.0:1746147215.365224:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310466688 00000100:00100000:3.0:1746147215.365264:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20212 00000100:00100000:3.0:1746147215.365271:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2959:x1830967310466688:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147215.365285:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.365301:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db80600/0x3139939425063487 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f460 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.365327:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093730c00/0x31399394250632ea lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f372 expref: 25 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.365336:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009844aa00/0x313993942506341e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f41a expref: 8 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.365342:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425063353 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3cd expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.365353:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.365354:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.365357:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80600/0x3139939425063487 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f460 expref: 13 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.365379:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425063353 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3cd expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.365390:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425063353 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3cd expref: 13 pid: 9586 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746147215.365399:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311516032:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.365798:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009844aa00/0x313993942506341e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f41a expref: 8 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.365808:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009844aa00/0x313993942506341e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f41a expref: 8 pid: 17600 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746147215.365816:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311516160:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.365849:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093730c00/0x31399394250632ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f372 expref: 25 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.365857:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093730c00/0x31399394250632ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f372 expref: 25 pid: 1136 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746147215.365870:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311516288:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147215.365892:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.367775:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.367879:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310466816 00000100:00100000:0.0:1746147215.367886:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310466816 00010000:00010000:0.0:1746147215.367914:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425063353 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3cd expref: 14 pid: 9586 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746147215.368029:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311516032:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147215.368323:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9182 00000100:00100000:0.0:1746147215.368331:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310466816:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147215.368343:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147215.368362:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425063353 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3cd expref: 14 pid: 9586 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746147215.368373:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425063353 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3cd expref: 14 pid: 9586 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746147215.368393:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984ef800/0x3139939425063353 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3cd expref: 14 pid: 9586 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746147215.368406:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147215.368471:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310466816:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 140us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.368809:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9182 00000001:00080000:3.0:1746147215.368886:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937419 is committed 00000004:00080000:3.0:1746147215.368892:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1302 committed 00000004:00080000:3.0:1746147215.368901:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1314 committed 00000004:00080000:3.0:1746147215.369105:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1313 committed 00000004:00080000:3.0:1746147215.369108:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1312 committed 00000004:00080000:3.0:1746147215.369110:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1311 committed 00000004:00080000:3.0:1746147215.369111:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1301 committed 00000004:00080000:3.0:1746147215.369113:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1310 committed 00000004:00080000:3.0:1746147215.369114:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1300 committed 00000004:00080000:3.0:1746147215.369116:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1309 committed 00000004:00080000:3.0:1746147215.369117:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1299 committed 00000004:00080000:3.0:1746147215.369118:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1298 committed 00000004:00080000:3.0:1746147215.369120:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1297 committed 00000004:00080000:3.0:1746147215.369121:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1308 committed 00000004:00080000:3.0:1746147215.369123:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1307 committed 00000004:00080000:3.0:1746147215.369125:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1296 committed 00000004:00080000:3.0:1746147215.369126:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1295 committed 00000004:00080000:3.0:1746147215.369128:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1306 committed 00000100:00100000:2.0:1746147215.369240:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311516416:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147215.369280:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.369350:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311516544:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147215.369477:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311516928:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147215.369493:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147215.369505:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746147215.369509:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311516800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147215.369523:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147215.369545:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311516416 00000100:00100000:2.0:1746147215.369548:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311516416 00000100:00100000:2.0:1746147215.369582:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311516928 00000100:00100000:2.0:1746147215.369584:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311516928 00000100:00100000:2.0:1746147215.369597:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20213 00000100:00100000:2.0:1746147215.369601:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3765:x1830967311516416:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147215.369722:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147215.369724:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147214 -> 1746147214 00002000:00010000:2.0:1746147215.369726:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:2.0:1746147215.369728:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147214 -> 1746147214 00002000:00010000:2.0:1746147215.369730:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746147215.369753:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3765:x1830967311516416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 151us (472us total) trans 17179875310 rc 0/0 00000100:00100000:2.0:1746147215.369761:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20213 00000100:00100000:2.0:1746147215.369770:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311516800 00000100:00100000:2.0:1746147215.369772:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311516800 00000100:00100000:2.0:1746147215.369783:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20214 00000100:00100000:2.0:1746147215.369787:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3765:x1830967311516928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147215.369821:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147215.369823:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147215.369825:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147215.369827:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147215.369828:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:2.0:1746147215.369844:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3765:x1830967311516928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (349us total) trans 17179875311 rc 0/0 00000100:00100000:2.0:1746147215.369848:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20214 00000100:00100000:2.0:1746147215.369857:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20215 00000100:00100000:2.0:1746147215.369861:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3765:x1830967311516800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147215.369893:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147215.369895:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147214 -> 1746147214 00002000:00010000:2.0:1746147215.369897:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147212 -> 1746147212 00002000:00010000:2.0:1746147215.369899:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147214 -> 1746147214 00002000:00010000:2.0:1746147215.369900:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746147215.369915:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3765:x1830967311516800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (392us total) trans 17179875312 rc 0/0 00000100:00100000:2.0:1746147215.369920:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20215 00000100:00100000:2.0:1746147215.369938:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311516672:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147215.369957:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147215.370234:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311516672 00000100:00100000:1.0:1746147215.370237:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311516672 00000100:00100000:1.0:1746147215.370253:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20216 00000100:00100000:1.0:1746147215.370257:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+68:3767:x1830967311516672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147215.370313:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147215.370315:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147210 -> 1746147210 00002000:00010000:1.0:1746147215.370317:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147210 -> 1746147210 00002000:00010000:1.0:1746147215.370319:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147211 -> 1746147211 00002000:00010000:1.0:1746147215.370320:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:1.0:1746147215.370352:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+69:3767:x1830967311516672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (394us total) trans 21474842702 rc 0/0 00000100:00100000:1.0:1746147215.370357:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20216 00010000:00010000:0.0:1746147215.370689:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f444 expref: 10 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.370700:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147215.370703:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746147215.370707:0:7237:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x3139939425063472 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f44b expref: 26 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.370715:0:7237:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x3139939425063472 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f44b expref: 26 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.370721:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x3139939425063472 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f44b expref: 26 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.370727:0:7237:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063479 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f452 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.370732:0:7237:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063479 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f452 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.370736:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063479 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f452 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.370755:0:7237:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063479 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f452 expref: 10 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.370763:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311518464:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147215.370811:0:7237:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x3139939425063472 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f44b expref: 26 pid: 6215 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.370817:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311518592:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147215.370829:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.370959:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.370972:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310466944 00000100:00100000:0.0:1746147215.370975:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310466944 00010000:00010000:0.0:1746147215.370990:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009844aa00/0x313993942506341e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f41a expref: 9 pid: 17600 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746147215.371004:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9183 00000100:00100000:0.0:1746147215.371008:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967310466944:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147215.371015:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147215.371024:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009844aa00/0x313993942506341e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f41a expref: 9 pid: 17600 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746147215.371038:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009844aa00/0x313993942506341e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f41a expref: 9 pid: 17600 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746147215.371056:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147215.371076:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967310466944:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 66us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.371081:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9183 00000100:00100000:3.0:1746147215.371212:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.371233:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311517056:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.371254:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.371263:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311517568:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.371281:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.371291:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311518080:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.371306:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.371316:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1746147215.371320:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311517184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.371331:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.371340:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311517696:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.371351:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.371359:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311518208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.371372:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.371388:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311516544 00000100:00100000:3.0:1746147215.371391:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311516544 00000100:00100000:3.0:1746147215.371408:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20217 00000100:00100000:3.0:1746147215.371413:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3766:x1830967311516544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147215.371469:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147215.371471:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147212 -> 1746147212 00002000:00010000:3.0:1746147215.371473:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147213 -> 1746147213 00002000:00010000:3.0:1746147215.371475:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147212 -> 1746147212 00002000:00010000:3.0:1746147215.371477:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746147215.371498:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3766:x1830967311516544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (286us total) trans 17179875313 rc 0/0 00000100:00100000:3.0:1746147215.371503:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20217 00000100:00100000:3.0:1746147215.371512:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311517056 00000100:00100000:3.0:1746147215.371514:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311517056 00000100:00100000:3.0:1746147215.371525:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311517568 00000100:00100000:3.0:1746147215.371527:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311517568 00000100:00100000:3.0:1746147215.371537:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311518080 00000100:00100000:3.0:1746147215.371539:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311518080 00000100:00100000:3.0:1746147215.371546:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311517184 00000100:00100000:3.0:1746147215.371548:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311517184 00000100:00100000:3.0:1746147215.371554:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311517696 00000100:00100000:3.0:1746147215.371555:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311517696 00000100:00100000:3.0:1746147215.371561:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311518208 00000100:00100000:3.0:1746147215.371562:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311518208 00000100:00100000:3.0:1746147215.371579:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20218 00000100:00100000:3.0:1746147215.371583:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3766:x1830967311517056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.371635:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3766:x1830967311517056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (379us total) trans 17179875314 rc 0/0 00000100:00100000:3.0:1746147215.371640:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20218 00000100:00100000:3.0:1746147215.371650:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20219 00000100:00100000:3.0:1746147215.371653:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+71:3766:x1830967311517568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.371709:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+72:3766:x1830967311517568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (426us total) trans 21474842703 rc 0/0 00000100:00100000:3.0:1746147215.371714:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20219 00000100:00100000:3.0:1746147215.371723:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20220 00000100:00100000:3.0:1746147215.371728:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3766:x1830967311518080:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147215.371764:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:3.0:1746147215.371766:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147215.371768:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147215.371770:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147215.371772:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:3.0:1746147215.371787:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3766:x1830967311518080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (480us total) trans 17179875315 rc 0/0 00000100:00100000:3.0:1746147215.371793:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20220 00000100:00100000:3.0:1746147215.371802:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20221 00000100:00100000:3.0:1746147215.371806:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+71:3766:x1830967311517184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147215.371842:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147215.371844:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147214 -> 1746147214 00002000:00010000:3.0:1746147215.371846:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147213 -> 1746147213 00002000:00010000:3.0:1746147215.371848:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147214 -> 1746147214 00002000:00010000:3.0:1746147215.371849:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147215.371865:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+72:3766:x1830967311517184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (533us total) trans 21474842704 rc 0/0 00000100:00100000:3.0:1746147215.371870:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20221 00000100:00100000:3.0:1746147215.371880:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20222 00000100:00100000:3.0:1746147215.371884:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+71:3766:x1830967311517696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.371932:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+72:3766:x1830967311517696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (580us total) trans 21474842705 rc 0/0 00000100:00100000:3.0:1746147215.371937:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20222 00000100:00100000:3.0:1746147215.371945:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20223 00000100:00100000:3.0:1746147215.371948:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3766:x1830967311518208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.371992:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3766:x1830967311518208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (619us total) trans 17179875316 rc 0/0 00000100:00100000:3.0:1746147215.371996:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20223 00000004:00080000:3.0:1746147215.372031:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d75880/2, rc 0, transno 21474842704 00000100:00100000:3.0:1746147215.372039:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311517184:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147215.372045:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d74a80/2, rc 0, transno 21474842705 00000100:00100000:3.0:1746147215.372049:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311517696:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147215.372055:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258e680/2, rc 0, transno 17179875316 00000100:00100000:3.0:1746147215.372057:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311518208:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147215.372062:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f56a00/2, rc 0, transno 17179875314 00000100:00100000:3.0:1746147215.372064:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311517056:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147215.372068:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d76680/2, rc 0, transno 21474842703 00000100:00100000:3.0:1746147215.372070:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311517568:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147215.372074:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f57100/2, rc 0, transno 17179875315 00000100:00100000:3.0:1746147215.372076:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311518080:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147215.372081:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095063800/2, rc 0, transno 17179875313 00000100:00100000:3.0:1746147215.372083:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311516544:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746147215.372121:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009844aa00/0x313993942506341e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f41a expref: 8 pid: 17600 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746147215.372132:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311516160:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147215.372141:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311516288:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.372164:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db80600/0x3139939425063487 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f460 expref: 12 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.372173:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80600, rc 0) 00000100:00100000:3.0:1746147215.372192:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2959:x1830967310466688:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 6922us (7181us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.372197:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20212 00000100:00100000:3.0:1746147215.372310:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311517312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.372324:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.372334:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311517824:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.372344:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.372350:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311518336:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.372359:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.372368:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746147215.372371:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311517440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.372381:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.372387:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311517952:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.372396:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147215.372407:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311517312 00000100:00100000:3.0:1746147215.372409:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311517312 00000100:00100000:3.0:1746147215.372421:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311517824 00000100:00100000:3.0:1746147215.372423:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311517824 00000100:00100000:3.0:1746147215.372428:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311518336 00000100:00100000:3.0:1746147215.372429:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311518336 00000100:00100000:3.0:1746147215.372434:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311517440 00000100:00100000:3.0:1746147215.372435:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311517440 00000100:00100000:3.0:1746147215.372439:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311517952 00000100:00100000:3.0:1746147215.372440:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311517952 00000100:00100000:3.0:1746147215.372446:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20224 00000100:00100000:3.0:1746147215.372449:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+75:3764:x1830967311517312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147215.372487:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:3.0:1746147215.372490:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147214 -> 1746147214 00002000:00010000:3.0:1746147215.372492:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147214 -> 1746147214 00002000:00010000:3.0:1746147215.372494:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147214 -> 1746147214 00002000:00010000:3.0:1746147215.372495:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:3.0:1746147215.372515:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:3764:x1830967311517312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (190us total) trans 21474842706 rc 0/0 00000100:00100000:3.0:1746147215.372520:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20224 00000100:00100000:3.0:1746147215.372528:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20225 00000100:00100000:3.0:1746147215.372532:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+75:3764:x1830967311517824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147215.372577:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147215.372580:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147215.372581:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147215.372583:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147215.372584:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:3.0:1746147215.372601:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:3764:x1830967311517824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (256us total) trans 21474842707 rc 0/0 00000100:00100000:3.0:1746147215.372606:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20225 00000100:00100000:3.0:1746147215.372615:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20226 00000100:00100000:3.0:1746147215.372618:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3764:x1830967311518336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147215.372666:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3764:x1830967311518336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (305us total) trans 17179875317 rc 0/0 00000100:00100000:3.0:1746147215.372671:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20226 00000100:00100000:3.0:1746147215.372679:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20227 00000100:00100000:3.0:1746147215.372683:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+75:3764:x1830967311517440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147215.372719:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746147215.372721:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147215.372722:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147215.372724:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147215.372725:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:3.0:1746147215.372741:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:3764:x1830967311517440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (359us total) trans 21474842708 rc 0/0 00000100:00100000:3.0:1746147215.372746:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20227 00000100:00100000:3.0:1746147215.372753:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20228 00000100:00100000:3.0:1746147215.372757:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+75:3764:x1830967311517952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147215.372790:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:3.0:1746147215.372792:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147215.372794:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147215.372795:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147215.372797:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:3.0:1746147215.372812:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:3764:x1830967311517952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (414us total) trans 21474842709 rc 0/0 00000100:00100000:3.0:1746147215.372817:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20228 00000004:00080000:3.0:1746147215.372840:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d75180/2, rc 0, transno 21474842708 00000100:00100000:3.0:1746147215.372843:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311517440:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147215.372849:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d74700/2, rc 0, transno 21474842709 00000100:00100000:3.0:1746147215.372851:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311517952:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147215.372856:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d75c00/2, rc 0, transno 21474842706 00000100:00100000:3.0:1746147215.372859:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311517312:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147215.372864:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d75f80/2, rc 0, transno 21474842707 00000100:00100000:3.0:1746147215.372866:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311517824:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147215.372871:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3cc700/2, rc 0, transno 17179875317 00000100:00100000:3.0:1746147215.372874:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311518336:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147215.372959:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d77b80/2, rc 0, transno 21474842702 00000100:00100000:2.0:1746147215.372963:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311516672:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147215.372988:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095060a80/2, rc 0, transno 17179875312 00000100:00100000:2.0:1746147215.372991:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311516800:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147215.372997:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f084a80/2, rc 0, transno 17179875311 00000100:00100000:2.0:1746147215.372999:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311516928:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147215.373006:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800947e7480/2, rc 0, transno 17179875310 00000100:00100000:2.0:1746147215.373008:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311516416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147215.373994:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.374040:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311518464:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147215.374043:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311518720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147215.374072:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147215.374102:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.374120:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311518720 00000100:00100000:0.0:1746147215.374124:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311518720 00000100:00100000:1.0:1746147215.374158:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310467072 00000100:00100000:1.0:1746147215.374161:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310467072 00010000:00010000:1.0:1746147215.374180:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093730c00/0x31399394250632ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f372 expref: 26 pid: 1136 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746147215.374186:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310467200 00000100:00100000:2.0:1746147215.374190:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310467200 00000100:00100000:1.0:1746147215.374201:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9184 00000100:00100000:1.0:1746147215.374206:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2002:x1830967310467072:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147215.374216:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746147215.374222:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6179 00000100:00100000:2.0:1746147215.374227:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2969:x1830967310467200:12345-192.168.204.25@tcp:49:cat.0 00010000:00010000:1.0:1746147215.374228:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093730c00/0x31399394250632ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f372 expref: 26 pid: 1136 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.374239:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093730c00/0x31399394250632ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f372 expref: 26 pid: 1136 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.374259:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093730c00/0x31399394250632ea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f372 expref: 26 pid: 1136 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.374272:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.374274:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.374281:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db80600/0x3139939425063487 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f460 expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.374288:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80600/0x3139939425063487 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f460 expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.374302:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2969:x1830967310467200:12345-192.168.204.25@tcp:49:cat.0 Request processed in 75us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.374308:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6179 00010000:00010000:1.0:1746147215.374310:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011db80600/0x3139939425063487 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f460 expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147215.374320:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311518848:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147215.374357:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc540 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.375715:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20229 00000100:00100000:0.0:1746147215.375724:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+76:3765:x1830967311518720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147215.375884:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+77:3765:x1830967311518720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 162us (1810us total) trans 21474842710 rc 0/0 00000100:00100000:0.0:1746147215.375891:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20229 00000100:00100000:0.0:1746147215.375968:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311518592:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147215.376005:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4000/0x313993942506345d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f444 expref: 10 pid: 7237 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746147215.376023:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f444 expref: 9 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.376045:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a49c4800, rc 0) 00000004:00080000:3.0:1746147215.376162:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d75500/2, rc 0, transno 21474842710 00000100:00100000:3.0:1746147215.376167:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311518720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147215.378031:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2966:x1830967310464128:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 50469us (52935us total) trans 8589937419 rc 0/0 00000100:00100000:0.0:1746147215.378041:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16514 00000100:00100000:0.0:1746147215.378174:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.378234:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310467328 00000100:00100000:2.0:1746147215.378241:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310467328 00000100:00100000:0.0:1746147215.378278:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.378281:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6180 00000100:00100000:2.0:1746147215.378287:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2964:x1830967310467328:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:0.0:1746147215.378289:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310467456 00000100:00100000:0.0:1746147215.378291:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310467456 00000100:00100000:0.0:1746147215.378308:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16517 00000100:00100000:0.0:1746147215.378313:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2971:x1830967310467456:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147215.378321:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147215.378338:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c87200/0x313993942506348e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f467 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.378370:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c87200/0x313993942506348e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f467 expref: 29 pid: 7237 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.378430:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2964:x1830967310467328:12345-192.168.204.25@tcp:49:cat.0 Request processed in 143us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.378436:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6180 00000100:00100000:1.0:1746147215.378477:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311518848:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147215.378493:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147215.378511:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310467072:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4305us (4521us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.378519:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9184 00000100:00100000:1.0:1746147215.378604:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.378643:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310467584 00000100:00100000:2.0:1746147215.378646:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310467584 00000100:00100000:2.0:1746147215.378676:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20230 00000100:00100000:2.0:1746147215.378681:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2959:x1830967310467584:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147215.378689:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.378703:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0a00/0x3139939425063495 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f46e expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.378714:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c87200/0x313993942506348e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f467 expref: 28 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.378721:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x313993942506330d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f395 expref: 34 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.378728:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147215.378729:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x313993942506343a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f421 expref: 18 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.378731:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147215.378733:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c87200, rc 0) 00010000:00010000:2.0:1746147215.378735:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x313993942506335a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3d4 expref: 18 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.378741:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.378743:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.378746:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0a00/0x3139939425063495 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f46e expref: 18 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.378773:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x313993942506335a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3d4 expref: 18 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.378825:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x313993942506335a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3d4 expref: 18 pid: 1853 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746147215.378836:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311518976:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147215.380270:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2971:x1830967310467456:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1946us (1981us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.380277:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16517 00010000:00010000:2.0:1746147215.380890:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x313993942506343a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f421 expref: 18 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.380903:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x313993942506343a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f421 expref: 18 pid: 1136 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746147215.380915:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311519104:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.381217:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x313993942506330d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f395 expref: 34 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.381231:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x313993942506330d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f395 expref: 34 pid: 9584 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746147215.381240:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311519232:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.381272:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f206c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.384194:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.384410:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311518976:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.384422:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311519104:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147215.384495:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310467712 00000100:00100000:3.0:1746147215.384502:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310467712 00000100:00100000:3.0:1746147215.384660:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20231 00000100:00100000:3.0:1746147215.384668:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2969:x1830967310467712:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147215.384684:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.384701:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x313993942506349c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f475 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.384728:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425063480 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f459 expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.384735:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147215.384736:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147215.384740:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x313993942506349c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f475 expref: 9 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.384768:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425063480 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f459 expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.384777:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425063480 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f459 expref: 11 pid: 10340 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.384788:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311519360:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147215.385578:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.385597:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.386495:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.386519:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.386605:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310467968 00000100:00100000:1.0:1746147215.386611:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310467968 00010000:00010000:1.0:1746147215.386641:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x313993942506343a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f421 expref: 19 pid: 1136 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.386663:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310467840 00000100:00100000:1.0:1746147215.386665:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310467840 00010000:00010000:1.0:1746147215.386675:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x313993942506335a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3d4 expref: 19 pid: 1853 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.386687:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310468096 00000100:00100000:1.0:1746147215.386689:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310468096 00000100:00100000:1.0:1746147215.386707:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9185 00000100:00100000:1.0:1746147215.386714:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2002:x1830967310467968:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147215.386724:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147215.386745:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x313993942506343a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f421 expref: 19 pid: 1136 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.386760:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x313993942506343a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f421 expref: 19 pid: 1136 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.386779:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e5c7800/0x313993942506343a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f421 expref: 19 pid: 1136 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.386794:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147215.386825:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310467968:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 111us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.386831:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9185 00000100:00100000:1.0:1746147215.386844:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9186 00000100:00100000:1.0:1746147215.386848:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2002:x1830967310467840:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147215.386855:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147215.386861:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x313993942506335a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3d4 expref: 19 pid: 1853 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.386867:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x313993942506335a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3d4 expref: 19 pid: 1853 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.386878:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984eee00/0x313993942506335a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3d4 expref: 19 pid: 1853 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.386884:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147215.386895:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2002:x1830967310467840:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 47us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.386903:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9186 00000100:00100000:1.0:1746147215.386910:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1005 00000100:00100000:1.0:1746147215.386914:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967310468096:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147215.386920:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147215.386933:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c87200/0x313993942506348e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f467 expref: 28 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.386943:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147215.386946:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147215.386954:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967310468096:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 41us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.386959:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1005 00000100:00100000:2.0:1746147215.387033:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311519232:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.387067:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0a00/0x3139939425063495 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f46e expref: 17 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.387076:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a0a00, rc 0) 00000100:00100000:2.0:1746147215.387115:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2959:x1830967310467584:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 8434us (8512us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.387121:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20230 00000100:00100000:0.0:1746147215.389735:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.389902:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311519360:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.389934:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x313993942506349c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f475 expref: 9 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.389951:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a31e00, rc 0) 00000100:00100000:3.0:1746147215.389997:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2969:x1830967310467712:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5330us (5813us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.390005:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20231 00000100:00100000:3.0:1746147215.390029:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310468352 00000100:00100000:3.0:1746147215.390034:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310468352 00000100:00100000:3.0:1746147215.390057:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20232 00000100:00100000:3.0:1746147215.390063:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2966:x1830967310468352:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147215.390077:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.390110:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f47c expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.390133:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x313993942506331b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f39c expref: 34 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.390141:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x313993942506342c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f428 expref: 19 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.390148:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984efe00/0x3139939425063368 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3db expref: 16 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.390154:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.390155:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.390160:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3104768->3145727] (req 3104768->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 19 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.390186:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984efe00/0x3139939425063368 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3db expref: 16 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.390196:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984efe00/0x3139939425063368 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3db expref: 16 pid: 13712 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746147215.390208:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311519488:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.390266:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x313993942506342c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f428 expref: 19 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.390273:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x313993942506342c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f428 expref: 19 pid: 17600 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746147215.390280:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311519616:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.390302:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x313993942506331b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f39c expref: 34 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.390310:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x313993942506331b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f39c expref: 34 pid: 9586 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746147215.390316:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311519744:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147215.390329:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.390383:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.390403:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310468224 00000100:00100000:0.0:1746147215.390406:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310468224 00010000:00010000:0.0:1746147215.390422:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x313993942506330d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f395 expref: 35 pid: 9584 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746147215.390437:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9187 00000100:00100000:0.0:1746147215.390442:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967310468224:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147215.390449:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147215.390468:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x313993942506330d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f395 expref: 35 pid: 9584 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746147215.390482:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x313993942506330d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f395 expref: 35 pid: 9584 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746147215.390499:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x313993942506330d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f395 expref: 35 pid: 9584 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746147215.390511:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.390512:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.390518:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0a00/0x3139939425063495 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f46e expref: 16 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.390525:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0a00/0x3139939425063495 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f46e expref: 16 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.390543:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0a00/0x3139939425063495 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f46e expref: 16 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.390551:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094187480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311519872:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147215.390582:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.393286:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.393364:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.393654:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094187480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311519872:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147215.393676:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147215.393677:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310468480 00000100:00100000:2.0:1746147215.393685:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310468480 00010000:00010000:2.0:1746147215.393723:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984efe00/0x3139939425063368 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3db expref: 17 pid: 13712 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.393727:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967310468224:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3283us (3342us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.393735:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9187 00000100:00100000:2.0:1746147215.393751:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9188 00000100:00100000:2.0:1746147215.393757:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310468480:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.393766:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147215.393768:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310468736 00000100:00100000:1.0:1746147215.393771:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310468736 00010000:00010000:2.0:1746147215.393786:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984efe00/0x3139939425063368 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3db expref: 18 pid: 13712 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.393792:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20233 00010000:00010000:2.0:1746147215.393797:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984efe00/0x3139939425063368 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3db expref: 18 pid: 13712 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.393797:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2959:x1830967310468736:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147215.393812:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.393820:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147215.393824:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x31399394250634aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f483 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.393841:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310468480:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 84us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.393846:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9188 00010000:00010000:1.0:1746147215.393853:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.393858:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [3104768->3145727] (req 3104768->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 19 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.393864:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147215.393867:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x31399394250634aa lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f483 expref: 18 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.393934:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984efe00/0x3139939425063368 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3db expref: 18 pid: 13712 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746147215.393949:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311519488:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147215.393959:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311519616:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147215.393967:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311519744:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.393996:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3104768->3145727] (req 3104768->3145727) gid 0 flags: 0x40000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 19 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.394005:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a30400, rc 0) 00000100:00100000:3.0:1746147215.394025:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2966:x1830967310468352:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3962us (4299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.394030:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20232 00010000:00010000:1.0:1746147215.394086:0:12225:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3104768->3145727] (req 3104768->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 18 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.394117:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x31399394250634aa lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f483 expref: 17 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.394125:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38c200, rc 0) 00000100:00100000:1.0:1746147215.394141:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2959:x1830967310468736:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 344us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.394146:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20233 00000100:00100000:0.0:1746147215.395184:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.395225:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.395264:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310468864 00000100:00100000:2.0:1746147215.395268:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310468864 00000100:00100000:3.0:1746147215.395281:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310468608 00000100:00100000:3.0:1746147215.395284:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310468608 00010000:00010000:2.0:1746147215.395284:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x313993942506342c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f428 expref: 19 pid: 17600 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.395294:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x313993942506331b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f39c expref: 34 pid: 9586 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746147215.395409:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.395447:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9189 00000100:00100000:2.0:1746147215.395454:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310468864:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.395462:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.395473:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x313993942506342c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f428 expref: 19 pid: 17600 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746147215.395482:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x313993942506342c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f428 expref: 19 pid: 17600 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746147215.395497:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009844b600/0x313993942506342c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f428 expref: 19 pid: 17600 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746147215.395510:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147215.395528:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310468864:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 75us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.395533:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9189 00000100:00100000:2.0:1746147215.395586:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9190 00000100:00100000:2.0:1746147215.395590:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967310468608:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.395599:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.395605:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x313993942506331b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f39c expref: 34 pid: 9586 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746147215.395615:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x313993942506331b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f39c expref: 34 pid: 9586 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746147215.395626:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091e31c00/0x313993942506331b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f39c expref: 34 pid: 9586 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746147215.395633:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.395635:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.395641:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 17 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.395649:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 17 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.395671:0:7225:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 17 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147215.395841:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310468992 00000100:00100000:1.0:1746147215.395845:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310468992 00000100:00100000:1.0:1746147215.395863:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20234 00000100:00100000:1.0:1746147215.395867:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2971:x1830967310468992:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147215.395877:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.395887:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f48a expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.395961:0:7225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 17 pid: 9584 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.395975:0:7225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311520128:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147215.396017:0:7225:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20b40 going to sleep for 11 seconds 00010000:00010000:1.0:1746147215.396421:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147215.396426:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x31399394250634aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f483 expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.396432:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746147215.396440:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3514368->3567615] (req 3514368->3567615) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.396466:0:12225:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x31399394250634aa lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f483 expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.396479:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3514368->3567615] (req 3514368->3567615) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.396486:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38c800, rc 0) 00000100:00100000:1.0:1746147215.396504:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2971:x1830967310468992:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 636us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.396509:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20234 00000100:00100000:2.0:1746147215.396639:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.396721:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310469248 00000100:00100000:3.0:1746147215.396725:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310469248 00002000:00100000:3.0:1746147215.396753:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3145727) req@ffff88009514b800 x1830967310469248/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.396762:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514b800 with x1830967310469248 ext(2097152->3145727) 00002000:00010000:3.0:1746147215.396766:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009514b800 00000100:00100000:3.0:1746147215.396780:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7430 00000100:00100000:3.0:1746147215.396786:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310469248:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147215.404978:0:7225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7225:1830967311520128:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147215.404981:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147215.405003:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147215.405047:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310469504 00000100:00100000:1.0:1746147215.405056:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310469504 00000100:00100000:2.0:1746147215.405069:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2001:x1830967310468608:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 9476us (9841us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.405078:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9190 00002000:00100000:1.0:1746147215.405129:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (3104768->3108863) req@ffff880094185c00 x1830967310469504/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.405148:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094185c00 with x1830967310469504 ext(3104768->3108863) 00010000:00010000:1.0:1746147215.405158:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 18 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.405175:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 18 pid: 9584 timeout: 853 lvb_type: 0 00002000:00010000:1.0:1746147215.405181:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094185c00 00000100:00100000:1.0:1746147215.405207:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1752 00000100:00100000:1.0:1746147215.405213:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310469504:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147215.405352:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310469504:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 138us (374us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147215.405359:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1752 00002000:00100000:1.0:1746147215.405364:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (3104768->3108863) req@ffff880094185c00 x1830967310469504/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/4536 e 0 to 0 dl 1746147226 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.405371:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094185c00 with x1830967310469504 ext(3104768->3108863) 00010000:00010000:1.0:1746147215.405377:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 18 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.405385:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 18 pid: 9584 timeout: 853 lvb_type: 0 00002000:00010000:1.0:1746147215.405390:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094185c00 00000100:00100000:3.0:1746147215.407069:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310469248:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 9885us (10032us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147215.407082:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7430 00002000:00100000:3.0:1746147215.407119:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3145727) req@ffff88009514b800 x1830967310469248/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.407128:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514b800 with x1830967310469248 ext(2097152->3145727) 00002000:00010000:3.0:1746147215.407133:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009514b800 00000100:00100000:0.0:1746147215.411777:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.411828:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.411919:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.412335:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310469888 00000100:00100000:2.0:1746147215.412339:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310470016 00000100:00100000:2.0:1746147215.412346:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310470016 00000100:00100000:1.0:1746147215.412346:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310469888 00000100:00100000:2.0:1746147215.412392:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20235 00000100:00100000:2.0:1746147215.412399:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2964:x1830967310470016:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.412419:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746147215.412424:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310469760 00000100:00100000:3.0:1746147215.412428:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310469760 00002000:00100000:3.0:1746147215.412461:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3104768->3145727) req@ffff880094185f80 x1830967310469760/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.412471:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094185f80 with x1830967310469760 ext(3104768->3145727) 00010000:00010000:3.0:1746147215.412481:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 18 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.412492:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 18 pid: 9584 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746147215.412499:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094185f80 00000100:00100000:3.0:1746147215.412526:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1753 00000100:00100000:3.0:1746147215.412532:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310469760:12345-192.168.204.25@tcp:4:multiop.0 00010000:00010000:2.0:1746147215.412678:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800982a3e00/0x31399394250634b8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f498 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.412704:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147215.412710:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3514368->3567615] (req 3514368->3567615) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.412716:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746147215.412720:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800982a3e00/0x31399394250634b8 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f498 expref: 35 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.412756:0:9584:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3514368->3567615] (req 3514368->3567615) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 35 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.412768:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800982a3e00/0x31399394250634b8 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f498 expref: 35 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.412778:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982a3e00, rc 0) 00000100:00100000:2.0:1746147215.412804:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2964:x1830967310470016:12345-192.168.204.25@tcp:101:cat.0 Request processed in 405us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.412810:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20235 00000100:00100000:2.0:1746147215.413355:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20236 00000100:00100000:2.0:1746147215.413363:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2966:x1830967310469888:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147215.413371:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.413382:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f491 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.413397:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x3139939425063314 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3a3 expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.413405:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x3139939425063441 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f42f expref: 10 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.413412:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425063361 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3e2 expref: 11 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.413417:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.413419:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.413421:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->2408447] (req 2097152->2408447) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 10 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.413436:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425063361 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3e2 expref: 11 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.413445:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425063361 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3e2 expref: 11 pid: 1136 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746147215.413455:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311520512:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.413521:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x3139939425063441 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f42f expref: 10 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.413528:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x3139939425063441 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f42f expref: 10 pid: 17600 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746147215.413535:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311520640:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.413793:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x3139939425063314 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3a3 expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.413802:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x3139939425063314 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3a3 expref: 24 pid: 9584 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746147215.413810:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311520768:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.413830:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147215.415317:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310469760:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 2778us (3543us total) trans 21474842711 rc 0/0 00000100:00100000:3.0:1746147215.415327:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1753 00002000:00100000:3.0:1746147215.415337:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3104768->3145727) req@ffff880094185f80 x1830967310469760/t21474842711(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/448 e 0 to 0 dl 1746147226 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.415347:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094185f80 with x1830967310469760 ext(3104768->3145727) 00010000:00010000:3.0:1746147215.415355:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 20 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.415365:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 20 pid: 9584 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746147215.415371:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094185f80 00000100:00100000:2.0:1746147215.417898:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311520512:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.417913:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311520640:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.417921:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311520768:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.417958:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [2097152->2408447] (req 2097152->2408447) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 10 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.417975:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982a3200, rc 0) 00000100:00100000:2.0:1746147215.418030:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2966:x1830967310469888:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4667us (6200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.418039:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20236 00000100:00100000:0.0:1746147215.418446:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.418656:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310470144 00000100:00100000:2.0:1746147215.418662:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310470144 00010000:00010000:2.0:1746147215.418689:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x3139939425063441 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f42f expref: 10 pid: 17600 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746147215.418722:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9191 00000100:00100000:2.0:1746147215.418729:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310470144:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.418742:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.418760:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x3139939425063441 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f42f expref: 10 pid: 17600 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746147215.418769:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x3139939425063441 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f42f expref: 10 pid: 17600 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746147215.418790:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009844b000/0x3139939425063441 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f42f expref: 10 pid: 17600 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746147215.418818:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147215.418905:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.418930:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.419073:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310470400 00000100:00100000:3.0:1746147215.419077:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310470400 00010000:00010000:3.0:1746147215.419119:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x3139939425063314 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3a3 expref: 25 pid: 9584 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746147215.419136:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310470272 00000100:00100000:3.0:1746147215.419138:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310470272 00010000:00010000:3.0:1746147215.419149:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425063361 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3e2 expref: 12 pid: 1136 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746147215.419174:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9192 00000100:00100000:3.0:1746147215.419179:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310470400:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.419186:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147215.419190:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9193 00010000:00010000:3.0:1746147215.419195:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x3139939425063314 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3a3 expref: 25 pid: 9584 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746147215.419197:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310470272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.419203:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x3139939425063314 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3a3 expref: 25 pid: 9584 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.419204:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147215.419211:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425063361 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3e2 expref: 12 pid: 1136 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.419216:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e05000/0x3139939425063314 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3a3 expref: 25 pid: 9584 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746147215.419219:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425063361 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3e2 expref: 12 pid: 1136 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.419230:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.419230:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093731e00/0x3139939425063361 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f3e2 expref: 12 pid: 1136 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746147215.419232:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.419238:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 9 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.419245:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 9 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.419415:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.419428:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310470528 00000100:00100000:0.0:1746147215.419431:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310470528 00010000:00010000:0.0:1746147215.419447:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 20 pid: 9584 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746147215.419464:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9194 00000100:00100000:0.0:1746147215.419469:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2003:x1830967310470528:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147215.419477:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746147215.419489:0:4349:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147214 -> 1746147215 00002000:00010000:0.0:1746147215.419492:0:4349:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147214 -> 1746147215 00010000:00010000:0.0:1746147215.419495:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 20 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.419503:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 20 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.419516:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x31399394250634a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f47c expref: 20 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.419530:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.419531:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.419536:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x31399394250634aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f483 expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.419547:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x31399394250634aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f483 expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.419713:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310470144:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 109us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.419722:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9191 00010000:00010000:1.0:1746147215.419813:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147215.419858:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310470272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 661us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.419865:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9193 00010000:00010000:3.0:1746147215.419929:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 8 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.419947:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311520896:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147215.420057:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x31399394250634aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f483 expref: 16 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.420066:0:4349:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x31399394250634aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f483 expref: 16 pid: 12225 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746147215.420074:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769ad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311521024:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147215.420249:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.420580:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147215.422394:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311520896:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147215.422414:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147215.422452:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310470400:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3272us (3546us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.422462:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9192 00000100:00100000:0.0:1746147215.422607:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769ad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311521024:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147215.422621:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147215.422637:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2003:x1830967310470528:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3168us (3222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.422643:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9194 00000100:00100000:1.0:1746147215.422895:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.422938:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310470656 00000100:00100000:2.0:1746147215.422944:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310470656 00000100:00100000:2.0:1746147215.422973:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20237 00000100:00100000:2.0:1746147215.422980:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2959:x1830967310470656:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147215.422996:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.423012:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982a2200/0x31399394250634c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f49f expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.423040:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 8 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.423047:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147215.423049:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147215.423053:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a2200/0x31399394250634c6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f49f expref: 12 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.423081:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 8 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.423108:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 8 pid: 9584 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.423120:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311521152:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.423247:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.424255:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311521152:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.424272:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800982a2200/0x31399394250634c6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f49f expref: 12 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.424289:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982a2200, rc 0) 00000100:00100000:2.0:1746147215.424328:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2959:x1830967310470656:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1348us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.424334:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20237 00000100:00100000:0.0:1746147215.425077:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.425177:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310470912 00000100:00100000:3.0:1746147215.425182:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310470912 00002000:00100000:3.0:1746147215.425258:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (2404352->2408447) req@ffff8800769ad180 x1830967310470912/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.425275:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ad180 with x1830967310470912 ext(2404352->2408447) 00010000:00010000:3.0:1746147215.425282:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 9 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.425292:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 9 pid: 9584 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746147215.425298:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800769ad180 00000100:00100000:3.0:1746147215.425325:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1754 00000100:00100000:3.0:1746147215.425331:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310470912:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147215.425471:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310470912:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 139us (395us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147215.425477:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1754 00002000:00100000:3.0:1746147215.425482:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (2404352->2408447) req@ffff8800769ad180 x1830967310470912/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/4536 e 0 to 0 dl 1746147226 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.425489:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ad180 with x1830967310470912 ext(2404352->2408447) 00010000:00010000:3.0:1746147215.425493:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 9 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.425500:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 9 pid: 9584 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746147215.425505:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800769ad180 00000100:00100000:0.0:1746147215.427855:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.427930:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310471296 00000100:00100000:2.0:1746147215.427938:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310471296 00000100:00100000:2.0:1746147215.427999:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6181 00000100:00100000:2.0:1746147215.428007:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f8b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2966:x1830967310471296:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:0.0:1746147215.428262:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.428475:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310471424 00000100:00100000:1.0:1746147215.428480:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310471424 00002000:00100000:1.0:1746147215.428510:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->2408447) req@ffff8800769adc00 x1830967310471424/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.428520:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769adc00 with x1830967310471424 ext(2097152->2408447) 00010000:00010000:1.0:1746147215.428529:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 9 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.428541:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 9 pid: 9584 timeout: 853 lvb_type: 0 00002000:00010000:1.0:1746147215.428553:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800769adc00 00000100:00100000:2.0:1746147215.428784:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f8b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2966:x1830967310471296:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 778us (939us total) trans 8589937420 rc 0/0 00000100:00100000:2.0:1746147215.428795:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6181 00000100:00100000:1.0:1746147215.429347:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1755 00000100:00100000:1.0:1746147215.429355:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310471424:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:1.0:1746147215.435953:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2000:x1830967310471424:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 6585us (7678us total) trans 17179875318 rc 0/0 00000100:00100000:1.0:1746147215.435968:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1755 00002000:00100000:1.0:1746147215.435982:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->2408447) req@ffff8800769adc00 x1830967310471424/t17179875318(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/448 e 0 to 0 dl 1746147226 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.435992:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769adc00 with x1830967310471424 ext(2097152->2408447) 00010000:00010000:1.0:1746147215.436003:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 11 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.436016:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 11 pid: 9584 timeout: 853 lvb_type: 0 00002000:00010000:1.0:1746147215.436024:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800769adc00 00000100:00100000:0.0:1746147215.438201:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.438271:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310471552 00000100:00100000:2.0:1746147215.438281:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310471552 00010000:00010000:2.0:1746147215.438318:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 11 pid: 9584 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.438361:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9195 00000100:00100000:2.0:1746147215.438369:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2003:x1830967310471552:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.438383:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147215.438401:0:4349:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147214 -> 1746147215 00002000:00010000:2.0:1746147215.438404:0:4349:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147214 -> 1746147215 00010000:00010000:2.0:1746147215.438409:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 11 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.438419:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 11 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.438518:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982a3200/0x31399394250634bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f491 expref: 11 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.438548:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.438550:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.438558:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982a2200/0x31399394250634c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f49f expref: 11 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.438612:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a2200/0x31399394250634c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f49f expref: 11 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.438674:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800982a2200/0x31399394250634c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f49f expref: 11 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.438688:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311521280:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147215.438780:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.440302:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311521280:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147215.440321:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147215.440357:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2003:x1830967310471552:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1988us (2164us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.440365:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9195 00000100:00100000:0.0:1746147215.441137:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.441168:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.441193:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.441214:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.441228:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.441237:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310471680 00000100:00100000:2.0:1746147215.441244:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310471680 00000100:00100000:1.0:1746147215.441244:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310471808 00000100:00100000:1.0:1746147215.441249:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310471808 00000100:00100000:0.0:1746147215.441251:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.441275:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20238 00000100:00100000:1.0:1746147215.441282:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310471808:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:2.0:1746147215.441322:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310471936 00000100:00100000:2.0:1746147215.441325:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310471936 00000100:00100000:3.0:1746147215.441334:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310472064 00000100:00100000:3.0:1746147215.441338:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310472064 00000100:00100000:2.0:1746147215.441339:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310472192 00000100:00100000:2.0:1746147215.441340:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310472192 00000100:00100000:2.0:1746147215.441350:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310472320 00000100:00100000:2.0:1746147215.441351:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310472320 00000100:00100000:3.0:1746147215.441358:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20239 00000100:00100000:3.0:1746147215.441363:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310471680:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:2.0:1746147215.441369:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20240 00000100:00100000:2.0:1746147215.441374:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310471936:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:2.0:1746147215.441428:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147215.441429:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147215.441430:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147212 -> 1746147214 00002000:00010000:1.0:1746147215.441432:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147214 -> 1746147214 00002000:00010000:1.0:1746147215.441435:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147210 -> 1746147214 00002000:00010000:3.0:1746147215.441436:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746147215.441437:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147214 -> 1746147215 00002000:00010000:3.0:1746147215.441438:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147210 -> 1746147214 00002000:00010000:1.0:1746147215.441439:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:3.0:1746147215.441440:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147210 -> 1746147214 00002000:00010000:3.0:1746147215.441441:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147211 -> 1746147215 00002000:00010000:3.0:1746147215.441443:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:3.0:1746147215.441467:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967310471680:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 103us (332us total) trans 21474842712 rc 0/0 00000100:00100000:1.0:1746147215.441467:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310471808:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 185us (297us total) trans 17179875319 rc 0/0 00000100:00100000:3.0:1746147215.441473:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20239 00002000:00010000:2.0:1746147215.441548:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147213 -> 1746147214 00002000:00010000:2.0:1746147215.441551:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147212 -> 1746147215 00002000:00010000:2.0:1746147215.441553:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746147215.441576:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20238 00000100:00100000:2.0:1746147215.441585:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310471936:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 210us (390us total) trans 17179875320 rc 0/0 00000100:00100000:2.0:1746147215.441590:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20240 00000100:00100000:1.0:1746147215.441600:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20241 00000100:00100000:1.0:1746147215.441606:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310472192:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147215.441648:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:1.0:1746147215.441651:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147215 -> 1746147214 00002000:00010000:1.0:1746147215.441652:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147214 -> 1746147214 00002000:00010000:1.0:1746147215.441654:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147215 -> 1746147215 00002000:00010000:1.0:1746147215.441656:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:1.0:1746147215.441676:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967310472192:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 70us (446us total) trans 21474842713 rc 0/0 00000100:00100000:1.0:1746147215.441682:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20241 00000100:00100000:2.0:1746147215.441689:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20242 00000100:00100000:1.0:1746147215.441693:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20243 00000100:00100000:2.0:1746147215.441696:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310472064:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:1.0:1746147215.441697:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310472320:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:2.0:1746147215.441737:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147215.441738:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147215.441739:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147214 -> 1746147214 00002000:00010000:1.0:1746147215.441740:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147215 -> 1746147214 00002000:00010000:2.0:1746147215.441741:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147213 -> 1746147214 00002000:00010000:1.0:1746147215.441742:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147212 -> 1746147214 00002000:00010000:2.0:1746147215.441743:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147214 -> 1746147215 00002000:00010000:1.0:1746147215.441743:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147215 -> 1746147215 00002000:00010000:2.0:1746147215.441744:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:1.0:1746147215.441745:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746147215.441761:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967310472064:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 66us (546us total) trans 21474842714 rc 0/0 00000100:00100000:1.0:1746147215.441765:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310472320:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 67us (512us total) trans 17179875321 rc 0/0 00000100:00100000:2.0:1746147215.441767:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20242 00000100:00100000:1.0:1746147215.441771:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20243 00000100:00100000:0.0:1746147215.443686:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.443870:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310472448 00000100:00100000:2.0:1746147215.443877:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310472448 00000100:00100000:0.0:1746147215.443890:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147215.443910:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425063480 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f459 expref: 15 pid: 10340 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.443944:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310472704 00000100:00100000:2.0:1746147215.443947:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310472704 00010000:00010000:2.0:1746147215.443959:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x31399394250634aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f483 expref: 20 pid: 12225 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746147215.443961:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.443974:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9196 00000100:00100000:2.0:1746147215.443980:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310472448:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746147215.443982:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310472576 00000100:00100000:0.0:1746147215.443984:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310472576 00010000:00010000:2.0:1746147215.443992:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.444008:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425063480 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f459 expref: 15 pid: 10340 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746147215.444009:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16518 00000100:00100000:0.0:1746147215.444014:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+6:2959:x1830967310472576:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147215.444024:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425063480 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f459 expref: 15 pid: 10340 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.444034:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.444046:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095052400/0x3139939425063480 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f459 expref: 15 pid: 10340 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.444048:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x31399394250634cd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f4a6 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.444062:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.444064:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.444072:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x313993942506349c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f475 expref: 9 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.444078:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x313993942506349c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f475 expref: 9 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.444116:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x31399394250634cd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4a6 expref: 7 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.444128:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x31399394250634cd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4a6 expref: 7 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.444131:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x313993942506349c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f475 expref: 9 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.444141:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00000100:00100000:2.0:1746147215.444142:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311521408:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147215.444144:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147215.444147:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093709200, rc 0) 00000100:00100000:0.0:1746147215.444178:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2959:x1830967310472576:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 163us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.444183:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16518 00000100:00100000:2.0:1746147215.444200:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147215.444311:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9197 00000100:00100000:1.0:1746147215.444318:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967310472704:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147215.444327:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147215.444339:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x31399394250634aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f483 expref: 20 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.444349:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x31399394250634aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f483 expref: 20 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.444364:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x31399394250634aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f483 expref: 20 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.444382:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.444384:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.444388:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 34 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.444394:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x60080000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 34 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.444414:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 34 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.444426:0:16749:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x70000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 34 pid: 12225 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746147215.444434:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311521536:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147215.444460:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.449001:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.449063:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.449135:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310472832 00000100:00100000:3.0:1746147215.449144:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310472832 00000100:00100000:1.0:1746147215.449266:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311521536:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147215.449289:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147215.449562:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310472704:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5242us (5669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.449583:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9197 00000100:00100000:2.0:1746147215.449585:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311521408:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147215.449598:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147215.449617:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310473088 00000100:00100000:1.0:1746147215.449620:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310473088 00000100:00100000:3.0:1746147215.449636:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20244 00000100:00100000:3.0:1746147215.449644:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2959:x1830967310472832:12345-192.168.204.25@tcp:101:lfs.0 00002000:00100000:1.0:1746147215.449651:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (3514368->3518463) req@ffff880095121880 x1830967310473088/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746147215.449657:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:1.0:1746147215.449660:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095121880 with x1830967310473088 ext(3514368->3518463) 00010000:00010000:1.0:1746147215.449670:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 35 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.449672:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7800/0x31399394250634d4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f4ad expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.449683:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 35 pid: 12225 timeout: 853 lvb_type: 0 00002000:00010000:1.0:1746147215.449690:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095121880 00010000:00010000:3.0:1746147215.449697:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x313993942506349c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f475 expref: 9 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.449703:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746147215.449704:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1756 00010000:00010000:3.0:1746147215.449705:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.449707:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7800/0x31399394250634d4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4ad expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147215.449709:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967310473088:12345-192.168.204.25@tcp:3:multiop.0 00010000:00010000:3.0:1746147215.449739:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x313993942506349c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f475 expref: 9 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.449749:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x313993942506349c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f475 expref: 9 pid: 9584 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.449759:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311521664:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.449802:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310472448:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5821us (6124us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.449809:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9196 00000100:00100000:3.0:1746147215.449810:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b180 going to sleep for 11 seconds 00000100:00100000:1.0:1746147215.449815:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967310473088:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 105us (750us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147215.449821:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1756 00002000:00100000:1.0:1746147215.449826:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (3514368->3518463) req@ffff880095121880 x1830967310473088/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/4536 e 0 to 0 dl 1746147226 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.449839:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095121880 with x1830967310473088 ext(3514368->3518463) 00010000:00010000:1.0:1746147215.449843:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 35 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.449851:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 35 pid: 12225 timeout: 853 lvb_type: 0 00002000:00010000:1.0:1746147215.449856:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095121880 00000100:00100000:0.0:1746147215.452651:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.452850:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311521664:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147215.452853:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310473344 00000100:00100000:1.0:1746147215.452861:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310473344 00010000:00010000:3.0:1746147215.452883:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7800/0x31399394250634d4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4ad expref: 15 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.452901:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e5c7800, rc 0) 00002000:00100000:1.0:1746147215.452904:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880095122300 x1830967310473344/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.452914:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095122300 with x1830967310473344 ext(1048576->2097151) 00010000:00010000:1.0:1746147215.452920:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x313993942506349c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f475 expref: 10 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.452930:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x313993942506349c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f475 expref: 10 pid: 9584 timeout: 853 lvb_type: 0 00002000:00010000:1.0:1746147215.452937:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095122300 00000100:00100000:3.0:1746147215.452946:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2959:x1830967310472832:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3302us (3954us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.452953:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20244 00000100:00100000:1.0:1746147215.452967:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1757 00000100:00100000:1.0:1746147215.452974:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310473344:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147215.453277:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.454152:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310473600 00000100:00100000:0.0:1746147215.454157:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310473600 00002000:00100000:0.0:1746147215.454182:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (3563520->3567615) req@ffff880095123800 x1830967310473600/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147215.454190:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095123800 with x1830967310473600 ext(3563520->3567615) 00010000:00010000:0.0:1746147215.454197:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 35 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.454206:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 35 pid: 12225 timeout: 853 lvb_type: 0 00002000:00010000:0.0:1746147215.454211:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095123800 00000100:00100000:0.0:1746147215.454234:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1758 00000100:00100000:0.0:1746147215.454239:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967310473600:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147215.454332:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967310473600:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 92us (1055us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147215.454337:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1758 00002000:00100000:0.0:1746147215.454342:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (3563520->3567615) req@ffff880095123800 x1830967310473600/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/4536 e 0 to 0 dl 1746147226 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147215.454349:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095123800 with x1830967310473600 ext(3563520->3567615) 00010000:00010000:0.0:1746147215.454353:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 35 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746147215.454360:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 35 pid: 12225 timeout: 853 lvb_type: 0 00002000:00010000:0.0:1746147215.454370:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095123800 00000100:00100000:0.0:1746147215.460680:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.460718:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.460899:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310473984 00000100:00100000:2.0:1746147215.460909:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310473984 00000100:00100000:2.0:1746147215.460957:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6182 00000100:00100000:2.0:1746147215.460965:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2971:x1830967310473984:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147215.461014:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310473344:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 8039us (8371us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147215.461028:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1757 00002000:00100000:1.0:1746147215.461037:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880095122300 x1830967310473344/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.461047:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095122300 with x1830967310473344 ext(1048576->2097151) 00010000:00010000:1.0:1746147215.461055:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x313993942506349c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f475 expref: 10 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.461067:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x313993942506349c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f475 expref: 10 pid: 9584 timeout: 853 lvb_type: 0 00002000:00010000:1.0:1746147215.461075:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095122300 00000100:00100000:1.0:1746147215.461113:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310474112 00000100:00100000:1.0:1746147215.461116:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310474112 00002000:00100000:1.0:1746147215.461134:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (3514368->3567615) req@ffff880095123480 x1830967310474112/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.461141:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095123480 with x1830967310474112 ext(3514368->3567615) 00010000:00010000:1.0:1746147215.461147:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 35 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.461155:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 35 pid: 12225 timeout: 853 lvb_type: 0 00002000:00010000:1.0:1746147215.461160:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095123480 00000100:00100000:2.0:1746147215.461174:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2971:x1830967310473984:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 208us (503us total) trans 8589937421 rc 0/0 00000100:00100000:2.0:1746147215.461180:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6182 00000100:00100000:1.0:1746147215.461180:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1759 00000100:00100000:1.0:1746147215.461187:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967310474112:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147215.465477:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746147215.465498:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311521792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746147215.465552:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147215.465834:0:16752:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311521792 00000100:00100000:0.0:1746147215.465843:0:16752:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311521792 00000100:00100000:0.0:1746147215.465892:0:16752:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1746147215.465899:0:16752:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311521792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1746147215.465921:0:16752:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1142006848 pending 1155072 free 3911233536 avail 3679711232 00000100:00100000:0.0:1746147215.465962:0:16752:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311521792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.465968:0:16752:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00080000:3.0:1746147215.466042:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147215.466113:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.466384:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311521792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746147215.466528:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310474240 00000100:00100000:0.0:1746147215.466532:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310474240 00000100:00100000:2.0:1746147215.466657:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310474112:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 5470us (5936us total) trans 21474842715 rc 0/0 00000100:00100000:2.0:1746147215.466666:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1759 00002000:00100000:2.0:1746147215.466675:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (3514368->3567615) req@ffff880095123480 x1830967310474112/t21474842715(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/448 e 0 to 0 dl 1746147226 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.466684:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095123480 with x1830967310474112 ext(3514368->3567615) 00010000:00010000:2.0:1746147215.466694:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 37 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.466712:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 37 pid: 12225 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746147215.466719:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095123480 00000100:00100000:2.0:1746147215.466797:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.466817:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310474368 00000100:00100000:2.0:1746147215.466820:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310474368 00010000:00010000:2.0:1746147215.466840:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x313993942506349c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f475 expref: 11 pid: 9584 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746147215.467005:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20245 00000100:00100000:0.0:1746147215.467011:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2969:x1830967310474240:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147215.467019:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147215.467034:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250634db lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f4b4 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.467057:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011db80600/0x3139939425063487 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f460 expref: 14 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.467064:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147215.467066:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147215.467069:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250634db lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4b4 expref: 12 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.467118:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011db80600/0x3139939425063487 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f460 expref: 14 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.467128:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011db80600/0x3139939425063487 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f460 expref: 14 pid: 10340 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746147215.467138:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311521920:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147215.467181:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147215.467720:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9198 00000100:00100000:1.0:1746147215.467727:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967310474368:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147215.467737:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147215.467754:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x313993942506349c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f475 expref: 12 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.467764:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x313993942506349c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f475 expref: 12 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.467781:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a31e00/0x313993942506349c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f475 expref: 12 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.467796:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.467797:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.467803:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7800/0x31399394250634d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4ad expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.467809:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7800/0x31399394250634d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4ad expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.467829:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7800/0x31399394250634d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4ad expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147215.467837:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311522048:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147215.467861:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.470671:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.470824:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310474496 00000100:00100000:2.0:1746147215.470833:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310474496 00010000:00010000:2.0:1746147215.470867:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 37 pid: 12225 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.471229:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9199 00000100:00100000:2.0:1746147215.471237:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310474496:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.471251:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147215.471268:0:4349:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147214 -> 1746147215 00010000:00010000:2.0:1746147215.471275:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x60000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 37 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.471286:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 37 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.471311:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x31399394250634b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3567615) gid 0 flags: 0x44801000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f48a expref: 37 pid: 12225 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.471331:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.471333:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.471340:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800982a3e00/0x31399394250634b8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f498 expref: 36 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.471347:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800982a3e00/0x31399394250634b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f498 expref: 36 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.471381:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800982a3e00/0x31399394250634b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f498 expref: 36 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.471393:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311522176:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147215.471472:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.471727:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.471770:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310474624 00000100:00100000:3.0:1746147215.471774:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310474624 00010000:00010000:3.0:1746147215.471792:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011db80600/0x3139939425063487 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f460 expref: 15 pid: 10340 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.471808:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9200 00000100:00100000:3.0:1746147215.471812:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2002:x1830967310474624:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.471820:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147215.471831:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011db80600/0x3139939425063487 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f460 expref: 15 pid: 10340 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.471840:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011db80600/0x3139939425063487 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f460 expref: 15 pid: 10340 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.471852:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.471853:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.471856:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250634db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4b4 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.471862:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250634db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4b4 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.471878:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250634db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4b4 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.471884:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311522304:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147215.471911:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.472219:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:0.0:1746147215.472256:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db80600/0x3139939425063487 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f460 expref: 15 pid: 10340 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746147215.472276:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311521920:192.168.204.25@tcp:104: 00010000:00010000:0.0:1746147215.472299:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250634db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4b4 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.472306:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093715200, rc 0) 00000100:00100000:0.0:1746147215.472329:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2969:x1830967310474240:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5318us (6218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147215.472336:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20245 00000100:00100000:0.0:1746147215.472352:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310474752 00000100:00100000:0.0:1746147215.472355:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310474752 00000100:00100000:1.0:1746147215.472551:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311522048:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147215.472575:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147215.472594:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310474368:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4868us (5797us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.472601:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9198 00000100:00100000:0.0:1746147215.473271:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20246 00000100:00100000:0.0:1746147215.473278:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2959:x1830967310474752:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147215.473292:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147215.473307:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x31399394250634e2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f4bb expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.473325:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250634db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4b4 expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.473332:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.473333:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.473336:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x31399394250634e2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4bb expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.473355:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250634db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4b4 expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.473365:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250634db lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4b4 expref: 9 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746147215.473374:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311522432:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147215.473422:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147215.474199:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311522304:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147215.474199:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311522176:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147215.474214:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147215.474217:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147215.474236:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2002:x1830967310474624:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2423us (2509us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.474236:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2000:x1830967310474496:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3001us (3574us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.474243:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9200 00000100:00100000:2.0:1746147215.474246:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9199 00000100:00100000:2.0:1746147215.474828:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311522432:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.474848:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x31399394250634e2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4bb expref: 15 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.474860:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093714c00, rc 0) 00000100:00100000:2.0:1746147215.474893:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2959:x1830967310474752:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1615us (2674us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.474900:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20246 00000100:00100000:0.0:1746147215.478260:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.478312:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.478373:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310475008 00000100:00100000:1.0:1746147215.478383:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310475008 00000100:00100000:2.0:1746147215.478395:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310475264 00000100:00100000:2.0:1746147215.478399:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310475264 00002000:00100000:2.0:1746147215.478431:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880095123b80 x1830967310475264/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.478431:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880095120000 x1830967310475008/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.478440:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095123b80 with x1830967310475264 ext(1048576->2097151) 00002000:00100000:1.0:1746147215.478440:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095120000 with x1830967310475008 ext(3145728->4194303) 00002000:00010000:1.0:1746147215.478445:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095120000 00010000:00010000:2.0:1746147215.478450:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250634db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4b4 expref: 10 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.478465:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250634db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4b4 expref: 10 pid: 1853 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746147215.478472:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095123b80 00000100:00100000:1.0:1746147215.478481:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1760 00000100:00100000:2.0:1746147215.478487:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7431 00000100:00100000:1.0:1746147215.478489:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310475264:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147215.478492:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310475008:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147215.487887:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310475264:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 9384us (9559us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147215.487900:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1760 00002000:00100000:1.0:1746147215.487913:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880095123b80 x1830967310475264/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.487924:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095123b80 with x1830967310475264 ext(1048576->2097151) 00010000:00010000:1.0:1746147215.487934:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250634db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4b4 expref: 10 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746147215.487950:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250634db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4b4 expref: 10 pid: 1853 timeout: 853 lvb_type: 0 00002000:00010000:1.0:1746147215.487957:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095123b80 00000100:00100000:2.0:1746147215.489480:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310475008:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 10980us (11224us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147215.489491:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7431 00002000:00100000:2.0:1746147215.489499:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880095120000 x1830967310475008/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.489507:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095120000 with x1830967310475008 ext(3145728->4194303) 00002000:00010000:2.0:1746147215.489512:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095120000 00000100:00100000:2.0:1746147215.494577:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.495493:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310475392 00000100:00100000:0.0:1746147215.495506:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310475392 00000100:00100000:0.0:1746147215.495581:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20247 00000100:00100000:0.0:1746147215.495590:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2964:x1830967310475392:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147215.495611:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147215.495633:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x31399394250634e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f4c2 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.495666:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982a2200/0x31399394250634c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f49f expref: 14 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.495674:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147215.495676:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147215.495679:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x31399394250634e9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c2 expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.495714:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800982a2200/0x31399394250634c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f49f expref: 14 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.495725:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800982a2200/0x31399394250634c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f49f expref: 14 pid: 9584 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746147215.495737:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096898a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311522560:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147215.495825:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.495916:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.495983:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.496039:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310475648 00000100:00100000:2.0:1746147215.496042:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310475648 00010000:00010000:2.0:1746147215.496062:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250634db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4b4 expref: 10 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.496079:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9201 00000100:00100000:2.0:1746147215.496084:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310475648:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.496110:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.496129:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250634db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4b4 expref: 10 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.496139:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250634db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4b4 expref: 10 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.496157:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093715200/0x31399394250634db lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4b4 expref: 10 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.496172:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.496174:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.496179:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x31399394250634e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4bb expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.496187:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x31399394250634e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4bb expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.496206:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x31399394250634e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4bb expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.496214:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311522688:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147215.496249:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147215.496358:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310475520 00000100:00100000:1.0:1746147215.496363:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310475520 00000100:00100000:1.0:1746147215.496399:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20248 00000100:00100000:1.0:1746147215.496405:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2969:x1830967310475520:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147215.496413:0:12225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.496428:0:12225:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x31399394250634f0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f4c9 expref: -99 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.496447:0:12225:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0a00/0x3139939425063495 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f46e expref: 18 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.496453:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147215.496455:0:12225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147215.496457:0:12225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x31399394250634f0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c9 expref: 20 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.496473:0:12225:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0a00/0x3139939425063495 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f46e expref: 18 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.496480:0:12225:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0a00/0x3139939425063495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f46e expref: 18 pid: 13695 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746147215.496487:0:12225:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311522816:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147215.496521:0:12225:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.498162:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096898a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311522560:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147215.498162:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147215.498188:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x31399394250634e9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c2 expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.498201:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940c4400, rc 0) 00000100:00100000:3.0:1746147215.498217:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310475776 00000100:00100000:3.0:1746147215.498224:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310475776 00000100:00100000:2.0:1746147215.498242:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2964:x1830967310475392:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2653us (3687us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.498249:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20247 00010000:00010000:3.0:1746147215.498251:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800982a2200/0x31399394250634c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f49f expref: 15 pid: 9584 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.498287:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9202 00000100:00100000:3.0:1746147215.498293:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310475776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.498304:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147215.498319:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800982a2200/0x31399394250634c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f49f expref: 15 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.498330:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800982a2200/0x31399394250634c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f49f expref: 15 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.498347:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982a2200/0x31399394250634c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f49f expref: 15 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.498361:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.498362:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.498368:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x31399394250634e9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c2 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.498375:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x31399394250634e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c2 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.498401:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x31399394250634e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c2 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.498411:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311522944:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147215.498456:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.498616:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.498693:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311522688:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147215.498705:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147215.498724:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310475648:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2639us (2741us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.498730:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9201 00000100:00100000:2.0:1746147215.498749:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310475904 00000100:00100000:2.0:1746147215.498751:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310475904 00000100:00100000:2.0:1746147215.498765:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20249 00000100:00100000:2.0:1746147215.498770:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2959:x1830967310475904:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147215.498780:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.498794:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x31399394250634f7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f4d0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.498811:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800982a3e00/0x31399394250634b8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f498 expref: 35 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.498817:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.498818:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.498821:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x31399394250634f7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d0 expref: 20 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.498837:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800982a3e00/0x31399394250634b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f498 expref: 35 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.498851:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800982a3e00/0x31399394250634b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f498 expref: 35 pid: 9584 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.498861:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311523072:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.498883:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147215.499591:0:12225:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:12225:1830967311522816:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147215.499613:0:12225:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x31399394250634f0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c9 expref: 20 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.499629:0:12225:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38ce00, rc 0) 00000100:00100000:1.0:1746147215.499652:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2969:x1830967310475520:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3247us (3736us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.499659:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20248 00000100:00100000:2.0:1746147215.502635:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311523072:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.502671:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x31399394250634f7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d0 expref: 20 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.502687:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0fa00, rc 0) 00000100:00100000:2.0:1746147215.502729:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2959:x1830967310475904:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3957us (4113us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.502738:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20249 00000100:00100000:3.0:1746147215.503771:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311522944:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147215.503789:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147215.503817:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2000:x1830967310475776:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5524us (5658us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.503827:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9202 00000100:00100000:0.0:1746147215.504343:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.504594:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310476032 00000100:00100000:3.0:1746147215.504600:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310476032 00010000:00010000:3.0:1746147215.504626:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800982a3e00/0x31399394250634b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f498 expref: 36 pid: 9584 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.504878:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9203 00000100:00100000:3.0:1746147215.504886:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2001:x1830967310476032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.504899:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147215.504920:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800982a3e00/0x31399394250634b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f498 expref: 36 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.504931:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800982a3e00/0x31399394250634b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f498 expref: 36 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.504953:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982a3e00/0x31399394250634b8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f498 expref: 36 pid: 9584 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.504967:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.504969:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.504976:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x31399394250634f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d0 expref: 19 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.504989:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x31399394250634f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d0 expref: 19 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.505018:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x31399394250634f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d0 expref: 19 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.505030:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311523200:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147215.506047:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.507915:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.508147:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311523200:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147215.508173:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147215.508469:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310476160 00000100:00100000:2.0:1746147215.508476:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310476160 00000100:00100000:2.0:1746147215.508529:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20250 00000100:00100000:2.0:1746147215.508537:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2959:x1830967310476160:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147215.508554:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.508582:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250634fe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f4d7 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.508611:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x31399394250634e9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c2 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.508627:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.508629:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.508632:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250634fe lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d7 expref: 15 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.508664:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x31399394250634e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c2 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.508674:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x31399394250634e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c2 expref: 24 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.508686:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311523328:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.508894:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00000100:00100000:3.0:1746147215.508898:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2001:x1830967310476032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3997us (4540us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.508912:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9203 00000100:00100000:0.0:1746147215.509153:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.509233:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310476416 00000100:00100000:2.0:1746147215.509236:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310476416 00002000:00100000:2.0:1746147215.509266:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff88009689a680 x1830967310476416/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.509275:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689a680 with x1830967310476416 ext(3145728->4194303) 00010000:00010000:2.0:1746147215.509282:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x31399394250634e9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c2 expref: 25 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.509291:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x31399394250634e9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c2 expref: 25 pid: 1853 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746147215.509297:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009689a680 00000100:00100000:2.0:1746147215.509325:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1761 00000100:00100000:2.0:1746147215.509331:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310476416:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147215.510146:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311523328:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.510172:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250634fe lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d7 expref: 15 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.510186:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0e000, rc 0) 00000100:00100000:3.0:1746147215.510377:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2959:x1830967310476160:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1839us (2470us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.510384:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20250 00000100:00100000:2.0:1746147215.518682:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310476416:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 9337us (9515us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147215.518695:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1761 00002000:00100000:2.0:1746147215.518707:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff88009689a680 x1830967310476416/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.518717:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009689a680 with x1830967310476416 ext(3145728->4194303) 00010000:00010000:2.0:1746147215.518728:0:29476:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x31399394250634e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c2 expref: 25 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.518740:0:29476:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x31399394250634e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c2 expref: 25 pid: 1853 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746147215.518749:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009689a680 00000100:00100000:0.0:1746147215.525391:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.525438:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.525455:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.525469:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.525482:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.525493:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.525514:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.525535:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310476544 00000100:00100000:0.0:1746147215.525543:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310476544 00000100:00100000:0.0:1746147215.525587:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310476800 00000100:00100000:0.0:1746147215.525589:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310476800 00000100:00100000:0.0:1746147215.525609:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310477056 00000100:00100000:0.0:1746147215.525611:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310477056 00000100:00100000:0.0:1746147215.525634:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310477312 00000100:00100000:0.0:1746147215.525636:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310477312 00000100:00100000:0.0:1746147215.525646:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310476928 00000100:00100000:0.0:1746147215.525648:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310476928 00000100:00100000:0.0:1746147215.525658:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310477184 00000100:00100000:0.0:1746147215.525659:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310477184 00000100:00100000:0.0:1746147215.525673:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20251 00000100:00100000:0.0:1746147215.525681:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967310476544:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147215.525701:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147215.525718:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2ae00/0x3139939425063505 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f4de expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.525774:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20252 00000100:00100000:0.0:1746147215.525774:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311523456:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147215.525780:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310476800:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.525788:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.525798:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0f600/0x313993942506350c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f4e5 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.525822:0:1136:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311523584:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147215.525850:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.525852:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20253 00000100:00100000:2.0:1746147215.525857:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967310477056:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.525866:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746147215.525866:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20254 00000100:00100000:0.0:1746147215.525870:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967310477312:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.525872:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425063513 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f4f3 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.525876:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147215.525881:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x313993942506351a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f501 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.525891:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311523712:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147215.525891:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147215.525899:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x313993942506351a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f501 expref: 29 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147215.525907:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00010000:00010000:0.0:1746147215.525908:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2a400/0x313993942506351a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f501 expref: 29 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147215.525921:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20255 00010000:00010000:0.0:1746147215.525921:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2a400, rc 0) 00000100:00100000:2.0:1746147215.525925:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967310476928:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.525931:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.525936:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0400/0x3139939425063521 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f4ec expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.525939:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967310477312:12345-192.168.204.25@tcp:101:cat.0 Request processed in 69us (456us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147215.525945:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20254 00000100:00100000:2.0:1746147215.525955:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311523840:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147215.525959:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20256 00000100:00100000:0.0:1746147215.525963:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967310477184:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147215.525968:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147215.525972:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1503c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746147215.525974:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425063528 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f4fa expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.525982:0:1136:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.525994:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311523968:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147215.526004:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310476672 00000100:00100000:2.0:1746147215.526008:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310476672 00000100:00100000:0.0:1746147215.526010:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746147215.526023:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x31399394250634e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c2 expref: 29 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.526041:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9204 00000100:00100000:2.0:1746147215.526045:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310476672:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.526053:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.526072:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x31399394250634e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c2 expref: 29 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.526086:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x31399394250634e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c2 expref: 29 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.526127:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800940c4400/0x31399394250634e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c2 expref: 29 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.526142:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.526144:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.526151:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250634fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d7 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.526158:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250634fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d7 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.526183:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250634fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d7 expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.526191:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311524096:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147215.526220:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1500c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.528159:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311523968:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147215.528188:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425063528 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4fa expref: 40 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.528204:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2bc00/0x3139939425063528 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4fa expref: 40 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.528214:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2bc00, rc 0) 00000100:00100000:0.0:1746147215.528247:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967310477184:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2282us (2730us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147215.528254:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20256 00000100:00100000:2.0:1746147215.528401:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311523840:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147215.528423:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0400/0x3139939425063521 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4ec expref: 28 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.528432:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0400/0x3139939425063521 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4ec expref: 28 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.528445:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a0400, rc 0) 00000100:00100000:2.0:1746147215.528465:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2003:x1830967310476928:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2539us (2971us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147215.528470:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20255 00000100:00100000:2.0:1746147215.528501:0:1136:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1136:1830967311523584:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147215.528517:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0f600/0x313993942506350c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4e5 expref: 26 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.528526:0:1136:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0f600/0x313993942506350c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4e5 expref: 26 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.528533:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0f600, rc 0) 00000100:00100000:2.0:1746147215.528549:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2003:x1830967310476800:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2769us (3092us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147215.528554:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20252 00000100:00100000:2.0:1746147215.528589:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311524096:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147215.528599:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147215.528616:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310476672:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2570us (3177us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.528623:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9204 00000100:00100000:3.0:1746147215.528713:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311523712:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147215.528729:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425063513 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4f3 expref: 38 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.528738:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0f400/0x3139939425063513 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4f3 expref: 38 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.528748:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0f400, rc 0) 00000100:00100000:3.0:1746147215.528766:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2003:x1830967310477056:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2908us (3296us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147215.528771:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20253 00000100:00100000:1.0:1746147215.528855:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311523456:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147215.528872:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2ae00/0x3139939425063505 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4de expref: 36 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.528879:0:13712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2ae00/0x3139939425063505 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4de expref: 36 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.528886:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2ae00, rc 0) 00000100:00100000:1.0:1746147215.528902:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967310476544:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3223us (3524us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147215.528907:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20251 00000100:00100000:0.0:1746147215.529079:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.529720:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.529744:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.529759:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.529772:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.529787:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310477568 00000100:00100000:0.0:1746147215.529793:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310477568 00000100:00100000:0.0:1746147215.529821:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310477824 00000100:00100000:0.0:1746147215.529823:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310477824 00000100:00100000:0.0:1746147215.529834:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310478080 00000100:00100000:0.0:1746147215.529836:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310478080 00000100:00100000:0.0:1746147215.529844:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310477440 00000100:00100000:3.0:1746147215.529846:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310477696 00000100:00100000:0.0:1746147215.529846:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310477440 00000100:00100000:3.0:1746147215.529848:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310477696 00000100:00100000:0.0:1746147215.529857:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20257 00000100:00100000:0.0:1746147215.529863:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310477568:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:3.0:1746147215.529867:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20258 00000100:00100000:3.0:1746147215.529870:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967310477824:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:3.0:1746147215.529973:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147215.529973:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147215.529976:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147214 -> 1746147214 00002000:00010000:0.0:1746147215.529976:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147214 -> 1746147214 00002000:00010000:3.0:1746147215.529978:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147214 -> 1746147214 00002000:00010000:0.0:1746147215.529978:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147214 -> 1746147214 00002000:00010000:3.0:1746147215.529980:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147215 -> 1746147215 00002000:00010000:0.0:1746147215.529980:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147215 -> 1746147215 00002000:00010000:3.0:1746147215.529982:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:0.0:1746147215.529983:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147215.530011:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310477568:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 148us (933us total) trans 17179875322 rc 0/0 00000100:00100000:0.0:1746147215.530017:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20257 00000100:00100000:0.0:1746147215.530027:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20259 00000100:00100000:0.0:1746147215.530031:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310478080:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147215.530071:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147215.530073:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147214 -> 1746147214 00002000:00010000:0.0:1746147215.530075:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147214 -> 1746147214 00002000:00010000:0.0:1746147215.530076:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147215 -> 1746147215 00002000:00010000:0.0:1746147215.530078:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746147215.530116:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310478080:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 83us (371us total) trans 17179875323 rc 0/0 00000100:00100000:0.0:1746147215.530121:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20259 00000100:00100000:0.0:1746147215.530130:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20260 00000100:00100000:0.0:1746147215.530135:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2001:x1830967310477440:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147215.530179:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147215.530181:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147214 -> 1746147214 00002000:00010000:0.0:1746147215.530183:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147214 -> 1746147214 00002000:00010000:0.0:1746147215.530185:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147215 -> 1746147215 00002000:00010000:0.0:1746147215.530186:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:0.0:1746147215.530201:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2001:x1830967310477440:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 66us (442us total) trans 21474842717 rc 0/0 00000100:00100000:2.0:1746147215.530204:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20261 00000100:00100000:0.0:1746147215.530207:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20260 00000100:00100000:2.0:1746147215.530210:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310477696:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:0.0:1746147215.530249:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00010000:2.0:1746147215.530251:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147215.530253:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147214 -> 1746147214 00002000:00010000:2.0:1746147215.530255:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147214 -> 1746147214 00002000:00010000:2.0:1746147215.530257:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147215 -> 1746147215 00002000:00010000:2.0:1746147215.530258:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746147215.530263:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310477952 00000100:00100000:0.0:1746147215.530266:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310477952 00000100:00100000:2.0:1746147215.530272:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310477696:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 62us (498us total) trans 17179875324 rc 0/0 00000100:00100000:2.0:1746147215.530277:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20261 00000100:00100000:0.0:1746147215.530280:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20262 00000100:00100000:0.0:1746147215.530284:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2001:x1830967310477952:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147215.530322:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:0.0:1746147215.530324:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147215 -> 1746147214 00002000:00010000:0.0:1746147215.530326:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147214 -> 1746147214 00002000:00010000:0.0:1746147215.530328:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147215 -> 1746147215 00002000:00010000:0.0:1746147215.530329:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:3.0:1746147215.530335:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2001:x1830967310477824:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 463us (614us total) trans 21474842716 rc 0/0 00000100:00100000:3.0:1746147215.530340:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20258 00000100:00100000:0.0:1746147215.530342:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2001:x1830967310477952:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 58us (93us total) trans 21474842718 rc 0/0 00000100:00100000:0.0:1746147215.530347:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20262 00000100:00100000:2.0:1746147215.532243:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.532556:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310478336 00000100:00100000:0.0:1746147215.532571:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310478336 00000100:00100000:0.0:1746147215.532622:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6183 00000100:00100000:0.0:1746147215.532629:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2959:x1830967310478336:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:0.0:1746147215.532804:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2959:x1830967310478336:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 174us (568us total) trans 8589937422 rc 0/0 00000100:00100000:0.0:1746147215.532810:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6183 00000100:00100000:1.0:1746147215.533527:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.533750:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310478464 00000100:00100000:3.0:1746147215.533754:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310478464 00010000:00010000:3.0:1746147215.533780:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0a00/0x3139939425063495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f46e expref: 23 pid: 13695 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.533801:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9205 00000100:00100000:3.0:1746147215.533807:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2002:x1830967310478464:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.533817:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147215.533834:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0a00/0x3139939425063495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f46e expref: 23 pid: 13695 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.533844:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0a00/0x3139939425063495 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f46e expref: 23 pid: 13695 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.533868:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0a00/0x3139939425063495 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f46e expref: 23 pid: 13695 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.533881:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.533883:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.533890:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x31399394250634f0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c9 expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.533898:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x31399394250634f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c9 expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.533929:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x31399394250634f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c9 expref: 19 pid: 12225 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.533941:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311524224:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147215.533991:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147215.534586:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.534666:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310478592 00000100:00100000:3.0:1746147215.534670:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310478592 00000100:00100000:3.0:1746147215.534707:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20263 00000100:00100000:3.0:1746147215.534714:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2964:x1830967310478592:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147215.534725:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.534743:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a31e00/0x313993942506352f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f508 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.534761:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x31399394250634f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d0 expref: 22 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.534767:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147215.534768:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147215.534771:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a31e00/0x313993942506352f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [4194304->4890623] (req 4194304->4890623) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f508 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.534788:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x31399394250634f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d0 expref: 22 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.534798:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x31399394250634f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d0 expref: 22 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.534806:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311524352:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147215.536232:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.536694:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.537651:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310478848 00000100:00100000:1.0:1746147215.537659:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310478848 00000100:00100000:1.0:1746147215.537881:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6184 00000100:00100000:1.0:1746147215.537889:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2959:x1830967310478848:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:1.0:1746147215.538396:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2959:x1830967310478848:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 505us (1703us total) trans 8589937423 rc 0/0 00000100:00100000:1.0:1746147215.538402:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6184 00000100:00100000:1.0:1746147215.540582:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.540782:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311524224:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147215.540805:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147215.540846:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2002:x1830967310478464:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7037us (7319us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.540856:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9205 00000100:00100000:2.0:1746147215.541276:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310479104 00000100:00100000:2.0:1746147215.541284:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310479104 00002000:00100000:2.0:1746147215.541321:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880097d77800 x1830967310479104/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.541330:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d77800 with x1830967310479104 ext(1048576->2097151) 00002000:00010000:2.0:1746147215.541335:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d77800 00000100:00100000:2.0:1746147215.541348:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7432 00000100:00100000:2.0:1746147215.541354:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310479104:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147215.543151:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311524352:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.543183:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a31e00/0x313993942506352f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [4194304->4890623] (req 4194304->4890623) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f508 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.543201:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a31e00, rc 0) 00000100:00100000:3.0:1746147215.543237:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2964:x1830967310478592:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8522us (8650us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.543246:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20263 00000100:00100000:0.0:1746147215.544438:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.544796:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310479232 00000100:00100000:3.0:1746147215.544803:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310479232 00010000:00010000:3.0:1746147215.544834:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x31399394250634f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d0 expref: 22 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.544866:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9206 00000100:00100000:3.0:1746147215.544872:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2000:x1830967310479232:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.544883:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147215.544903:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x31399394250634f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d0 expref: 22 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.544914:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x31399394250634f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d0 expref: 22 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.544938:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0fa00/0x31399394250634f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d0 expref: 22 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.544951:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.544954:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.544961:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a31e00/0x313993942506352f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f508 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.544969:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a31e00/0x313993942506352f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f508 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.544997:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095a31e00/0x313993942506352f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f508 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.545009:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311524480:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147215.545946:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147215.549236:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311524480:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147215.549262:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147215.549309:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2000:x1830967310479232:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4435us (4872us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.549320:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9206 00000100:00100000:3.0:1746147215.550058:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310479104:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 8702us (9482us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147215.550066:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7432 00002000:00100000:3.0:1746147215.550077:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880097d77800 x1830967310479104/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.550086:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d77800 with x1830967310479104 ext(1048576->2097151) 00002000:00010000:3.0:1746147215.550113:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d77800 00000100:00100000:0.0:1746147215.550764:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.551003:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310479488 00000100:00100000:3.0:1746147215.551010:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310479488 00002000:00100000:3.0:1746147215.551042:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88012b8b2a00 x1830967310479488/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.551055:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b2a00 with x1830967310479488 ext(4194304->4890623) 00002000:00010000:3.0:1746147215.551058:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8b2a00 00000100:00100000:3.0:1746147215.551697:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7433 00000100:00100000:3.0:1746147215.551705:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967310479488:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147215.561287:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2003:x1830967310479488:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9567us (10507us total) trans 0 rc 696320/696320 00000100:00100000:3.0:1746147215.561301:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7433 00002000:00100000:3.0:1746147215.561316:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88012b8b2a00 x1830967310479488/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.561326:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b2a00 with x1830967310479488 ext(4194304->4890623) 00002000:00010000:3.0:1746147215.561332:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8b2a00 00000100:00100000:2.0:1746147215.562316:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.562652:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310479616 00000100:00100000:3.0:1746147215.562662:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310479616 00000100:00100000:3.0:1746147215.562717:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20264 00000100:00100000:3.0:1746147215.562725:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310479616:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147215.562742:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.562764:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x3139939425063536 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f50f expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.562825:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311524608:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147215.563746:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.564437:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.564609:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310479744 00000100:00100000:0.0:1746147215.564616:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310479744 00000100:00100000:0.0:1746147215.564652:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20265 00000100:00100000:0.0:1746147215.564659:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310479744:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147215.564674:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147215.564692:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5a4400/0x313993942506353d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f516 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.564736:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311524736:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147215.564799:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.565054:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.565070:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.565110:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.565220:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310479872 00000100:00100000:3.0:1746147215.565224:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310479872 00000100:00100000:3.0:1746147215.565241:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310480000 00000100:00100000:3.0:1746147215.565244:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310480000 00000100:00100000:3.0:1746147215.565255:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310480128 00000100:00100000:3.0:1746147215.565256:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310480128 00000100:00100000:3.0:1746147215.565271:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20266 00000100:00100000:3.0:1746147215.565276:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967310479872:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147215.565283:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.565290:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134ae9c00/0x3139939425063544 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f51d expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.565314:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311524864:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147215.565343:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147215.565358:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20267 00000100:00100000:3.0:1746147215.565363:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310480000:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147215.565371:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.565381:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091eba800/0x313993942506354b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f524 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.565393:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.565395:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.565403:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091eba800/0x313993942506354b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f524 expref: 23 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.565417:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091eba800/0x313993942506354b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f524 expref: 23 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.565427:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091eba800, rc 0) 00000100:00100000:3.0:1746147215.565449:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2000:x1830967310480000:12345-192.168.204.25@tcp:101:cat.0 Request processed in 86us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.565455:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20267 00000100:00100000:3.0:1746147215.565473:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20268 00000100:00100000:3.0:1746147215.565478:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310480128:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147215.565483:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.565490:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011db80600/0x3139939425063552 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f52b expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.565512:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311524992:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147215.565531:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.567335:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.567512:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.567536:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.567557:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.567578:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.567667:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311524736:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147215.567697:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f5a4400/0x313993942506353d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f516 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.567709:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5a4400/0x313993942506353d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f516 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746147215.567765:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310480384 00000100:00100000:1.0:1746147215.567770:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310480384 00000100:00100000:1.0:1746147215.567806:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310480640 00000100:00100000:1.0:1746147215.567808:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310480640 00010000:00010000:0.0:1746147215.568025:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5a4400, rc 0) 00000100:00100000:1.0:1746147215.568055:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310480256 00000100:00100000:1.0:1746147215.568058:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310480256 00000100:00100000:2.0:1746147215.568084:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310480512 00000100:00100000:2.0:1746147215.568110:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310480512 00000100:00100000:2.0:1746147215.568128:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310480768 00000100:00100000:2.0:1746147215.568130:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310480768 00000100:00100000:2.0:1746147215.568142:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20269 00000100:00100000:2.0:1746147215.568149:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310480384:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.568163:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.568176:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d43400/0x3139939425063559 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f539 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.568220:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311525120:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147215.568284:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1500c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.568315:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20270 00000100:00100000:2.0:1746147215.568320:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310480640:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.568328:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.568339:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425063560 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f547 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.568351:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.568353:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.568362:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425063560 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f547 expref: 38 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.568376:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425063560 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f547 expref: 38 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.568385:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d42c00, rc 0) 00000100:00100000:2.0:1746147215.568401:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310480640:12345-192.168.204.25@tcp:101:cat.0 Request processed in 80us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.568406:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20270 00000100:00100000:2.0:1746147215.568422:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20271 00000100:00100000:2.0:1746147215.568426:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310480256:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.568431:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.568438:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d43a00/0x3139939425063567 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f532 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.568457:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311525248:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147215.568475:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1503c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.568489:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20272 00000100:00100000:2.0:1746147215.568494:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310480512:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.568500:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.568506:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x313993942506356e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f540 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.568526:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311525376:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147215.568542:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.568877:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20273 00000100:00100000:0.0:1746147215.568884:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310480768:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147215.568890:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147215.568897:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x3139939425063575 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f54e expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147215.568918:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311525504:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147215.568938:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.568960:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310479744:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4302us (4527us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147215.568966:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20265 00000100:00100000:3.0:1746147215.569117:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311524992:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147215.569140:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011db80600/0x3139939425063552 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f52b expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.569150:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011db80600/0x3139939425063552 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f52b expref: 12 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.569168:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011db80600, rc 0) 00000100:00100000:3.0:1746147215.569187:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2000:x1830967310480128:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3709us (4076us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147215.569193:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20268 00000100:00100000:3.0:1746147215.569224:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311524864:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147215.569268:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134ae9c00/0x3139939425063544 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f51d expref: 10 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.569282:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134ae9c00/0x3139939425063544 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f51d expref: 10 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.569289:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ae9c00, rc 0) 00000100:00100000:3.0:1746147215.569302:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310479872:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4026us (4248us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147215.569306:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20266 00000100:00100000:3.0:1746147215.569341:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311524608:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147215.569357:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x3139939425063536 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f50f expref: 22 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.569365:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x3139939425063536 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f50f expref: 22 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.569371:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a30400, rc 0) 00000100:00100000:3.0:1746147215.569382:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310479616:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6659us (7072us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147215.569387:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20264 00000100:00100000:2.0:1746147215.570853:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311525120:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147215.570886:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d43400/0x3139939425063559 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f539 expref: 29 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.570900:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d43400/0x3139939425063559 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f539 expref: 29 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.570921:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43400, rc 0) 00000100:00100000:3.0:1746147215.570923:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311525248:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147215.570942:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d43a00/0x3139939425063567 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f532 expref: 38 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.570952:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d43a00/0x3139939425063567 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f532 expref: 38 pid: 10340 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147215.570962:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310480384:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2813us (3633us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147215.570968:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20269 00010000:00010000:3.0:1746147215.571544:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43a00, rc 0) 00000100:00100000:3.0:1746147215.571584:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310480256:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3156us (4045us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147215.571590:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20271 00000100:00100000:2.0:1746147215.572975:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311525376:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147215.573016:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x313993942506356e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f540 expref: 27 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.573030:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x313993942506356e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f540 expref: 27 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.573040:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43c00, rc 0) 00000100:00100000:1.0:1746147215.573362:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311525504:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147215.573387:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x3139939425063575 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f54e expref: 26 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.573397:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x3139939425063575 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f54e expref: 26 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.573419:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c42200, rc 0) 00000100:00100000:2.0:1746147215.573671:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310480512:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5174us (6110us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147215.573682:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20272 00000100:00100000:1.0:1746147215.573831:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310480768:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4948us (6251us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147215.573837:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20273 00000100:00100000:0.0:1746147215.576465:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.576536:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310481024 00000100:00100000:3.0:1746147215.576546:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310481024 00002000:00100000:3.0:1746147215.576599:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88012b8b3800 x1830967310481024/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.576610:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b3800 with x1830967310481024 ext(2097152->3145727) 00002000:00010000:3.0:1746147215.576615:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8b3800 00000100:00100000:3.0:1746147215.576636:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7434 00000100:00100000:3.0:1746147215.576643:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2003:x1830967310481024:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147215.583836:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.583902:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.583936:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.583961:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.584140:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310481280 00000100:00100000:2.0:1746147215.584151:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310481280 00000100:00100000:2.0:1746147215.584200:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310481536 00000100:00100000:2.0:1746147215.584203:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310481536 00000100:00100000:3.0:1746147215.584259:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310481152 00000100:00100000:3.0:1746147215.584263:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310481152 00000100:00100000:2.0:1746147215.584263:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310481408 00000100:00100000:2.0:1746147215.584266:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310481408 00000100:00100000:2.0:1746147215.584283:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20274 00000100:00100000:2.0:1746147215.584291:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310481280:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:3.0:1746147215.584293:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20275 00000100:00100000:3.0:1746147215.584297:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310481536:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147215.584319:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20276 00000100:00100000:2.0:1746147215.584324:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310481408:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147215.584364:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20277 00000100:00100000:1.0:1746147215.584371:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310481152:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147215.584389:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.584410:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e7200/0x313993942506357c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f555 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147215.584471:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d77100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311525632:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147215.584544:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc540 going to sleep for 11 seconds 00010000:00010000:3.0:1746147215.584782:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.584782:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.584793:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425063583 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f56a expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.584793:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x313993942506358a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f563 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.584820:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311525760:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147215.584825:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311525888:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147215.584846:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.584851:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00010000:00010000:2.0:1746147215.584863:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.584870:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d43400/0x3139939425063591 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f55c expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.584891:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094187480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311526016:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147215.584909:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147215.586967:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311525760:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147215.587009:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425063583 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f56a expref: 29 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.587021:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95400/0x3139939425063583 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f56a expref: 29 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.587035:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95400, rc 0) 00000100:00100000:3.0:1746147215.587076:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310481536:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2777us (3173us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147215.587085:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20275 00000100:00100000:2.0:1746147215.587411:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311525888:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147215.587431:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x313993942506358a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f563 expref: 27 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.587440:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0fc00/0x313993942506358a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f563 expref: 27 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.587447:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0fc00, rc 0) 00000100:00100000:2.0:1746147215.587472:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310481408:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3146us (3509us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147215.587477:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20276 00000100:00100000:1.0:1746147215.587681:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d77100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311525632:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147215.587702:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e7200/0x313993942506357c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f555 expref: 38 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.587710:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7200/0x313993942506357c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f555 expref: 38 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.587722:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e7200, rc 0) 00000100:00100000:1.0:1746147215.587742:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310481152:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3372us (3805us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147215.587757:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20277 00000100:00100000:2.0:1746147215.588233:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2003:x1830967310481024:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11590us (11774us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147215.588243:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7434 00002000:00100000:2.0:1746147215.588254:0:29476:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88012b8b3800 x1830967310481024/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.588264:0:29476:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8b3800 with x1830967310481024 ext(2097152->3145727) 00002000:00010000:2.0:1746147215.588270:0:29476:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8b3800 00000100:00100000:3.0:1746147215.588345:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094187480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311526016:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147215.588363:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d43400/0x3139939425063591 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f55c expref: 25 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.588372:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d43400/0x3139939425063591 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f55c expref: 25 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.588379:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43400, rc 0) 00000100:00100000:3.0:1746147215.588397:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310481280:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4107us (4579us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147215.588402:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20274 00000100:00100000:1.0:1746147215.592949:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.593320:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310481664 00000100:00100000:3.0:1746147215.593330:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310481664 00000100:00100000:3.0:1746147215.593379:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20278 00000100:00100000:3.0:1746147215.593388:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2969:x1830967310481664:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147215.593410:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.593432:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425063598 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f571 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.593469:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250634fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d7 expref: 17 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.593477:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147215.593479:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147215.593483:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425063598 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f571 expref: 10 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.593514:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250634fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d7 expref: 17 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.593526:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250634fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d7 expref: 17 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.593538:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311526144:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147215.593639:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.594865:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.595240:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310481920 00000100:00100000:1.0:1746147215.595248:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310481920 00000100:00100000:1.0:1746147215.595328:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6185 00000100:00100000:1.0:1746147215.595336:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2964:x1830967310481920:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:1.0:1746147215.595546:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2964:x1830967310481920:12345-192.168.204.25@tcp:35:cat.0 Request processed in 209us (686us total) trans 8589937424 rc 0/0 00000100:00100000:1.0:1746147215.595553:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6185 00000100:00100000:0.0:1746147215.598652:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.598771:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311526144:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.598815:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425063598 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f571 expref: 10 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.598834:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95600, rc 0) 00000100:00100000:3.0:1746147215.598878:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2969:x1830967310481664:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5491us (5943us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.598887:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20278 00000100:00100000:2.0:1746147215.598976:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310482048 00000100:00100000:2.0:1746147215.598984:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310482048 00010000:00010000:2.0:1746147215.599010:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250634fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d7 expref: 18 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.599031:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9207 00000100:00100000:2.0:1746147215.599037:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310482048:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.599048:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.599066:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250634fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d7 expref: 18 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.599078:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250634fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d7 expref: 18 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.599122:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0e000/0x31399394250634fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4d7 expref: 18 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.599145:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.599146:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.599152:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425063598 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f571 expref: 9 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.599217:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425063598 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f571 expref: 9 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.599243:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425063598 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f571 expref: 9 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.599256:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311526272:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147215.599320:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.602955:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311526272:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147215.602983:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147215.603033:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310482048:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3994us (4394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.603045:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9207 00000100:00100000:0.0:1746147215.617410:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.617465:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.617591:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310482432 00000100:00100000:1.0:1746147215.617602:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310482432 00002000:00100000:1.0:1746147215.617654:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88009514d880 x1830967310482432/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.617664:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514d880 with x1830967310482432 ext(2097152->4194303) 00002000:00010000:1.0:1746147215.617670:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009514d880 00000100:00100000:1.0:1746147215.617701:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310482560 00000100:00100000:1.0:1746147215.617703:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310482560 00002000:00100000:1.0:1746147215.617720:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88009514ea00 x1830967310482560/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746147215.617722:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7435 00002000:00100000:1.0:1746147215.617727:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514ea00 with x1830967310482560 ext(3145728->4194303) 00002000:00010000:1.0:1746147215.617731:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514ea00 00000100:00100000:0.0:1746147215.617734:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2003:x1830967310482432:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147215.618327:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7436 00000100:00100000:1.0:1746147215.618334:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310482560:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147215.630870:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310482560:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12525us (13393us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147215.630883:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7436 00002000:00100000:1.0:1746147215.630895:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88009514ea00 x1830967310482560/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.630905:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514ea00 with x1830967310482560 ext(3145728->4194303) 00002000:00010000:1.0:1746147215.630910:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514ea00 00000100:00100000:2.0:1746147215.647433:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2003:x1830967310482432:12345-192.168.204.25@tcp:3:cat.0 Request processed in 29690us (30023us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147215.647445:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7435 00002000:00100000:2.0:1746147215.647457:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88009514d880 x1830967310482432/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.647467:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514d880 with x1830967310482432 ext(2097152->4194303) 00002000:00010000:2.0:1746147215.647473:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009514d880 00000100:00100000:0.0:1746147215.660414:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.660505:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.661010:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.661077:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310482688 00000100:00100000:3.0:1746147215.661106:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310482688 00000100:00100000:3.0:1746147215.661150:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310482816 00000100:00100000:3.0:1746147215.661153:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310482816 00000100:00100000:3.0:1746147215.661168:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310482944 00000100:00100000:3.0:1746147215.661170:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310482944 00000100:00100000:3.0:1746147215.661269:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20279 00000100:00100000:3.0:1746147215.661278:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2003:x1830967310482688:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147215.661295:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20280 00010000:00010000:3.0:1746147215.661298:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147215.661303:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2003:x1830967310482816:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147215.661310:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.661318:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d94000/0x313993942506359f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f578 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.661320:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e7000/0x31399394250635a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f57f expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.661369:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311526528:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147215.661369:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311526400:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147215.661637:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.661673:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20281 00000100:00100000:2.0:1746147215.661681:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2002:x1830967310482944:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.661687:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.661695:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x31399394250635ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f586 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.661718:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311526656:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147215.661731:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.661741:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147215.663264:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311526400:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147215.663291:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e7000/0x31399394250635a6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f57f expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.663308:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e7000/0x31399394250635a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f57f expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.663320:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e7000, rc 0) 00000100:00100000:1.0:1746147215.663349:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2003:x1830967310482816:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2047us (2843us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147215.663356:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20280 00000100:00100000:3.0:1746147215.663439:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311526528:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147215.663457:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d94000/0x313993942506359f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f578 expref: 22 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.663466:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d94000/0x313993942506359f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f578 expref: 22 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.663477:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94000, rc 0) 00000100:00100000:3.0:1746147215.663494:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2003:x1830967310482688:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2219us (3094us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147215.663499:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20279 00000100:00100000:2.0:1746147215.663671:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311526656:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147215.663690:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x31399394250635ad lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f586 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.663697:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d43c00/0x31399394250635ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f586 expref: 11 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.663708:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43c00, rc 0) 00000100:00100000:2.0:1746147215.663725:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2002:x1830967310482944:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2046us (2716us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147215.663730:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20281 00000100:00100000:0.0:1746147215.670136:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.670609:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310483200 00000100:00100000:2.0:1746147215.670618:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310483200 00002000:00100000:2.0:1746147215.670663:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88009514c000 x1830967310483200/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.670672:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514c000 with x1830967310483200 ext(4194304->4890623) 00002000:00010000:2.0:1746147215.670678:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514c000 00000100:00100000:2.0:1746147215.671713:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7437 00000100:00100000:2.0:1746147215.671725:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310483200:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147215.677072:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.677858:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310483456 00000100:00100000:2.0:1746147215.677869:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310483456 00000100:00100000:2.0:1746147215.678031:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16519 00000100:00100000:2.0:1746147215.678040:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2978:x1830967310483456:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147215.678070:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.678122:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250635b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f58d expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.678205:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43c00/0x31399394250635bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678220:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43c00/0x31399394250635bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678231:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43c00/0x31399394250635bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678243:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x31399394250635c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678249:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x31399394250635c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678254:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x31399394250635c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678355:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250635c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678363:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250635c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678369:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250635c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147215.678376:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147215.678445:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43c00/0x31399394250635bb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678450:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43c00/0x31399394250635bb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678458:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43c00/0x31399394250635bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678464:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43c00/0x31399394250635bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678469:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d43c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147215.678473:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43c00/0x31399394250635bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678479:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43c00/0x31399394250635bb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678490:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147215.678493:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147215.678496:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43c00/0x31399394250635bb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678501:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43c00/0x31399394250635bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678653:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x31399394250635c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678660:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x31399394250635c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678664:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x31399394250635c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678668:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d43400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147215.678671:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x31399394250635c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678683:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x31399394250635c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678691:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ec09700) 00010000:00010000:2.0:1746147215.678692:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147215.678694:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x31399394250635c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678698:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d43400/0x31399394250635c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.678737:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250635b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f58d expref: 13 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.678748:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250635c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f58d expref: 12 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.678757:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147215.678758:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147215.678760:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d42000, rc 0) 00000100:00100000:2.0:1746147215.678825:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2978:x1830967310483456:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 786us (1765us total) trans 8589937425 rc 0/0 00000100:00100000:2.0:1746147215.678832:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16519 00000100:00100000:2.0:1746147215.679341:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310483200:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7618us (9214us total) trans 0 rc 696320/696320 00000100:00100000:2.0:1746147215.679351:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7437 00002000:00100000:2.0:1746147215.679359:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff88009514c000 x1830967310483200/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.679374:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514c000 with x1830967310483200 ext(4194304->4890623) 00002000:00010000:2.0:1746147215.679378:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514c000 00000100:00100000:0.0:1746147215.686430:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.686474:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.686581:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.686679:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310483584 00000100:00100000:1.0:1746147215.686692:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310483584 00000100:00100000:1.0:1746147215.686757:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310483712 00000100:00100000:1.0:1746147215.686759:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310483712 00000100:00100000:1.0:1746147215.686773:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310483840 00000100:00100000:1.0:1746147215.686775:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310483840 00000100:00100000:1.0:1746147215.686790:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20282 00000100:00100000:1.0:1746147215.686796:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310483584:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147215.686810:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.686825:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e7e00/0x31399394250635d7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f594 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147215.686865:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311526784:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147215.686947:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc780 going to sleep for 11 seconds 00000100:00100000:1.0:1746147215.686967:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20283 00000100:00100000:1.0:1746147215.686971:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2002:x1830967310483712:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147215.686977:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.686985:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x31399394250635de lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f59b expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147215.687008:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311526912:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147215.687026:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129f20000 going to sleep for 11 seconds 00000100:00100000:1.0:1746147215.687042:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20284 00000100:00100000:1.0:1746147215.687046:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2002:x1830967310483840:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147215.687051:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.687057:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e7000/0x31399394250635e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f5a2 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147215.687075:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311527040:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147215.687124:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.690131:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.691352:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310483968 00000100:00100000:3.0:1746147215.691370:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310483968 00000100:00100000:3.0:1746147215.691437:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20285 00000100:00100000:3.0:1746147215.691445:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2978:x1830967310483968:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147215.691464:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.691484:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x31399394250635ec lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f5a9 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.691514:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425063598 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f571 expref: 15 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.691521:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.691522:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.691525:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x31399394250635ec lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2822144->3047423] (req 2822144->3047423) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5a9 expref: 15 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.691554:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425063598 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f571 expref: 15 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.691572:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425063598 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f571 expref: 15 pid: 10340 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.691584:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311527168:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147215.691691:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.693950:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.694070:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311526784:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147215.694123:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e7e00/0x31399394250635d7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f594 expref: 22 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.694136:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7e00/0x31399394250635d7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f594 expref: 22 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.694151:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e7e00, rc 0) 00000100:00100000:2.0:1746147215.694175:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311527040:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147215.694199:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310483584:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7402us (7781us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147215.694207:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20282 00010000:00010000:2.0:1746147215.694327:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e7000/0x31399394250635e5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5a2 expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.694341:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e7000/0x31399394250635e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5a2 expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.694355:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e7000, rc 0) 00000100:00100000:3.0:1746147215.694583:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310484224 00000100:00100000:3.0:1746147215.694590:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310484224 00000100:00100000:3.0:1746147215.694627:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16520 00000100:00100000:3.0:1746147215.694633:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2980:x1830967310484224:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147215.694652:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.694667:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250635f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f5b0 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.694736:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x31399394250635fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.694748:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x31399394250635fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.694759:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x31399394250635fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.694769:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x3139939425063601 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.694774:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x3139939425063601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.694779:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x3139939425063601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.694881:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x3139939425063608 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.694890:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x3139939425063608 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.694895:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x3139939425063608 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147215.694903:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147215.694977:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x31399394250635fa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.694987:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x31399394250635fa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.694992:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x31399394250635fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.694998:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x31399394250635fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.695003:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d94a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147215.695007:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x31399394250635fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.695013:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x31399394250635fa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.695023:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147215.695026:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147215.695029:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x31399394250635fa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.695033:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x31399394250635fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147215.695083:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4394a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311526912:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147215.695138:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2002:x1830967310483840:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7344us (7809us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147215.695146:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20284 00000100:00100000:2.0:1746147215.695223:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311527168:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.695243:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x31399394250635ec lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2822144->3047423] (req 2822144->3047423) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5a9 expref: 13 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.695254:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94000, rc 0) 00000100:00100000:2.0:1746147215.695274:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2978:x1830967310483968:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3830us (5150us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.695279:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20285 00010000:00010000:3.0:1746147215.697485:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x3139939425063601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.697501:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x3139939425063601 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.697508:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x3139939425063601 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.697514:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d94e00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147215.697520:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x3139939425063601 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.697527:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x3139939425063601 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.697544:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009823a600) 00010000:00010000:3.0:1746147215.697547:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147215.697550:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x3139939425063601 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.697555:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x3139939425063601 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.697641:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95000/0x31399394250635f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5b0 expref: 32 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.697654:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x3139939425063608 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5b0 expref: 31 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.697659:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.697661:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147215.697664:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95e00, rc 0) 00010000:00010000:0.0:1746147215.697690:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x31399394250635de lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f59b expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.697702:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x31399394250635de lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f59b expref: 12 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147215.697717:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e7600, rc 0) 00000100:00100000:3.0:1746147215.697725:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2980:x1830967310484224:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3090us (3781us total) trans 8589937426 rc 0/0 00000100:00100000:3.0:1746147215.697733:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16520 00000100:00100000:0.0:1746147215.697744:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2002:x1830967310483712:12345-192.168.204.25@tcp:101:cat.0 Request processed in 10771us (11269us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147215.697750:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20283 00000100:00100000:0.0:1746147215.698957:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.699063:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310484352 00000100:00100000:2.0:1746147215.699074:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310484352 00010000:00010000:2.0:1746147215.699174:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425063598 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f571 expref: 11 pid: 10340 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.699203:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9208 00000100:00100000:2.0:1746147215.699210:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2000:x1830967310484352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.699222:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.699240:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425063598 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f571 expref: 11 pid: 10340 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.699251:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425063598 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f571 expref: 11 pid: 10340 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.699270:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95600/0x3139939425063598 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f571 expref: 11 pid: 10340 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.699299:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.699301:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.699311:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x31399394250635ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3047423) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5a9 expref: 10 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.699318:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x31399394250635ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3047423) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5a9 expref: 10 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.699348:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x31399394250635ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3047423) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5a9 expref: 10 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.699359:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311527296:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147215.699539:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.700752:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.700785:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.700812:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.700839:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.700926:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310484480 00000100:00100000:1.0:1746147215.700933:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310484480 00000100:00100000:1.0:1746147215.700963:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310484608 00000100:00100000:1.0:1746147215.700966:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310484608 00000100:00100000:1.0:1746147215.700976:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310484736 00000100:00100000:1.0:1746147215.700977:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310484736 00000100:00100000:1.0:1746147215.701000:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310484864 00000100:00100000:1.0:1746147215.701002:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310484864 00000100:00100000:3.0:1746147215.701007:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20286 00000100:00100000:3.0:1746147215.701020:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310484480:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147215.701029:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20287 00010000:00010000:3.0:1746147215.701034:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147215.701035:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2002:x1830967310484608:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147215.701043:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.701048:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425063616 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f5b7 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.701052:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e7000/0x313993942506361d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f5be expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147215.701079:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311527552:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147215.701080:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311527424:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147215.701157:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800984893c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.701176:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20288 00000100:00100000:1.0:1746147215.701181:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20289 00000100:00100000:2.0:1746147215.701184:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2002:x1830967310484736:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:1.0:1746147215.701187:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2002:x1830967310484864:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.701190:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.701193:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.701196:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d43a00/0x3139939425063624 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f5c5 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.701199:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e6a00/0x313993942506362b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f5cc expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.701218:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094187b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311527680:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147215.701219:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311527808:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147215.701237:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.701242:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147215.701294:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.701922:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.702155:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311527296:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147215.702169:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147215.702191:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310484352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2982us (3246us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.702199:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9208 00000100:00100000:3.0:1746147215.702877:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310485120 00000100:00100000:3.0:1746147215.702882:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310485120 00002000:00100000:3.0:1746147215.702909:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (2822144->2826239) req@ffff8800984d7800 x1830967310485120/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.702917:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d7800 with x1830967310485120 ext(2822144->2826239) 00002000:00010000:3.0:1746147215.702920:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d7800 00000100:00100000:3.0:1746147215.702947:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7438 00000100:00100000:3.0:1746147215.702952:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2003:x1830967310485120:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147215.703041:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2003:x1830967310485120:12345-192.168.204.25@tcp:3:cat.0 Request processed in 88us (1119us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147215.703046:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7438 00002000:00100000:3.0:1746147215.703051:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (2822144->2826239) req@ffff8800984d7800 x1830967310485120/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/4536 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.703058:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d7800 with x1830967310485120 ext(2822144->2826239) 00002000:00010000:3.0:1746147215.703060:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d7800 00000100:00100000:2.0:1746147215.703399:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311527424:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147215.703418:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425063616 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5b7 expref: 22 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.703428:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d95800/0x3139939425063616 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5b7 expref: 22 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.703437:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95800, rc 0) 00000100:00100000:2.0:1746147215.703456:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310484480:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2442us (2709us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147215.703462:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20286 00000100:00100000:3.0:1746147215.703530:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094187b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311527680:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147215.703545:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d43a00/0x3139939425063624 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5c5 expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.703554:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d43a00/0x3139939425063624 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5c5 expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147215.703578:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43a00, rc 0) 00000100:00100000:3.0:1746147215.703595:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2002:x1830967310484736:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2413us (2782us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147215.703600:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20288 00002000:00010000:1.0:1746147215.703861:0:1854:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime: 1746147214 -> 1746147215 00002000:00010000:1.0:1746147215.703865:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime: 1746147214 -> 1746147215 00000100:00100000:1.0:1746147215.703873:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311527808:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147215.703889:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e6a00/0x313993942506362b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5cc expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.703902:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e6a00/0x313993942506362b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5cc expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.703913:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e6a00, rc 0) 00000100:00100000:1.0:1746147215.703946:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2002:x1830967310484864:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2759us (3106us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147215.703951:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20289 00000100:00100000:1.0:1746147215.704455:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311527552:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147215.704470:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e7000/0x313993942506361d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5be expref: 11 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.704479:0:13712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e7000/0x313993942506361d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5be expref: 11 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.704486:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e7000, rc 0) 00000100:00100000:1.0:1746147215.704504:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2002:x1830967310484608:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3469us (3719us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147215.704509:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20287 00000100:00100000:1.0:1746147215.710364:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.710411:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.710879:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310485376 00000100:00100000:2.0:1746147215.710889:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310485376 00002000:00100000:2.0:1746147215.710930:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x98:0x0] (3043328->3047423) req@ffff8800947e4e00 x1830967310485376/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.710940:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e4e00 with x1830967310485376 ext(3043328->3047423) 00002000:00010000:2.0:1746147215.710946:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947e4e00 00000100:00100000:2.0:1746147215.712024:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7439 00000100:00100000:2.0:1746147215.712036:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2002:x1830967310485376:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147215.713642:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2002:x1830967310485376:12345-192.168.204.25@tcp:3:cat.0 Request processed in 1601us (3277us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147215.713652:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7439 00002000:00100000:2.0:1746147215.713661:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x98:0x0] (3043328->3047423) req@ffff8800947e4e00 x1830967310485376/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/4536 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.713670:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e4e00 with x1830967310485376 ext(3043328->3047423) 00002000:00010000:2.0:1746147215.713675:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947e4e00 00000100:00100000:0.0:1746147215.713677:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310485504 00000100:00100000:0.0:1746147215.713684:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310485504 00000100:00100000:3.0:1746147215.713950:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.714055:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310485760 00000100:00100000:2.0:1746147215.714059:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310485760 00000100:00100000:0.0:1746147215.714149:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20290 00000100:00100000:0.0:1746147215.714157:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2980:x1830967310485504:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147215.714173:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147215.714190:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425063632 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f5d3 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.714208:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6186 00000100:00100000:2.0:1746147215.714214:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2969:x1830967310485760:12345-192.168.204.25@tcp:35:cat.0 00010000:00010000:0.0:1746147215.714218:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7800/0x31399394250634d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4ad expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.714230:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147215.714232:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147215.714235:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425063632 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1269760->1511423] (req 1269760->1511423) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5d3 expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.714269:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7800/0x31399394250634d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4ad expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147215.714279:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7800/0x31399394250634d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4ad expref: 16 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746147215.714292:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311527936:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.714349:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2969:x1830967310485760:12345-192.168.204.25@tcp:35:cat.0 Request processed in 134us (400us total) trans 8589937427 rc 0/0 00000100:00100000:0.0:1746147215.714350:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.714354:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6186 00000100:00100000:1.0:1746147215.716884:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311527936:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147215.716911:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425063632 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1269760->1511423] (req 1269760->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5d3 expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.716931:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c42a00, rc 0) 00000100:00100000:1.0:1746147215.716973:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2980:x1830967310485504:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 2818us (6561us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.716980:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20290 00000100:00100000:0.0:1746147215.719466:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.719511:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.719593:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310486144 00000100:00100000:1.0:1746147215.719601:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310486144 00000100:00100000:1.0:1746147215.719655:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6187 00000100:00100000:1.0:1746147215.719662:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2978:x1830967310486144:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147215.719842:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2978:x1830967310486144:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 179us (328us total) trans 8589937428 rc 0/0 00000100:00100000:1.0:1746147215.719848:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6187 00000100:00100000:2.0:1746147215.719943:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310485888 00000100:00100000:2.0:1746147215.719947:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310485888 00010000:00010000:2.0:1746147215.719964:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7800/0x31399394250634d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4ad expref: 17 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.719992:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9209 00000100:00100000:2.0:1746147215.719996:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2000:x1830967310485888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.720004:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.720018:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7800/0x31399394250634d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4ad expref: 17 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.720028:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7800/0x31399394250634d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4ad expref: 17 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.720046:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e5c7800/0x31399394250634d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4ad expref: 17 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.720057:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.720060:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.720065:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425063632 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1511423) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5d3 expref: 24 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.720072:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425063632 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1511423) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5d3 expref: 24 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.720119:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425063632 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5d3 expref: 24 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.720135:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311528064:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147215.720188:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.724914:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.724916:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311528064:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147215.724937:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147215.724991:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310485888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4993us (5531us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.725204:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9209 00000100:00100000:3.0:1746147215.725692:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310486400 00000100:00100000:3.0:1746147215.725699:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310486400 00002000:00100000:3.0:1746147215.725731:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x96:0x0] (1269760->1273855) req@ffff8800984d7b80 x1830967310486400/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.725740:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d7b80 with x1830967310486400 ext(1269760->1273855) 00002000:00010000:3.0:1746147215.725744:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d7b80 00000100:00100000:3.0:1746147215.725760:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7440 00000100:00100000:3.0:1746147215.725765:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310486400:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147215.725875:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310486400:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 109us (968us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147215.725880:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7440 00002000:00100000:3.0:1746147215.725884:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x96:0x0] (1269760->1273855) req@ffff8800984d7b80 x1830967310486400/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/4536 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.725890:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d7b80 with x1830967310486400 ext(1269760->1273855) 00002000:00010000:3.0:1746147215.725893:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d7b80 00000100:00100000:0.0:1746147215.730742:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.730842:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310486656 00000100:00100000:2.0:1746147215.730850:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310486656 00002000:00100000:2.0:1746147215.730888:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x96:0x0] (1507328->1511423) req@ffff8800984d4000 x1830967310486656/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.730896:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d4000 with x1830967310486656 ext(1507328->1511423) 00002000:00010000:2.0:1746147215.730901:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d4000 00000100:00100000:2.0:1746147215.730933:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7441 00000100:00100000:2.0:1746147215.730940:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310486656:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147215.731059:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310486656:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 119us (322us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147215.731065:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7441 00002000:00100000:2.0:1746147215.731070:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x96:0x0] (1507328->1511423) req@ffff8800984d4000 x1830967310486656/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/4536 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.731076:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d4000 with x1830967310486656 ext(1507328->1511423) 00002000:00010000:2.0:1746147215.731078:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d4000 00000100:00100000:0.0:1746147215.736949:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.737076:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310486912 00000100:00100000:1.0:1746147215.737084:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310486912 00000100:00100000:1.0:1746147215.738217:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6188 00000100:00100000:1.0:1746147215.738227:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2980:x1830967310486912:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147215.738434:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2980:x1830967310486912:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 208us (1494us total) trans 8589937429 rc 0/0 00000100:00100000:1.0:1746147215.738440:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6188 00010000:00010000:1.0:1746147215.821939:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147215.825340:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.825441:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310487168 00000100:00100000:3.0:1746147215.825456:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310487168 00000100:00100000:3.0:1746147215.825535:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16521 00000100:00100000:3.0:1746147215.825545:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2986:x1830967310487168:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147215.825576:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.825593:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x3139939425063639 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f5da expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.825678:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425063640 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.825690:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425063640 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.825699:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425063640 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147215.825708:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147215.825788:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x3139939425063639 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5da expref: 35 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.825819:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425063640 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5da expref: 34 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.825826:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.825828:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746147215.825830:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94a00, rc 0) 00000100:00100000:3.0:1746147215.827837:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2986:x1830967310487168:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2284us (2499us total) trans 8589937430 rc 0/0 00000100:00100000:3.0:1746147215.827847:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16521 00000100:00100000:0.0:1746147215.830575:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.830912:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.830955:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.831037:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310487296 00000100:00100000:1.0:1746147215.831047:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310487296 00000100:00100000:1.0:1746147215.831134:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310487424 00000100:00100000:1.0:1746147215.831137:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310487424 00000100:00100000:1.0:1746147215.831155:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310487552 00000100:00100000:1.0:1746147215.831158:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310487552 00000100:00100000:1.0:1746147215.831175:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20291 00000100:00100000:1.0:1746147215.831182:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310487296:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147215.831204:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.831224:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x313993942506364e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f5e1 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.831286:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20292 00000100:00100000:1.0:1746147215.831288:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311528192:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147215.831304:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310487424:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.831322:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.831339:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d43400/0x3139939425063655 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f5e8 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147215.831380:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.831385:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311528320:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147215.831435:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.831456:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20293 00000100:00100000:2.0:1746147215.831461:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310487552:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.831466:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.831471:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d43a00/0x313993942506365c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f5ef expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.831489:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094187b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311528448:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147215.831501:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746147215.834193:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311528192:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147215.834230:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x313993942506364e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5e1 expref: 38 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.834245:0:13712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958e7800/0x313993942506364e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5e1 expref: 38 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.834274:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e7800, rc 0) 00000100:00100000:1.0:1746147215.834317:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310487296:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3135us (3760us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147215.834326:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20291 00000100:00100000:2.0:1746147215.834930:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311528320:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147215.834954:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094187b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311528448:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147215.834955:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d43400/0x3139939425063655 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5e8 expref: 28 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.834965:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d43400/0x3139939425063655 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5e8 expref: 28 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.834970:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d43a00/0x313993942506365c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5ef expref: 28 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.834980:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d43a00/0x313993942506365c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5ef expref: 27 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.834989:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43400, rc 0) 00010000:00010000:1.0:1746147215.834992:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43a00, rc 0) 00000100:00100000:1.0:1746147215.835022:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310487552:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3561us (4067us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147215.835028:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20293 00000100:00100000:2.0:1746147215.835710:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310487424:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4411us (4795us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147215.835717:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20292 00000100:00100000:0.0:1746147215.840079:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.841190:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310487680 00000100:00100000:2.0:1746147215.841202:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310487680 00000100:00100000:2.0:1746147215.841337:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20294 00000100:00100000:2.0:1746147215.841348:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2986:x1830967310487680:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.841368:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.841388:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425063663 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f5f6 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.841419:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009844ae00/0x313993942506344f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f436 expref: 20 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.841427:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147215.841429:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147215.841432:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425063663 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5f6 expref: 38 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.841467:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009844ae00/0x313993942506344f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f436 expref: 20 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.841480:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009844ae00/0x313993942506344f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f436 expref: 20 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.841492:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311528576:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.843085:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.845162:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.845223:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310487936 00000100:00100000:3.0:1746147215.845232:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310487936 00000100:00100000:3.0:1746147215.845280:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16522 00000100:00100000:3.0:1746147215.845288:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2989:x1830967310487936:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147215.845313:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.845333:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x313993942506366a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f5fd expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.845435:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x3139939425063671 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.845449:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x3139939425063671 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147215.845459:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x3139939425063671 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147215.845468:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147215.845576:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x313993942506366a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5fd expref: 17 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.845604:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x3139939425063671 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5fd expref: 16 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.845611:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.845614:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746147215.845616:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95600, rc 0) 00000100:00100000:3.0:1746147215.845663:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2989:x1830967310487936:12345-192.168.204.25@tcp:101:cat.0 Request processed in 377us (511us total) trans 8589937431 rc 0/0 00000100:00100000:3.0:1746147215.845669:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16522 00000100:00100000:0.0:1746147215.847649:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.848372:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311528576:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.848410:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425063663 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5f6 expref: 38 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.848427:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43200, rc 0) 00000100:00100000:2.0:1746147215.848481:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2986:x1830967310487680:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7134us (8416us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.848490:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20294 00000100:00100000:3.0:1746147215.848782:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310488064 00000100:00100000:3.0:1746147215.848789:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310488064 00010000:00010000:3.0:1746147215.848816:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009844ae00/0x313993942506344f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f436 expref: 21 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.848850:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9210 00000100:00100000:3.0:1746147215.848856:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2000:x1830967310488064:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.848869:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147215.848887:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009844ae00/0x313993942506344f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f436 expref: 21 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.848900:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009844ae00/0x313993942506344f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f436 expref: 21 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.848922:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009844ae00/0x313993942506344f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f436 expref: 21 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.848933:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.848935:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.848943:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425063663 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5f6 expref: 37 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.848950:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425063663 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5f6 expref: 37 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.848981:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425063663 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5f6 expref: 37 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.848992:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311528704:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147215.849058:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.849061:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147215.849392:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310488192 00000100:00100000:2.0:1746147215.849395:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310488192 00000100:00100000:2.0:1746147215.849417:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20295 00000100:00100000:2.0:1746147215.849422:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2001:x1830967310488192:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.849433:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.849443:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d43600/0x313993942506367f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f604 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.849459:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.849460:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.849463:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d43600/0x313993942506367f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f604 expref: 22 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.849473:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d43600/0x313993942506367f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f604 expref: 22 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.849481:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43600, rc 0) 00000100:00100000:2.0:1746147215.849499:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310488192:12345-192.168.204.25@tcp:101:cat.0 Request processed in 77us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.849504:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20295 00000100:00100000:3.0:1746147215.850259:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.850302:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.850367:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310488320 00000100:00100000:1.0:1746147215.850372:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310488320 00000100:00100000:1.0:1746147215.850402:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310488448 00000100:00100000:1.0:1746147215.850404:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310488448 00000100:00100000:1.0:1746147215.850419:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20296 00000100:00100000:1.0:1746147215.850424:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310488320:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147215.850454:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20297 00000100:00100000:2.0:1746147215.850460:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310488448:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.850470:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.850482:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x3139939425063686 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f612 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147215.850520:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311528832:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147215.850583:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.850591:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942506368d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f60b expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147215.850617:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311528960:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147215.851403:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147215.851510:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147215.853387:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311528704:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147215.853412:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147215.853471:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967310488064:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4612us (5826us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.853482:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9210 00000100:00100000:2.0:1746147215.854382:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311528832:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147215.854416:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x3139939425063686 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f612 expref: 13 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.854430:0:10340:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d43e00/0x3139939425063686 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f612 expref: 13 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147215.854447:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43e00, rc 0) 00000100:00100000:2.0:1746147215.854489:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310488448:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4029us (4185us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147215.854497:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20297 00002000:00010000:1.0:1746147215.855004:0:13712:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime: 1746147214 -> 1746147215 00002000:00010000:1.0:1746147215.855009:0:13712:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime: 1746147214 -> 1746147215 00000100:00100000:1.0:1746147215.855018:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311528960:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147215.855039:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942506368d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f60b expref: 11 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.855047:0:13712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e6c00/0x313993942506368d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f60b expref: 11 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147215.855074:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e6c00, rc 0) 00000100:00100000:1.0:1746147215.855118:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310488320:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4693us (4861us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147215.855124:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20296 00000100:00100000:0.0:1746147215.856198:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.856270:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310488832 00000100:00100000:2.0:1746147215.856277:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310488832 00002000:00100000:2.0:1746147215.856317:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880099156a00 x1830967310488832/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.856326:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099156a00 with x1830967310488832 ext(0->1048575) 00002000:00010000:2.0:1746147215.856331:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099156a00 00000100:00100000:2.0:1746147215.856434:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7442 00000100:00100000:2.0:1746147215.856441:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310488832:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147215.859082:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.859182:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310488960 00000100:00100000:3.0:1746147215.859190:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310488960 00002000:00100000:3.0:1746147215.859237:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880099154a80 x1830967310488960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 504/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.859247:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099154a80 with x1830967310488960 ext(1048576->2097151) 00002000:00010000:3.0:1746147215.859254:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099154a80 00000100:00100000:3.0:1746147215.859278:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7443 00000100:00100000:3.0:1746147215.859287:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310488960:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147215.861622:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.861891:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310489216 00000100:00100000:2.0:1746147215.861901:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310489216 00002000:00100000:2.0:1746147215.861956:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880099155880 x1830967310489216/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.861965:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099155880 with x1830967310489216 ext(0->1048575) 00002000:00010000:2.0:1746147215.861972:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099155880 00000100:00100000:2.0:1746147215.862008:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7444 00000100:00100000:2.0:1746147215.862016:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310489216:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147215.863802:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310488832:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7352us (7596us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147215.863813:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7442 00002000:00100000:2.0:1746147215.863822:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880099156a00 x1830967310488832/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.863830:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099156a00 with x1830967310488832 ext(0->1048575) 00002000:00010000:2.0:1746147215.863835:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099156a00 00000100:00100000:3.0:1746147215.866604:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310488960:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7306us (7523us total) trans 0 rc 806912/806912 00000100:00100000:3.0:1746147215.866617:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7443 00002000:00100000:3.0:1746147215.866628:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880099154a80 x1830967310488960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 504/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 806912/806912 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.866637:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099154a80 with x1830967310488960 ext(1048576->2097151) 00002000:00010000:3.0:1746147215.866643:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099154a80 00000100:00100000:2.0:1746147215.871941:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310489216:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9911us (10316us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147215.871955:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7444 00002000:00100000:2.0:1746147215.871967:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880099155880 x1830967310489216/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.871977:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099155880 with x1830967310489216 ext(0->1048575) 00002000:00010000:2.0:1746147215.871982:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099155880 00000100:00100000:0.0:1746147215.874342:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.874488:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310489344 00000100:00100000:1.0:1746147215.874499:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310489344 00000100:00100000:1.0:1746147215.874574:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20298 00000100:00100000:1.0:1746147215.874583:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2986:x1830967310489344:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147215.874604:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.874627:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x3139939425063694 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f619 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.874662:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x31399394250634e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4bb expref: 15 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.874670:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147215.874672:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147215.874675:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x3139939425063694 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f619 expref: 26 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.874708:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x31399394250634e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4bb expref: 15 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.874721:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x31399394250634e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4bb expref: 15 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746147215.874740:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311529088:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147215.874843:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.876827:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.876935:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311529088:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147215.876966:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x3139939425063694 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f619 expref: 26 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.876987:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e7600, rc 0) 00000100:00100000:1.0:1746147215.877031:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2986:x1830967310489344:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2449us (2701us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.877040:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20298 00000100:00100000:3.0:1746147215.877125:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310489472 00000100:00100000:3.0:1746147215.877131:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310489472 00010000:00010000:3.0:1746147215.877158:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x31399394250634e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4bb expref: 16 pid: 1853 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.877195:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9211 00000100:00100000:3.0:1746147215.877201:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2000:x1830967310489472:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.877213:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147215.877233:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x31399394250634e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4bb expref: 16 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.877244:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x31399394250634e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4bb expref: 16 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.877267:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093714c00/0x31399394250634e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4bb expref: 16 pid: 1853 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.877291:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.877293:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.877300:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x3139939425063694 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f619 expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.877308:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x3139939425063694 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f619 expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.877336:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x3139939425063694 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f619 expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.877347:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311529216:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147215.877397:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.878142:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.878226:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310489600 00000100:00100000:1.0:1746147215.878230:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310489600 00000100:00100000:1.0:1746147215.878383:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20299 00000100:00100000:1.0:1746147215.878389:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2989:x1830967310489600:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147215.878403:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.878645:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e6600/0x313993942506369b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f620 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.878674:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425063632 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5d3 expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.878681:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147215.878683:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147215.878685:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e6600/0x313993942506369b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f620 expref: 11 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.878708:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425063632 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1511423) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5d3 expref: 25 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.878719:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425063632 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1511423) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5d3 expref: 25 pid: 13712 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746147215.878729:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311529344:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147215.878819:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147215.879770:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311529216:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147215.879787:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147215.879815:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2000:x1830967310489472:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2613us (2996us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.879824:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9211 00000100:00100000:1.0:1746147215.880784:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:13712:1830967311529344:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147215.880807:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e6600/0x313993942506369b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f620 expref: 11 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.880825:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e6600, rc 0) 00000100:00100000:1.0:1746147215.880852:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2989:x1830967310489600:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2464us (2711us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.880859:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20299 00000100:00100000:0.0:1746147215.882054:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.882192:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310489728 00000100:00100000:2.0:1746147215.882203:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310489728 00002000:00100000:2.0:1746147215.882264:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1269760->1511423) req@ffff880099155c00 x1830967310489728/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.882274:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099155c00 with x1830967310489728 ext(1269760->1511423) 00010000:00010000:2.0:1746147215.882284:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425063632 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5d3 expref: 26 pid: 13712 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.882299:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425063632 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5d3 expref: 26 pid: 13712 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746147215.882307:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099155c00 00000100:00100000:2.0:1746147215.882342:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1762 00000100:00100000:2.0:1746147215.882355:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310489728:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147215.883323:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.883362:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.883458:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310490112 00000100:00100000:3.0:1746147215.883464:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310490112 00002000:00100000:3.0:1746147215.883491:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880099156680 x1830967310490112/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.883499:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099156680 with x1830967310490112 ext(1048576->2097151) 00002000:00010000:3.0:1746147215.883504:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099156680 00000100:00100000:3.0:1746147215.883518:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310490240 00000100:00100000:3.0:1746147215.883522:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310490240 00002000:00100000:3.0:1746147215.883535:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099156300 x1830967310490240/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.883543:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099156300 with x1830967310490240 ext(1048576->2097151) 00002000:00010000:3.0:1746147215.883547:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099156300 00000100:00100000:3.0:1746147215.883583:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7445 00000100:00100000:3.0:1746147215.883589:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967310490112:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147215.884010:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7446 00000100:00100000:2.0:1746147215.884017:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967310490240:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147215.888162:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310489728:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5794us (6099us total) trans 17179875325 rc 0/0 00000100:00100000:2.0:1746147215.888177:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1762 00002000:00100000:2.0:1746147215.888189:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x96:0x0] (1269760->1511423) req@ffff880099155c00 x1830967310489728/t17179875325(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/448 e 0 to 0 dl 1746147226 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.888200:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099155c00 with x1830967310489728 ext(1269760->1511423) 00010000:00010000:2.0:1746147215.888210:0:13302:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425063632 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5d3 expref: 30 pid: 13712 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.888224:0:13302:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425063632 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5d3 expref: 30 pid: 13712 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746147215.888236:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099155c00 00000100:00100000:2.0:1746147215.893656:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967310490240:12345-192.168.204.25@tcp:3:cat.0 Request processed in 9622us (10276us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147215.893674:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7446 00002000:00100000:2.0:1746147215.893691:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099156300 x1830967310490240/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.893702:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099156300 with x1830967310490240 ext(1048576->2097151) 00002000:00010000:2.0:1746147215.893709:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099156300 00000100:00100000:0.0:1746147215.895299:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.895986:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310490368 00000100:00100000:3.0:1746147215.895998:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310490368 00010000:00010000:3.0:1746147215.896043:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425063632 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5d3 expref: 30 pid: 13712 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.896109:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9212 00000100:00100000:3.0:1746147215.896117:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310490368:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.896134:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147215.896155:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425063632 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5d3 expref: 30 pid: 13712 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.896167:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425063632 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1511423) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5d3 expref: 30 pid: 13712 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.896192:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42a00/0x3139939425063632 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1511423) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5d3 expref: 30 pid: 13712 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.896225:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.896227:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.896235:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e6600/0x313993942506369b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f620 expref: 10 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.896243:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e6600/0x313993942506369b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f620 expref: 10 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.896279:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e6600/0x313993942506369b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f620 expref: 10 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.896291:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311529472:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147215.896666:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147215.897624:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967310490112:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14031us (14298us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147215.897633:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7445 00002000:00100000:3.0:1746147215.897643:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880099156680 x1830967310490112/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.897652:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099156680 with x1830967310490112 ext(1048576->2097151) 00002000:00010000:3.0:1746147215.897656:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099156680 00000100:00100000:3.0:1746147215.900302:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311529472:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147215.900324:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147215.900523:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310490368:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4404us (5228us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.900534:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9212 00000100:00100000:0.0:1746147215.903211:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.903803:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310490624 00000100:00100000:3.0:1746147215.903821:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310490624 00002000:00100000:3.0:1746147215.903891:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88012ca10700 x1830967310490624/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.903902:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca10700 with x1830967310490624 ext(1048576->2097151) 00002000:00010000:3.0:1746147215.903911:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca10700 00000100:00100000:2.0:1746147215.904496:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7447 00000100:00100000:2.0:1746147215.904508:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310490624:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147215.914382:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.914563:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310490880 00000100:00100000:3.0:1746147215.914573:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310490880 00002000:00100000:3.0:1746147215.914620:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88012ca13800 x1830967310490880/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.914629:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca13800 with x1830967310490880 ext(2097152->3145727) 00002000:00010000:3.0:1746147215.914636:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ca13800 00000100:00100000:3.0:1746147215.914717:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7448 00000100:00100000:3.0:1746147215.914726:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967310490880:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147215.918639:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310490624:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14119us (15426us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147215.918655:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7447 00002000:00100000:3.0:1746147215.918668:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff88012ca10700 x1830967310490624/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.918678:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca10700 with x1830967310490624 ext(1048576->2097151) 00002000:00010000:3.0:1746147215.918685:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca10700 00000100:00100000:3.0:1746147215.922587:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967310490880:12345-192.168.204.25@tcp:3:cat.0 Request processed in 7848us (8202us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147215.922603:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7448 00002000:00100000:3.0:1746147215.922617:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88012ca13800 x1830967310490880/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.922628:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca13800 with x1830967310490880 ext(2097152->3145727) 00002000:00010000:3.0:1746147215.922635:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ca13800 00000100:00100000:0.0:1746147215.924942:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147215.925009:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310491008 00000100:00100000:1.0:1746147215.925019:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310491008 00000100:00100000:1.0:1746147215.925185:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20300 00000100:00100000:1.0:1746147215.925194:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2989:x1830967310491008:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147215.925214:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147215.925236:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f01ae00/0x31399394250636a2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f627 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.925269:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.925271:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147215.925279:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f01ae00/0x31399394250636a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f627 expref: 12 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.925294:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f01ae00/0x31399394250636a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f627 expref: 12 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147215.925305:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f01ae00, rc 0) 00000100:00100000:1.0:1746147215.925343:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2989:x1830967310491008:12345-192.168.204.25@tcp:101:cat.0 Request processed in 151us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147215.925349:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20300 00000100:00100000:0.0:1746147215.926369:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.926436:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310491136 00000100:00100000:2.0:1746147215.926441:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310491136 00000100:00100000:2.0:1746147215.926479:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20301 00000100:00100000:2.0:1746147215.926485:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2986:x1830967310491136:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.926495:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.926507:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x31399394250636a9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f62e expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.926525:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x31399394250635ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3047423) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5a9 expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.926531:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147215.926532:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147215.926535:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x31399394250636a9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f62e expref: 28 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.926570:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x31399394250635ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3047423) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5a9 expref: 11 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.926585:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x31399394250635ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3047423) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5a9 expref: 11 pid: 10340 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.926597:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311529600:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147215.926665:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.928504:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.928628:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311529600:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147215.928657:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x31399394250636a9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f62e expref: 28 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.928674:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3e000, rc 0) 00000100:00100000:2.0:1746147215.928709:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2986:x1830967310491136:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2223us (2343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.928716:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20301 00000100:00100000:3.0:1746147215.928807:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310491264 00000100:00100000:3.0:1746147215.928813:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310491264 00002000:00100000:3.0:1746147215.928856:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x98:0x0] (2822144->3047423) req@ffff88012ca12a00 x1830967310491264/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.928866:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca12a00 with x1830967310491264 ext(2822144->3047423) 00010000:00010000:3.0:1746147215.928872:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x31399394250635ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5a9 expref: 12 pid: 10340 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.928884:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x31399394250635ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5a9 expref: 12 pid: 10340 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746147215.928890:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ca12a00 00000100:00100000:3.0:1746147215.928921:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1763 00000100:00100000:3.0:1746147215.928928:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2001:x1830967310491264:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147215.929862:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.930108:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310491520 00000100:00100000:2.0:1746147215.930113:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310491520 00002000:00100000:2.0:1746147215.930141:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88012ca11500 x1830967310491520/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.930150:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca11500 with x1830967310491520 ext(1048576->2097151) 00002000:00010000:2.0:1746147215.930154:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca11500 00000100:00100000:2.0:1746147215.930170:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7449 00000100:00100000:2.0:1746147215.930176:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310491520:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147215.933989:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967310491264:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5045us (5476us total) trans 17179875326 rc 0/0 00000100:00100000:3.0:1746147215.934003:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1763 00002000:00100000:3.0:1746147215.934016:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x98:0x0] (2822144->3047423) req@ffff88012ca12a00 x1830967310491264/t17179875326(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/448 e 0 to 0 dl 1746147226 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.934025:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca12a00 with x1830967310491264 ext(2822144->3047423) 00010000:00010000:3.0:1746147215.934035:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x31399394250635ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5a9 expref: 16 pid: 10340 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.934051:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x31399394250635ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5a9 expref: 16 pid: 10340 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746147215.934058:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ca12a00 00000100:00100000:2.0:1746147215.936086:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310491520:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5900us (6216us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147215.936132:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7449 00002000:00100000:2.0:1746147215.936141:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff88012ca11500 x1830967310491520/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.936150:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca11500 with x1830967310491520 ext(1048576->2097151) 00002000:00010000:2.0:1746147215.936157:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca11500 00000100:00100000:0.0:1746147215.938165:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.938344:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310491648 00000100:00100000:3.0:1746147215.938355:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310491648 00010000:00010000:3.0:1746147215.938395:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x31399394250635ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2822144->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5a9 expref: 14 pid: 10340 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.939543:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9213 00000100:00100000:3.0:1746147215.939566:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2003:x1830967310491648:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.939587:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147215.939612:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x31399394250635ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2822144->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5a9 expref: 14 pid: 10340 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.939631:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x31399394250635ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2822144->3047423) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5a9 expref: 14 pid: 10340 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.939659:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d94000/0x31399394250635ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2822144->3047423) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5a9 expref: 14 pid: 10340 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.939698:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.939700:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147215.939708:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x31399394250636a9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f62e expref: 27 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.939716:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x31399394250636a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f62e expref: 27 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.939752:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x31399394250636a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f62e expref: 27 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147215.939766:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311529728:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147215.939859:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.950701:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.950849:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311529728:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147215.950873:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147215.950928:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2003:x1830967310491648:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 11374us (12768us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.950940:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9213 00000100:00100000:0.0:1746147215.951068:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.951283:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310491776 00000100:00100000:2.0:1746147215.951291:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310491776 00000100:00100000:2.0:1746147215.951336:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20302 00000100:00100000:2.0:1746147215.951343:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2989:x1830967310491776:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147215.951361:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.951377:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x31399394250636b0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f635 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.951400:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.951402:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147215.951409:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x31399394250636b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f635 expref: 14 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.951422:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x31399394250636b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f635 expref: 14 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.951432:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e3fa00, rc 0) 00000100:00100000:2.0:1746147215.951456:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2989:x1830967310491776:12345-192.168.204.25@tcp:101:cat.0 Request processed in 114us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.951461:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20302 00000100:00100000:0.0:1746147215.951586:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.951988:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310492032 00000100:00100000:3.0:1746147215.951992:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310492032 00002000:00100000:3.0:1746147215.952018:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88012ca12300 x1830967310492032/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.952027:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca12300 with x1830967310492032 ext(2097152->4194303) 00002000:00010000:3.0:1746147215.952032:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca12300 00000100:00100000:3.0:1746147215.952043:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310492288 00000100:00100000:3.0:1746147215.952045:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310492288 00002000:00100000:3.0:1746147215.952057:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88012ca12d80 x1830967310492288/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147215.952064:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca12d80 with x1830967310492288 ext(3145728->4194303) 00002000:00010000:3.0:1746147215.952067:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ca12d80 00000100:00100000:3.0:1746147215.952085:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7450 00000100:00100000:3.0:1746147215.952105:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310492032:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147215.953891:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7451 00000100:00100000:1.0:1746147215.953905:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310492288:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147215.955265:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147215.955349:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310492544 00000100:00100000:3.0:1746147215.955356:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310492544 00000100:00100000:3.0:1746147215.955402:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16523 00000100:00100000:3.0:1746147215.955408:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2991:x1830967310492544:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147215.955946:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147215.958061:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90e00/0x31399394250636b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f63c expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.958206:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250636be lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147215.958224:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250635c9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f58d expref: 17 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.958237:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x3139939425063608 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5b0 expref: 33 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.958243:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250636be lrc: 5/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147215.958278:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x3139939425063608 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5b0 expref: 33 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.958290:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x3139939425063608 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5b0 expref: 33 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.958304:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311529856:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.958405:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250635c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f58d expref: 17 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.958413:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250635c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f58d expref: 17 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.958421:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311529984:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147215.958437:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:0.0:1746147215.963621:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.964005:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310492800 00000100:00100000:2.0:1746147215.964014:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310492800 00002000:00100000:2.0:1746147215.964060:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88012ca11880 x1830967310492800/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/0 e 0 to 0 dl 1746147226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.964070:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca11880 with x1830967310492800 ext(2097152->4194303) 00002000:00010000:2.0:1746147215.964075:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca11880 00000100:00100000:2.0:1746147215.964122:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7452 00000100:00100000:2.0:1746147215.964130:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310492800:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147215.966207:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800975a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311529856:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147215.966222:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311529984:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147215.966247:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250636be lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:0.0:1746147215.975609:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147215.977360:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.977429:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310492928 00000100:00100000:2.0:1746147215.977439:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310492928 00010000:00010000:2.0:1746147215.977479:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x3139939425063608 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5b0 expref: 34 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746147215.978297:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310493056 00000100:00100000:2.0:1746147215.978301:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310493056 00010000:00010000:2.0:1746147215.978318:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250635c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f58d expref: 18 pid: 7238 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746147215.978390:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9214 00000100:00100000:3.0:1746147215.978401:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2003:x1830967310492928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147215.978416:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147215.978423:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x3139939425063608 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5b0 expref: 34 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.978433:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x3139939425063608 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5b0 expref: 34 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.978455:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x3139939425063608 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5b0 expref: 34 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.978480:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00000100:00100000:2.0:1746147215.978731:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9215 00000100:00100000:2.0:1746147215.978738:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310493056:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147215.978747:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147215.978752:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250635c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f58d expref: 18 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746147215.979214:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250636be lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147215.979224:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250636be lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147215.979230:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147215.979282:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2003:x1830967310492928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 884us (5192us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147215.979289:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9214 00010000:00010000:2.0:1746147215.981250:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250635c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f58d expref: 18 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.981282:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42000/0x31399394250635c9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f58d expref: 18 pid: 7238 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746147215.981319:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147215.981324:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250636be lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147215.981332:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250636be lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147215.981339:0:4349:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250636be lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147215.981365:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147215.981653:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250636be lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147215.981661:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250636be lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:3.0:1746147215.981684:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147215.981815:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d90e00/0x31399394250636b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f63c expref: 19 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.981827:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250636be lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f63c expref: 18 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147215.981834:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147215.981836:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147215.981838:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94000, rc 0) 00000100:00100000:2.0:1746147215.982550:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310493056:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3809us (5194us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147215.982568:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9215 00000100:00100000:2.0:1746147215.982668:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147215.982691:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310493312 00000100:00100000:2.0:1746147215.982699:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310493312 00000100:00100000:2.0:1746147215.982727:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16524 00000100:00100000:2.0:1746147215.982732:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2993:x1830967310493312:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147215.982753:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147215.982768:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3f600/0x31399394250636cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f643 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.982824:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x31399394250636d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.982834:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x31399394250636d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.982841:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x31399394250636d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.982854:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x31399394250636da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.982859:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x31399394250636da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.982863:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x31399394250636da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.982943:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250636e1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.982951:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250636e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.982956:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250636e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147215.982968:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147215.983020:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x31399394250636d3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.983029:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x31399394250636d3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.983034:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x31399394250636d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.983042:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x31399394250636d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.983047:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096e3ea00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147215.983050:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x31399394250636d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.983056:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x31399394250636d3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.983064:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147215.983066:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147215.983069:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x31399394250636d3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.983073:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3ea00/0x31399394250636d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.983085:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x31399394250636da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.983109:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x31399394250636da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.983113:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x31399394250636da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.983117:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f9fe800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147215.983118:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x31399394250636da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.983123:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x31399394250636da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.983129:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096e23e00) 00010000:00010000:2.0:1746147215.983130:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147215.983132:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x31399394250636da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.983137:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9fe800/0x31399394250636da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147215.983163:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096e3f600/0x31399394250636cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f643 expref: 36 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.983172:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250636e1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f643 expref: 35 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147215.983178:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147215.983179:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147215.983181:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9ff600, rc 0) 00000100:00100000:2.0:1746147215.983205:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2993:x1830967310493312:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 472us (536us total) trans 8589937433 rc 0/0 00000100:00100000:2.0:1746147215.983211:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16524 00000100:00100000:2.0:1746147215.983371:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310492032:12345-192.168.204.25@tcp:3:cat.0 Request processed in 31265us (32302us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147215.985057:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7450 00002000:00100000:2.0:1746147215.985074:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88012ca12300 x1830967310492032/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147215.985085:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca12300 with x1830967310492032 ext(2097152->4194303) 00002000:00010000:2.0:1746147215.985104:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca12300 00000100:00100000:3.0:1746147215.985453:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2991:x1830967310492544:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 30042us (30190us total) trans 8589937432 rc 0/0 00000100:00100000:3.0:1746147215.985462:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16523 00000100:00100000:1.0:1746147215.986914:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310492288:12345-192.168.204.25@tcp:3:cat.0 Request processed in 33007us (35320us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147215.986925:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7451 00002000:00100000:1.0:1746147215.986934:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88012ca12d80 x1830967310492288/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147215.986943:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca12d80 with x1830967310492288 ext(3145728->4194303) 00002000:00010000:1.0:1746147215.986949:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ca12d80 00000100:00100000:2.0:1746147215.998337:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.000288:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310493440 00000100:00100000:1.0:1746147216.000302:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310493440 00000100:00080000:3.0:1746147216.000385:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746147216.000396:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20303 00000100:00100000:1.0:1746147216.000407:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310493440:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147216.000432:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147216.000452:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x31399394250636ef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f64a expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.000482:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147216.000484:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147216.000493:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x31399394250636ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f64a expref: 29 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147216.000508:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x31399394250636ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f64a expref: 29 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147216.000519:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9800, rc 0) 00000100:00100000:1.0:1746147216.000586:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310493440:12345-192.168.204.25@tcp:101:cat.0 Request processed in 182us (2257us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.000592:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20303 00000100:00100000:2.0:1746147216.007350:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310492800:12345-192.168.204.25@tcp:3:cat.0 Request processed in 41655us (42174us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147216.007368:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7452 00002000:00100000:2.0:1746147216.007383:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff88012ca11880 x1830967310492800/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:591/0 lens 488/440 e 0 to 0 dl 1746147226 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.007400:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ca11880 with x1830967310492800 ext(2097152->4194303) 00002000:00010000:2.0:1746147216.007406:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ca11880 00000100:00100000:0.0:1746147216.009004:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.011646:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310493568 00000100:00100000:2.0:1746147216.011659:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310493568 00000100:00100000:2.0:1746147216.011756:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20304 00000100:00100000:2.0:1746147216.011766:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2993:x1830967310493568:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147216.011786:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.011809:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250636f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f651 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.011840:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a31e00/0x313993942506352f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f508 expref: 39 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.011849:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091eba800/0x313993942506354b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f524 expref: 21 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.011855:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.011856:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.011859:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250636f6 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2576384->2637823] (req 2576384->2637823) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f651 expref: 39 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.011890:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091eba800/0x313993942506354b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f524 expref: 21 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.011901:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091eba800/0x313993942506354b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f524 expref: 21 pid: 12201 timeout: 854 lvb_type: 1 00000100:00100000:2.0:1746147216.011918:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311530112:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.012012:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a31e00/0x313993942506352f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f508 expref: 39 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.012018:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a31e00/0x313993942506352f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f508 expref: 39 pid: 9586 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.012025:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311530240:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.012039:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00000100:00080000:3.0:1746147216.012171:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147216.015920:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311530112:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.015933:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10340:1830967311530240:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.015968:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250636f6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2576384->2637823] (req 2576384->2637823) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f651 expref: 39 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.015986:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9fe800, rc 0) 00000100:00100000:2.0:1746147216.016046:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2993:x1830967310493568:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4282us (7049us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.016056:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20304 00000100:00100000:0.0:1746147216.017458:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.017529:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310493696 00000100:00100000:2.0:1746147216.017536:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310493696 00000100:00100000:2.0:1746147216.017591:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20305 00000100:00100000:2.0:1746147216.017598:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2991:x1830967310493696:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147216.017615:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.017633:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d90000/0x31399394250636fd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f658 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.017659:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x3139939425063694 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f619 expref: 28 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.017667:0:10340:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f01ae00/0x31399394250636a2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f627 expref: 15 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.017673:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.017674:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.017677:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d90000/0x31399394250636fd lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1638400->1851391] (req 1638400->1851391) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f658 expref: 15 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.017704:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f01ae00/0x31399394250636a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f627 expref: 15 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.017714:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f01ae00/0x31399394250636a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f627 expref: 15 pid: 13712 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.017725:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311530368:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.017803:0:10340:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x3139939425063694 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f619 expref: 28 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.017811:0:10340:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x3139939425063694 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f619 expref: 28 pid: 13712 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.017818:0:10340:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311530496:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.017835:0:10340:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147216.019349:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.019421:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310493824 00000100:00100000:2.0:1746147216.019426:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310493824 00010000:00010000:2.0:1746147216.019458:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a31e00/0x313993942506352f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f508 expref: 39 pid: 9586 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.019490:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9216 00000100:00100000:2.0:1746147216.019496:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967310493824:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147216.019506:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147216.019526:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a31e00/0x313993942506352f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f508 expref: 39 pid: 9586 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.019536:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a31e00/0x313993942506352f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f508 expref: 39 pid: 9586 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.019570:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a31e00/0x313993942506352f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f508 expref: 39 pid: 9586 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.019591:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147216.019884:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310493824:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 386us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.019891:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9216 00000100:00100000:0.0:1746147216.025037:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.025137:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.025706:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311530368:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.025717:0:10340:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10340:1830967311530496:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.025750:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d90000/0x31399394250636fd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1638400->1851391] (req 1638400->1851391) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f658 expref: 15 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.025768:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d90000, rc 0) 00000100:00100000:3.0:1746147216.025826:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2991:x1830967310493696:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 8227us (8372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.025834:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20305 00000100:00100000:3.0:1746147216.026155:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310493952 00000100:00100000:3.0:1746147216.026162:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310493952 00010000:00010000:3.0:1746147216.026184:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f01ae00/0x31399394250636a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f627 expref: 15 pid: 13712 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.026203:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310494080 00000100:00100000:3.0:1746147216.026205:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310494080 00010000:00010000:3.0:1746147216.026217:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x3139939425063694 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f619 expref: 29 pid: 13712 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.026230:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9217 00000100:00100000:3.0:1746147216.026235:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310493952:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.026247:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.026264:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f01ae00/0x31399394250636a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f627 expref: 15 pid: 13712 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.026273:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f01ae00/0x31399394250636a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f627 expref: 15 pid: 13712 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.026295:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f01ae00/0x31399394250636a2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f627 expref: 15 pid: 13712 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.026309:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147216.026323:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310493952:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 88us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.026328:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9217 00000100:00100000:3.0:1746147216.026367:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9218 00000100:00100000:3.0:1746147216.026371:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310494080:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.026378:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.026383:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x3139939425063694 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f619 expref: 29 pid: 13712 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.026390:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x3139939425063694 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f619 expref: 29 pid: 13712 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.026400:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e7600/0x3139939425063694 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f619 expref: 29 pid: 13712 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.026406:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.026409:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.026414:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d90000/0x31399394250636fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1851391) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f658 expref: 13 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.026421:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d90000/0x31399394250636fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1851391) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f658 expref: 13 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.026445:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d90000/0x31399394250636fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1851391) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f658 expref: 13 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.026455:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311530624:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147216.026505:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147216.028233:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.028291:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.028373:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310494208 00000100:00100000:1.0:1746147216.028381:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310494208 00000100:00100000:1.0:1746147216.028423:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310494336 00000100:00100000:1.0:1746147216.028425:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310494336 00000100:00100000:0.0:1746147216.028494:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20306 00000100:00100000:0.0:1746147216.028503:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310494208:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147216.028521:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147216.028537:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f01b800/0x3139939425063704 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f65f expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147216.028596:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311530752:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147216.028658:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b4d49c0 going to sleep for 11 seconds 00000100:00080000:2.0:1746147216.028978:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147216.029023:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20307 00000100:00100000:1.0:1746147216.029029:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310494336:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147216.029038:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147216.029050:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9e00/0x313993942506370b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f666 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.029064:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147216.029073:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9e00/0x313993942506370b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f666 expref: 23 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147216.029083:0:13712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9e00/0x313993942506370b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f666 expref: 23 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147216.029126:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9e00, rc 0) 00000100:00100000:1.0:1746147216.029154:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2001:x1830967310494336:12345-192.168.204.25@tcp:101:cat.0 Request processed in 124us (862us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147216.029160:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20307 00000100:00100000:0.0:1746147216.037239:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.037268:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310494464 00000100:00100000:0.0:1746147216.037277:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310494464 00010000:00010000:0.0:1746147216.037315:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091eba800/0x313993942506354b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f524 expref: 22 pid: 12201 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746147216.037365:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9219 00000100:00100000:0.0:1746147216.037375:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2000:x1830967310494464:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147216.037392:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147216.037416:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091eba800/0x313993942506354b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f524 expref: 22 pid: 12201 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746147216.037431:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091eba800/0x313993942506354b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f524 expref: 22 pid: 12201 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746147216.037455:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091eba800/0x313993942506354b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f524 expref: 22 pid: 12201 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746147216.037482:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147216.037485:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147216.037492:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250636f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->2637823) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f651 expref: 37 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.037501:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250636f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->2637823) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f651 expref: 37 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.037534:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250636f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->2637823) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f651 expref: 37 pid: 10340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147216.037547:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311530880:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147216.037636:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147216.037686:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.037856:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311530624:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147216.037874:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147216.037904:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310494080:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 11531us (12766us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.037912:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9218 00000100:00100000:3.0:1746147216.037978:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310494720 00000100:00100000:3.0:1746147216.037982:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310494720 00002000:00100000:3.0:1746147216.038010:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x97:0x0] (1638400->1642495) req@ffff88009455d180 x1830967310494720/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147216.038019:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455d180 with x1830967310494720 ext(1638400->1642495) 00002000:00010000:3.0:1746147216.038024:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009455d180 00000100:00100000:3.0:1746147216.038045:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7453 00000100:00100000:3.0:1746147216.038050:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967310494720:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147216.038190:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967310494720:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 139us (503us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147216.038194:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7453 00002000:00100000:3.0:1746147216.038199:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x97:0x0] (1638400->1642495) req@ffff88009455d180 x1830967310494720/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/4536 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147216.038205:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455d180 with x1830967310494720 ext(1638400->1642495) 00002000:00010000:3.0:1746147216.038208:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009455d180 00002000:00010000:1.0:1746147216.039859:0:9584:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime: 1746147214 -> 1746147215 00002000:00010000:1.0:1746147216.039866:0:9584:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime: 1746147214 -> 1746147215 00000100:00100000:1.0:1746147216.039886:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311530752:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147216.039919:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f01b800/0x3139939425063704 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f65f expref: 15 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147216.039931:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f01b800/0x3139939425063704 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f65f expref: 15 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147216.039941:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f01b800, rc 0) 00000100:00100000:1.0:1746147216.039990:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310494208:12345-192.168.204.25@tcp:101:cat.0 Request processed in 11488us (11766us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147216.039997:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20306 00000100:00100000:0.0:1746147216.040142:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311530880:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147216.040154:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147216.040169:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2000:x1830967310494464:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2796us (2944us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.040177:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9219 00000100:00100000:0.0:1746147216.040218:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.040272:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310494976 00000100:00100000:2.0:1746147216.040278:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310494976 00002000:00100000:2.0:1746147216.040305:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2633728->2637823) req@ffff88009455c700 x1830967310494976/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.040319:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455c700 with x1830967310494976 ext(2633728->2637823) 00002000:00010000:2.0:1746147216.040329:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009455c700 00000100:00100000:2.0:1746147216.040342:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7454 00000100:00100000:2.0:1746147216.040348:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310494976:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147216.040439:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310494976:12345-192.168.204.25@tcp:3:cat.0 Request processed in 91us (219us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147216.040444:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7454 00002000:00100000:2.0:1746147216.040448:0:13302:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2633728->2637823) req@ffff88009455c700 x1830967310494976/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/4536 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.040454:0:13302:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455c700 with x1830967310494976 ext(2633728->2637823) 00002000:00010000:2.0:1746147216.040457:0:13302:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009455c700 00000100:00100000:0.0:1746147216.045321:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.045395:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310495104 00000100:00100000:1.0:1746147216.045406:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310495104 00000100:00100000:1.0:1746147216.045465:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20308 00000100:00100000:1.0:1746147216.045474:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2989:x1830967310495104:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147216.045494:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147216.045515:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425063712 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f66d expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.045545:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250636f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->2637823) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f651 expref: 37 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.045561:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147216.045563:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147216.045567:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425063712 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [4194304->4890623] (req 4194304->4890623) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f66d expref: 22 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.045599:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250636f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->2637823) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f651 expref: 37 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.045612:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250636f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->2637823) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f651 expref: 37 pid: 10340 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746147216.045624:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311531008:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147216.046398:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.046485:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.047367:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746147216.047389:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310495360 00000100:00100000:1.0:1746147216.047396:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310495360 00000100:00100000:0.0:1746147216.047489:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310495616 00000100:00100000:0.0:1746147216.047494:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310495616 00002000:00100000:0.0:1746147216.047528:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x97:0x0] (1847296->1851391) req@ffff88009455d500 x1830967310495616/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147216.047538:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455d500 with x1830967310495616 ext(1847296->1851391) 00002000:00010000:0.0:1746147216.047543:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009455d500 00000100:00100000:0.0:1746147216.047569:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7455 00000100:00100000:0.0:1746147216.047576:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2002:x1830967310495616:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147216.047711:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2002:x1830967310495616:12345-192.168.204.25@tcp:3:cat.0 Request processed in 134us (1225us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147216.047717:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7455 00002000:00100000:0.0:1746147216.047723:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x97:0x0] (1847296->1851391) req@ffff88009455d500 x1830967310495616/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/4536 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147216.047730:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009455d500 with x1830967310495616 ext(1847296->1851391) 00002000:00010000:0.0:1746147216.047733:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009455d500 00000100:00100000:1.0:1746147216.047779:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6189 00000100:00100000:1.0:1746147216.047786:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2993:x1830967310495360:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147216.050152:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2993:x1830967310495360:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 2354us (3742us total) trans 8589937434 rc 0/0 00000100:00100000:1.0:1746147216.050164:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6189 00000100:00100000:1.0:1746147216.053177:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.053263:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311531008:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.053291:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425063712 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [4194304->4890623] (req 4194304->4890623) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f66d expref: 22 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147216.053299:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310495744 00000100:00100000:0.0:1746147216.053307:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310495744 00010000:00010000:2.0:1746147216.053311:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9a00, rc 0) 00002000:00100000:0.0:1746147216.053349:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2576384->2637823) req@ffff8800947e5180 x1830967310495744/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147216.053359:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e5180 with x1830967310495744 ext(2576384->2637823) 00010000:00010000:0.0:1746147216.053366:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250636f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f651 expref: 38 pid: 10340 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.053378:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250636f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f651 expref: 38 pid: 10340 timeout: 854 lvb_type: 0 00002000:00010000:0.0:1746147216.053384:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947e5180 00000100:00100000:0.0:1746147216.053947:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1764 00000100:00100000:0.0:1746147216.053957:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310495744:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147216.054235:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2989:x1830967310495104:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8760us (8924us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.054243:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20308 00000100:00100000:2.0:1746147216.059838:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967311531264:0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.059885:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3767:1830967311531136:0@lo:400:kworker.0 00000100:00100000:2.0:1746147216.059910:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147216.059936:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.059943:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3764:1830967311531776:0@lo:400:kworker.0 00000100:00100000:2.0:1746147216.059966:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.059983:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3765:1830967311531392:0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.059987:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311531648:0@lo:400:kworker.0 00000100:00100000:2.0:1746147216.060001:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147216.060010:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.060014:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3765:1830967311531904:0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.060026:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3767:1830967311532160:0@lo:400:kworker.0 00000100:00100000:2.0:1746147216.060031:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147216.060042:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.060045:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311532416:0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.060056:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3767:1830967311532672:0@lo:400:kworker.0 00000100:00100000:2.0:1746147216.060063:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147216.060074:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147216.060111:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1746147216.060116:0:8099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311531136 00000100:00100000:0.0:1746147216.060117:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311531520:0@lo:400:kworker.0 00000100:00100000:2.0:1746147216.060123:0:8099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311531136 00000100:00100000:0.0:1746147216.060134:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147216.060140:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311531648 00000100:00100000:1.0:1746147216.060144:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311531648 00000100:00100000:0.0:1746147216.060145:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3767:1830967311532032:0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.060160:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.060171:0:8099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1746147216.060171:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311532544:0@lo:400:kworker.0 00000100:00100000:1.0:1746147216.060178:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311532416 00000100:00100000:2.0:1746147216.060179:0:8099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3767:x1830967311531136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746147216.060180:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311532416 00000100:00100000:0.0:1746147216.060185:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147216.060200:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311531520 00000100:00100000:1.0:1746147216.060201:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311531520 00000100:00100000:0.0:1746147216.060202:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311531776 00000100:00100000:0.0:1746147216.060204:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311531776 00000100:00100000:2.0:1746147216.060220:0:8099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d90bd0ba-3ac8-4630-92c4-d49c5c871e70+23:3767:x1830967311531136:12345-0@lo:400:kworker.0 Request processed in 42us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.060221:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311532544 00000100:00100000:1.0:1746147216.060222:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311532544 00000100:00100000:0.0:1746147216.060224:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311531392 00000100:00100000:2.0:1746147216.060226:0:8099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1746147216.060226:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311531392 00000100:00100000:0.0:1746147216.060234:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311531904 00000100:00100000:1.0:1746147216.060235:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1746147216.060236:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311531904 00000100:00100000:1.0:1746147216.060239:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311531648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.060246:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311532160 00000100:00100000:0.0:1746147216.060247:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311532160 00000100:00100000:2.0:1746147216.060254:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:0.0:1746147216.060256:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311532672 00000100:00100000:0.0:1746147216.060258:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311532672 00000100:00100000:2.0:1746147216.060259:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:3765:x1830967311532416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.060266:0:7239:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311532032 00000100:00100000:0.0:1746147216.060267:0:7239:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311532032 00000100:00100000:1.0:1746147216.060270:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311531648:12345-0@lo:400:kworker.0 Request processed in 31us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.060275:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1746147216.060277:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:0.0:1746147216.060281:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3764:x1830967311531776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147216.060284:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:3765:x1830967311532416:12345-0@lo:400:kworker.0 Request processed in 25us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.060284:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:1.0:1746147216.060287:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311531520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147216.060289:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:2.0:1746147216.060299:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:2.0:1746147216.060303:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3767:x1830967311532544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.060303:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3764:x1830967311531776:12345-0@lo:400:kworker.0 Request processed in 22us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.060304:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311531520:12345-0@lo:400:kworker.0 Request processed in 17us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.060308:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:1.0:1746147216.060309:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:0.0:1746147216.060316:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:0.0:1746147216.060319:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3765:x1830967311531392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746147216.060322:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3767:x1830967311532544:12345-0@lo:400:kworker.0 Request processed in 19us (136us total) trans 0 rc 0/0 00000100:00080000:1.0:1746147216.060323:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1746147216.060325:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746147216.060326:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00080000:1.0:1746147216.060328:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147216.060338:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3765:x1830967311531392:12345-0@lo:400:kworker.0 Request processed in 18us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.060342:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:0.0:1746147216.060346:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:2.0:1746147216.060348:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3765:x1830967311531904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.060354:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:0.0:1746147216.060358:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3767:x1830967311532160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.060824:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3767:x1830967311532160:12345-0@lo:400:kworker.0 Request processed in 464us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.060830:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:0.0:1746147216.060843:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:0.0:1746147216.060847:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3767:x1830967311532672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.060869:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3767:x1830967311532672:12345-0@lo:400:kworker.0 Request processed in 22us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.060873:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:0.0:1746147216.060882:0:7239:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:0.0:1746147216.060886:0:7239:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3767:x1830967311532032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.060905:0:7239:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3767:x1830967311532032:12345-0@lo:400:kworker.0 Request processed in 19us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.060910:0:7239:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:0.0:1746147216.060950:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311531520:0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.060959:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3767:1830967311532032:0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.060966:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311532544:0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.060972:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d90bd0ba-3ac8-4630-92c4-d49c5c871e70:3767:1830967311531136:0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.060978:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311531648:0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.060985:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3767:1830967311532160:0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.060991:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3767:1830967311532672:0@lo:400:kworker.0 00000100:00100000:3.0:1746147216.061109:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311531264 00000100:00100000:3.0:1746147216.061114:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311531264 00000100:00100000:3.0:1746147216.061142:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:3.0:1746147216.061146:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3764:x1830967311531264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746147216.061182:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3764:x1830967311531264:12345-0@lo:400:kworker.0 Request processed in 35us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.061186:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:3.0:1746147216.061225:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3764:1830967311531776:0@lo:400:kworker.0 00000100:00100000:3.0:1746147216.061231:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311532288:0@lo:400:kworker.0 00000100:00100000:3.0:1746147216.061250:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.061285:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967311531264:0@lo:400:kworker.0 00000100:00100000:3.0:1746147216.061310:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3765:1830967311531392:0@lo:400:kworker.0 00000100:00100000:3.0:1746147216.061318:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311532416:0@lo:400:kworker.0 00000100:00100000:2.0:1746147216.061643:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3765:x1830967311531904:12345-0@lo:400:kworker.0 Request processed in 1294us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.061649:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1746147216.061714:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3765:1830967311531904:0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.061944:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311532288 00000100:00100000:0.0:1746147216.061948:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311532288 00000100:00100000:0.0:1746147216.061967:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:0.0:1746147216.061972:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3764:x1830967311532288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.062001:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3764:x1830967311532288:12345-0@lo:400:kworker.0 Request processed in 29us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.062005:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:3.0:1746147216.062522:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311532288:0@lo:400:kworker.0 00000100:00100000:0.0:1746147216.065076:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967310495744:12345-192.168.204.25@tcp:4:cat.0 Request processed in 11109us (11900us total) trans 21474842719 rc 0/0 00000100:00100000:0.0:1746147216.065111:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1764 00002000:00100000:0.0:1746147216.065124:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2576384->2637823) req@ffff8800947e5180 x1830967310495744/t21474842719(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/448 e 0 to 0 dl 1746147227 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147216.065133:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e5180 with x1830967310495744 ext(2576384->2637823) 00010000:00010000:0.0:1746147216.065144:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250636f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f651 expref: 40 pid: 10340 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.065161:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250636f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f651 expref: 40 pid: 10340 timeout: 854 lvb_type: 0 00002000:00010000:0.0:1746147216.065169:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947e5180 00000100:00100000:0.0:1746147216.068264:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.071493:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310495872 00000100:00100000:2.0:1746147216.071511:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310495872 00010000:00010000:2.0:1746147216.071576:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250636f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f651 expref: 40 pid: 10340 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.071621:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9220 00000100:00100000:2.0:1746147216.071630:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+40:2001:x1830967310495872:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147216.071646:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147216.071665:0:4349:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147214 -> 1746147215 00010000:00010000:2.0:1746147216.071672:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250636f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2576384->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f651 expref: 40 pid: 10340 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.071687:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250636f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2576384->2637823) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f651 expref: 40 pid: 10340 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.071712:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f9fe800/0x31399394250636f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2576384->2637823) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f651 expref: 40 pid: 10340 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.071744:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.071747:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.071755:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425063712 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f66d expref: 21 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.071770:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425063712 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f66d expref: 21 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.071812:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425063712 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f66d expref: 21 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147216.071826:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311532800:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147216.071940:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147216.079880:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.079951:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310496128 00000100:00100000:1.0:1746147216.079961:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310496128 00002000:00100000:1.0:1746147216.080011:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff8800968a3480 x1830967310496128/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147216.080020:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a3480 with x1830967310496128 ext(4194304->4890623) 00002000:00010000:1.0:1746147216.080025:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968a3480 00000100:00100000:2.0:1746147216.081275:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311532800:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147216.081305:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147216.081360:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967310495872:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 9729us (13104us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.081371:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9220 00000100:00100000:1.0:1746147216.081477:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7456 00000100:00100000:1.0:1746147216.081488:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2002:x1830967310496128:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147216.089583:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746147216.089608:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967311532928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746147216.089680:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.090110:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746147216.090120:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311533056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746147216.091112:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.091205:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311532928 00000100:00100000:2.0:1746147216.091213:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311532928 00000100:00100000:2.0:1746147216.091255:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311533056 00000100:00100000:2.0:1746147216.091258:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311533056 00000100:00100000:2.0:1746147216.091270:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1746147216.091276:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3765:x1830967311532928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1746147216.091310:0:7244:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445519360 avail 1316057088 00000100:00100000:2.0:1746147216.091354:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3765:x1830967311532928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (1675us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.091360:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1746147216.091376:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:2.0:1746147216.091380:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3764:x1830967311533056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1746147216.091395:0:7244:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445597184 avail 1316134912 00000100:00100000:2.0:1746147216.091484:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3764:x1830967311533056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.091489:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1746147216.092146:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3765:1830967311532928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746147216.092175:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311533056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746147216.094488:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2002:x1830967310496128:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12994us (14611us total) trans 0 rc 696320/696320 00000100:00100000:3.0:1746147216.094499:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7456 00002000:00100000:3.0:1746147216.094508:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff8800968a3480 x1830967310496128/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147216.094517:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a3480 with x1830967310496128 ext(4194304->4890623) 00002000:00010000:3.0:1746147216.094522:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968a3480 00000100:00100000:0.0:1746147216.116692:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.116780:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310496256 00000100:00100000:2.0:1746147216.116790:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310496256 00000100:00100000:2.0:1746147216.117053:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16525 00000100:00100000:2.0:1746147216.117063:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2999:x1830967310496256:12345-192.168.204.25@tcp:101:lfs.0 00000100:00080000:1.0:1746147216.117080:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746147216.117127:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.117147:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6400/0x3139939425063719 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f674 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.117212:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7200/0x3139939425063720 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.117226:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7200/0x3139939425063720 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.117239:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7200/0x3139939425063720 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.117251:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x3139939425063727 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.117256:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x3139939425063727 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.117262:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x3139939425063727 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.117333:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506372e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.117342:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250636be lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f63c expref: 16 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.117349:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506372e lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.117378:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250636be lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f63c expref: 16 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.117429:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250636be lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f63c expref: 16 pid: 7237 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.117440:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311533184:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.118156:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746147216.119833:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.119972:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310496512 00000100:00100000:1.0:1746147216.119980:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310496512 00000100:00100000:1.0:1746147216.120044:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6190 00000100:00100000:1.0:1746147216.120051:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:30601:x1830967310496512:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147216.120181:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311533184:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.120206:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506372e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00080000:0.0:1746147216.120254:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746147216.120274:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:30601:x1830967310496512:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 223us (446us total) trans 8589937435 rc 0/0 00000100:00100000:1.0:1746147216.120281:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6190 00000100:00100000:0.0:1746147216.121291:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.121474:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310496640 00000100:00100000:2.0:1746147216.121480:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310496640 00010000:00010000:2.0:1746147216.121508:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250636be lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f63c expref: 18 pid: 7237 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.121543:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9221 00000100:00100000:2.0:1746147216.121550:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310496640:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147216.121572:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147216.121577:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250636be lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f63c expref: 18 pid: 7237 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.121634:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250636be lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f63c expref: 18 pid: 7237 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.121657:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x31399394250636be lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f63c expref: 18 pid: 7237 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.121682:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147216.121687:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506372e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.121696:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506372e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.121704:0:4349:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506372e lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.121729:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147216.121768:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506372e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.121785:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506372e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147216.121832:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147216.121836:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147216.121851:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506372e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.121862:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506372e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.121871:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7200/0x3139939425063720 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.121876:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7200/0x3139939425063720 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.121881:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7200/0x3139939425063720 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.121887:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7200/0x3139939425063720 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.121891:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e7200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147216.121895:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7200/0x3139939425063720 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.121900:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7200/0x3139939425063720 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.121913:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147216.121915:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147216.121919:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7200/0x3139939425063720 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.121923:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7200/0x3139939425063720 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.121947:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x3139939425063727 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.121952:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x3139939425063727 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.121957:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x3139939425063727 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.121960:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e6200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147216.121962:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x3139939425063727 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.121966:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x3139939425063727 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.121972:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a3cf4500) 00010000:00010000:3.0:1746147216.121974:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147216.121976:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x3139939425063727 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.121979:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x3139939425063727 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00000100:00100000:2.0:1746147216.121985:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310496640:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 434us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.121991:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9221 00010000:00010000:3.0:1746147216.122012:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6400/0x3139939425063719 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f674 expref: 11 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.122023:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506372e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f674 expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.122033:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147216.122035:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147216.122037:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e7600, rc 0) 00000100:00100000:3.0:1746147216.122117:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2999:x1830967310496256:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5029us (5410us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.122124:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16525 00000100:00100000:0.0:1746147216.125167:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.125824:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310496768 00000100:00100000:3.0:1746147216.125834:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310496768 00000100:00080000:1.0:1746147216.125898:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147216.126224:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.126242:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.126273:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.126291:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310497024 00000100:00100000:1.0:1746147216.126294:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310497024 00000100:00080000:1.0:1746147216.126306:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147216.126372:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20309 00000100:00100000:3.0:1746147216.126382:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967310496768:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147216.126402:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.126420:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063735 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f67b expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.126443:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.126445:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.126454:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063735 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f67b expref: 21 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.126469:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063735 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f67b expref: 21 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.126479:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94800, rc 0) 00000100:00100000:3.0:1746147216.126523:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967310496768:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 144us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.126548:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310496896 00000100:00100000:2.0:1746147216.126580:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310496896 00000100:00100000:1.0:1746147216.126584:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310497152 00000100:00100000:1.0:1746147216.126586:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310497152 00000100:00100000:2.0:1746147216.126599:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20310 00000100:00100000:1.0:1746147216.126603:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20311 00000100:00100000:2.0:1746147216.126604:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310497024:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:1.0:1746147216.126607:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310496896:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:1.0:1746147216.126619:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20312 00010000:00010000:2.0:1746147216.126621:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147216.126623:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2001:x1830967310497152:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147216.126627:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.126631:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x313993942506373c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f689 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.126634:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990c6e00/0x3139939425063743 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f690 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.126647:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147216.126648:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147216.126652:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c6e00/0x3139939425063743 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f690 expref: 23 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147216.126660:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990c6e00/0x3139939425063743 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f690 expref: 23 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147216.126666:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c6e00, rc 0) 00000100:00100000:2.0:1746147216.126672:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311533312:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147216.126681:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2001:x1830967310497152:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 58us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.126686:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20312 00010000:00010000:1.0:1746147216.126707:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147216.126713:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x313993942506374a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f682 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147216.126719:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00010000:00010000:1.0:1746147216.126723:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147216.126724:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147216.126731:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x313993942506374a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f682 expref: 18 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147216.126739:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x313993942506374a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f682 expref: 18 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147216.126746:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990c7c00, rc 0) 00000100:00100000:1.0:1746147216.126758:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310496896:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 151us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.126765:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20311 00000100:00100000:3.0:1746147216.126854:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20309 00000100:00100000:0.0:1746147216.127423:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.127636:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.127680:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310497280 00000100:00100000:3.0:1746147216.127685:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310497280 00000100:00100000:3.0:1746147216.127705:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310497408 00000100:00100000:3.0:1746147216.127708:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310497408 00000100:00100000:3.0:1746147216.127719:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20313 00000100:00100000:3.0:1746147216.127725:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2000:x1830967310497280:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147216.127732:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.127742:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425063751 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f697 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.127753:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.127755:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.127759:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425063751 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f697 expref: 23 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.127769:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425063751 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f697 expref: 23 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.127776:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94400, rc 0) 00000100:00100000:0.0:1746147216.127835:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20314 00000100:00100000:0.0:1746147216.127841:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310497408:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147216.127847:0:10340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147216.127854:0:10340:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x3139939425063758 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f69e expref: -99 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.127863:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147216.127864:0:10340:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147216.127868:0:10340:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x3139939425063758 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f69e expref: 19 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147216.127876:0:10340:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x3139939425063758 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f69e expref: 19 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147216.127887:0:10340:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c42200, rc 0) 00000100:00100000:3.0:1746147216.127927:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2000:x1830967310497280:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 202us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.128003:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20313 00000100:00100000:0.0:1746147216.128223:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310497408:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 382us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.128228:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20314 00002000:00010000:3.0:1746147216.128675:0:1398:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime: 1746147215 -> 1746147216 00000100:00100000:3.0:1746147216.128694:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311533312:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147216.128722:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x313993942506373c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f689 expref: 18 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.128732:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312e7e00/0x313993942506373c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f689 expref: 18 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.128743:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e7e00, rc 0) 00000100:00100000:3.0:1746147216.128765:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310497024:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2161us (2542us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147216.128771:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20310 00000100:00100000:0.0:1746147216.136328:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.137563:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310497664 00000100:00100000:3.0:1746147216.137573:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310497664 00000100:00100000:3.0:1746147216.137625:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16526 00000100:00100000:3.0:1746147216.137634:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2999:x1830967310497664:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147216.137715:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.137736:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506375f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f6a5 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.137839:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425063766 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.137853:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506372e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f674 expref: 11 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.137860:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425063766 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.137893:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506372e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f674 expref: 11 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.137905:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506372e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f674 expref: 11 pid: 7238 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.137917:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311533440:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.138016:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147216.143051:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.143123:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310497792 00000100:00100000:2.0:1746147216.143132:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310497792 00010000:00010000:2.0:1746147216.143173:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506372e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f674 expref: 12 pid: 7238 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.143206:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9222 00000100:00100000:2.0:1746147216.143213:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310497792:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147216.143228:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147216.143235:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506372e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f674 expref: 12 pid: 7238 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.143245:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506372e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f674 expref: 12 pid: 7238 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.143246:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311533440:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.143268:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x313993942506372e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f674 expref: 12 pid: 7238 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.143270:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425063766 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.143288:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147216.143292:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425063766 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.143302:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425063766 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.143309:0:4349:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425063766 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.143335:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147216.143385:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310497792:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 171us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.143392:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9222 00010000:00010000:3.0:1746147216.143749:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425063766 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.143757:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425063766 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147216.143776:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147216.143912:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506375f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6a5 expref: 12 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.143930:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425063766 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6a5 expref: 11 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.143936:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147216.143939:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147216.143941:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d94000, rc 0) 00000100:00100000:3.0:1746147216.145027:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2999:x1830967310497664:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 7382us (8698us total) trans 8589937436 rc 0/0 00000100:00100000:3.0:1746147216.145035:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16526 00000100:00100000:0.0:1746147216.150327:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.150589:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310497920 00000100:00100000:3.0:1746147216.150598:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310497920 00000100:00100000:3.0:1746147216.150658:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16527 00000100:00100000:3.0:1746147216.150669:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2999:x1830967310497920:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147216.150698:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.150719:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x3139939425063774 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f6ac expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.151270:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506377b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.151286:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425063766 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6a5 expref: 12 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.151293:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506377b lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.151326:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425063766 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6a5 expref: 12 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.151338:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425063766 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6a5 expref: 12 pid: 7238 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.151351:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311533568:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.152385:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147216.154797:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311533696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746147216.154865:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147216.155025:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311533824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746147216.155055:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147216.155513:0:16752:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311533696 00000100:00100000:0.0:1746147216.155521:0:16752:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311533696 00000100:00100000:1.0:1746147216.155534:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311533824 00000100:00100000:1.0:1746147216.155537:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311533824 00000100:00100000:0.0:1746147216.155578:0:16752:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1746147216.155586:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1746147216.155586:0:16752:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+77:3766:x1830967311533696:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746147216.155590:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3767:x1830967311533824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746147216.155606:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1142522944 pending 1671168 free 3911233536 avail 3679711232 00002000:00000024:0.0:1746147216.155606:0:16752:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1316500544 pending 4722688 free 3905277952 avail 3673755648 00000100:00100000:1.0:1746147216.155640:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3767:x1830967311533824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.155646:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1746147216.155650:0:16752:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+77:3766:x1830967311533696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.155654:0:16752:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1746147216.155682:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311533824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746147216.155783:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311533696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746147216.156671:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.156703:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311533568:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.156722:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506377b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:2.0:1746147216.156724:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310498048 00000100:00100000:2.0:1746147216.156730:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310498048 00010000:00010000:2.0:1746147216.156754:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425063766 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6a5 expref: 13 pid: 7238 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.156787:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9223 00000100:00100000:2.0:1746147216.156794:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310498048:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147216.156803:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147216.156809:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425063766 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6a5 expref: 13 pid: 7238 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.156820:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425063766 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6a5 expref: 13 pid: 7238 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.156842:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94000/0x3139939425063766 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6a5 expref: 13 pid: 7238 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.156871:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147216.156876:0:4349:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506377b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.156890:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506377b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.156897:0:4349:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506377b lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.156922:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147216.156955:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310498048:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 162us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.156961:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9223 00010000:00010000:3.0:1746147216.157052:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506377b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.157060:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506377b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147216.157130:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147216.157134:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147216.157151:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506377b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.157179:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94e00/0x3139939425063774 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6ac expref: 12 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.157196:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506377b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6ac expref: 11 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.157202:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147216.157205:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147216.157207:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d95e00, rc 0) 00000100:00100000:3.0:1746147216.157235:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2999:x1830967310497920:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 6570us (6921us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.157241:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16527 00000100:00100000:0.0:1746147216.162746:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.162966:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310498176 00000100:00100000:3.0:1746147216.162976:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310498176 00000100:00100000:3.0:1746147216.163022:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20315 00000100:00100000:3.0:1746147216.163030:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310498176:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147216.163124:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.163143:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x3139939425063782 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f6b3 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.163200:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311533952:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147216.163296:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147216.169346:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311533952:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147216.169385:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x3139939425063782 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6b3 expref: 18 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.169401:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8000/0x3139939425063782 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6b3 expref: 18 pid: 1398 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.170000:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e8000, rc 0) 00000100:00100000:3.0:1746147216.170066:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310498176:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 7035us (7329us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147216.170076:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20315 00000100:00100000:2.0:1746147216.174524:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.174623:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310498432 00000100:00100000:3.0:1746147216.174633:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310498432 00000100:00100000:3.0:1746147216.174718:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16528 00000100:00100000:3.0:1746147216.174726:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2999:x1830967310498432:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147216.174895:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.174918:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9400/0x3139939425063789 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f6ba expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.175046:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9e00/0x3139939425063790 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.175062:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9e00/0x3139939425063790 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.175073:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9e00/0x3139939425063790 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:3.0:1746147216.175085:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147216.175212:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9400/0x3139939425063789 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6ba expref: 14 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.175244:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9e00/0x3139939425063790 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6ba expref: 13 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.175252:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147216.175255:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147216.175259:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2e9e00, rc 0) 00000100:00100000:3.0:1746147216.177250:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2999:x1830967310498432:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2510us (2722us total) trans 8589937437 rc 0/0 00000100:00100000:3.0:1746147216.177262:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16528 00000100:00100000:0.0:1746147216.189325:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.189369:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.189539:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.189651:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.189674:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310498688 00000100:00100000:3.0:1746147216.189684:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310498688 00000100:00100000:3.0:1746147216.189733:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310498944 00000100:00100000:3.0:1746147216.189736:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310498944 00000100:00100000:3.0:1746147216.189749:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310499200 00000100:00100000:3.0:1746147216.189751:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310499200 00000100:00100000:3.0:1746147216.189766:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20316 00000100:00100000:3.0:1746147216.189774:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310498688:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147216.189821:0:1398:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x313993942506379e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.189841:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e6600/0x313993942506369b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f620 expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.189849:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x313993942506374a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f682 expref: 18 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.189862:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x31399394250636ef lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f64a expref: 27 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.189868:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.189870:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.189873:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x313993942506379e lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.189909:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x31399394250636ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f64a expref: 27 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.189922:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x31399394250636ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f64a expref: 27 pid: 13712 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746147216.189936:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311534080:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.190030:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x313993942506374a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f682 expref: 18 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.190038:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x313993942506374a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f682 expref: 18 pid: 9584 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746147216.190045:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311534208:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.190069:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e6600/0x313993942506369b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f620 expref: 13 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.190081:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958e6600/0x313993942506369b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f620 expref: 13 pid: 13712 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.190105:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311534336:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.190125:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147216.190146:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20317 00000100:00100000:3.0:1746147216.190152:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2001:x1830967310498944:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147216.190172:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096e3f800/0x31399394250637a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.190182:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x31399394250634f0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c9 expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.190188:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990c6e00/0x3139939425063743 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f690 expref: 23 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.190194:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425063560 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f547 expref: 38 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.190198:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.190200:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.190201:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e3f800/0x31399394250637a5 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.190215:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425063560 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f547 expref: 38 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.190223:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425063560 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f547 expref: 38 pid: 10340 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746147216.190232:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311534464:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.190252:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800990c6e00/0x3139939425063743 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f690 expref: 23 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.190258:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800990c6e00/0x3139939425063743 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f690 expref: 23 pid: 17600 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746147216.190265:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311534592:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.190281:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x31399394250634f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c9 expref: 21 pid: 12225 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.190287:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x31399394250634f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c9 expref: 21 pid: 12225 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.190294:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099155f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311534720:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.190305:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147216.190436:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20318 00000100:00100000:3.0:1746147216.190441:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310499200:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147216.190456:0:13695:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x31399394250637ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.190470:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x31399394250636a9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f62e expref: 27 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.190477:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x3139939425063758 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f69e expref: 18 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.190482:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x31399394250636b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f635 expref: 13 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.190486:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.190487:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.190489:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x31399394250637ac lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.190500:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x31399394250636b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f635 expref: 13 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.190506:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x31399394250636b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f635 expref: 13 pid: 10340 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.190512:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311534848:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.190535:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x3139939425063758 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f69e expref: 18 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.190541:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x3139939425063758 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f69e expref: 18 pid: 10340 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746147216.190563:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311534976:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.190580:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x31399394250636a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f62e expref: 27 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.190586:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x31399394250636a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f62e expref: 27 pid: 10340 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.190592:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311535104:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.190601:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b300 going to sleep for 11 seconds 00000100:00100000:2.0:1746147216.190770:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310498560 00000100:00100000:2.0:1746147216.190774:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310498560 00000100:00100000:2.0:1746147216.190798:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20319 00000100:00100000:2.0:1746147216.190802:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2001:x1830967310498560:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147216.190816:0:13712:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250637b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.190826:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425063663 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5f6 expref: 38 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.190832:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063735 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f67b expref: 24 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.190838:0:13712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d43600/0x313993942506367f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f604 expref: 21 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.190842:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.190844:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.190845:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250637b3 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.190859:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d43600/0x313993942506367f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f604 expref: 21 pid: 10340 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.190865:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d43600/0x313993942506367f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f604 expref: 21 pid: 10340 timeout: 854 lvb_type: 1 00000100:00100000:2.0:1746147216.190872:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311535232:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.190907:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063735 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f67b expref: 24 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.190915:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063735 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f67b expref: 24 pid: 13712 timeout: 854 lvb_type: 1 00000100:00100000:2.0:1746147216.190921:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311535360:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.190938:0:13712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425063663 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5f6 expref: 38 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.190944:0:13712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425063663 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5f6 expref: 38 pid: 10340 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.190950:0:13712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311535488:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.190959:0:13712:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147216.190979:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.191020:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.191055:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310498816 00000100:00100000:2.0:1746147216.191057:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310498816 00000100:00100000:2.0:1746147216.191071:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310499072 00000100:00100000:2.0:1746147216.191072:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310499072 00000100:00100000:2.0:1746147216.191082:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20320 00000100:00100000:2.0:1746147216.191086:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2001:x1830967310498816:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147216.191114:0:12201:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x31399394250637ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.191124:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d90000/0x31399394250636fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1851391) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f658 expref: 13 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.191130:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147216.191131:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147216.191133:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x31399394250637ba lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.191149:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d90000/0x31399394250636fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1851391) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f658 expref: 13 pid: 10340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.191156:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d90000/0x31399394250636fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1851391) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f658 expref: 13 pid: 10340 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.191163:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311535616:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.191191:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e600 going to sleep for 11 seconds 00000100:00100000:2.0:1746147216.191225:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20321 00000100:00100000:2.0:1746147216.191230:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+25:2001:x1830967310499072:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147216.191247:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x31399394250637c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.191257:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425063712 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f66d expref: 21 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.191264:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425063751 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f697 expref: 25 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.191269:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.191271:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.191273:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x31399394250637c1 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.191287:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425063751 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f697 expref: 25 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.191295:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425063751 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f697 expref: 25 pid: 13712 timeout: 854 lvb_type: 1 00000100:00100000:2.0:1746147216.191302:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311535744:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.191325:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425063712 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f66d expref: 21 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.191332:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425063712 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f66d expref: 21 pid: 9584 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.191344:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311535872:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.191355:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098985f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746147216.196156:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311534080:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.196172:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311534208:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.196181:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311534336:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.196209:0:1398:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x313993942506379e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.196251:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311535360:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.196262:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311535488:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.196425:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311534464:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.197543:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311535744:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.197566:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311535872:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.197593:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x31399394250637c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147216.197739:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311535616:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.197754:0:12201:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x31399394250637ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147216.199618:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.201536:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310499584 00000100:00100000:2.0:1746147216.201548:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310499584 00010000:00010000:2.0:1746147216.201604:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063735 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f67b expref: 26 pid: 13712 timeout: 854 lvb_type: 1 00000100:00100000:2.0:1746147216.201640:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9224 00000100:00100000:2.0:1746147216.201647:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+26:2002:x1830967310499584:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147216.201671:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147216.201694:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063735 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f67b expref: 26 pid: 13712 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746147216.201705:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063735 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f67b expref: 26 pid: 13712 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746147216.201728:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063735 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f67b expref: 26 pid: 13712 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746147216.201939:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147216.201991:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+25:2002:x1830967310499584:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 344us (2378us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.201998:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9224 00000100:00100000:0.0:1746147216.202354:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.202385:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.202396:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310499712 00000100:00100000:0.0:1746147216.202401:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310499712 00010000:00010000:0.0:1746147216.202414:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425063663 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5f6 expref: 39 pid: 10340 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746147216.202427:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310499968 00000100:00100000:0.0:1746147216.202429:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310499968 00010000:00010000:0.0:1746147216.202436:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425063751 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f697 expref: 25 pid: 13712 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746147216.202447:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9225 00000100:00100000:0.0:1746147216.202451:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2003:x1830967310499712:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147216.202456:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147216.202464:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425063663 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5f6 expref: 39 pid: 10340 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.202472:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425063663 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5f6 expref: 39 pid: 10340 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.202483:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d43200/0x3139939425063663 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5f6 expref: 39 pid: 10340 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.202493:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147216.202510:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967310499712:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 58us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.202515:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9225 00000100:00100000:0.0:1746147216.202527:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9226 00000100:00100000:0.0:1746147216.202531:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+25:2003:x1830967310499968:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147216.202539:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147216.202548:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425063751 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f697 expref: 25 pid: 13712 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746147216.202566:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425063751 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f697 expref: 25 pid: 13712 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746147216.202576:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d94400/0x3139939425063751 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f697 expref: 25 pid: 13712 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746147216.202585:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147216.202601:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+24:2003:x1830967310499968:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 69us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.202606:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9226 00000100:00100000:0.0:1746147216.202648:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.202763:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310499840 00000100:00100000:3.0:1746147216.202768:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310499840 00002000:00100000:3.0:1746147216.203257:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x97:0x0] (1638400->1851391) req@ffff880095148a80 x1830967310499840/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147216.203266:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095148a80 with x1830967310499840 ext(1638400->1851391) 00010000:00010000:3.0:1746147216.203273:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d90000/0x31399394250636fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f658 expref: 14 pid: 10340 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.203282:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d90000/0x31399394250636fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f658 expref: 14 pid: 10340 timeout: 854 lvb_type: 0 00002000:00010000:3.0:1746147216.203288:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095148a80 00000100:00100000:3.0:1746147216.203304:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1765 00000100:00100000:3.0:1746147216.203309:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2003:x1830967310499840:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147216.213841:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099154000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311534848:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.213853:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311534976:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.213861:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311535104:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.213892:0:13695:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x31399394250637ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147216.213951:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.214032:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.214042:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.214060:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.214064:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099154e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311534592:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.214075:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099155f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311534720:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.214111:0:1854:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096e3f800/0x31399394250637a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147216.214137:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310500352 00000100:00100000:2.0:1746147216.214143:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310500352 00000100:00100000:3.0:1746147216.214153:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310500608 00000100:00100000:3.0:1746147216.214156:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310500608 00010000:00010000:3.0:1746147216.214176:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d43600/0x313993942506367f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f604 expref: 22 pid: 10340 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746147216.214176:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x3139939425063758 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f69e expref: 20 pid: 10340 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746147216.214208:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310500480 00000100:00100000:3.0:1746147216.214211:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310500480 00000100:00100000:2.0:1746147216.214218:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310500736 00000100:00100000:2.0:1746147216.214221:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310500736 00010000:00010000:3.0:1746147216.214227:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425063712 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f66d expref: 23 pid: 9584 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.214235:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x31399394250636a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f62e expref: 28 pid: 10340 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.214384:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9227 00000100:00100000:3.0:1746147216.214392:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2002:x1830967310500352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.214405:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.214432:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x3139939425063758 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f69e expref: 20 pid: 10340 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.214442:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x3139939425063758 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f69e expref: 20 pid: 10340 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.214464:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c42200/0x3139939425063758 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f69e expref: 20 pid: 10340 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.214482:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147216.214493:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9228 00000100:00100000:2.0:1746147216.214500:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2002:x1830967310500608:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147216.214509:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147216.214517:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2002:x1830967310500352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 126us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.214524:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9227 00010000:00010000:2.0:1746147216.214524:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d43600/0x313993942506367f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f604 expref: 23 pid: 10340 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746147216.214537:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d43600/0x313993942506367f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f604 expref: 23 pid: 10340 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746147216.214538:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9229 00000100:00100000:3.0:1746147216.214542:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+23:2002:x1830967310500480:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.214548:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147216.214560:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.214562:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.214565:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425063712 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f66d expref: 23 pid: 9584 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.214567:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250637b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.214572:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425063712 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f66d expref: 23 pid: 9584 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.214575:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250637b3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.214582:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f2e9a00/0x3139939425063712 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4890623) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f66d expref: 23 pid: 9584 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.214589:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.214590:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.214590:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147216.214593:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x31399394250637c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.214600:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x31399394250637c1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147216.214609:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2002:x1830967310500608:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 109us (575us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147216.214611:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147216.214615:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9228 00000100:00100000:3.0:1746147216.214623:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310500480:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 81us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.214627:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9230 00000100:00100000:2.0:1746147216.214632:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2002:x1830967310500736:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147216.214638:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147216.214644:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x31399394250636a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f62e expref: 28 pid: 10340 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.214652:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x31399394250636a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f62e expref: 28 pid: 10340 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.214664:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e3e000/0x31399394250636a9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f62e expref: 28 pid: 10340 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.214686:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147216.214705:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2002:x1830967310500736:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 73us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.215126:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.215142:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310499328 00000100:00100000:0.0:1746147216.215145:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310499328 00010000:00010000:0.0:1746147216.215159:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x31399394250636ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f64a expref: 28 pid: 13712 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746147216.215422:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9229 00010000:00010000:3.0:1746147216.215444:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x31399394250637c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.215451:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x31399394250637c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.215467:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x31399394250637c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.215474:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x31399394250637c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.215481:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x31399394250637c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.215487:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094ffc600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147216.215491:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x31399394250637c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.215498:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x31399394250637c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.215508:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x31399394250637c1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.215514:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x31399394250637c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.215569:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2001:x1830967310499072:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 24337us (24546us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.215577:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20321 00010000:00010000:3.0:1746147216.215616:0:13712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d43600/0x313993942506367f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f604 expref: 20 pid: 10340 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746147216.215624:0:13712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:13712:1830967311535232:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.215645:0:13712:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250637b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.215651:0:13712:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250637b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.215656:0:13712:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250637b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.215668:0:13712:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250637b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.215674:0:13712:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250637b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.215679:0:13712:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250637b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.215685:0:13712:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e7a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147216.215687:0:13712:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250637b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.215693:0:13712:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250637b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.215701:0:13712:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250637b3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.215712:0:13712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801312e7a00/0x31399394250637b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.215742:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2001:x1830967310498560:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 24939us (26090us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.215748:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20319 00000100:00100000:2.0:1746147216.215943:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9230 00000100:00100000:1.0:1746147216.216052:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.216122:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.216137:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.216154:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.216163:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310500096 00000100:00100000:2.0:1746147216.216166:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310500096 00010000:00010000:2.0:1746147216.216181:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800990c6e00/0x3139939425063743 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f690 expref: 22 pid: 17600 timeout: 854 lvb_type: 1 00000100:00100000:2.0:1746147216.216197:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310499456 00000100:00100000:2.0:1746147216.216199:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310499456 00010000:00010000:2.0:1746147216.216207:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x313993942506374a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f682 expref: 19 pid: 9584 timeout: 854 lvb_type: 1 00000100:00100000:2.0:1746147216.216217:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310500224 00000100:00100000:2.0:1746147216.216218:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310500224 00010000:00010000:2.0:1746147216.216224:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x31399394250634f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c9 expref: 20 pid: 12225 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.216231:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310500864 00000100:00100000:2.0:1746147216.216232:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310500864 00010000:00010000:2.0:1746147216.216240:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425063560 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f547 expref: 38 pid: 10340 timeout: 854 lvb_type: 1 00000100:00100000:2.0:1746147216.216248:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9231 00000100:00100000:2.0:1746147216.216252:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2000:x1830967310500096:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147216.216262:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147216.216269:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800990c6e00/0x3139939425063743 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f690 expref: 22 pid: 17600 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746147216.216277:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800990c6e00/0x3139939425063743 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f690 expref: 22 pid: 17600 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746147216.216290:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990c6e00/0x3139939425063743 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f690 expref: 22 pid: 17600 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746147216.216300:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147216.216317:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2000:x1830967310500096:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 64us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.216322:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9231 00000100:00100000:2.0:1746147216.216331:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9232 00000100:00100000:2.0:1746147216.216334:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310499456:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147216.216340:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147216.216441:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9233 00000100:00100000:1.0:1746147216.216448:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310500224:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147216.216456:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147216.216464:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x31399394250634f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c9 expref: 20 pid: 12225 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746147216.216477:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x31399394250634f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c9 expref: 20 pid: 12225 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746147216.216489:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x31399394250634f0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4c9 expref: 20 pid: 12225 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746147216.216503:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147216.216519:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2000:x1830967310500224:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 71us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.216525:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9233 00000100:00100000:1.0:1746147216.216536:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9234 00000100:00100000:1.0:1746147216.216541:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310500864:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147216.216544:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x313993942506374a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f682 expref: 19 pid: 9584 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746147216.216547:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147216.216561:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x313993942506374a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f682 expref: 19 pid: 9584 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746147216.216565:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425063560 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f547 expref: 38 pid: 10340 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746147216.216573:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425063560 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f547 expref: 38 pid: 10340 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746147216.216574:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800990c7c00/0x313993942506374a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f682 expref: 19 pid: 9584 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746147216.216584:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d42c00/0x3139939425063560 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f547 expref: 38 pid: 10340 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746147216.216589:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147216.216592:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147216.216593:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147216.216596:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e3f800/0x31399394250637a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.216603:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e3f800/0x31399394250637a5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147216.216606:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310499456:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 270us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.216611:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9232 00010000:00010000:1.0:1746147216.216619:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147216.216632:0:1854:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096e3f800/0x31399394250637a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147216.216633:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310500864:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 92us (479us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147216.216639:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e3f800/0x31399394250637a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147216.216640:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9234 00010000:00010000:2.0:1746147216.216652:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096e3f800/0x31399394250637a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.216658:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096e3f800/0x31399394250637a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.216664:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096e3f800/0x31399394250637a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.216669:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096e3f800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147216.216672:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096e3f800/0x31399394250637a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.216679:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096e3f800/0x31399394250637a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.216693:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096e3f800/0x31399394250637a5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.216699:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e3f800/0x31399394250637a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147216.216731:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967310498944:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 26579us (27361us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.216737:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20317 00000100:00100000:0.0:1746147216.218174:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9235 00000100:00100000:0.0:1746147216.218186:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310499328:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147216.218200:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147216.218215:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x31399394250636ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f64a expref: 27 pid: 13712 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746147216.218231:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x31399394250636ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f64a expref: 27 pid: 13712 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746147216.218246:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e9800/0x31399394250636ef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f64a expref: 27 pid: 13712 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746147216.218458:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.218491:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.218528:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310500992 00000100:00100000:3.0:1746147216.218534:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310500992 00010000:00010000:3.0:1746147216.218562:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x31399394250636b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f635 expref: 16 pid: 10340 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.218576:0:7225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310501120 00000100:00100000:3.0:1746147216.218578:0:7225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310501120 00010000:00010000:3.0:1746147216.218584:0:7225:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e6600/0x313993942506369b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f620 expref: 17 pid: 13712 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.218595:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9236 00000100:00100000:3.0:1746147216.218599:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967310500992:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.218605:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.218614:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x31399394250636b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f635 expref: 17 pid: 10340 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.218621:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x31399394250636b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f635 expref: 17 pid: 10340 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.218632:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e3fa00/0x31399394250636b0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f635 expref: 17 pid: 10340 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.218644:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.218646:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.218649:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x31399394250637ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.218656:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x31399394250637ac lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.218672:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147216.218704:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967310500992:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 104us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.218709:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9236 00000100:00100000:3.0:1746147216.218722:0:7225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9237 00000100:00100000:3.0:1746147216.218726:0:7225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2001:x1830967310501120:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.218732:0:7225:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.218739:0:7225:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958e6600/0x313993942506369b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f620 expref: 15 pid: 13712 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.218747:0:7225:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958e6600/0x313993942506369b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f620 expref: 15 pid: 13712 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.218757:0:7225:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e6600/0x313993942506369b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f620 expref: 15 pid: 13712 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.218764:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.218767:0:7225:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.218769:0:7225:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x313993942506379e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.218775:0:7225:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x313993942506379e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.218788:0:7225:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147216.218802:0:7225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310501120:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 75us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.218806:0:7225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9237 00010000:00010000:3.0:1746147216.218822:0:13695:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x31399394250637ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.218829:0:13695:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x31399394250637ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.218841:0:13695:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x31399394250637ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.218848:0:13695:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x31399394250637ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.218854:0:13695:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x31399394250637ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.218861:0:13695:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d90e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147216.218864:0:13695:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x31399394250637ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.218874:0:13695:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x31399394250637ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.218882:0:13695:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x31399394250637ac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.218887:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d90e00/0x31399394250637ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.218928:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310499200:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 28485us (29388us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.218934:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20318 00010000:00010000:3.0:1746147216.218954:0:1398:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x313993942506379e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.218961:0:1398:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x313993942506379e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.218971:0:1398:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x313993942506379e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.218976:0:1398:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x313993942506379e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.218982:0:1398:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x313993942506379e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.218991:0:1398:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2e8c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147216.218994:0:1398:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x313993942506379e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.218999:0:1398:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x313993942506379e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.219006:0:1398:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x313993942506379e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.219010:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2e8c00/0x313993942506379e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.219029:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310498688:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 29257us (29716us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.219033:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20316 00010000:00010000:0.0:1746147216.219597:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147216.219620:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310499328:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1437us (4493us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.219626:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9235 00000100:00100000:2.0:1746147216.222198:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2003:x1830967310499840:12345-192.168.204.25@tcp:4:cat.0 Request processed in 18877us (19539us total) trans 17179875327 rc 0/0 00000100:00100000:2.0:1746147216.222211:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1765 00002000:00100000:2.0:1746147216.222222:0:29477:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x97:0x0] (1638400->1851391) req@ffff880095148a80 x1830967310499840/t17179875327(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/448 e 0 to 0 dl 1746147227 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.222230:0:29477:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095148a80 with x1830967310499840 ext(1638400->1851391) 00010000:00010000:2.0:1746147216.222240:0:29477:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d90000/0x31399394250636fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f658 expref: 14 pid: 10340 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.222254:0:29477:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d90000/0x31399394250636fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f658 expref: 14 pid: 10340 timeout: 854 lvb_type: 0 00002000:00010000:2.0:1746147216.222262:0:29477:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095148a80 00000100:00100000:0.0:1746147216.224981:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.225051:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310501248 00000100:00100000:1.0:1746147216.225061:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310501248 00010000:00010000:1.0:1746147216.225114:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d90000/0x31399394250636fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1638400->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f658 expref: 14 pid: 10340 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746147216.225145:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9238 00000100:00100000:1.0:1746147216.225151:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310501248:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147216.225166:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147216.225185:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d90000/0x31399394250636fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1638400->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f658 expref: 14 pid: 10340 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746147216.225197:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d90000/0x31399394250636fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1638400->1851391) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f658 expref: 14 pid: 10340 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746147216.225220:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d90000/0x31399394250636fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1638400->1851391) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f658 expref: 14 pid: 10340 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746147216.225247:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147216.225249:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147216.225254:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x31399394250637ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.225262:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x31399394250637ba lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.225294:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147216.225333:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310501248:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 181us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.225339:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9238 00010000:00010000:3.0:1746147216.225574:0:12201:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x31399394250637ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.225584:0:12201:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x31399394250637ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.225602:0:12201:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x31399394250637ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.225609:0:12201:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x31399394250637ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.225617:0:12201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x31399394250637ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.225625:0:12201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e6c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147216.225628:0:12201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x31399394250637ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.225636:0:12201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x31399394250637ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.225646:0:12201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x31399394250637ba lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.225652:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6c00/0x31399394250637ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.225701:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310498816:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 34613us (34720us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.225708:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20320 00000100:00100000:0.0:1746147216.227686:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.227900:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310501504 00000100:00100000:3.0:1746147216.227906:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310501504 00000100:00100000:3.0:1746147216.227977:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16529 00000100:00100000:3.0:1746147216.227985:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2999:x1830967310501504:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:3.0:1746147216.228038:0:7238:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1746147216.228063:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95e00/0x313993942506377b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6ac expref: 13 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.228080:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093709200/0x31399394250634cd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f4a6 expref: 12 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.228108:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147216.228112:0:7238:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147216.228139:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.228151:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250636e1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f643 expref: 35 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.228157:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f444 expref: 16 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.228162:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x3139939425063472 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f44b expref: 35 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.228168:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063479 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f452 expref: 16 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.228173:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425063640 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5da expref: 35 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.228179:0:7238:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x3139939425063671 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5fd expref: 16 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.228184:0:7238:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 9/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.228215:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x3139939425063671 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5fd expref: 16 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.228227:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x3139939425063671 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5fd expref: 16 pid: 7238 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.228240:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311536000:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.228931:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425063640 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5da expref: 35 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.228940:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425063640 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5da expref: 35 pid: 7238 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.228947:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca13100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311536128:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.228972:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063479 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f452 expref: 16 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.228978:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063479 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f452 expref: 16 pid: 6215 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.228984:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca10000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311536256:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.229002:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x3139939425063472 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f44b expref: 35 pid: 6215 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.229007:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x3139939425063472 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f44b expref: 35 pid: 6215 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.229018:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca13480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311536384:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.229033:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f444 expref: 16 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.229039:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f444 expref: 16 pid: 7237 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.229045:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311536512:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.229061:0:7238:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250636e1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f643 expref: 35 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.229067:0:7238:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250636e1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f643 expref: 35 pid: 7238 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.229072:0:7238:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ca11f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311536640:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.229085:0:7238:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a550b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147216.231436:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311536000:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147216.232442:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.232710:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca13100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311536128:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147216.232769:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310501760 00000100:00100000:1.0:1746147216.232776:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310501760 00000100:00100000:1.0:1746147216.232820:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6191 00000100:00100000:1.0:1746147216.232827:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:30601:x1830967310501760:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147216.233031:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:30601:x1830967310501760:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 203us (591us total) trans 8589937438 rc 0/0 00000100:00100000:1.0:1746147216.233038:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6191 00000100:00100000:1.0:1746147216.234694:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.234811:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca10000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311536256:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.234820:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca13480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311536384:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147216.235012:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.235142:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311536512:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.235150:0:7238:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ca11f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7238:1830967311536640:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.235190:0:7238:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000100:00100000:2.0:1746147216.235272:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310502016 00000100:00100000:2.0:1746147216.235279:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310502016 00000100:00100000:2.0:1746147216.235317:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6192 00000100:00100000:2.0:1746147216.235324:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:16261:x1830967310502016:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746147216.235479:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:16261:x1830967310502016:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 154us (791us total) trans 8589937439 rc 0/0 00000100:00100000:2.0:1746147216.235485:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6192 00000100:00100000:1.0:1746147216.235675:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.235689:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.235701:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.235727:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.235859:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310502272 00000100:00100000:0.0:1746147216.235864:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310502272 00010000:00010000:0.0:1746147216.235885:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f444 expref: 18 pid: 7237 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746147216.235902:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310502144 00000100:00100000:0.0:1746147216.235905:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310502144 00010000:00010000:0.0:1746147216.235912:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x3139939425063472 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f44b expref: 37 pid: 6215 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746147216.235920:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310502400 00000100:00100000:0.0:1746147216.235922:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310502400 00010000:00010000:0.0:1746147216.235929:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250636e1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f643 expref: 38 pid: 7238 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746147216.235941:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310502528 00000100:00100000:0.0:1746147216.235942:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310502528 00010000:00010000:0.0:1746147216.235949:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063479 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f452 expref: 19 pid: 6215 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746147216.235956:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310502656 00000100:00100000:0.0:1746147216.235958:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310502656 00010000:00010000:0.0:1746147216.235963:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x3139939425063671 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5fd expref: 20 pid: 7238 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746147216.235971:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9239 00000100:00100000:0.0:1746147216.235975:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2001:x1830967310502272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147216.235983:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147216.235988:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f444 expref: 20 pid: 7237 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.235995:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f444 expref: 20 pid: 7237 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.236013:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a49c4800/0x3139939425063464 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f444 expref: 20 pid: 7237 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.236027:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147216.236031:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147216.236039:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147216.236057:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2001:x1830967310502272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 82us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.236063:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9239 00000100:00100000:0.0:1746147216.236073:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9240 00000100:00100000:0.0:1746147216.236076:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310502144:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147216.236081:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147216.236084:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x3139939425063472 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f44b expref: 38 pid: 6215 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.236112:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x3139939425063472 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f44b expref: 38 pid: 6215 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.236122:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d200/0x3139939425063472 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f44b expref: 38 pid: 6215 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.236128:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147216.236131:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147216.236135:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147216.236148:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2001:x1830967310502144:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 72us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.236153:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9240 00000100:00100000:0.0:1746147216.236163:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9241 00000100:00100000:0.0:1746147216.236167:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:2002:x1830967310502400:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147216.236173:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147216.236176:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250636e1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f643 expref: 36 pid: 7238 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.236186:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250636e1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f643 expref: 36 pid: 7238 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.236195:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9ff600/0x31399394250636e1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f643 expref: 36 pid: 7238 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.236201:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147216.236204:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147216.236208:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147216.236218:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2002:x1830967310502400:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 51us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.236222:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9241 00000100:00100000:0.0:1746147216.236233:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9242 00000100:00100000:0.0:1746147216.236237:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310502528:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147216.236242:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147216.236245:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063479 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f452 expref: 18 pid: 6215 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.236252:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063479 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f452 expref: 18 pid: 6215 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.236259:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d600/0x3139939425063479 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f452 expref: 18 pid: 6215 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.236265:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147216.236268:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147216.236272:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147216.236282:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2000:x1830967310502528:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 45us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.236286:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9242 00000100:00100000:0.0:1746147216.236295:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9243 00000100:00100000:0.0:1746147216.236299:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310502656:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147216.236305:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147216.236308:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x3139939425063671 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5fd expref: 16 pid: 7238 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.236315:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x3139939425063671 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5fd expref: 16 pid: 7238 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.236325:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d95600/0x3139939425063671 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5fd expref: 16 pid: 7238 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.236333:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147216.236335:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147216.236339:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147216.236351:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310502656:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 52us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.236356:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9243 00000100:00100000:0.0:1746147216.238409:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.239022:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310502784 00000100:00100000:3.0:1746147216.239031:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310502784 00010000:00010000:3.0:1746147216.239063:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425063640 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5da expref: 35 pid: 7238 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.239127:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9244 00000100:00100000:3.0:1746147216.239134:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2000:x1830967310502784:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.239152:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.239157:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425063640 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5da expref: 35 pid: 7238 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.239173:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425063640 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5da expref: 35 pid: 7238 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.239190:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d94a00/0x3139939425063640 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f5da expref: 35 pid: 7238 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.239202:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147216.239207:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.239214:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.239220:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7238 initiator: MDT0 00010000:00010000:3.0:1746147216.239237:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147216.239343:0:7238:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147216.239351:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000040:00080000:0.0:1746147216.239597:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1336, 88 off125432 00000004:00080000:0.0:1746147216.239604:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754229514440ns, next at 694367945074ns, rc = 0 00000100:00100000:3.0:1746147216.240201:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+34:2000:x1830967310502784:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1064us (1796us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.240210:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9244 00000040:00080000:0.0:1746147216.240724:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1327, 88 off124640 00000004:00080000:0.0:1746147216.240731:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754230641592ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147216.240762:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1328, 88 off124728 00000004:00080000:0.0:1746147216.240766:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754230676360ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147216.240778:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1337, 88 off125520 00000004:00080000:0.0:1746147216.240781:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754230691691ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147216.240789:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1338, 88 off125608 00000004:00080000:0.0:1746147216.240793:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754230703881ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147216.240801:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1329, 88 off124816 00000004:00080000:0.0:1746147216.240804:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754230714401ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147216.240811:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1330, 88 off124904 00000004:00080000:0.0:1746147216.240814:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754230724385ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147216.240822:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1331, 88 off124992 00000004:00080000:0.0:1746147216.240824:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754230734362ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147216.240831:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1339, 88 off125696 00000004:00080000:0.0:1746147216.240834:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754230744446ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147216.240841:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1332, 88 off125080 00000004:00080000:0.0:1746147216.240845:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754230755591ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147216.240853:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1340, 88 off125784 00000004:00080000:0.0:1746147216.240856:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754230766539ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147216.240863:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1333, 88 off125168 00000004:00080000:0.0:1746147216.240867:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754230777801ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147216.240875:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1341, 88 off125872 00000004:00080000:0.0:1746147216.240878:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754230788362ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147216.240885:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1342, 88 off125960 00000004:00080000:0.0:1746147216.240888:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754230798552ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147216.240895:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1343, 88 off126048 00000004:00080000:0.0:1746147216.240899:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754230809282ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147216.240907:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1344, 88 off126136 00000004:00080000:0.0:1746147216.240910:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754230820769ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147216.240918:0:7238:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1334, 88 off125256 00000004:00080000:0.0:1746147216.240921:0:7238:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754230832055ns, next at 694367916532ns, rc = 0 00000001:00080000:3.0:1746147216.243593:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937440 is committed 00000004:00080000:3.0:1746147216.243606:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1310 committed 00000004:00080000:3.0:1746147216.243627:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1323 committed 00000004:00080000:3.0:1746147216.243642:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1322 committed 00000004:00080000:3.0:1746147216.243645:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1321 committed 00000004:00080000:3.0:1746147216.243648:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1320 committed 00000004:00080000:3.0:1746147216.243653:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1309 committed 00000004:00080000:3.0:1746147216.243656:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1319 committed 00000004:00080000:3.0:1746147216.243659:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1308 committed 00000004:00080000:3.0:1746147216.243660:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1318 committed 00000004:00080000:3.0:1746147216.243663:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1307 committed 00000004:00080000:3.0:1746147216.243664:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1306 committed 00000004:00080000:3.0:1746147216.243666:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1305 committed 00000004:00080000:3.0:1746147216.243667:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1317 committed 00000004:00080000:3.0:1746147216.243670:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1316 committed 00000004:00080000:3.0:1746147216.243672:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1304 committed 00000004:00080000:3.0:1746147216.243675:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1303 committed 00000004:00080000:3.0:1746147216.243677:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1315 committed 00000001:00080000:3.0:1746147216.243682:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937439 is committed 00000001:00080000:3.0:1746147216.243688:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937438 is committed 00000100:00100000:2.0:1746147216.243868:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311537024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147216.243932:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.243961:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311537536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147216.243974:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.243989:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746147216.243993:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097ebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311537152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147216.244005:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.244014:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311537664:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147216.244023:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.244043:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311537024 00000100:00100000:2.0:1746147216.244050:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311537024 00000100:00100000:2.0:1746147216.244081:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311537536 00000100:00100000:2.0:1746147216.244083:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311537536 00000100:00100000:2.0:1746147216.244114:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311537152 00000100:00100000:2.0:1746147216.244116:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311537152 00000100:00100000:2.0:1746147216.244126:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311537664 00000100:00100000:2.0:1746147216.244127:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311537664 00000100:00100000:2.0:1746147216.244139:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20322 00000100:00100000:2.0:1746147216.244145:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3766:x1830967311537024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147216.244290:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3766:x1830967311537024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 144us (357us total) trans 17179875328 rc 0/0 00000100:00100000:2.0:1746147216.244295:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20322 00000100:00100000:2.0:1746147216.244308:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20323 00000100:00100000:2.0:1746147216.244312:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3766:x1830967311537536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147216.244367:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3766:x1830967311537536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (391us total) trans 17179875329 rc 0/0 00000100:00100000:2.0:1746147216.244372:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20323 00000100:00100000:2.0:1746147216.244380:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20324 00000100:00100000:2.0:1746147216.244384:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3766:x1830967311537152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147216.244426:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147216.244429:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00000100:00100000:1.0:1746147216.244429:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20325 00002000:00010000:2.0:1746147216.244431:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147216.244433:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147216.244434:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746147216.244437:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3766:x1830967311537664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147216.244450:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3766:x1830967311537152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (444us total) trans 17179875330 rc 0/0 00000100:00100000:2.0:1746147216.244454:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20324 00000004:00080000:2.0:1746147216.244492:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097ebbb80/2, rc 0, transno 17179875330 00000100:00100000:1.0:1746147216.244495:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3766:x1830967311537664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (471us total) trans 17179875331 rc 0/0 00000100:00100000:2.0:1746147216.244496:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097ebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311537152:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147216.244501:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20325 00000004:00080000:2.0:1746147216.244503:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009455fb80/2, rc 0, transno 17179875331 00000100:00100000:2.0:1746147216.244505:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311537664:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147216.244511:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097eb9180/2, rc 0, transno 17179875328 00000100:00100000:2.0:1746147216.244513:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311537024:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147216.244519:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097eb8000/2, rc 0, transno 17179875329 00000100:00100000:2.0:1746147216.244521:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311537536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147216.244542:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311538048:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.244574:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147216.244581:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311538176:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.244587:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311538560:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147216.244598:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.244606:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311538048 00000100:00100000:1.0:1746147216.244608:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311538688:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.244609:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311538048 00000100:00100000:1.0:1746147216.244621:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.244624:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311538176 00000100:00100000:2.0:1746147216.244626:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311538176 00000100:00100000:2.0:1746147216.244633:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311538688 00000100:00100000:2.0:1746147216.244635:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311538688 00000100:00100000:1.0:1746147216.244638:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20326 00000100:00100000:1.0:1746147216.244643:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+79:3766:x1830967311538048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.244646:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20327 00000100:00100000:2.0:1746147216.244649:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+79:3767:x1830967311538176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.244697:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20328 00000100:00100000:2.0:1746147216.244702:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+81:3767:x1830967311538688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147216.244724:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+81:3766:x1830967311538048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (149us total) trans 21474842721 rc 0/0 00000100:00100000:1.0:1746147216.244729:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20326 00002000:00010000:2.0:1746147216.244746:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00000100:00100000:1.0:1746147216.244747:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746147216.244748:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147216.244751:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147216.244752:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147216.244754:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000004:00080000:1.0:1746147216.244762:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8b0e00/2, rc 0, transno 21474842721 00000100:00100000:1.0:1746147216.244768:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311538048:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.244773:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+81:3767:x1830967311538688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (151us total) trans 21474842722 rc 0/0 00000100:00100000:1.0:1746147216.244777:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311538560 00000100:00100000:2.0:1746147216.244778:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20328 00000100:00100000:1.0:1746147216.244779:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311538560 00000100:00100000:1.0:1746147216.244792:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20329 00000100:00100000:1.0:1746147216.244796:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+81:3766:x1830967311538560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147216.244800:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746147216.244802:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147216.244803:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147216.244805:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147216.244807:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:2.0:1746147216.244822:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+82:3767:x1830967311538176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 172us (224us total) trans 21474842720 rc 0/0 00000100:00100000:2.0:1746147216.244828:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20327 00002000:00010000:1.0:1746147216.244831:0:12225:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147216.244833:0:12225:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147216.244834:0:12225:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147216.244836:0:12225:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147216.244838:0:12225:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:1.0:1746147216.244855:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+81:3766:x1830967311538560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (107us total) trans 21474842723 rc 0/0 00000100:00100000:1.0:1746147216.244860:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20329 00000004:00080000:1.0:1746147216.244878:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8b1180/2, rc 0, transno 21474842723 00000100:00100000:1.0:1746147216.244881:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311538560:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147216.244904:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8b1880/2, rc 0, transno 21474842720 00000100:00100000:1.0:1746147216.244907:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311538176:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147216.244912:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094187b80/2, rc 0, transno 21474842722 00000100:00100000:1.0:1746147216.244914:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311538688:0@lo:2:osp-syn-0-0.0 00000004:00010000:0.0:1746147216.245026:0:7238:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880095149f80 reply state ffff88011db22400 transno 8589937440 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147216.245045:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147216.245054:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147216.245057:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746147216.245061:0:7238:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1746147216.245169:0:7238:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746147216.245181:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2999:x1830967310501504:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 17195us (17501us total) trans 8589937440 rc 0/0 00000100:00100000:0.0:1746147216.245187:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16529 00010000:00010000:0.0:1746147216.245209:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147216.245216:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147216.245222:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147216.245228:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d42600 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147216.245232:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147216.245239:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147216.245247:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147216.245249:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147216.245252:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:0.0:1746147216.245256:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d42600/0x31399394250637c8 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00000100:00100000:3.0:1746147216.245428:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311536896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147216.245455:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.245473:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311537408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147216.245487:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.245505:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311537920:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147216.245518:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.245527:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311538432:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147216.245538:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.245548:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 5 async RPCs [0->1] 00000100:00100000:3.0:1746147216.245564:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311536768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147216.245577:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.245585:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311537280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147216.245597:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.245606:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311537792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147216.245620:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.245629:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311538304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147216.245641:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.245647:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311538816:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147216.245658:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.245677:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311536896 00000100:00100000:3.0:1746147216.245680:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311536896 00000100:00100000:3.0:1746147216.245697:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311537408 00000100:00100000:3.0:1746147216.245699:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311537408 00000100:00100000:3.0:1746147216.245708:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311537920 00000100:00100000:3.0:1746147216.245710:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311537920 00000100:00100000:3.0:1746147216.245719:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311538432 00000100:00100000:3.0:1746147216.245720:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311538432 00000100:00100000:3.0:1746147216.245727:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311536768 00000100:00100000:3.0:1746147216.245728:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311536768 00000100:00100000:3.0:1746147216.245734:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311537280 00000100:00100000:3.0:1746147216.245735:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311537280 00000100:00100000:3.0:1746147216.245740:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311537792 00000100:00100000:3.0:1746147216.245742:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311537792 00000100:00100000:3.0:1746147216.245748:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311538304 00000100:00100000:3.0:1746147216.245749:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311538304 00000100:00100000:3.0:1746147216.245755:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311538816 00000100:00100000:3.0:1746147216.245757:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311538816 00000100:00100000:3.0:1746147216.245764:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20330 00000100:00100000:3.0:1746147216.245768:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3765:x1830967311536896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147216.245834:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3765:x1830967311536896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (378us total) trans 17179875332 rc 0/0 00000100:00100000:3.0:1746147216.245839:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20330 00000100:00100000:3.0:1746147216.245849:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20331 00000100:00100000:3.0:1746147216.245852:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3765:x1830967311537408:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147216.245890:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:3.0:1746147216.245892:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147216.245894:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147216.245896:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:3.0:1746147216.245897:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:3.0:1746147216.245914:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3765:x1830967311537408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (426us total) trans 17179875333 rc 0/0 00000100:00100000:3.0:1746147216.245920:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20331 00000100:00100000:3.0:1746147216.245927:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20332 00000100:00100000:3.0:1746147216.245931:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:3765:x1830967311537920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147216.246063:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20333 00000100:00100000:1.0:1746147216.246069:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:3765:x1830967311538432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147216.246269:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20334 00000100:00100000:3.0:1746147216.246275:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3765:x1830967311536768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147216.246332:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3765:x1830967311536768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (753us total) trans 17179875334 rc 0/0 00000100:00100000:3.0:1746147216.246337:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20334 00000100:00100000:3.0:1746147216.246347:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20335 00000100:00100000:3.0:1746147216.246351:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3765:x1830967311537280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147216.246397:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3765:x1830967311537280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (799us total) trans 17179875335 rc 0/0 00000100:00100000:3.0:1746147216.246402:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20335 00000100:00100000:3.0:1746147216.246410:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20336 00000100:00100000:3.0:1746147216.246414:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+85:3765:x1830967311537792:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147216.246448:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097eb8e00/2, rc 0, transno 17179875334 00000100:00100000:3.0:1746147216.246452:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311536768:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147216.246458:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097eb8700/2, rc 0, transno 17179875335 00000100:00100000:3.0:1746147216.246460:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311537280:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147216.246466:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097eb9500/2, rc 0, transno 17179875332 00000100:00100000:3.0:1746147216.246469:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311536896:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147216.246475:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097eb9f80/2, rc 0, transno 17179875333 00000100:00100000:3.0:1746147216.246477:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311537408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147216.246491:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20337 00000100:00100000:3.0:1746147216.246496:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+85:3765:x1830967311538304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147216.246615:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20338 00000100:00100000:0.0:1746147216.246623:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+85:3765:x1830967311538816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147216.246691:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+86:3765:x1830967311538816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1032us total) trans 21474842724 rc 0/0 00000100:00100000:0.0:1746147216.246697:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20338 00000001:00080000:0.0:1746147216.247306:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842723 is committed 00000001:00080000:0.0:1746147216.247317:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842719 is committed 00000001:00080000:0.0:1746147216.247327:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842718 is committed 00000001:00080000:0.0:1746147216.247341:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842711 is committed 00000100:00100000:1.0:1746147216.247353:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+78:3765:x1830967311538432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1284us (1813us total) trans 21474842725 rc 0/0 00000100:00100000:1.0:1746147216.247358:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20333 00000100:00100000:1.0:1746147216.252829:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.253000:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310502912 00000100:00100000:0.0:1746147216.253010:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310502912 00000100:00100000:0.0:1746147216.253063:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16530 00000100:00100000:0.0:1746147216.253072:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2999:x1830967310502912:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147216.253113:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147216.253132:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250637cf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f6c1 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.253193:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250637cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6c1 expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.253207:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250637cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6c1 expref: 8 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.253223:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147216.253226:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147216.253229:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e7a00, rc 0) 00000100:00100000:0.0:1746147216.253263:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2999:x1830967310502912:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 193us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.253270:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16530 00000100:00100000:2.0:1746147216.253528:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3765:x1830967311537920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 7590us (8002us total) trans 21474842727 rc 0/0 00000100:00100000:2.0:1746147216.253537:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20332 00000004:00080000:2.0:1746147216.253600:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009514d500/2, rc 0, transno 21474842724 00000100:00100000:2.0:1746147216.253607:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311538816:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.253618:0:3765:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474842723 gen 2 00000004:00080000:2.0:1746147216.253622:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a2a00, transno 21474842621 00000004:00080000:2.0:1746147216.253629:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a3100, transno 21474842622 00000004:00080000:2.0:1746147216.253632:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a1180, transno 21474842623 00000004:00080000:2.0:1746147216.253635:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a1880, transno 21474842624 00000004:00080000:2.0:1746147216.253637:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a2680, transno 21474842625 00000004:00080000:2.0:1746147216.253639:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800933f6a00, transno 21474842626 00000004:00080000:2.0:1746147216.253642:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a3480, transno 21474842627 00000004:00080000:2.0:1746147216.253644:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a0380, transno 21474842628 00000004:00080000:2.0:1746147216.253646:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801349a1500, transno 21474842629 00000004:00080000:2.0:1746147216.253648:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cd880, transno 21474842634 00000004:00080000:2.0:1746147216.253651:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cdc00, transno 21474842635 00000004:00080000:2.0:1746147216.253653:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cf100, transno 21474842636 00000004:00080000:2.0:1746147216.253655:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cca80, transno 21474842637 00000004:00080000:2.0:1746147216.253658:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cc380, transno 21474842638 00000004:00080000:2.0:1746147216.253660:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cdf80, transno 21474842639 00000004:00080000:2.0:1746147216.253662:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cfb80, transno 21474842640 00000004:00080000:2.0:1746147216.253663:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cc000, transno 21474842641 00000004:00080000:2.0:1746147216.253665:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cce00, transno 21474842642 00000004:00080000:2.0:1746147216.253667:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099155500, transno 21474842643 00000004:00080000:2.0:1746147216.253669:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009455ca80, transno 21474842644 00000004:00080000:2.0:1746147216.253672:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095127100, transno 21474842645 00000004:00080000:2.0:1746147216.253675:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009455c380, transno 21474842646 00000004:00080000:2.0:1746147216.253677:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095125880, transno 21474842647 00000004:00080000:2.0:1746147216.253679:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009455c000, transno 21474842648 00000004:00080000:2.0:1746147216.253681:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095127480, transno 21474842649 00000004:00080000:2.0:1746147216.253683:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099157100, transno 21474842650 00000004:00080000:2.0:1746147216.253686:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009455df80, transno 21474842651 00000004:00080000:2.0:1746147216.253688:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258f100, transno 21474842659 00000004:00080000:2.0:1746147216.253690:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4394380, transno 21474842660 00000004:00080000:2.0:1746147216.253693:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258ed80, transno 21474842661 00000004:00080000:2.0:1746147216.253695:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5575180, transno 21474842662 00000004:00080000:2.0:1746147216.253698:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258c380, transno 21474842663 00000004:00080000:2.0:1746147216.253700:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4397b80, transno 21474842664 00000004:00080000:2.0:1746147216.253702:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258ca80, transno 21474842665 00000004:00080000:2.0:1746147216.253704:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4397800, transno 21474842666 00000004:00080000:2.0:1746147216.253706:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5577100, transno 21474842667 00000004:00080000:2.0:1746147216.253708:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099150e00, transno 21474842669 00000004:00080000:2.0:1746147216.253710:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099151c00, transno 21474842670 00000004:00080000:2.0:1746147216.253712:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099151500, transno 21474842671 00000004:00080000:2.0:1746147216.253714:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099150a80, transno 21474842672 00000004:00080000:2.0:1746147216.253717:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800769d9f80, transno 21474842673 00000004:00080000:2.0:1746147216.253719:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099151f80, transno 21474842674 00000004:00080000:2.0:1746147216.253721:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800769daa00, transno 21474842675 00000004:00080000:2.0:1746147216.253723:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099151880, transno 21474842676 00000004:00080000:2.0:1746147216.253726:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800769dad80, transno 21474842677 00000004:00080000:2.0:1746147216.253729:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947e4000, transno 21474842683 00000004:00080000:2.0:1746147216.253731:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947e6680, transno 21474842684 00000004:00080000:2.0:1746147216.253733:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947e5c00, transno 21474842685 00000004:00080000:2.0:1746147216.253735:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947e4700, transno 21474842686 00000004:00080000:2.0:1746147216.253737:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947e5f80, transno 21474842687 00000004:00080000:2.0:1746147216.253740:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947e7b80, transno 21474842688 00000004:00080000:2.0:1746147216.253743:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947e6300, transno 21474842689 00000004:00080000:2.0:1746147216.253745:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099010000, transno 21474842690 00000004:00080000:2.0:1746147216.253748:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947e4380, transno 21474842691 00000004:00080000:2.0:1746147216.253750:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094712d80, transno 21474842693 00000004:00080000:2.0:1746147216.253752:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094710000, transno 21474842694 00000004:00080000:2.0:1746147216.253755:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094711880, transno 21474842695 00000004:00080000:2.0:1746147216.253757:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094710700, transno 21474842696 00000004:00080000:2.0:1746147216.253760:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094710e00, transno 21474842697 00000004:00080000:2.0:1746147216.253762:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094184700, transno 21474842698 00000004:00080000:2.0:1746147216.253765:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094713800, transno 21474842699 00000004:00080000:2.0:1746147216.253767:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094713b80, transno 21474842700 00000004:00080000:2.0:1746147216.253768:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094711180, transno 21474842701 00000004:00080000:2.0:1746147216.253771:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d77b80, transno 21474842702 00000004:00080000:2.0:1746147216.253773:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d76680, transno 21474842703 00000004:00080000:2.0:1746147216.253775:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d75880, transno 21474842704 00000004:00080000:2.0:1746147216.253777:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d74a80, transno 21474842705 00000004:00080000:2.0:1746147216.253779:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d75c00, transno 21474842706 00000004:00080000:2.0:1746147216.253781:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d75f80, transno 21474842707 00000004:00080000:2.0:1746147216.253783:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d75180, transno 21474842708 00000004:00080000:2.0:1746147216.253785:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d74700, transno 21474842709 00000004:00080000:2.0:1746147216.253787:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d75500, transno 21474842710 00000004:00080000:2.0:1746147216.253789:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8b1880, transno 21474842720 00000004:00080000:2.0:1746147216.253790:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8b0e00, transno 21474842721 00000004:00080000:2.0:1746147216.253792:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094187b80, transno 21474842722 00000004:00080000:2.0:1746147216.253794:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8b1180, transno 21474842723 00000100:00100000:2.0:1746147216.253800:0:3765:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009514d500 x1830967311538816/t21474842724(21474842724) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147232 ref 2 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:2.0:1746147216.253807:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8b1c00/2, rc 0, transno 21474842727 00000100:00100000:2.0:1746147216.253811:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311537920:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147216.253821:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8b3100/2, rc 0, transno 21474842725 00000100:00100000:2.0:1746147216.253824:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311538432:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147216.255303:0:8110:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 5 in progress, 2 in flight, 76 done 00000100:00100000:0.0:1746147216.255947:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3765:x1830967311538304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 9445us (10299us total) trans 21474842728 rc 0/0 00000100:00100000:0.0:1746147216.255958:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20337 00000100:00100000:3.0:1746147216.256712:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3765:x1830967311537792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 10295us (11088us total) trans 21474842726 rc 0/0 00000100:00100000:3.0:1746147216.256720:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20336 00000004:00080000:2.0:1746147216.256803:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8b1f80/2, rc 0, transno 21474842726 00000100:00100000:2.0:1746147216.256809:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311537792:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147216.256819:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8b2680/2, rc 0, transno 21474842728 00000100:00100000:2.0:1746147216.256821:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311538304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147216.259050:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.259185:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310503040 00000100:00100000:2.0:1746147216.259193:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310503040 00000100:00100000:2.0:1746147216.259510:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16531 00000100:00100000:2.0:1746147216.259518:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2999:x1830967310503040:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147216.259538:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.259569:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f007800/0x31399394250637d6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f6c8 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.259667:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x31399394250637dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.259683:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x31399394250637dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.259958:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x31399394250637dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147216.259991:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:2.0:1746147216.259995:0:7238:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746147216.260012:0:7238:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x31399394250637dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.260040:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f007800/0x31399394250637d6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6c8 expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.260072:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x31399394250637dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6c8 expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.260079:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147216.260082:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147216.260085:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f15f800, rc 0) 00000100:00100000:2.0:1746147216.260624:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2999:x1830967310503040:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1104us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.260631:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16531 00000100:00100000:0.0:1746147216.264420:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.264565:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310503168 00000100:00100000:3.0:1746147216.264574:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310503168 00000100:00100000:1.0:1746147216.265516:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.266185:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.266234:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310503424 00000100:00100000:3.0:1746147216.266239:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310503424 00000100:00100000:3.0:1746147216.266271:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20339 00000100:00100000:3.0:1746147216.266280:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2001:x1830967310503168:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147216.266299:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.266319:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d42600/0x31399394250637e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f6cf expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147216.266341:0:1136:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x93:0x0] initial LVB size: 1048576, mtime: 0x6814178e, atime: 0x6814178e, ctime: 0x6814178f, blocks: 0x7e8 00010000:00010000:3.0:1746147216.266360:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.266362:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.266371:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d42600/0x31399394250637e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6cf expref: 9 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.266385:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096d42600/0x31399394250637e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6cf expref: 9 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.266395:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d42600, rc 0) 00000100:00100000:3.0:1746147216.266437:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310503168:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 159us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.266442:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20339 00000100:00100000:3.0:1746147216.266456:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20340 00000100:00100000:3.0:1746147216.266460:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310503424:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147216.266466:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.266477:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d43800/0x31399394250637eb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f6dd expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147216.266490:0:1136:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x97:0x0] initial LVB size: 2097152, mtime: 0x6814178f, atime: 0x6814178f, ctime: 0x6814178f, blocks: 0x800 00010000:00010000:3.0:1746147216.266497:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.266498:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.266501:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d43800/0x31399394250637eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6dd expref: 16 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.266509:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d43800/0x31399394250637eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6dd expref: 16 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.266515:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d43800, rc 0) 00000100:00100000:3.0:1746147216.266526:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310503424:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 65us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.266530:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20340 00000100:00100000:2.0:1746147216.268174:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310503680 00000100:00100000:2.0:1746147216.268183:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310503680 00000100:00100000:1.0:1746147216.268339:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.268569:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.268584:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310503296 00000100:00100000:2.0:1746147216.268587:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310503296 00000100:00100000:2.0:1746147216.268610:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20341 00000100:00100000:2.0:1746147216.268616:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2001:x1830967310503680:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147216.268632:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.268651:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1e80c00/0x31399394250637f2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f6eb expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147216.268671:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4886560, mtime: 0x6814178f, atime: 0x6814178e, ctime: 0x6814178f, blocks: 0x1558 00010000:00010000:2.0:1746147216.268685:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.268687:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.268694:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e80c00/0x31399394250637f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6eb expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.268711:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e80c00/0x31399394250637f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6eb expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.268719:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e80c00, rc 0) 00000100:00100000:2.0:1746147216.268758:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310503680:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 142us (2573us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.268763:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20341 00000100:00100000:2.0:1746147216.268779:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20342 00000100:00100000:2.0:1746147216.268783:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310503296:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147216.268790:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.268804:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1e80200/0x31399394250637f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f6d6 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147216.268816:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x96:0x0] initial LVB size: 2097152, mtime: 0x6814178f, atime: 0x6814178f, ctime: 0x6814178f, blocks: 0x808 00010000:00010000:2.0:1746147216.268824:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.268826:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.268829:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1e80200/0x31399394250637f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6d6 expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.268837:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b1e80200/0x31399394250637f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6d6 expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.268843:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e80200, rc 0) 00000100:00100000:2.0:1746147216.268855:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310503296:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 72us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.268863:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20342 00000100:00100000:1.0:1746147216.269086:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.269155:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310503552 00000100:00100000:3.0:1746147216.269159:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310503552 00000100:00100000:3.0:1746147216.269173:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310503808 00000100:00100000:3.0:1746147216.269174:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310503808 00000100:00100000:3.0:1746147216.269184:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20343 00000100:00100000:3.0:1746147216.269188:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310503552:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147216.269194:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.269203:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425063800 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f6e4 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147216.269214:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6814178e, atime: 0x6814178e, ctime: 0x6814178f, blocks: 0x808 00010000:00010000:3.0:1746147216.269220:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.269222:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.269226:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425063800 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6e4 expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.269234:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425063800 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6e4 expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.269245:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ffc600, rc 0) 00000100:00100000:3.0:1746147216.269261:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310503552:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 73us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.269265:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20343 00000100:00100000:3.0:1746147216.269274:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20344 00000100:00100000:3.0:1746147216.269278:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+17:2001:x1830967310503808:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147216.269282:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.269289:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425063807 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f6f2 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746147216.269298:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x98:0x0] initial LVB size: 4194304, mtime: 0x6814178f, atime: 0x6814178f, ctime: 0x6814178f, blocks: 0x1008 00010000:00010000:3.0:1746147216.269304:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.269305:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.269307:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425063807 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f2 expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.269315:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425063807 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f2 expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.269320:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ffd800, rc 0) 00000100:00100000:3.0:1746147216.269332:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2001:x1830967310503808:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 53us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.269335:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20344 00000100:00100000:0.0:1746147216.273645:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.273718:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.273807:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.273960:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.273995:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310504064 00000100:00100000:2.0:1746147216.274005:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310504064 00000100:00100000:0.0:1746147216.274234:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.274255:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310503936 00000100:00100000:3.0:1746147216.274258:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310503936 00000100:00100000:3.0:1746147216.274283:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310504320 00000100:00100000:3.0:1746147216.274285:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310504320 00000100:00100000:3.0:1746147216.274294:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310504576 00000100:00100000:3.0:1746147216.274296:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310504576 00000100:00100000:3.0:1746147216.274314:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20345 00000100:00100000:3.0:1746147216.274321:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2002:x1830967310504064:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147216.274426:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2002:x1830967310504064:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 105us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.274432:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20345 00000100:00100000:3.0:1746147216.274447:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20346 00000100:00100000:3.0:1746147216.274452:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310503936:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147216.274488:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2003:x1830967310503936:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 36us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.274493:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20346 00000100:00100000:3.0:1746147216.274509:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20347 00000100:00100000:3.0:1746147216.274513:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2002:x1830967310504320:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147216.274540:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2002:x1830967310504320:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 27us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.274545:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20347 00000100:00100000:3.0:1746147216.274564:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20348 00000100:00100000:3.0:1746147216.274568:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2002:x1830967310504576:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147216.274596:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2002:x1830967310504576:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 27us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.274600:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20348 00000100:00100000:0.0:1746147216.275136:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.275188:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310504192 00000100:00100000:1.0:1746147216.275193:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310504192 00000100:00100000:1.0:1746147216.275214:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310504448 00000100:00100000:1.0:1746147216.275216:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310504448 00000100:00100000:1.0:1746147216.275228:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20349 00000100:00100000:1.0:1746147216.275234:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2003:x1830967310504192:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147216.275292:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2003:x1830967310504192:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 58us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.275297:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20349 00000100:00100000:1.0:1746147216.275305:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20350 00000100:00100000:1.0:1746147216.275309:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2003:x1830967310504448:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147216.275343:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2003:x1830967310504448:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 33us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.275348:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20350 00000100:00100000:0.0:1746147216.277835:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.277967:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310504704 00000100:00100000:3.0:1746147216.277976:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310504704 00000100:00100000:3.0:1746147216.278018:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20351 00000100:00100000:3.0:1746147216.278025:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310504704:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147216.278155:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310504704:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 129us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.278161:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20351 00000100:00100000:0.0:1746147216.280045:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.280812:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310504832 00000100:00100000:2.0:1746147216.280822:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310504832 00000100:00100000:2.0:1746147216.280874:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20352 00000100:00100000:2.0:1746147216.280881:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310504832:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147216.280984:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310504832:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 104us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.280990:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20352 00000100:00100000:1.0:1746147216.281222:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.281421:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.281448:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.281626:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310504960 00000100:00100000:2.0:1746147216.281630:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310504960 00000100:00100000:2.0:1746147216.281815:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310505088 00000100:00100000:2.0:1746147216.281818:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310505088 00000100:00100000:1.0:1746147216.281856:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.282300:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310505216 00000100:00100000:3.0:1746147216.282304:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310505216 00000100:00100000:3.0:1746147216.282324:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310505344 00000100:00100000:3.0:1746147216.282327:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310505344 00000100:00100000:3.0:1746147216.282340:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20353 00000100:00100000:3.0:1746147216.282345:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310504960:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147216.282410:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310504960:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 63us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.282416:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20353 00000100:00100000:3.0:1746147216.282427:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20354 00000100:00100000:3.0:1746147216.282431:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310505088:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147216.282471:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310505088:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 39us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.282476:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20354 00000100:00100000:3.0:1746147216.282485:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20355 00000100:00100000:3.0:1746147216.282489:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310505216:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147216.282519:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310505216:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 29us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.282525:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20355 00000100:00100000:3.0:1746147216.282536:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20356 00000100:00100000:3.0:1746147216.282540:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310505344:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147216.282582:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2000:x1830967310505344:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 41us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.282587:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20356 00000100:00100000:0.0:1746147216.285231:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.285640:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310505472 00000100:00100000:2.0:1746147216.285649:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310505472 00000100:00100000:2.0:1746147216.285943:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20357 00000100:00100000:2.0:1746147216.285952:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+18:2002:x1830967310505472:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:2.0:1746147216.286206:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147216.286209:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147216.286211:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147216.286213:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147216.286214:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:2.0:1746147216.286264:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2002:x1830967310505472:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 314us (1043us total) trans 17179875336 rc 0/0 00000100:00100000:2.0:1746147216.286270:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20357 00000100:00100000:0.0:1746147216.289454:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.289677:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310505600 00000100:00100000:2.0:1746147216.289686:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310505600 00000100:00100000:2.0:1746147216.289738:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20358 00000100:00100000:2.0:1746147216.289746:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2000:x1830967310505600:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:2.0:1746147216.289936:0:10340:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147216.289939:0:10340:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147216.289941:0:10340:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147216.289943:0:10340:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147216.289945:0:10340:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:2.0:1746147216.290001:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310505600:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 255us (557us total) trans 21474842729 rc 0/0 00000100:00100000:2.0:1746147216.290007:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20358 00000100:00100000:0.0:1746147216.300295:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.300403:0:29477:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310505856 00000100:00100000:2.0:1746147216.300413:0:29477:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310505856 00000100:00100000:2.0:1746147216.300476:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7457 00000100:00100000:2.0:1746147216.300483:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2002:x1830967310505856:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147216.300521:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f007c00/0x313993942506380e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.300537:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.300539:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.300544:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f007c00/0x313993942506380e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.300568:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f007c00/0x313993942506380e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147216.307631:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.308473:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.309041:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.309075:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310506240 00000100:00100000:0.0:1746147216.309086:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310506240 00000100:00100000:1.0:1746147216.309448:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.309473:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310506496 00000100:00100000:0.0:1746147216.309476:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310506496 00000100:00100000:0.0:1746147216.309502:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310506368 00000100:00100000:0.0:1746147216.309504:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310506368 00000100:00100000:0.0:1746147216.309528:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7458 00000100:00100000:0.0:1746147216.309536:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2002:x1830967310506240:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:0.0:1746147216.309581:0:13302:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x3139939425063815 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.309595:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147216.309597:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147216.309603:0:13302:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x3139939425063815 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.309617:0:13302:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x3139939425063815 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147216.310124:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7459 00000100:00100000:2.0:1746147216.310133:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2002:x1830967310506496:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147216.310151:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x313993942506381c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.310158:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.310159:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.310162:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x313993942506381c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.310170:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x313993942506381c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.310286:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7460 00000100:00100000:3.0:1746147216.310294:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2002:x1830967310506368:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147216.310308:0:29478:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b417c400/0x3139939425063823 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.310314:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.310315:0:29478:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.310318:0:29478:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b417c400/0x3139939425063823 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.310325:0:29478:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b417c400/0x3139939425063823 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147216.314475:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.316155:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310506752 00000100:00100000:2.0:1746147216.316168:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310506752 00000100:00100000:2.0:1746147216.316238:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310506880 00000100:00100000:2.0:1746147216.316241:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310506880 00000100:00100000:2.0:1746147216.316271:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7461 00000100:00100000:2.0:1746147216.316278:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2002:x1830967310506752:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147216.316315:0:13334:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x313993942506382a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.316329:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.316331:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.316337:0:13334:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x313993942506382a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.316350:0:13334:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x313993942506382a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.317061:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7462 00000100:00100000:3.0:1746147216.317071:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2002:x1830967310506880:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147216.317104:0:29475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063831 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.317113:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.317114:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.317118:0:29475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063831 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.317131:0:29475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063831 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.317259:0:29477:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f007c00/0x313993942506380e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.317269:0:29477:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f007c00/0x313993942506380e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.317281:0:29477:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f007c00/0x313993942506380e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.317287:0:29477:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f007c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147216.317291:0:29477:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f007c00/0x313993942506380e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.317298:0:29477:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f007c00/0x313993942506380e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.317314:0:29477:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f007c00/0x313993942506380e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.317321:0:29477:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f007c00/0x313993942506380e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147216.317373:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2002:x1830967310505856:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 16889us (17089us total) trans 0 rc 1032192/1032192 00000100:00100000:2.0:1746147216.317379:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7457 00010000:00010000:3.0:1746147216.322521:0:29478:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b417c400/0x3139939425063823 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.322539:0:29478:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b417c400/0x3139939425063823 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.322557:0:29478:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b417c400/0x3139939425063823 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.322565:0:29478:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b417c400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147216.322569:0:29478:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b417c400/0x3139939425063823 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.322576:0:29478:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b417c400/0x3139939425063823 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.322596:0:29478:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b417c400/0x3139939425063823 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.322601:0:29478:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b417c400/0x3139939425063823 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29478 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.323709:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2002:x1830967310506368:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 13407us (14660us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147216.323727:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7460 00010000:00010000:2.0:1746147216.331885:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x313993942506381c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.331911:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x313993942506381c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.331919:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x313993942506381c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.331927:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b1e81000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147216.331932:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x313993942506381c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.331941:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x313993942506381c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.331966:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x313993942506381c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.331972:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e81000/0x313993942506381c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147216.332085:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2002:x1830967310506496:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 21946us (23606us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147216.332126:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7459 00010000:00010000:1.0:1746147216.336562:0:13302:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x3139939425063815 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.336581:0:13302:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x3139939425063815 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.336590:0:13302:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x3139939425063815 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.336604:0:13302:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e6e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147216.336608:0:13302:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x3139939425063815 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.336616:0:13302:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x3139939425063815 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.336637:0:13302:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x3139939425063815 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.336644:0:13302:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312e6e00/0x3139939425063815 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147216.336757:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2002:x1830967310506240:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 27213us (29130us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147216.336768:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7458 00010000:00010000:2.0:1746147216.346009:0:13334:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x313993942506382a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.346028:0:13334:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x313993942506382a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.346043:0:13334:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x313993942506382a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.346054:0:13334:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a9a4a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147216.346059:0:13334:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x313993942506382a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.346068:0:13334:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x313993942506382a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.346119:0:13334:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x313993942506382a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.346125:0:13334:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a4a00/0x313993942506382a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147216.346233:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2002:x1830967310506752:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 29948us (36778us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147216.346245:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7461 00010000:00010000:3.0:1746147216.353662:0:29475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063831 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.353680:0:29475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063831 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.353689:0:29475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063831 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.353696:0:29475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d94800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147216.353700:0:29475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063831 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.353707:0:29475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063831 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.353724:0:29475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063831 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.353730:0:29475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d94800/0x3139939425063831 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.354780:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2002:x1830967310506880:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 37702us (40307us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147216.354792:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7462 00000100:00100000:0.0:1746147216.364435:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.365295:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310507264 00000100:00100000:2.0:1746147216.365305:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310507264 00000100:00100000:2.0:1746147216.365365:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16532 00000100:00100000:2.0:1746147216.365373:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+9:2999:x1830967310507264:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:2.0:1746147216.365427:0:7238:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147216.365454:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f15f800/0x31399394250637dd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6c8 expref: 9 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.365489:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147216.365493:0:7238:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147216.365541:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425063838 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.365567:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425063838 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.365576:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425063838 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00010000:2.0:1746147216.366582:0:7238:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093145c00 reply state ffff880097d8d000 transno 8589937441 ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425063838 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.366594:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425063838 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.366976:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147216.366979:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746147216.366982:0:7238:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746147216.367334:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2999:x1830967310507264:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 1959us (2907us total) trans 8589937441 rc 0/0 00000100:00100000:2.0:1746147216.367343:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16532 00000100:00100000:0.0:1746147216.369535:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.369731:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310507392 00000100:00100000:2.0:1746147216.369741:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310507392 00000100:00100000:2.0:1746147216.370006:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20359 00000100:00100000:2.0:1746147216.370014:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2999:x1830967310507392:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147216.370032:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.370050:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x313993942506383f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f6f9 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.370080:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d42600/0x31399394250637e4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6cf expref: 13 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.370114:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.370116:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.370120:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x313993942506383f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f9 expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.370431:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d42600/0x31399394250637e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6cf expref: 13 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.370445:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d42600/0x31399394250637e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6cf expref: 13 pid: 1136 timeout: 854 lvb_type: 1 00000100:00100000:2.0:1746147216.370459:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095126300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311538944:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.370576:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147216.374720:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095126300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311538944:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.374760:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x313993942506383f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f9 expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.374780:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822bc00, rc 0) 00000100:00100000:2.0:1746147216.374838:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2999:x1830967310507392:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4823us (5310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.374847:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20359 00000100:00100000:0.0:1746147216.378302:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.379119:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310507520 00000100:00100000:3.0:1746147216.379129:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310507520 00010000:00010000:3.0:1746147216.379168:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d42600/0x31399394250637e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6cf expref: 13 pid: 1136 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746147216.379210:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9245 00000100:00100000:3.0:1746147216.379218:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310507520:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.379230:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.379251:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d42600/0x31399394250637e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6cf expref: 13 pid: 1136 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.379264:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d42600/0x31399394250637e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6cf expref: 13 pid: 1136 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.379289:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d42600/0x31399394250637e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6cf expref: 13 pid: 1136 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.379316:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.379318:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.379325:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x313993942506383f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f9 expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.379334:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x313993942506383f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f9 expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.379367:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x313993942506383f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f9 expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.379378:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311539072:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147216.379459:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caa000 going to sleep for 11 seconds 00000100:00100000:3.0:1746147216.381639:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311539072:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147216.381663:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147216.381714:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310507520:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2496us (3421us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.381724:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9245 00000100:00100000:0.0:1746147216.381950:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.382029:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310507648 00000100:00100000:2.0:1746147216.382036:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310507648 00000100:00100000:2.0:1746147216.382078:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20360 00000100:00100000:2.0:1746147216.382084:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2999:x1830967310507648:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147216.382119:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.382134:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x3139939425063846 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f700 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.382164:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e80200/0x31399394250637f9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6d6 expref: 20 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.382171:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.382173:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.382176:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x3139939425063846 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f700 expref: 20 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.382200:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1e80200/0x31399394250637f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6d6 expref: 20 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.382209:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b1e80200/0x31399394250637f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6d6 expref: 20 pid: 9585 timeout: 854 lvb_type: 1 00000100:00100000:2.0:1746147216.382219:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095126300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311539200:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.382273:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc780 going to sleep for 11 seconds 00000100:00100000:2.0:1746147216.385425:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095126300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311539200:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.385461:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x3139939425063846 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f700 expref: 20 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.385489:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822b400, rc 0) 00000100:00100000:2.0:1746147216.385559:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2999:x1830967310507648:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3463us (3599us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.385567:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20360 00000100:00100000:0.0:1746147216.386262:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.386338:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310507776 00000100:00100000:3.0:1746147216.386345:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310507776 00010000:00010000:3.0:1746147216.386372:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1e80200/0x31399394250637f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6d6 expref: 20 pid: 9585 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746147216.386407:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9246 00000100:00100000:3.0:1746147216.386413:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2001:x1830967310507776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.386425:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.386471:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b1e80200/0x31399394250637f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6d6 expref: 20 pid: 9585 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.386482:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b1e80200/0x31399394250637f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6d6 expref: 20 pid: 9585 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.386504:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e80200/0x31399394250637f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6d6 expref: 20 pid: 9585 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.386692:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.386694:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.386703:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x3139939425063846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f700 expref: 19 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.386716:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x3139939425063846 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f700 expref: 19 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.386746:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x3139939425063846 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f700 expref: 19 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.386758:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311539328:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147216.386824:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caad80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147216.389396:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.389527:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311539328:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147216.389559:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147216.389759:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310507904 00000100:00100000:2.0:1746147216.389770:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310507904 00000100:00100000:2.0:1746147216.389824:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20361 00000100:00100000:2.0:1746147216.389831:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2999:x1830967310507904:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147216.389847:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.389864:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822b200/0x313993942506384d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f707 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.389890:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d43800/0x31399394250637eb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6dd expref: 21 pid: 1136 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.389897:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.389899:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.389902:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822b200/0x313993942506384d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f707 expref: 21 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.389931:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967310507776:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3516us (3668us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147216.389931:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d43800/0x31399394250637eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6dd expref: 21 pid: 1136 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147216.389940:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9246 00010000:00010000:2.0:1746147216.389942:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d43800/0x31399394250637eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6dd expref: 21 pid: 1136 timeout: 854 lvb_type: 1 00000100:00100000:2.0:1746147216.389957:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095126300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311539456:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.390016:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147216.392076:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.392111:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095126300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311539456:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.392140:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009822b200/0x313993942506384d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f707 expref: 20 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.392156:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822b200, rc 0) 00000100:00100000:2.0:1746147216.392199:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2999:x1830967310507904:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2361us (2803us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.392208:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20361 00000100:00100000:3.0:1746147216.392213:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310508032 00000100:00100000:3.0:1746147216.392219:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310508032 00010000:00010000:3.0:1746147216.392240:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d43800/0x31399394250637eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6dd expref: 20 pid: 1136 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746147216.392270:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9247 00000100:00100000:3.0:1746147216.392275:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2000:x1830967310508032:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.392285:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.392303:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d43800/0x31399394250637eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6dd expref: 20 pid: 1136 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.392319:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d43800/0x31399394250637eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6dd expref: 20 pid: 1136 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.392339:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d43800/0x31399394250637eb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6dd expref: 20 pid: 1136 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.392703:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.392705:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.392713:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009822b200/0x313993942506384d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f707 expref: 19 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.392720:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822b200/0x313993942506384d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f707 expref: 19 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.392747:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009822b200/0x313993942506384d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f707 expref: 19 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.392760:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311539584:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147216.393711:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caad80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147216.396560:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.396630:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310508160 00000100:00100000:0.0:1746147216.396640:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310508160 00000100:00100000:0.0:1746147216.396697:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20362 00000100:00100000:0.0:1746147216.396706:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2999:x1830967310508160:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147216.396724:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147216.396743:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801312e6400/0x3139939425063854 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f70e expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.396772:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425063800 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6e4 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147216.396779:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147216.396781:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147216.396784:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e6400/0x3139939425063854 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f70e expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.396815:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425063800 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6e4 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147216.396827:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425063800 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6e4 expref: 13 pid: 1854 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746147216.396839:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093144000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311539712:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147216.396910:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147216.397033:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311539584:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147216.397050:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147216.397077:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2000:x1830967310508032:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4801us (5006us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.397086:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9247 00000100:00100000:1.0:1746147216.400662:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.400780:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093144000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311539712:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.400819:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801312e6400/0x3139939425063854 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f70e expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.400838:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e6400, rc 0) 00000100:00100000:2.0:1746147216.400884:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2999:x1830967310508160:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4178us (4340us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.400893:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20362 00000100:00100000:3.0:1746147216.401154:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310508288 00000100:00100000:3.0:1746147216.401162:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310508288 00010000:00010000:3.0:1746147216.401187:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425063800 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6e4 expref: 13 pid: 1854 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746147216.401209:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9248 00000100:00100000:3.0:1746147216.401215:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310508288:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.401228:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.401247:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425063800 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6e4 expref: 13 pid: 1854 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.401259:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425063800 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6e4 expref: 13 pid: 1854 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.401282:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094ffc600/0x3139939425063800 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6e4 expref: 13 pid: 1854 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.401308:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.401310:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.401317:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801312e6400/0x3139939425063854 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f70e expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.401324:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e6400/0x3139939425063854 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f70e expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.401798:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801312e6400/0x3139939425063854 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f70e expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.401810:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311539840:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147216.402431:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caad80 going to sleep for 11 seconds 00000100:00100000:3.0:1746147216.404214:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311539840:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147216.404232:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147216.404618:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009455e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310508288:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3401us (3965us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.404629:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9248 00000100:00100000:0.0:1746147216.405111:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.405330:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310508416 00000100:00100000:2.0:1746147216.405337:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310508416 00000100:00100000:2.0:1746147216.405372:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20363 00000100:00100000:2.0:1746147216.405378:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2999:x1830967310508416:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147216.405397:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.405414:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009822b000/0x313993942506385b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f715 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.405441:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e80c00/0x31399394250637f2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6eb expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.405447:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.405449:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.405452:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009822b000/0x313993942506385b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f715 expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.405480:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1e80c00/0x31399394250637f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6eb expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.405493:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e80c00/0x31399394250637f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6eb expref: 13 pid: 9585 timeout: 854 lvb_type: 1 00000100:00100000:2.0:1746147216.405505:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095124e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311539968:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.405571:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147216.408568:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.408688:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095124e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1398:1830967311539968:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.408724:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009822b000/0x313993942506385b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f715 expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.408742:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822b000, rc 0) 00000100:00100000:2.0:1746147216.408782:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2999:x1830967310508416:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3403us (3672us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.408791:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20363 00000100:00100000:3.0:1746147216.408986:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310508544 00000100:00100000:3.0:1746147216.408994:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310508544 00010000:00010000:3.0:1746147216.409148:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e80c00/0x31399394250637f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6eb expref: 13 pid: 9585 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746147216.409170:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9249 00000100:00100000:3.0:1746147216.409177:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310508544:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.409189:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.409214:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1e80c00/0x31399394250637f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6eb expref: 13 pid: 9585 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.409224:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1e80c00/0x31399394250637f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6eb expref: 13 pid: 9585 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.409246:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e80c00/0x31399394250637f2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6eb expref: 13 pid: 9585 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.409260:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.409262:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.409268:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009822b000/0x313993942506385b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f715 expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.409278:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009822b000/0x313993942506385b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f715 expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.409305:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009822b000/0x313993942506385b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f715 expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.409316:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311540096:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147216.409382:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caad80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147216.412301:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.415197:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310508672 00000100:00100000:2.0:1746147216.415211:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310508672 00000100:00100000:2.0:1746147216.415279:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20364 00000100:00100000:2.0:1746147216.415287:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2999:x1830967310508672:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147216.415307:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.415327:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x3139939425063862 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f71c expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.415355:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425063807 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f2 expref: 20 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.415363:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.415365:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.415368:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x3139939425063862 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f71c expref: 20 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.415397:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425063807 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f2 expref: 20 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.415407:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425063807 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f2 expref: 20 pid: 1854 timeout: 854 lvb_type: 1 00000100:00100000:2.0:1746147216.415419:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095124e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311540224:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.415515:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc780 going to sleep for 11 seconds 00000100:00100000:3.0:1746147216.415762:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8909:1830967311540096:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147216.415779:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147216.416024:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2001:x1830967310508544:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6846us (7465us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.416034:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9249 00000100:00100000:0.0:1746147216.419234:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.419295:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310508800 00000100:00100000:3.0:1746147216.419304:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310508800 00010000:00010000:3.0:1746147216.419340:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425063807 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f2 expref: 21 pid: 1854 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746147216.419372:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9250 00000100:00100000:3.0:1746147216.419380:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2000:x1830967310508800:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.419396:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.419417:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425063807 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f2 expref: 21 pid: 1854 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.419436:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425063807 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f2 expref: 21 pid: 1854 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.419460:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.419463:0:8909:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.419470:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x3139939425063862 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f71c expref: 21 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.419478:0:8909:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x3139939425063862 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f71c expref: 21 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.419488:0:1398:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094ffd800/0x3139939425063807 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f2 expref: 21 pid: 1854 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746147216.419511:0:8909:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x3139939425063862 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f71c expref: 20 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.419523:0:8909:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311540352:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147216.419609:0:8909:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091caad80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147216.420076:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095124e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311540224:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.420133:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x3139939425063862 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f71c expref: 20 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.420143:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009822a000, rc 0) 00000100:00100000:2.0:1746147216.420182:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2999:x1830967310508672:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 4894us (7890us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.420189:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20364 00000100:00100000:0.0:1746147216.423511:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.423532:0:8909:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8909:1830967311540352:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147216.423543:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147216.423561:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147216.423572:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.423595:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.423600:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310508928 00000100:00100000:3.0:1746147216.423606:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310508928 00000100:00100000:0.0:1746147216.423608:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.423627:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310509056 00000100:00100000:0.0:1746147216.423630:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310509056 00000100:00100000:3.0:1746147216.423637:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310509184 00000100:00100000:3.0:1746147216.423638:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310509184 00000100:00100000:3.0:1746147216.423649:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310509312 00000100:00100000:0.0:1746147216.423649:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310509440 00000100:00100000:3.0:1746147216.423650:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310509312 00000100:00100000:0.0:1746147216.423651:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310509440 00000100:00100000:3.0:1746147216.423663:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20365 00000100:00100000:3.0:1746147216.423669:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310508928:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:3.0:1746147216.423806:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147216.423808:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147214 -> 1746147215 00002000:00010000:3.0:1746147216.423811:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147214 -> 1746147216 00002000:00010000:3.0:1746147216.423813:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147215 -> 1746147216 00002000:00010000:3.0:1746147216.423814:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:3.0:1746147216.423838:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310508928:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 169us (338us total) trans 21474842730 rc 0/0 00000100:00100000:0.0:1746147216.424292:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20366 00000100:00100000:0.0:1746147216.424299:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967310509056:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147216.424382:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147216.424385:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147215 -> 1746147215 00002000:00010000:0.0:1746147216.424386:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147215 -> 1746147216 00002000:00010000:0.0:1746147216.424388:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147215 -> 1746147216 00002000:00010000:0.0:1746147216.424390:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147216.424408:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2001:x1830967310509056:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 111us (865us total) trans 17179875337 rc 0/0 00000100:00100000:0.0:1746147216.424415:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20366 00000100:00100000:2.0:1746147216.424557:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20367 00000100:00100000:2.0:1746147216.424568:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2001:x1830967310509184:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:2.0:1746147216.424615:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147216.424617:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147215 -> 1746147215 00002000:00010000:2.0:1746147216.424619:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147215 -> 1746147216 00002000:00010000:2.0:1746147216.424621:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147215 -> 1746147216 00002000:00010000:2.0:1746147216.424623:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746147216.424640:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2001:x1830967310509184:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 76us (1067us total) trans 17179875338 rc 0/0 00000100:00100000:2.0:1746147216.424646:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20367 00000100:00100000:2.0:1746147216.424660:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20368 00000100:00100000:2.0:1746147216.424670:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310509312:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:2.0:1746147216.424712:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147216.424715:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147214 -> 1746147215 00002000:00010000:2.0:1746147216.424717:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147214 -> 1746147216 00002000:00010000:2.0:1746147216.424719:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147215 -> 1746147216 00002000:00010000:2.0:1746147216.424721:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746147216.424736:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310509312:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 71us (1141us total) trans 21474842731 rc 0/0 00000100:00100000:2.0:1746147216.424741:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20368 00000100:00100000:2.0:1746147216.424750:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20369 00000100:00100000:2.0:1746147216.424755:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310509440:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:2.0:1746147216.424791:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:2.0:1746147216.424793:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147215 -> 1746147215 00002000:00010000:2.0:1746147216.424795:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147214 -> 1746147216 00002000:00010000:2.0:1746147216.424796:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147215 -> 1746147216 00002000:00010000:2.0:1746147216.424798:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:2.0:1746147216.424813:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+16:2001:x1830967310509440:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 58us (1204us total) trans 21474842732 rc 0/0 00000100:00100000:2.0:1746147216.424818:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20369 00000100:00100000:0.0:1746147216.424932:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.424950:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310509568 00000100:00100000:0.0:1746147216.424954:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310509568 00000100:00100000:0.0:1746147216.424971:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20370 00000100:00100000:0.0:1746147216.424975:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2001:x1830967310509568:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147216.425018:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147216.425020:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147215 -> 1746147215 00002000:00010000:0.0:1746147216.425022:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147215 -> 1746147216 00002000:00010000:0.0:1746147216.425025:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147215 -> 1746147216 00002000:00010000:0.0:1746147216.425026:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746147216.425040:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+23:2001:x1830967310509568:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 65us (108us total) trans 17179875339 rc 0/0 00000100:00100000:0.0:1746147216.425046:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20370 00000100:00100000:3.0:1746147216.425213:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20365 00000100:00100000:3.0:1746147216.425248:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2000:x1830967310508800:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5869us (6023us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.425256:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9250 00000100:00100000:0.0:1746147216.428214:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.428608:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310509824 00000100:00100000:2.0:1746147216.428617:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310509824 00000100:00100000:2.0:1746147216.428727:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6193 00000100:00100000:2.0:1746147216.428734:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f8a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2999:x1830967310509824:12345-192.168.204.25@tcp:35:lfs.0 00000004:00010000:2.0:1746147216.428795:0:7240:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x30:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9e00/0x3139939425063790 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6ba expref: 10 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.428843:0:7240:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x3139939425063869 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7240 initiator: MDT0 00010000:00010000:2.0:1746147216.428859:0:7240:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250637cf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6c1 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.428865:0:7240:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x3139939425063869 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7240 initiator: MDT0 00010000:00010000:2.0:1746147216.428895:0:7240:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250637cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6c1 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.428906:0:7240:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250637cf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6c1 expref: 10 pid: 9138 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.428919:0:7240:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095124e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7240:1830967311540480:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.429803:0:7240:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc780 going to sleep for 11 seconds 00000100:00100000:0.0:1746147216.431648:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.431971:0:7240:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095124e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7240:1830967311540480:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.431999:0:7240:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x3139939425063869 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7240 initiator: MDT0 00000100:00100000:3.0:1746147216.432157:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310509952 00000100:00100000:3.0:1746147216.432164:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310509952 00010000:00010000:3.0:1746147216.432196:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250637cf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6c1 expref: 11 pid: 9138 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.432220:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9251 00000100:00100000:3.0:1746147216.432226:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+11:2001:x1830967310509952:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.432238:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.432244:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250637cf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6c1 expref: 11 pid: 9138 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.432253:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250637cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6c1 expref: 11 pid: 9138 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.432274:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250637cf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6c1 expref: 11 pid: 9138 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.433075:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147216.433081:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x3139939425063869 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7240 initiator: MDT0 00010000:00010000:3.0:1746147216.433120:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x3139939425063869 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7240 initiator: MDT0 00010000:00010000:3.0:1746147216.433126:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x3139939425063869 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7240 initiator: MDT0 00010000:00010000:3.0:1746147216.433169:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147216.433210:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+10:2001:x1830967310509952:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 982us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.433217:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9251 00010000:00010000:2.0:1746147216.433264:0:7240:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x3139939425063869 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7240 initiator: MDT0 00010000:00010000:2.0:1746147216.433271:0:7240:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x3139939425063869 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7240 initiator: MDT0 00000040:00080000:2.0:1746147216.433558:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1345, 88 off126224 00000004:00080000:2.0:1746147216.433564:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754423473884ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147216.433591:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1335, 88 off125344 00000004:00080000:2.0:1746147216.433594:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754423504189ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147216.433604:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1336, 88 off125432 00000004:00080000:2.0:1746147216.433607:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754423517744ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147216.433614:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1346, 88 off126312 00000004:00080000:2.0:1746147216.433616:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754423526372ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147216.433622:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1347, 88 off126400 00000004:00080000:2.0:1746147216.433625:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754423535474ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147216.433632:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1337, 88 off125520 00000004:00080000:2.0:1746147216.433634:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754423544372ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147216.433642:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1338, 88 off125608 00000004:00080000:2.0:1746147216.433645:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754423555134ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147216.433651:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1339, 88 off125696 00000004:00080000:2.0:1746147216.433654:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754423563979ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147216.434466:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1348, 88 off126488 00000004:00080000:2.0:1746147216.434473:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754424383384ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147216.434490:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1340, 88 off125784 00000004:00080000:2.0:1746147216.434493:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754424403594ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147216.434515:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1349, 88 off126576 00000004:00080000:2.0:1746147216.434518:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754424428689ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147216.434537:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1341, 88 off125872 00000004:00080000:2.0:1746147216.434540:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754424450892ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147216.434559:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1350, 88 off126664 00000004:00080000:2.0:1746147216.434565:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754424475934ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147216.434576:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1351, 88 off126752 00000004:00080000:2.0:1746147216.434578:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754424488494ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147216.434586:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1352, 88 off126840 00000004:00080000:2.0:1746147216.434589:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754424499124ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147216.434596:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1353, 88 off126928 00000004:00080000:2.0:1746147216.434599:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754424510179ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147216.434609:0:7240:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1342, 88 off125960 00000004:00080000:2.0:1746147216.434611:0:7240:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754424522026ns, next at 694367916532ns, rc = 0 00000001:00080000:0.0:1746147216.439060:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937442 is committed 00000004:00080000:0.0:1746147216.439071:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1318 committed 00000004:00080000:0.0:1746147216.439856:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1332 committed 00000004:00080000:0.0:1746147216.439870:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1331 committed 00000004:00080000:0.0:1746147216.439872:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1330 committed 00000004:00080000:0.0:1746147216.439874:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1329 committed 00000004:00080000:0.0:1746147216.439876:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1317 committed 00000004:00080000:0.0:1746147216.439878:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1328 committed 00010000:00010000:2.0:1746147216.439879:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425063838 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00000004:00080000:0.0:1746147216.439879:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1316 committed 00000004:00080000:0.0:1746147216.439881:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1327 committed 00000004:00080000:0.0:1746147216.439883:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1315 committed 00000004:00080000:0.0:1746147216.439885:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1314 committed 00000004:00080000:0.0:1746147216.439886:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1313 committed 00000004:00080000:0.0:1746147216.439888:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1326 committed 00000004:00080000:0.0:1746147216.439890:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1325 committed 00000004:00080000:0.0:1746147216.439891:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1312 committed 00010000:00010000:2.0:1746147216.439893:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425063838 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00000004:00080000:0.0:1746147216.439893:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1311 committed 00000004:00080000:0.0:1746147216.439894:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1324 committed 00010000:00010000:2.0:1746147216.439900:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425063838 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.439906:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009822b800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147216.439910:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425063838 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.439921:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425063838 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.439940:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147216.439943:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147216.439947:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425063838 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.439953:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009822b800/0x3139939425063838 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00000004:00010000:2.0:1746147216.440018:0:7240:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a4f8a850 reply state ffff88008f389400 transno 8589937442 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x3139939425063869 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7240 initiator: MDT0 00010000:00010000:2.0:1746147216.440030:0:7240:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x3139939425063869 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7240 initiator: MDT0 00010000:00010000:2.0:1746147216.440036:0:7240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147216.440039:0:7240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746147216.440043:0:7240:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746147216.440049:0:7240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147216.440051:0:7240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746147216.440058:0:7240:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2e9e00/0x3139939425063790 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6ba expref: 7 pid: 7238 timeout: 0 lvb_type: 0 00010000:00080000:2.0:1746147216.440186:0:7240:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746147216.440198:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f8a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2999:x1830967310509824:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 11462us (11993us total) trans 8589937442 rc 0/0 00000100:00100000:2.0:1746147216.440210:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6193 00000100:00100000:2.0:1746147216.440275:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311540608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.440320:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.441863:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311541120:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.441900:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.441916:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746147216.441922:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311540992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147216.442053:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311540736:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746147216.442157:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x3139939425063869 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7240 initiator: MDT0 00010000:00010000:1.0:1746147216.442167:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x3139939425063869 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7240 initiator: MDT0 00010000:00010000:1.0:1746147216.442173:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x3139939425063869 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7240 initiator: MDT0 00010000:00010000:1.0:1746147216.442178:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974a6a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147216.442182:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x3139939425063869 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7240 initiator: MDT0 00010000:00010000:1.0:1746147216.442188:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x3139939425063869 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7240 initiator: MDT0 00010000:00010000:1.0:1746147216.442201:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147216.442203:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147216.442206:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x3139939425063869 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7240 initiator: MDT0 00010000:00010000:1.0:1746147216.442210:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x3139939425063869 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7240 initiator: MDT0 00000100:00100000:1.0:1746147216.442247:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311540864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147216.442371:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.442389:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311541632:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147216.442407:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.442419:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311542144:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147216.442420:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.442441:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311541248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147216.442456:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.442467:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311541760:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147216.442480:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.442494:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311542272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147216.442509:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.442529:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311541504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147216.442558:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.442570:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311542016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147216.442583:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.442593:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311542528:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147216.442607:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.442633:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311540608 00000100:00100000:3.0:1746147216.442640:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311540608 00000100:00100000:3.0:1746147216.442674:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311541120 00000100:00100000:3.0:1746147216.442676:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311541120 00000100:00100000:3.0:1746147216.442686:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311540992 00000100:00100000:3.0:1746147216.442688:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311540992 00000100:00100000:3.0:1746147216.442695:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311541632 00000100:00100000:3.0:1746147216.442697:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311541632 00000100:00100000:3.0:1746147216.442703:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311540736 00000100:00100000:3.0:1746147216.442704:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311540736 00000100:00100000:3.0:1746147216.442710:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311541248 00000100:00100000:3.0:1746147216.442712:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311541248 00000100:00100000:3.0:1746147216.442719:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311541760 00000100:00100000:3.0:1746147216.442720:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311541760 00000100:00100000:3.0:1746147216.442726:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311542272 00000100:00100000:3.0:1746147216.442728:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311542272 00000100:00100000:3.0:1746147216.442734:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311541504 00000100:00100000:3.0:1746147216.442736:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311541504 00000100:00100000:3.0:1746147216.442741:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311542016 00000100:00100000:3.0:1746147216.442743:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311542016 00000100:00100000:3.0:1746147216.442748:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311542528 00000100:00100000:3.0:1746147216.442750:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311542528 00000100:00100000:3.0:1746147216.442759:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20371 00000100:00100000:3.0:1746147216.442766:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967311540608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147216.442900:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147216.442903:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147215 -> 1746147215 00002000:00010000:3.0:1746147216.442905:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147216 -> 1746147216 00002000:00010000:3.0:1746147216.442907:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147216 -> 1746147216 00002000:00010000:3.0:1746147216.442909:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:3.0:1746147216.442937:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3765:x1830967311540608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 172us (2616us total) trans 21474842733 rc 0/0 00000100:00100000:3.0:1746147216.442943:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20371 00000100:00100000:3.0:1746147216.442957:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20372 00000100:00100000:3.0:1746147216.442961:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3765:x1830967311541120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746147216.442998:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147216.443001:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147215 -> 1746147215 00002000:00010000:3.0:1746147216.443002:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147216 -> 1746147216 00002000:00010000:3.0:1746147216.443004:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147216 -> 1746147216 00002000:00010000:3.0:1746147216.443006:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147216.443021:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3765:x1830967311541120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (1121us total) trans 21474842734 rc 0/0 00000100:00100000:3.0:1746147216.443026:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20372 00000100:00100000:3.0:1746147216.443034:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20373 00000100:00100000:3.0:1746147216.443038:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3765:x1830967311540992:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147216.443110:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746147216.443112:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147215 -> 1746147215 00002000:00010000:3.0:1746147216.443114:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147216 -> 1746147216 00002000:00010000:3.0:1746147216.443116:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147216 -> 1746147216 00002000:00010000:3.0:1746147216.443118:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746147216.443135:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3765:x1830967311540992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (764us total) trans 17179875340 rc 0/0 00000100:00100000:3.0:1746147216.443140:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20373 00000100:00100000:3.0:1746147216.443148:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20374 00000100:00100000:3.0:1746147216.443152:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3765:x1830967311541632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147216.443200:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3765:x1830967311541632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (791us total) trans 17179875341 rc 0/0 00000100:00100000:3.0:1746147216.443205:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20374 00000100:00100000:3.0:1746147216.443213:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20375 00000100:00100000:3.0:1746147216.443217:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3766:x1830967311540736:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147216.443249:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147216.443251:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147215 -> 1746147215 00002000:00010000:3.0:1746147216.443253:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147216 -> 1746147216 00002000:00010000:3.0:1746147216.443255:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147216 -> 1746147216 00002000:00010000:3.0:1746147216.443256:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147216.443276:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3766:x1830967311540736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (857us total) trans 17179875342 rc 0/0 00000100:00100000:3.0:1746147216.443281:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20375 00000100:00100000:3.0:1746147216.443289:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20376 00000100:00100000:3.0:1746147216.443293:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3766:x1830967311541248:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147216.443326:0:12201:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147216.443329:0:12201:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147216.443330:0:12201:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147216.443332:0:12201:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147216.443333:0:12201:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746147216.443353:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3766:x1830967311541248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (896us total) trans 17179875343 rc 0/0 00000100:00100000:2.0:1746147216.443353:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.443358:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20376 00000100:00100000:3.0:1746147216.443365:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311542144 00000100:00100000:3.0:1746147216.443367:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311542144 00000100:00100000:3.0:1746147216.443376:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20377 00000100:00100000:3.0:1746147216.443379:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3766:x1830967311541760:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147216.443381:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099155f80/2, rc 0, transno 17179875340 00000100:00100000:2.0:1746147216.443386:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311540992:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147216.443393:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009455dc00/2, rc 0, transno 21474842734 00000100:00100000:2.0:1746147216.443401:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311541120:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147216.443407:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009455d880/2, rc 0, transno 21474842733 00000100:00100000:2.0:1746147216.443410:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311540608:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147216.443419:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095148e00/2, rc 0, transno 17179875341 00000100:00100000:2.0:1746147216.443421:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311541632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147216.443423:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3766:x1830967311541760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (942us total) trans 17179875344 rc 0/0 00000100:00100000:3.0:1746147216.443427:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20377 00000100:00100000:3.0:1746147216.443437:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20378 00000100:00100000:3.0:1746147216.443441:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3766:x1830967311542272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.443450:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20379 00000100:00100000:2.0:1746147216.443456:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3764:x1830967311541504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147216.443602:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147216.443616:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311541376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147216.443631:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147216.443637:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311541888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147216.443649:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746147216.443650:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:2.0:1746147216.443653:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:2.0:1746147216.443655:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147216.443656:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00000100:00100000:1.0:1746147216.443656:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311542400:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147216.443658:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:1.0:1746147216.443667:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.443684:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3764:x1830967311541504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (1124us total) trans 17179875345 rc 0/0 00000100:00100000:2.0:1746147216.443690:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20379 00000100:00100000:1.0:1746147216.443690:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311540864 00000100:00100000:1.0:1746147216.443693:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311540864 00000100:00100000:2.0:1746147216.443701:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311541376 00000100:00100000:2.0:1746147216.443703:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311541376 00000100:00100000:1.0:1746147216.443706:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311541888 00000100:00100000:1.0:1746147216.443708:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311541888 00000100:00100000:2.0:1746147216.443714:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311542400 00000100:00100000:2.0:1746147216.443716:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311542400 00000100:00100000:1.0:1746147216.443717:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20380 00000100:00100000:1.0:1746147216.443721:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3764:x1830967311542016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.443723:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20381 00000100:00100000:2.0:1746147216.443728:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3764:x1830967311542528:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147216.443766:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746147216.443768:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147216.443771:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147216.443773:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147216.443774:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00002000:00010000:2.0:1746147216.443776:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:2.0:1746147216.443778:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147216.443780:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147216.443782:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147216.443783:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00000100:00100000:1.0:1746147216.443792:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3764:x1830967311542016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1208us total) trans 21474842735 rc 0/0 00000100:00100000:1.0:1746147216.443797:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20380 00000100:00100000:2.0:1746147216.443803:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3764:x1830967311542528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (1193us total) trans 21474842736 rc 0/0 00000100:00100000:1.0:1746147216.443806:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20382 00000100:00100000:1.0:1746147216.443810:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3765:x1830967311542144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.443811:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20381 00000100:00100000:2.0:1746147216.443821:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20383 00000100:00100000:2.0:1746147216.443826:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3767:x1830967311540864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147216.443862:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3765:x1830967311542144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (509us total) trans 21474842737 rc 0/0 00002000:00010000:2.0:1746147216.443864:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147216.443867:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147215 -> 1746147215 00000100:00100000:1.0:1746147216.443867:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20382 00002000:00010000:2.0:1746147216.443868:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147216 -> 1746147216 00002000:00010000:2.0:1746147216.443870:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147216 -> 1746147216 00002000:00010000:2.0:1746147216.443871:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746147216.443876:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20384 00000100:00100000:1.0:1746147216.443880:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3767:x1830967311541376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147216.443893:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3767:x1830967311540864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (290us total) trans 17179875346 rc 0/0 00000100:00100000:2.0:1746147216.443898:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20383 00000100:00100000:2.0:1746147216.443908:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20385 00000100:00100000:2.0:1746147216.443912:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3767:x1830967311541888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147216.443933:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3767:x1830967311541376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (301us total) trans 17179875347 rc 0/0 00000100:00100000:1.0:1746147216.443938:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20384 00000100:00100000:1.0:1746147216.443947:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20386 00002000:00010000:2.0:1746147216.443951:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00000100:00100000:1.0:1746147216.443951:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3767:x1830967311542400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147216.443953:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147215 -> 1746147215 00002000:00010000:2.0:1746147216.443955:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147216 -> 1746147216 00002000:00010000:2.0:1746147216.443957:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147216 -> 1746147216 00002000:00010000:2.0:1746147216.443958:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:2.0:1746147216.443980:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3767:x1830967311541888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (329us total) trans 21474842738 rc 0/0 00000100:00100000:2.0:1746147216.443985:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20385 00002000:00010000:1.0:1746147216.443987:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147216.443990:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147216.443992:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147216.443993:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147216.443995:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000004:00080000:2.0:1746147216.444008:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099157100/2, rc 0, transno 17179875345 00000100:00100000:2.0:1746147216.444011:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311541504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147216.444014:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3767:x1830967311542400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (344us total) trans 21474842739 rc 0/0 00000004:00080000:2.0:1746147216.444018:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009455c380/2, rc 0, transno 21474842735 00000100:00100000:2.0:1746147216.444021:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311542016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147216.444021:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20386 00000004:00080000:2.0:1746147216.444027:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258f100/2, rc 0, transno 21474842736 00000100:00100000:2.0:1746147216.444030:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311542528:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.444086:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746147216.444108:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311542656:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.444127:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.444144:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311542656 00000100:00100000:2.0:1746147216.444147:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311542656 00000100:00100000:2.0:1746147216.444160:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20387 00000100:00100000:2.0:1746147216.444164:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3764:x1830967311542656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.444219:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3764:x1830967311542656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (91us total) trans 21474842740 rc 0/0 00000100:00100000:2.0:1746147216.444224:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20387 00000004:00080000:2.0:1746147216.444242:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4394380/2, rc 0, transno 21474842740 00000100:00100000:2.0:1746147216.444245:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311542656:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147216.444258:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099156d80/2, rc 0, transno 17179875342 00000100:00100000:2.0:1746147216.444261:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311540736:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147216.444268:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099154000/2, rc 0, transno 17179875343 00000100:00100000:2.0:1746147216.444270:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311541248:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147216.444276:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009514b100/2, rc 0, transno 17179875344 00000100:00100000:2.0:1746147216.444279:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311541760:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147216.446156:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099154e00/2, rc 0, transno 17179875346 00000100:00100000:1.0:1746147216.446168:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311540864:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147216.446179:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099155500/2, rc 0, transno 17179875347 00000100:00100000:1.0:1746147216.446181:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311541376:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147216.446193:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009455ca80/2, rc 0, transno 21474842738 00000100:00100000:1.0:1746147216.446196:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311541888:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147216.446204:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009455f100/2, rc 0, transno 21474842739 00000100:00100000:1.0:1746147216.446207:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311542400:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147216.446234:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009455c000/2, rc 0, transno 21474842737 00000100:00100000:1.0:1746147216.446237:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311542144:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147216.447529:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3766:x1830967311542272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4083us (5014us total) trans 21474842741 rc 0/0 00000004:00080000:2.0:1746147216.447540:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009455df80/2, rc 0, transno 21474842741 00000100:00100000:3.0:1746147216.447541:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20378 00000100:00100000:2.0:1746147216.447556:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311542272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147216.447847:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.447933:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310510080 00000100:00100000:2.0:1746147216.447940:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310510080 00000100:00100000:2.0:1746147216.449120:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16533 00000100:00100000:2.0:1746147216.449129:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+6:2999:x1830967310510080:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147216.449148:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.449166:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425063870 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f723 expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.449220:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425063870 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f723 expref: 7 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.449233:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425063870 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f723 expref: 7 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.449247:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147216.449249:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147216.449252:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092543e00, rc 0) 00000100:00100000:2.0:1746147216.453034:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2999:x1830967310510080:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3893us (5176us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.453047:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16533 00000100:00100000:0.0:1746147216.457846:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.458037:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310510336 00000100:00100000:2.0:1746147216.458048:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310510336 00000100:00100000:0.0:1746147216.458184:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6194 00000100:00100000:0.0:1746147216.458192:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2999:x1830967310510336:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:0.0:1746147216.458418:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2999:x1830967310510336:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 226us (582us total) trans 8589937443 rc 0/0 00000100:00100000:0.0:1746147216.458424:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6194 00000100:00100000:0.0:1746147216.482049:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.482208:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310510592 00000100:00100000:2.0:1746147216.482219:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310510592 00000100:00100000:2.0:1746147216.482270:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16534 00000100:00100000:2.0:1746147216.482278:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:3007:x1830967310510592:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147216.482305:0:7238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.482326:0:7238:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542000/0x3139939425063877 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f72a expref: -99 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.482408:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x313993942506387e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.482421:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x313993942506387e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.482432:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x313993942506387e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.482443:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425063885 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.482448:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425063885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.482453:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425063885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.482571:0:7238:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542600/0x313993942506388c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.482579:0:7238:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092542600/0x313993942506388c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.482585:0:7238:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092542600/0x313993942506388c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00000004:00200000:2.0:1746147216.482594:0:7238:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147216.482671:0:7238:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x313993942506387e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.482677:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x313993942506387e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.482686:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x313993942506387e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.482692:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x313993942506387e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.482698:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092543c00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147216.482701:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x313993942506387e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.482708:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x313993942506387e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.482719:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147216.482722:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147216.482726:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x313993942506387e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.482731:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092543c00/0x313993942506387e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00000100:00100000:0.0:1746147216.483262:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.483281:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310510848 00000100:00100000:0.0:1746147216.483284:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310510848 00000100:00100000:0.0:1746147216.484909:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16535 00000100:00100000:0.0:1746147216.484924:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:3005:x1830967310510848:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:0.0:1746147216.484944:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147216.484961:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x313993942506389a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f731 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.485026:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250638a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.485037:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250638a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.485047:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250638a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.485055:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x31399394250638a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.485062:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x31399394250638a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.485067:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x31399394250638a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.485175:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x31399394250638af lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.485183:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x31399394250638af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.485189:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x31399394250638af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:0.0:1746147216.485196:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:0.0:1746147216.485257:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250638a1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.485263:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250638a1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.485269:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250638a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.485274:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250638a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.485279:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e7a00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147216.485282:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250638a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.485288:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250638a1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.485297:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147216.485300:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147216.485303:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250638a1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.485311:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7a00/0x31399394250638a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147216.485406:0:7238:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425063885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.485414:0:7238:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425063885 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.485420:0:7238:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425063885 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.485425:0:7238:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092542200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147216.485428:0:7238:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425063885 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.485437:0:7238:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425063885 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.485444:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094fbdd00) 00010000:00010000:2.0:1746147216.485446:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147216.485449:0:7238:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425063885 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.485454:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542200/0x3139939425063885 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7238 initiator: MDT0 00010000:00010000:2.0:1746147216.485492:0:7238:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542000/0x3139939425063877 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f72a expref: 29 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.485502:0:7238:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092542600/0x313993942506388c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f72a expref: 28 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.485508:0:7238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147216.485510:0:7238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746147216.485512:0:7238:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542600, rc 0) 00000100:00100000:2.0:1746147216.485595:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:3007:x1830967310510592:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 3316us (3557us total) trans 8589937444 rc 0/0 00000100:00100000:2.0:1746147216.486051:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16534 00010000:00010000:0.0:1746147216.488718:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x31399394250638a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.488733:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x31399394250638a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.488740:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x31399394250638a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.488745:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312e6200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:0.0:1746147216.488749:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x31399394250638a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.488756:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x31399394250638a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.488771:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094fbdd00) 00010000:00010000:0.0:1746147216.488774:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746147216.488778:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x31399394250638a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.488783:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6200/0x31399394250638a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147216.488957:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6000/0x313993942506389a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f731 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.488987:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x31399394250638af lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f731 expref: 9 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.488994:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147216.488996:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746147216.488999:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e7600, rc 0) 00000100:00100000:1.0:1746147216.489055:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:3005:x1830967310510848:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4136us (5793us total) trans 8589937445 rc 0/0 00000100:00100000:1.0:1746147216.489063:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16535 00000100:00100000:0.0:1746147216.492459:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.492773:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310511104 00000100:00100000:1.0:1746147216.492783:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310511104 00000100:00100000:1.0:1746147216.492847:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16536 00000100:00100000:1.0:1746147216.492855:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:3011:x1830967310511104:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147216.492879:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147216.492901:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x31399394250638bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f738 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.493005:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x31399394250638c4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147216.493019:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x31399394250638c4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147216.493029:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x31399394250638c4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147216.493040:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000100:00100000:0.0:1746147216.495277:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147216.496479:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98400/0x31399394250638bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f738 expref: 31 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.496500:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x31399394250638c4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f738 expref: 30 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.496509:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147216.496511:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746147216.496515:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974a6a00, rc 0) 00000100:00100000:1.0:1746147216.496582:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:3011:x1830967310511104:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3727us (4134us total) trans 8589937446 rc 0/0 00000100:00100000:1.0:1746147216.496591:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16536 00000100:00100000:1.0:1746147216.496620:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310511360 00000100:00100000:1.0:1746147216.496626:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310511360 00000100:00100000:1.0:1746147216.496660:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16537 00000100:00100000:1.0:1746147216.496665:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:3010:x1830967310511360:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147216.496681:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147216.496693:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98200/0x31399394250638d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f73f expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.496760:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x31399394250638d9 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147216.497259:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x31399394250638d9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147216.497273:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x31399394250638d9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:1.0:1746147216.497293:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:1.0:1746147216.497411:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d98200/0x31399394250638d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f73f expref: 12 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.497427:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x31399394250638d9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f73f expref: 11 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.497434:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147216.497437:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746147216.497439:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1adb600, rc 0) 00000100:00100000:1.0:1746147216.497497:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:3010:x1830967310511360:12345-192.168.204.25@tcp:101:cat.0 Request processed in 831us (2229us total) trans 8589937447 rc 0/0 00000100:00100000:1.0:1746147216.497505:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16537 00000100:00100000:2.0:1746147216.503236:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.503259:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.503337:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.503371:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310511872 00000100:00100000:2.0:1746147216.503380:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310511872 00000100:00100000:2.0:1746147216.503422:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20388 00000100:00100000:2.0:1746147216.503430:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+5:3010:x1830967310511872:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147216.503446:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746147216.503452:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310511616 00010000:00010000:2.0:1746147216.503464:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x31399394250638e7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f754 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147216.503464:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310511616 00010000:00010000:2.0:1746147216.503492:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x313993942506383f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f9 expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.503500:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147216.503501:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147216.503504:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x31399394250638e7 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f754 expref: 6 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147216.503504:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310511744 00000100:00100000:1.0:1746147216.503507:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310511744 00000100:00100000:1.0:1746147216.503525:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16538 00010000:00010000:2.0:1746147216.503532:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x313993942506383f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f9 expref: 14 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147216.503532:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:3007:x1830967310511616:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147216.503543:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x313993942506383f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f9 expref: 14 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746147216.503557:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147216.503560:0:9138:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:2.0:1746147216.503566:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095127b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311542784:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147216.503584:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092542600/0x313993942506388c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f72a expref: 31 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.503597:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147216.503601:0:9138:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147216.503610:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098446600/0x31399394250638ee lrc: 2/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f746 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.503648:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250638f5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147216.503659:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x31399394250638af lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f731 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.503664:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425063870 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f723 expref: 7 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.503669:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x31399394250638c4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f738 expref: 31 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.503673:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x31399394250638d9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f73f expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.503682:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250638f5 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147216.503709:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x31399394250638d9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f73f expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.503717:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x31399394250638d9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f73f expref: 10 pid: 9138 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746147216.503727:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311542912:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.503744:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16539 00000100:00100000:3.0:1746147216.503753:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:3011:x1830967310511744:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147216.503766:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.503776:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093731e00/0x31399394250638fc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f74d expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.503852:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.503861:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250638f5 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147216.503866:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.503876:0:7237:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250638f5 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147216.503884:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000100:00100000:2.0:1746147216.506124:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1ccf00 going to sleep for 11 seconds 00010000:00010000:1.0:1746147216.506678:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x31399394250638c4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f738 expref: 32 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.506692:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x31399394250638c4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f738 expref: 32 pid: 9138 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746147216.506705:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311543040:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147216.509573:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425063870 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f723 expref: 7 pid: 7238 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.509587:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425063870 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f723 expref: 7 pid: 7238 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746147216.509599:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311543168:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147216.510139:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x31399394250638af lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f731 expref: 10 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.510151:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x31399394250638af lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f731 expref: 10 pid: 9138 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746147216.510159:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5577100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311543296:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147216.511647:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147216.512267:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311542912:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147216.512280:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311543040:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147216.513475:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.513502:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.513522:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310512000 00000100:00100000:0.0:1746147216.513522:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.513529:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310512000 00010000:00010000:3.0:1746147216.513570:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x31399394250638d9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f73f expref: 11 pid: 9138 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.513874:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095127b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311542784:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.513902:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x31399394250638e7 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f754 expref: 6 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.513919:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092543a00, rc 0) 00000100:00100000:2.0:1746147216.513959:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+6:3010:x1830967310511872:12345-192.168.204.25@tcp:101:cat.0 Request processed in 10529us (10621us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.513966:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20388 00000100:00100000:3.0:1746147216.514258:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310512256 00000100:00100000:3.0:1746147216.514261:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310512256 00000100:00100000:0.0:1746147216.514267:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147216.514274:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x313993942506383f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f9 expref: 15 pid: 1398 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.514287:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310512128 00000100:00100000:3.0:1746147216.514289:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310512128 00010000:00010000:3.0:1746147216.514297:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x31399394250638c4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f738 expref: 33 pid: 9138 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746147216.514298:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310512384 00000100:00100000:0.0:1746147216.514301:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310512384 00000100:00100000:3.0:1746147216.514310:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9252 00010000:00010000:0.0:1746147216.514314:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425063870 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f723 expref: 8 pid: 7238 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.514315:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310512000:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.514326:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746147216.514328:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9253 00010000:00010000:3.0:1746147216.514331:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x31399394250638d9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f73f expref: 11 pid: 9138 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746147216.514333:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132125180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+15:2001:x1830967310512256:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.514339:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x31399394250638d9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f73f expref: 11 pid: 9138 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.514340:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.514355:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1adb600/0x31399394250638d9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f73f expref: 11 pid: 9138 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.514355:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x313993942506383f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f9 expref: 15 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.514364:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x313993942506383f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f9 expref: 15 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.514375:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009822bc00/0x313993942506383f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f6f9 expref: 15 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.514380:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147216.514385:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147216.514386:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147216.514388:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.514390:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250638f5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.514393:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x31399394250638e7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f754 expref: 5 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.514395:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250638f5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147216.514399:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147216.514399:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x31399394250638e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f754 expref: 5 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.514402:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147216.514422:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x31399394250638e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f754 expref: 5 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.514441:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310512000:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 125us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.514447:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9252 00000100:00100000:0.0:1746147216.514448:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132127100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311543424:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147216.514481:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9254 00000100:00100000:0.0:1746147216.514482:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147216.514485:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132125c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:2001:x1830967310512128:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.514491:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.514495:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x31399394250638c4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f738 expref: 33 pid: 9138 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746147216.514495:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9255 00000100:00100000:0.0:1746147216.514500:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132125f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:2002:x1830967310512384:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.514501:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x31399394250638c4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f738 expref: 33 pid: 9138 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.514505:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147216.514508:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425063870 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f723 expref: 8 pid: 7238 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.514511:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974a6a00/0x31399394250638c4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f738 expref: 33 pid: 9138 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.514515:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425063870 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f723 expref: 8 pid: 7238 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.514526:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147216.515203:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092543e00/0x3139939425063870 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f723 expref: 8 pid: 7238 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746147216.515217:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311543168:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.515328:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.515335:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250638f5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147216.515339:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250638f5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147216.515343:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.515347:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147216.515365:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132125c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:2001:x1830967310512128:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 879us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.515370:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9254 00010000:00010000:0.0:1746147216.515821:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147216.515826:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147216.515832:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250638f5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.515837:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250638f5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.515841:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147216.515845:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147216.516867:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132125f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:2002:x1830967310512384:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2362us (2596us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.516874:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9255 00000100:00100000:2.0:1746147216.520937:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.521037:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5577100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311543296:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147216.521405:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310512512 00000100:00100000:0.0:1746147216.521411:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310512512 00010000:00010000:0.0:1746147216.521452:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x31399394250638af lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f731 expref: 10 pid: 9138 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746147216.521479:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9256 00000100:00100000:0.0:1746147216.521486:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310512512:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147216.521499:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147216.521505:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x31399394250638af lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f731 expref: 10 pid: 9138 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.521515:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x31399394250638af lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f731 expref: 10 pid: 9138 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.521535:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7600/0x31399394250638af lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f731 expref: 10 pid: 9138 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.521581:0:13715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147216.521586:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147216.521592:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250638f5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.521598:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250638f5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.521605:0:13715:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250638f5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 9138 initiator: MDT0 00010000:00010000:0.0:1746147216.521610:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147216.521616:0:13715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147216.521629:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147216.521666:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310512512:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 180us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.521672:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9256 00010000:00010000:1.0:1746147216.521812:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250638f5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147216.521824:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250638f5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 9138 initiator: MDT0 00010000:00010000:1.0:1746147216.521829:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250638f5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 9138 initiator: MDT0 00000040:00080000:1.0:1746147216.522140:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1354, 88 off127016 00000004:00080000:1.0:1746147216.522145:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754512055371ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147216.522187:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1343, 88 off126048 00000004:00080000:1.0:1746147216.522191:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754512101211ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147216.522217:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1344, 88 off126136 00000004:00080000:1.0:1746147216.522220:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754512130689ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147216.522228:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1355, 88 off127104 00000004:00080000:1.0:1746147216.522230:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754512141016ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147216.522242:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1356, 88 off127192 00000004:00080000:1.0:1746147216.522245:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754512155414ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147216.522256:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1345, 88 off126224 00000004:00080000:1.0:1746147216.522259:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754512169446ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147216.522266:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1346, 88 off126312 00000004:00080000:1.0:1746147216.522268:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754512179004ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147216.522275:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1347, 88 off126400 00000004:00080000:1.0:1746147216.522278:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754512188404ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147216.522285:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1357, 88 off127280 00000004:00080000:1.0:1746147216.522287:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754512197269ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147216.522298:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1348, 88 off126488 00000004:00080000:1.0:1746147216.522301:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754512211279ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147216.522308:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1358, 88 off127368 00000004:00080000:1.0:1746147216.522310:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754512220702ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147216.522320:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1349, 88 off126576 00000004:00080000:1.0:1746147216.522322:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754512232714ns, next at 694367916532ns, rc = 0 00000040:00080000:1.0:1746147216.522330:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1359, 88 off127456 00000004:00080000:1.0:1746147216.522332:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754512242382ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147216.522342:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1360, 88 off127544 00000004:00080000:1.0:1746147216.522344:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754512254651ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147216.522354:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1361, 88 off127632 00000004:00080000:1.0:1746147216.522356:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754512266499ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147216.522365:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1362, 88 off127720 00000004:00080000:1.0:1746147216.522368:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754512278154ns, next at 694367945074ns, rc = 0 00000040:00080000:1.0:1746147216.522379:0:9138:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1350, 88 off126664 00000004:00080000:1.0:1746147216.522382:0:9138:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754512292714ns, next at 694367916532ns, rc = 0 00000100:00100000:2.0:1746147216.523406:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132127100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311543424:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147216.523421:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147216.523444:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132125180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310512256:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 9110us (9940us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.523452:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9253 00000001:00080000:0.0:1746147216.527718:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937448 is committed 00000004:00080000:0.0:1746147216.527728:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1326 committed 00000004:00080000:0.0:1746147216.527745:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1341 committed 00000004:00080000:0.0:1746147216.527758:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1340 committed 00000004:00080000:0.0:1746147216.527759:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1339 committed 00000004:00080000:0.0:1746147216.527761:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1338 committed 00000004:00080000:0.0:1746147216.527763:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1325 committed 00000004:00080000:0.0:1746147216.527764:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1337 committed 00000004:00080000:0.0:1746147216.527765:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1324 committed 00000004:00080000:0.0:1746147216.527767:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1336 committed 00000004:00080000:0.0:1746147216.527768:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1323 committed 00000004:00080000:0.0:1746147216.527770:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1322 committed 00000004:00080000:0.0:1746147216.527771:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1321 committed 00000004:00080000:0.0:1746147216.527772:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1335 committed 00000004:00080000:0.0:1746147216.527774:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1334 committed 00000004:00080000:0.0:1746147216.527775:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1320 committed 00000004:00080000:0.0:1746147216.527777:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1319 committed 00000004:00080000:0.0:1746147216.527778:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1333 committed 00000001:00080000:0.0:1746147216.527783:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937447 is committed 00000001:00080000:0.0:1746147216.527792:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937443 is committed 00000100:00100000:2.0:1746147216.527874:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.527926:0:16099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310512640 00000100:00100000:0.0:1746147216.527933:0:16099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310512640 00000100:00100000:0.0:1746147216.527966:0:16099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16540 00000100:00100000:0.0:1746147216.527973:0:16099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:3010:x1830967310512640:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147216.527992:0:16099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147216.528006:0:16099:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7c00/0x313993942506390a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f75b expref: -99 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.528051:0:16099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7c00/0x313993942506390a lrc: 3/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f75b expref: 8 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.528061:0:16099:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7c00/0x313993942506390a lrc: 3/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f75b expref: 8 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.528072:0:16099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147216.528074:0:16099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147216.528077:0:16099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7c00/0x313993942506390a lrc: 3/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f75b expref: 8 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.528082:0:16099:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e7c00, rc 0) 00000100:00100000:0.0:1746147216.528135:0:16099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:3010:x1830967310512640:12345-192.168.204.25@tcp:101:cat.0 Request processed in 162us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.528141:0:16099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16540 00000100:00100000:1.0:1746147216.528611:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311543936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147216.528646:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147216.528667:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311544448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147216.528679:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147216.528689:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311544960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147216.528702:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147216.528710:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311545472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147216.528721:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147216.528733:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1746147216.528736:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311543808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147216.528748:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147216.528757:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311544320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147216.528768:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147216.528777:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311544832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147216.528787:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147216.528796:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311545344:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147216.528806:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147216.528825:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311543936 00000100:00100000:1.0:1746147216.528829:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311543936 00000100:00100000:1.0:1746147216.528856:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311544448 00000100:00100000:1.0:1746147216.528858:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311544448 00000100:00100000:1.0:1746147216.528867:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311544960 00000100:00100000:1.0:1746147216.528869:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311544960 00000100:00100000:1.0:1746147216.528879:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311545472 00000100:00100000:1.0:1746147216.528881:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311545472 00000100:00100000:1.0:1746147216.528888:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311543808 00000100:00100000:1.0:1746147216.528889:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311543808 00000100:00100000:1.0:1746147216.528897:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311544320 00000100:00100000:1.0:1746147216.528898:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311544320 00000100:00100000:1.0:1746147216.528903:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311544832 00000100:00100000:1.0:1746147216.528905:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311544832 00000100:00100000:1.0:1746147216.528909:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311545344 00000100:00100000:1.0:1746147216.528911:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311545344 00000100:00100000:1.0:1746147216.528918:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20389 00000100:00100000:1.0:1746147216.528923:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3765:x1830967311543936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147216.529031:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147216.529034:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147216.529036:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147216.529038:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147216.529040:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746147216.529062:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3765:x1830967311543936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 139us (415us total) trans 17179875348 rc 0/0 00000100:00100000:1.0:1746147216.529067:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20389 00000100:00100000:1.0:1746147216.529077:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20390 00000100:00100000:1.0:1746147216.529081:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3765:x1830967311544448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147216.529152:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3765:x1830967311544448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (471us total) trans 17179875349 rc 0/0 00000100:00100000:1.0:1746147216.529157:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20390 00000100:00100000:1.0:1746147216.529166:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20391 00000100:00100000:1.0:1746147216.529169:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3765:x1830967311544960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.529295:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311543552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147216.529318:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.529329:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311544064:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147216.529341:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.529347:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311544576:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.529357:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.529364:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311545088:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.529375:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.529385:0:3766:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1746147216.529389:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311543680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147216.529400:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.529407:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311544192:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147216.529418:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311543552 00000100:00100000:2.0:1746147216.529419:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.529421:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311543552 00000100:00100000:2.0:1746147216.529425:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311544704:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147216.529434:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311544064 00000100:00100000:3.0:1746147216.529436:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311544064 00000100:00100000:3.0:1746147216.529442:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311544576 00000100:00100000:3.0:1746147216.529443:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311544576 00000100:00100000:2.0:1746147216.529448:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.529449:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311545088 00000100:00100000:3.0:1746147216.529450:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311545088 00000100:00100000:3.0:1746147216.529456:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311543680 00000100:00100000:2.0:1746147216.529456:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311545216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147216.529457:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311543680 00000100:00100000:3.0:1746147216.529463:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311544192 00000100:00100000:3.0:1746147216.529464:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311544192 00000100:00100000:2.0:1746147216.529467:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147216.529470:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311544704 00000100:00100000:3.0:1746147216.529471:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311544704 00000100:00100000:3.0:1746147216.529477:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311545216 00000100:00100000:3.0:1746147216.529478:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311545216 00000100:00100000:3.0:1746147216.529486:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20392 00000100:00100000:3.0:1746147216.529490:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3765:x1830967311545472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.529490:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20393 00000100:00100000:2.0:1746147216.529497:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3765:x1830967311543808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147216.529538:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 6959104 -> 6959104 00002000:00010000:3.0:1746147216.529540:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147216.529542:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147216.529554:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:3.0:1746147216.529556:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5272 -> 5272 00002000:00010000:2.0:1746147216.529556:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147216.529559:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147215 -> 1746147215 00002000:00010000:2.0:1746147216.529561:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147216 -> 1746147216 00002000:00010000:2.0:1746147216.529563:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147216 -> 1746147216 00002000:00010000:2.0:1746147216.529564:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746147216.529637:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:3765:x1830967311543808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 140us (887us total) trans 17179875350 rc 0/0 00000100:00100000:2.0:1746147216.529643:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20393 00000100:00100000:2.0:1746147216.529654:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20394 00000100:00100000:2.0:1746147216.529658:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3765:x1830967311544320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147216.529713:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:3765:x1830967311544320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (943us total) trans 17179875351 rc 0/0 00000100:00100000:2.0:1746147216.529718:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20394 00000100:00100000:2.0:1746147216.529727:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20395 00000100:00100000:2.0:1746147216.529731:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3765:x1830967311544832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147216.529792:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20396 00000100:00100000:0.0:1746147216.529798:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+27:3765:x1830967311545344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147216.530129:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3765:x1830967311545472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 638us (1406us total) trans 21474842742 rc 0/0 00000100:00100000:3.0:1746147216.530138:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20392 00000100:00100000:3.0:1746147216.530150:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20397 00000100:00100000:3.0:1746147216.530161:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3766:x1830967311543552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147216.530225:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746147216.530227:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147215 -> 1746147215 00002000:00010000:3.0:1746147216.530229:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147216 -> 1746147216 00002000:00010000:3.0:1746147216.530233:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147216 -> 1746147216 00002000:00010000:3.0:1746147216.530235:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147216.530274:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3766:x1830967311543552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (952us total) trans 17179875352 rc 0/0 00000100:00100000:3.0:1746147216.530282:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20397 00000100:00100000:3.0:1746147216.530298:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20398 00000100:00100000:3.0:1746147216.530306:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3766:x1830967311544064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147216.530386:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3766:x1830967311544064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (1041us total) trans 17179875353 rc 0/0 00000100:00100000:3.0:1746147216.530394:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20398 00000100:00100000:3.0:1746147216.530411:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20399 00000100:00100000:3.0:1746147216.530418:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3766:x1830967311544576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.532772:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20400 00000100:00100000:2.0:1746147216.532784:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3766:x1830967311545088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746147216.532900:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746147216.532904:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147216.532906:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147216.532908:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147216.532909:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3976 -> 3976 00000100:00100000:1.0:1746147216.532956:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3765:x1830967311544960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3786us (4252us total) trans 21474842743 rc 0/0 00000100:00100000:1.0:1746147216.532963:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20391 00000100:00100000:1.0:1746147216.532981:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20401 00000100:00100000:1.0:1746147216.532987:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:3766:x1830967311543680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147216.533057:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147216.533059:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147215 -> 1746147215 00002000:00010000:1.0:1746147216.533060:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147216 -> 1746147216 00002000:00010000:1.0:1746147216.533062:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147216 -> 1746147216 00002000:00010000:1.0:1746147216.533063:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746147216.533084:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:3766:x1830967311543680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (3682us total) trans 17179875354 rc 0/0 00000100:00100000:1.0:1746147216.533112:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20401 00000100:00100000:1.0:1746147216.533130:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20402 00000100:00100000:1.0:1746147216.533135:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3766:x1830967311544192:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147216.533178:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb size from disk: 3813376 -> 3813376 00002000:00010000:1.0:1746147216.533180:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb mtime from disk: 1746147164 -> 1746147164 00002000:00010000:1.0:1746147216.533181:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147216.533183:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb ctime from disk: 1746147164 -> 1746147164 00002000:00010000:1.0:1746147216.533184:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x9a:0x0] updating lvb blocks from disk: 1304 -> 1304 00000100:00100000:1.0:1746147216.533204:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3766:x1830967311544192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (3783us total) trans 17179875355 rc 0/0 00000100:00100000:1.0:1746147216.533208:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20402 00000100:00100000:1.0:1746147216.533218:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20403 00000100:00100000:1.0:1746147216.533222:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3766:x1830967311544704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.533423:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3766:x1830967311545088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 643us (4046us total) trans 21474842746 rc 0/0 00000100:00100000:2.0:1746147216.533429:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20400 00000100:00100000:2.0:1746147216.533440:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20404 00000100:00100000:2.0:1746147216.533446:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3766:x1830967311545216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.533498:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3766:x1830967311545216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (4029us total) trans 21474842747 rc 0/0 00000100:00100000:2.0:1746147216.533504:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20404 00002000:00010000:0.0:1746147216.534807:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147216.534812:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147216.534814:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746147216.534816:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147216.534818:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:0.0:1746147216.534852:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+28:3765:x1830967311545344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 5053us (6043us total) trans 21474842745 rc 0/0 00000100:00100000:0.0:1746147216.534859:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20396 00002000:00010000:1.0:1746147216.535986:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147216.535991:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147215 -> 1746147215 00002000:00010000:1.0:1746147216.535993:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147216 -> 1746147216 00002000:00010000:1.0:1746147216.535994:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147216 -> 1746147216 00002000:00010000:1.0:1746147216.535996:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147216.536028:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3766:x1830967311544704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2804us (6578us total) trans 21474842748 rc 0/0 00000100:00100000:1.0:1746147216.536035:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20403 00000004:00080000:1.0:1746147216.536112:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800968a1500/2, rc 0, transno 17179875350 00000100:00100000:1.0:1746147216.536117:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311543808:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147216.536126:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800968a1f80/2, rc 0, transno 17179875351 00000100:00100000:1.0:1746147216.536128:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311544320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147216.536137:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099151500/2, rc 0, transno 21474842745 00000100:00100000:1.0:1746147216.536145:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311545344:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147216.536152:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800968a0700/2, rc 0, transno 17179875348 00000100:00100000:1.0:1746147216.536154:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311543936:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147216.536160:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800968a0000/2, rc 0, transno 17179875349 00000100:00100000:1.0:1746147216.536162:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311544448:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147216.536168:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4397b80/2, rc 0, transno 21474842743 00000100:00100000:1.0:1746147216.536170:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311544960:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147216.536176:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099150a80/2, rc 0, transno 21474842742 00000100:00100000:1.0:1746147216.536178:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311545472:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746147216.536228:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250638f5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f746 expref: 30 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.536237:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147216.536239:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746147216.536241:0:9138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147216.536248:0:9138:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147216.536252:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147216.536257:0:9138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7c00/0x313993942506390a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f75b expref: 7 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.536263:0:9138:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7c00/0x313993942506390a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f75b expref: 7 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.536268:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7c00/0x313993942506390a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f75b expref: 7 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.536289:0:9138:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7c00/0x313993942506390a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f75b expref: 7 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147216.536298:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311545600:192.168.204.25@tcp:105: 00002000:00010000:3.0:1746147216.536464:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746147216.536467:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147215 -> 1746147215 00002000:00010000:3.0:1746147216.536468:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147216 -> 1746147216 00002000:00010000:3.0:1746147216.536470:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147216 -> 1746147216 00002000:00010000:3.0:1746147216.536472:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:3.0:1746147216.536499:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3766:x1830967311544576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 6083us (7139us total) trans 21474842749 rc 0/0 00000100:00100000:3.0:1746147216.536505:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20399 00000004:00080000:3.0:1746147216.536534:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800968a1c00/2, rc 0, transno 17179875354 00000100:00100000:3.0:1746147216.536537:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311543680:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147216.536553:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800968a3800/2, rc 0, transno 17179875355 00000100:00100000:3.0:1746147216.536556:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311544192:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147216.536564:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5575180/2, rc 0, transno 21474842748 00000100:00100000:3.0:1746147216.536567:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311544704:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147216.536574:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099151c00/2, rc 0, transno 21474842747 00000100:00100000:3.0:1746147216.536576:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311545216:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147216.536583:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800968a2a00/2, rc 0, transno 17179875352 00000100:00100000:3.0:1746147216.536586:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311543552:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147216.536593:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800968a1180/2, rc 0, transno 17179875353 00000100:00100000:3.0:1746147216.536595:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311544064:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147216.536601:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5577100/2, rc 0, transno 21474842749 00000100:00100000:3.0:1746147216.536603:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311544576:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147216.536610:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099150e00/2, rc 0, transno 21474842746 00000100:00100000:3.0:1746147216.536613:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311545088:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147216.536766:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:2.0:1746147216.536770:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147215 -> 1746147215 00002000:00010000:2.0:1746147216.536772:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147216 -> 1746147216 00002000:00010000:2.0:1746147216.536774:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147216 -> 1746147216 00002000:00010000:2.0:1746147216.536775:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:2.0:1746147216.536813:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3765:x1830967311544832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 7080us (8023us total) trans 21474842744 rc 0/0 00000100:00100000:2.0:1746147216.536820:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20395 00000100:00100000:0.0:1746147216.536973:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746147216.536982:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311545728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147216.537008:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147216.537071:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311545728 00000100:00100000:2.0:1746147216.537077:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311545728 00000100:00100000:2.0:1746147216.537128:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20405 00000100:00100000:2.0:1746147216.537133:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3767:x1830967311545728:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147216.537216:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4397800/2, rc 0, transno 21474842744 00000100:00100000:3.0:1746147216.537220:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311544832:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147216.537346:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3767:x1830967311545728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 212us (337us total) trans 21474842750 rc 0/0 00000100:00100000:2.0:1746147216.537351:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20405 00000004:00080000:0.0:1746147216.538342:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880132127b80/2, rc 0, transno 21474842750 00000100:00100000:0.0:1746147216.538347:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311545728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147216.538602:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8f00 going to sleep for 11 seconds 00010000:00010000:3.0:1746147216.538877:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.538885:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:3.0:1746147216.538927:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147216.538930:0:7237:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147216.538946:0:7237:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.538976:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093731e00/0x31399394250638fc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f74d expref: 31 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.539490:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f74d expref: 30 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.539498:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147216.539500:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746147216.539503:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093730c00, rc 0) 00000100:00100000:3.0:1746147216.539554:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:3011:x1830967310511744:12345-192.168.204.25@tcp:101:cat.0 Request processed in 35803us (36293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.539560:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16539 00000100:00100000:1.0:1746147216.542557:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311545600:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147216.542593:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098446600/0x31399394250638ee lrc: 0/0,0 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f746 expref: 29 pid: 9138 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746147216.542615:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250638f5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f746 expref: 28 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.542640:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098447e00, rc 0) 00000100:00100000:0.0:1746147216.543431:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.543513:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:3007:x1830967310511616:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 39637us (39942us total) trans 8589937448 rc 0/0 00000100:00100000:1.0:1746147216.543521:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16538 00000100:00100000:3.0:1746147216.543598:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310512768 00000100:00100000:3.0:1746147216.543604:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310512768 00000100:00100000:3.0:1746147216.543634:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6195 00000100:00100000:3.0:1746147216.543640:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:3010:x1830967310512768:12345-192.168.204.25@tcp:49:cat.0 00000100:00100000:3.0:1746147216.543705:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:3010:x1830967310512768:12345-192.168.204.25@tcp:49:cat.0 Request processed in 65us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.543710:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6195 00000100:00100000:2.0:1746147216.544668:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.544899:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310512896 00000100:00100000:1.0:1746147216.544903:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310512896 00000100:00100000:1.0:1746147216.545379:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16541 00000100:00100000:1.0:1746147216.545386:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:3011:x1830967310512896:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147216.545397:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147216.545413:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef800/0x3139939425063911 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f762 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.545558:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef800/0x3139939425063911 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f762 expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.545571:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef800/0x3139939425063911 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f762 expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.545587:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147216.545589:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147216.545592:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ef800, rc 0) 00000100:00100000:1.0:1746147216.545621:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:3011:x1830967310512896:12345-192.168.204.25@tcp:101:cat.0 Request processed in 236us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.545630:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16541 00000100:00100000:0.0:1746147216.551995:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.552054:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.552132:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310513152 00000100:00100000:3.0:1746147216.552143:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310513152 00002000:00100000:3.0:1746147216.552187:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880132124000 x1830967310513152/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147216.552197:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132124000 with x1830967310513152 ext(0->1048575) 00002000:00010000:3.0:1746147216.552202:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132124000 00000100:00100000:3.0:1746147216.552240:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7463 00000100:00100000:3.0:1746147216.552247:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+6:2002:x1830967310513152:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147216.552610:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310513280 00000100:00100000:2.0:1746147216.552615:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310513280 00000100:00100000:2.0:1746147216.552645:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20406 00000100:00100000:2.0:1746147216.552650:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:3007:x1830967310513280:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147216.552861:0:1398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.552877:0:1398:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425063918 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f769 expref: -99 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.552896:0:1398:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009822b200/0x313993942506384d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f707 expref: 21 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.552902:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147216.552903:0:1398:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147216.552906:0:1398:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425063918 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1089536->1306623] (req 1089536->1306623) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f769 expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.552929:0:1398:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009822b200/0x313993942506384d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f707 expref: 21 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.552939:0:1398:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009822b200/0x313993942506384d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f707 expref: 21 pid: 1398 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.552948:0:1398:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009689a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311545856:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.553031:0:1398:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1ccf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147216.553840:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.555398:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310513408 00000100:00100000:3.0:1746147216.555407:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310513408 00000100:00100000:3.0:1746147216.555457:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1006 00000100:00100000:3.0:1746147216.555464:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2003:x1830967310513408:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.555474:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.555494:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ef800/0x3139939425063911 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f762 expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.555513:0:4349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147216.555516:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147216.555574:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2003:x1830967310513408:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 110us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.555580:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1006 00000100:00100000:2.0:1746147216.559026:0:1398:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009689a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1398:1830967311545856:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.559052:0:1398:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425063918 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1089536->1306623] (req 1089536->1306623) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f769 expref: 27 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.559068:0:1398:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092542000, rc 0) 00000100:00100000:2.0:1746147216.559612:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:3007:x1830967310513280:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6959us (7555us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.559620:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20406 00000100:00100000:0.0:1746147216.561435:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.561496:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.561525:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.562177:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.562214:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310513536 00000100:00100000:1.0:1746147216.562224:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310513536 00000100:00100000:2.0:1746147216.562235:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310513792 00000100:00100000:2.0:1746147216.562245:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310513792 00000100:00100000:1.0:1746147216.562264:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310514048 00000100:00100000:1.0:1746147216.562267:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310514048 00000100:00100000:0.0:1746147216.562588:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.562658:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310513664 00000100:00100000:3.0:1746147216.562670:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310513664 00000100:00100000:3.0:1746147216.562706:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20407 00000100:00100000:3.0:1746147216.562717:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+20:2001:x1830967310513536:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147216.562740:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.562762:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009504e600/0x313993942506391f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f770 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.562789:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.562791:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.562803:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009504e600/0x313993942506391f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f770 expref: 21 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.562822:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009504e600/0x313993942506391f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f770 expref: 21 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.562835:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504e600, rc 0) 00000100:00100000:3.0:1746147216.562895:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310513536:12345-192.168.204.25@tcp:101:cat.0 Request processed in 178us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.562901:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20407 00000100:00100000:3.0:1746147216.562923:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20408 00000100:00100000:3.0:1746147216.562930:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310513792:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147216.562941:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.562953:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009504f800/0x3139939425063926 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f77e expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.563004:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009455e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311545984:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147216.563067:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1c4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147216.563123:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20409 00000100:00100000:3.0:1746147216.563131:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+20:2001:x1830967310514048:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147216.563139:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.563150:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009256f800/0x313993942506392d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f78c expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.563182:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311546112:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147216.563213:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147216.563808:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20410 00000100:00100000:1.0:1746147216.563818:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310513664:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147216.563830:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147216.563841:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984ef400/0x3139939425063934 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f777 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147216.563886:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311546240:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147216.563935:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147216.564323:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.564349:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.564368:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310513920 00000100:00100000:2.0:1746147216.564378:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310513920 00000100:00100000:2.0:1746147216.564425:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310514176 00000100:00100000:2.0:1746147216.564428:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310514176 00000100:00100000:0.0:1746147216.564432:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20411 00000100:00100000:0.0:1746147216.564440:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967310513920:12345-192.168.204.25@tcp:101:cat.0 00000100:00100000:2.0:1746147216.564449:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20412 00010000:00010000:0.0:1746147216.564449:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746147216.564455:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967310514176:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147216.564457:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801312e7400/0x313993942506393b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f785 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.564469:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.564484:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d7600/0x3139939425063942 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f793 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147216.564484:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095121180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311546368:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147216.564526:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147216.564529:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009689a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311546496:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147216.564593:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1ccf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746147216.564631:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310514304 00000100:00100000:2.0:1746147216.564633:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310514304 00010000:00010000:2.0:1746147216.564647:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009822b200/0x313993942506384d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f707 expref: 22 pid: 1398 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.564663:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9257 00000100:00100000:2.0:1746147216.564667:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+22:2001:x1830967310514304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147216.564673:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147216.564687:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009822b200/0x313993942506384d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f707 expref: 22 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.564697:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009822b200/0x313993942506384d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f707 expref: 22 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.565440:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.565443:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.565707:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425063918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1089536->1306623) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f769 expref: 32 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.565718:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425063918 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1089536->1306623) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f769 expref: 32 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.565746:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425063918 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1089536->1306623) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f769 expref: 32 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147216.565755:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096898a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311546624:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147216.565817:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:2.0:1746147216.565897:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+6:2002:x1830967310513152:12345-192.168.204.25@tcp:3:cat.0 Request processed in 13650us (13913us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147216.565905:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7463 00002000:00100000:2.0:1746147216.565913:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880132124000 x1830967310513152/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.565921:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132124000 with x1830967310513152 ext(0->1048575) 00002000:00010000:2.0:1746147216.565924:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132124000 00010000:00010000:3.0:1746147216.566895:0:1853:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff88009822b000/0x313993942506385b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f715 expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.566901:0:9585:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff88009455e680 x1830967311545984) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009822b200/0x313993942506384d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f707 expref: 22 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.566924:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822b200/0x313993942506384d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f707 expref: 22 pid: 1398 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.566927:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311546112:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147216.566957:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009455e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311545984:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147216.566961:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009256f800/0x313993942506392d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f78c expref: 23 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.566975:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009256f800/0x313993942506392d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f78c expref: 23 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.566981:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009504f800/0x3139939425063926 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f77e expref: 32 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.566986:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256f800, rc 0) 00010000:00010000:2.0:1746147216.566990:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009504f800/0x3139939425063926 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f77e expref: 32 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.566996:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009504f800, rc 0) 00000100:00100000:3.0:1746147216.567033:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967310514048:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3900us (5506us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147216.567041:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20409 00000100:00100000:2.0:1746147216.567218:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967310513792:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4287us (5723us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147216.567225:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20408 00010000:00010000:1.0:1746147216.572724:0:17600:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x3139939425063846 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f700 expref: 21 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147216.572758:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17600:1830967311546240:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147216.572791:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984ef400/0x3139939425063934 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f777 expref: 30 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147216.572804:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984ef400/0x3139939425063934 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f777 expref: 30 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147216.572926:0:13695:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff8801312e6400/0x3139939425063854 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f70e expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147216.572947:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095121180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311546368:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147216.572969:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801312e7400/0x313993942506393b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f785 expref: 21 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147216.572978:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801312e7400/0x313993942506393b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f785 expref: 21 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147216.572991:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e7400, rc 0) 00010000:00010000:1.0:1746147216.573617:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ef400, rc 0) 00000100:00100000:0.0:1746147216.574464:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+20:2001:x1830967310513920:12345-192.168.204.25@tcp:101:cat.0 Request processed in 10014us (11866us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147216.574475:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20411 00010000:00010000:3.0:1746147216.574650:0:9584:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x3139939425063862 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f71c expref: 21 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.574678:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009689a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311546496:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147216.574712:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932d7600/0x3139939425063942 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f793 expref: 29 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.574725:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d7600/0x3139939425063942 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f793 expref: 29 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.574735:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d7600, rc 0) 00000100:00100000:1.0:1746147216.575352:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310513664:12345-192.168.204.25@tcp:101:cat.0 Request processed in 11534us (13172us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147216.575364:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20410 00000100:00100000:0.0:1746147216.576307:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096898a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311546624:192.168.204.25@tcp:105: 00010000:00010000:0.0:1746147216.576325:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147216.576331:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310514176:12345-192.168.204.25@tcp:101:cat.0 Request processed in 11873us (12009us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147216.576338:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20412 00000100:00100000:0.0:1746147216.576352:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2001:x1830967310514304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 11684us (12002us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.576361:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9257 00000100:00100000:3.0:1746147216.576615:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.576984:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310514560 00000100:00100000:2.0:1746147216.576992:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310514560 00002000:00100000:2.0:1746147216.577031:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x97:0x0] (1089536->1093631) req@ffff8800769adf80 x1830967310514560/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.577040:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769adf80 with x1830967310514560 ext(1089536->1093631) 00002000:00010000:2.0:1746147216.577045:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769adf80 00000100:00100000:2.0:1746147216.577063:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7464 00000100:00100000:2.0:1746147216.577070:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310514560:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147216.577225:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310514560:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 156us (610us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147216.577232:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7464 00002000:00100000:2.0:1746147216.577237:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x97:0x0] (1089536->1093631) req@ffff8800769adf80 x1830967310514560/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/4536 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.577244:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769adf80 with x1830967310514560 ext(1089536->1093631) 00002000:00010000:2.0:1746147216.577246:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769adf80 00000100:00100000:3.0:1746147216.577446:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.577465:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310514688 00000100:00100000:3.0:1746147216.577468:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310514688 00000100:00100000:3.0:1746147216.577489:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20413 00000100:00100000:3.0:1746147216.577494:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:3010:x1830967310514688:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147216.577503:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.577519:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009256f400/0x3139939425063949 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f79a expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.577555:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x3139939425063846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f700 expref: 20 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.577563:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147216.577565:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147216.577569:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009256f400/0x3139939425063949 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f79a expref: 14 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.577603:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x3139939425063846 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f700 expref: 20 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.577616:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x3139939425063846 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f700 expref: 20 pid: 1398 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.577628:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311546752:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.577681:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147216.580666:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311546752:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.580704:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009256f400/0x3139939425063949 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f79a expref: 14 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.580723:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256f400, rc 0) 00000100:00100000:3.0:1746147216.580771:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:3010:x1830967310514688:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3275us (3324us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.580780:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20413 00000100:00100000:0.0:1746147216.582170:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.582852:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310514816 00000100:00100000:2.0:1746147216.582861:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310514816 00010000:00010000:2.0:1746147216.582898:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x3139939425063846 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f700 expref: 21 pid: 1398 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.582935:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9258 00000100:00100000:2.0:1746147216.582943:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+21:2003:x1830967310514816:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147216.584693:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147216.584737:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x3139939425063846 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f700 expref: 21 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.584754:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x3139939425063846 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f700 expref: 21 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.584783:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822b400/0x3139939425063846 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f700 expref: 21 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.584829:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.584832:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.584843:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009256f400/0x3139939425063949 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f79a expref: 13 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.584852:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009256f400/0x3139939425063949 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f79a expref: 13 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.584906:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009256f400/0x3139939425063949 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f79a expref: 13 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147216.584922:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009689bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311546880:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147216.585048:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1ccf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147216.585480:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.585580:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.585609:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310514944 00000100:00100000:0.0:1746147216.585616:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310514944 00000100:00100000:0.0:1746147216.585657:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310515200 00000100:00100000:0.0:1746147216.585662:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310515200 00000100:00100000:0.0:1746147216.585687:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20414 00000100:00100000:0.0:1746147216.585695:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310514944:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147216.585712:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147216.585725:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x3139939425063950 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f7a1 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.585745:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147216.585747:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147216.585754:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x3139939425063950 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7a1 expref: 28 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147216.585767:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x3139939425063950 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7a1 expref: 28 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147216.585776:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e7200, rc 0) 00000100:00100000:0.0:1746147216.585816:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310514944:12345-192.168.204.25@tcp:101:cat.0 Request processed in 120us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.585822:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20414 00000100:00100000:0.0:1746147216.585842:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20415 00000100:00100000:0.0:1746147216.585849:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+20:2000:x1830967310515200:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147216.585858:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147216.585870:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801312e7e00/0x3139939425063957 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f7af expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147216.585907:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311547008:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147216.585965:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147216.586047:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.586075:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310515584 00000100:00100000:0.0:1746147216.586080:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310515584 00002000:00100000:0.0:1746147216.586146:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x97:0x0] (1302528->1306623) req@ffff880095122a00 x1830967310515584/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147216.586156:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095122a00 with x1830967310515584 ext(1302528->1306623) 00002000:00010000:0.0:1746147216.586161:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095122a00 00000100:00100000:0.0:1746147216.586182:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7465 00000100:00100000:0.0:1746147216.586189:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310515584:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147216.586328:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310515584:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 138us (280us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147216.586334:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7465 00002000:00100000:0.0:1746147216.586340:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x97:0x0] (1302528->1306623) req@ffff880095122a00 x1830967310515584/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/4536 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147216.586347:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095122a00 with x1830967310515584 ext(1302528->1306623) 00002000:00010000:0.0:1746147216.586350:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095122a00 00000100:00100000:2.0:1746147216.590922:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.590957:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.591011:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009689bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311546880:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147216.591033:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147216.591289:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310515072 00000100:00100000:0.0:1746147216.591296:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310515072 00000100:00100000:0.0:1746147216.591328:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310515328 00000100:00100000:0.0:1746147216.591330:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310515328 00000100:00100000:0.0:1746147216.591344:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20416 00000100:00100000:0.0:1746147216.591351:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967310515072:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147216.591368:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147216.591385:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cd2600/0x313993942506395e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f7a8 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147216.591441:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099010000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311547136:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147216.591526:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2003:x1830967310514816:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 8583us (9359us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.591535:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9258 00000100:00100000:3.0:1746147216.591639:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20417 00000100:00100000:3.0:1746147216.591647:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310515328:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147216.591655:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.591667:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x3139939425063965 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f7b6 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.591693:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311547264:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147216.591758:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147216.592030:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746147216.592321:0:17600:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff88009822b000/0x313993942506385b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f715 expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147216.592348:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311547008:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147216.592374:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801312e7e00/0x3139939425063957 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7af expref: 23 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147216.592384:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801312e7e00/0x3139939425063957 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7af expref: 23 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147216.592407:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e7e00, rc 0) 00000100:00100000:0.0:1746147216.592439:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2000:x1830967310515200:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6590us (6860us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147216.592445:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20415 00000100:00100000:0.0:1746147216.593188:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.593236:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.593238:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310515840 00000100:00100000:3.0:1746147216.593244:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310515840 00000100:00100000:1.0:1746147216.593276:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310516096 00000100:00100000:1.0:1746147216.593281:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310516096 00000100:00100000:1.0:1746147216.593313:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6196 00000100:00100000:1.0:1746147216.593318:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:3007:x1830967310516096:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147216.593487:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:3007:x1830967310516096:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 169us (251us total) trans 8589937449 rc 0/0 00000100:00100000:1.0:1746147216.593492:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6196 00002000:00100000:3.0:1746147216.593553:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880099013480 x1830967310515840/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147216.593563:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099013480 with x1830967310515840 ext(1048576->2097151) 00002000:00010000:3.0:1746147216.593568:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099013480 00000100:00100000:3.0:1746147216.593591:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7466 00000100:00100000:3.0:1746147216.593596:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2002:x1830967310515840:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:1.0:1746147216.596710:0:9585:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff8801312e6400/0x3139939425063854 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f70e expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147216.596745:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099010000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311547136:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147216.596781:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cd2600/0x313993942506395e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7a8 expref: 21 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147216.596795:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cd2600/0x313993942506395e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7a8 expref: 21 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147216.596807:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cd2600, rc 0) 00000100:00100000:1.0:1746147216.596850:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+20:2001:x1830967310515072:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5497us (5936us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147216.596858:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20416 00010000:00010000:3.0:1746147216.596955:0:1853:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x3139939425063862 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f71c expref: 19 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.596975:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311547264:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147216.596998:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x3139939425063965 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7b6 expref: 29 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.597006:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009256ee00/0x3139939425063965 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7b6 expref: 29 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.597017:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009256ee00, rc 0) 00000100:00100000:3.0:1746147216.597034:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310515328:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5389us (6076us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147216.597039:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20417 00000100:00100000:0.0:1746147216.608985:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.609048:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.609156:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.609273:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310516480 00000100:00100000:3.0:1746147216.609285:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310516480 00002000:00100000:3.0:1746147216.609340:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880099010000 x1830967310516480/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147216.609351:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099010000 with x1830967310516480 ext(0->1048575) 00002000:00010000:3.0:1746147216.609356:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099010000 00000100:00100000:3.0:1746147216.609375:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310516736 00000100:00100000:3.0:1746147216.609379:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310516736 00002000:00100000:3.0:1746147216.609397:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880095122d80 x1830967310516736/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 504/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147216.609404:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095122d80 with x1830967310516736 ext(1048576->2097151) 00002000:00010000:3.0:1746147216.609408:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095122d80 00000100:00100000:3.0:1746147216.609425:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310516608 00000100:00100000:3.0:1746147216.609429:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310516608 00002000:00100000:3.0:1746147216.609445:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8800933f6a00 x1830967310516608/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147216.609451:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f6a00 with x1830967310516608 ext(1048576->2097151) 00002000:00010000:3.0:1746147216.609455:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800933f6a00 00000100:00100000:3.0:1746147216.609476:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7467 00000100:00100000:3.0:1746147216.609487:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+20:2000:x1830967310516480:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147216.610337:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7468 00000100:00100000:3.0:1746147216.610344:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310516736:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147216.610672:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7469 00000100:00100000:0.0:1746147216.610678:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310516608:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147216.613882:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2002:x1830967310515840:12345-192.168.204.25@tcp:3:cat.0 Request processed in 20273us (20683us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746147216.613896:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7466 00002000:00100000:0.0:1746147216.613909:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff880099013480 x1830967310515840/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147216.613919:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099013480 with x1830967310515840 ext(1048576->2097151) 00002000:00010000:0.0:1746147216.613925:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099013480 00000100:00100000:0.0:1746147216.625189:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.625250:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310516992 00000100:00100000:0.0:1746147216.625261:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310516992 00000100:00100000:0.0:1746147216.625327:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20418 00000100:00100000:0.0:1746147216.625338:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:3010:x1830967310516992:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147216.625358:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147216.625376:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x313993942506396c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f7bd expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.625409:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425063918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1306623) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f769 expref: 31 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.625417:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147216.625418:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147216.625422:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x313993942506396c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7bd expref: 15 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.625453:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425063918 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1306623) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f769 expref: 31 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.625465:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425063918 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1306623) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f769 expref: 31 pid: 1398 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746147216.625479:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800933f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311547392:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147216.625570:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147216.625929:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310516736:12345-192.168.204.25@tcp:3:cat.0 Request processed in 15583us (16880us total) trans 0 rc 831488/831488 00000100:00100000:2.0:1746147216.625939:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7468 00002000:00100000:2.0:1746147216.626283:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880095122d80 x1830967310516736/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 504/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 831488/831488 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.626293:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095122d80 with x1830967310516736 ext(1048576->2097151) 00010000:00010000:2.0:1746147216.626301:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425063918 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f769 expref: 30 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.626312:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425063918 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f769 expref: 30 pid: 1398 timeout: 854 lvb_type: 0 00002000:00010000:2.0:1746147216.626324:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095122d80 00000100:00100000:3.0:1746147216.626561:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+20:2000:x1830967310516480:12345-192.168.204.25@tcp:3:cat.0 Request processed in 17076us (17588us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147216.626569:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7467 00002000:00100000:3.0:1746147216.626574:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880099010000 x1830967310516480/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147216.626587:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099010000 with x1830967310516480 ext(0->1048575) 00002000:00010000:3.0:1746147216.626591:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099010000 00000100:00100000:1.0:1746147216.633031:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800933f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311547392:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.633057:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310516608:12345-192.168.204.25@tcp:3:cat.0 Request processed in 22376us (23900us total) trans 0 rc 1048576/1048576 00010000:00010000:1.0:1746147216.633064:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x313993942506396c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7bd expref: 15 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147216.633068:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7469 00002000:00100000:2.0:1746147216.633078:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x96:0x0] (1048576->2097151) req@ffff8800933f6a00 x1830967310516608/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746147216.633084:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cd3800, rc 0) 00002000:00100000:2.0:1746147216.633112:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f6a00 with x1830967310516608 ext(1048576->2097151) 00002000:00010000:2.0:1746147216.633117:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800933f6a00 00000100:00100000:1.0:1746147216.633133:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:3010:x1830967310516992:12345-192.168.204.25@tcp:101:cat.0 Request processed in 7798us (7959us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.633141:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20418 00000100:00100000:0.0:1746147216.633227:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.633276:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310517120 00000100:00100000:3.0:1746147216.633283:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310517120 00002000:00100000:3.0:1746147216.633314:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x97:0x0] (1089536->1306623) req@ffff8800933f5f80 x1830967310517120/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147216.633323:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f5f80 with x1830967310517120 ext(1089536->1306623) 00010000:00010000:3.0:1746147216.633329:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425063918 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f769 expref: 28 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.633341:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425063918 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f769 expref: 28 pid: 1398 timeout: 854 lvb_type: 0 00002000:00010000:3.0:1746147216.633348:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800933f5f80 00000100:00100000:3.0:1746147216.633373:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1766 00000100:00100000:3.0:1746147216.633380:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310517120:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:3.0:1746147216.642915:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310517120:12345-192.168.204.25@tcp:4:cat.0 Request processed in 9523us (9676us total) trans 17179875356 rc 0/0 00000100:00100000:3.0:1746147216.642929:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1766 00002000:00100000:3.0:1746147216.642941:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x97:0x0] (1089536->1306623) req@ffff8800933f5f80 x1830967310517120/t17179875356(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/448 e 0 to 0 dl 1746147227 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147216.642950:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f5f80 with x1830967310517120 ext(1089536->1306623) 00010000:00010000:3.0:1746147216.642960:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425063918 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f769 expref: 30 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.642983:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425063918 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f769 expref: 30 pid: 1398 timeout: 854 lvb_type: 0 00002000:00010000:3.0:1746147216.642991:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800933f5f80 00000100:00100000:0.0:1746147216.648211:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.648293:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310517248 00000100:00100000:1.0:1746147216.648303:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310517248 00000100:00100000:1.0:1746147216.648494:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20419 00000100:00100000:1.0:1746147216.648503:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:3011:x1830967310517248:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147216.648520:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147216.648550:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425063973 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f7c4 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.648583:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147216.648590:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425063973 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7c4 expref: 31 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.648601:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425063973 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7c4 expref: 31 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.648611:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ee800, rc 0) 00000100:00100000:1.0:1746147216.649138:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:3011:x1830967310517248:12345-192.168.204.25@tcp:101:cat.0 Request processed in 636us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.649145:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20419 00000100:00100000:0.0:1746147216.649604:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.649653:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310517376 00000100:00100000:3.0:1746147216.649662:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310517376 00010000:00010000:3.0:1746147216.649681:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425063918 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1089536->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f769 expref: 31 pid: 1398 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.649703:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9259 00000100:00100000:3.0:1746147216.649709:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967310517376:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.649718:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147216.649737:0:7227:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147215 -> 1746147216 00010000:00010000:3.0:1746147216.649743:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425063918 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1089536->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f769 expref: 31 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.649752:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425063918 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1089536->1306623) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f769 expref: 31 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.649772:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092542000/0x3139939425063918 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1089536->1306623) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f769 expref: 31 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.649794:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.649796:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.649803:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x313993942506396c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7bd expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.649816:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x313993942506396c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7bd expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.649824:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.649825:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.649828:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425063973 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7c4 expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.649835:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425063973 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7c4 expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.649861:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425063973 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7c4 expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.649875:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311547520:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147216.649941:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x313993942506396c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7bd expref: 14 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.649953:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311547648:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147216.649976:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147216.655261:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.655262:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311547520:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147216.655272:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7227:1830967311547648:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147216.655299:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147216.655342:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967310517376:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5632us (5737us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.655354:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9259 00000100:00100000:2.0:1746147216.655365:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310517632 00000100:00100000:2.0:1746147216.655372:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310517632 00002000:00100000:2.0:1746147216.655416:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff8800933f4380 x1830967310517632/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.655424:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f4380 with x1830967310517632 ext(1048576->2097151) 00002000:00010000:2.0:1746147216.655429:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800933f4380 00000100:00100000:2.0:1746147216.655455:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7470 00000100:00100000:2.0:1746147216.655462:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800933f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2002:x1830967310517632:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147216.661611:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.661691:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310517888 00000100:00100000:1.0:1746147216.661701:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310517888 00002000:00100000:1.0:1746147216.661750:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880094712d80 x1830967310517888/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147216.661760:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094712d80 with x1830967310517888 ext(1048576->2097151) 00002000:00010000:1.0:1746147216.661765:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094712d80 00000100:00100000:1.0:1746147216.661801:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7471 00000100:00100000:1.0:1746147216.661810:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967310517888:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147216.678911:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800933f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2002:x1830967310517632:12345-192.168.204.25@tcp:3:cat.0 Request processed in 23434us (23645us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147216.678927:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7470 00002000:00100000:2.0:1746147216.678942:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff8800933f4380 x1830967310517632/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.678953:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800933f4380 with x1830967310517632 ext(1048576->2097151) 00002000:00010000:2.0:1746147216.678960:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800933f4380 00000100:00100000:1.0:1746147216.679836:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2003:x1830967310517888:12345-192.168.204.25@tcp:3:cat.0 Request processed in 18022us (18230us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147216.679845:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7471 00002000:00100000:1.0:1746147216.679852:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x97:0x0] (1048576->2097151) req@ffff880094712d80 x1830967310517888/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147216.679859:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094712d80 with x1830967310517888 ext(1048576->2097151) 00002000:00010000:1.0:1746147216.679863:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094712d80 00000100:00100000:0.0:1746147216.686310:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.686438:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310518016 00000100:00100000:1.0:1746147216.686449:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310518016 00000100:00100000:1.0:1746147216.687908:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20420 00000100:00100000:1.0:1746147216.687920:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+6:3010:x1830967310518016:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147216.687939:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147216.687957:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x313993942506397a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f7cb expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.687985:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801312e6400/0x3139939425063854 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f70e expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.687992:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147216.687995:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147216.687998:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x313993942506397a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7cb expref: 7 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.688033:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801312e6400/0x3139939425063854 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f70e expref: 13 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.688046:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801312e6400/0x3139939425063854 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f70e expref: 13 pid: 1398 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746147216.688058:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311547776:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147216.688576:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147216.692067:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.692216:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310518144 00000100:00100000:2.0:1746147216.692226:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310518144 00000100:00100000:2.0:1746147216.692273:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20421 00000100:00100000:2.0:1746147216.692281:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+20:3011:x1830967310518144:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147216.692379:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.692398:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063981 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f7d2 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.692426:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746147216.692431:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063981 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7d2 expref: 21 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.692441:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063981 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7d2 expref: 21 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.692450:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990cc600, rc 0) 00000100:00100000:2.0:1746147216.693031:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:3011:x1830967310518144:12345-192.168.204.25@tcp:101:cat.0 Request processed in 746us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.693038:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20421 00000100:00100000:1.0:1746147216.693648:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311547776:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147216.693670:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x313993942506397a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7cb expref: 7 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.693681:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32c00, rc 0) 00000100:00100000:2.0:1746147216.693733:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.693898:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310518272 00000100:00100000:3.0:1746147216.693902:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310518272 00010000:00010000:3.0:1746147216.693924:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e6400/0x3139939425063854 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f70e expref: 14 pid: 1398 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.693949:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9260 00000100:00100000:3.0:1746147216.693954:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+14:2001:x1830967310518272:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.693962:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.693980:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801312e6400/0x3139939425063854 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f70e expref: 14 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.693990:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801312e6400/0x3139939425063854 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f70e expref: 14 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.694009:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801312e6400/0x3139939425063854 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f70e expref: 14 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.694024:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.694026:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.694032:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x313993942506397a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7cb expref: 7 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.694039:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x313993942506397a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7cb expref: 7 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.694044:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.694046:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.694049:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063981 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7d2 expref: 20 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.694054:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063981 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7d2 expref: 20 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.694077:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063981 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7d2 expref: 20 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.694086:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095148700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311547904:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147216.694157:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x313993942506397a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7cb expref: 7 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.694164:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311548032:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147216.694178:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147216.694254:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:3010:x1830967310518016:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6336us (7956us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.694260:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20420 00000100:00100000:3.0:1746147216.695820:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095148700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311547904:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147216.695827:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311548032:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147216.695840:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147216.698916:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2001:x1830967310518272:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4947us (5169us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.698928:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9260 00000100:00100000:0.0:1746147216.699456:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.699517:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310518528 00000100:00100000:1.0:1746147216.699527:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310518528 00002000:00100000:1.0:1746147216.699577:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880094711880 x1830967310518528/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147216.699587:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094711880 with x1830967310518528 ext(1048576->2097151) 00002000:00010000:1.0:1746147216.699592:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094711880 00000100:00100000:1.0:1746147216.700051:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7472 00000100:00100000:1.0:1746147216.700059:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2002:x1830967310518528:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147216.702146:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.702238:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310518784 00000100:00100000:0.0:1746147216.702245:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310518784 00002000:00100000:0.0:1746147216.702284:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880096898000 x1830967310518784/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147216.702295:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096898000 with x1830967310518784 ext(1048576->2097151) 00002000:00010000:0.0:1746147216.702300:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096898000 00000100:00100000:0.0:1746147216.702319:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7473 00000100:00100000:0.0:1746147216.702326:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2002:x1830967310518784:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147216.710504:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2002:x1830967310518528:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 10433us (11037us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147216.710518:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7472 00002000:00100000:1.0:1746147216.710531:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880094711880 x1830967310518528/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147216.710549:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094711880 with x1830967310518528 ext(1048576->2097151) 00002000:00010000:1.0:1746147216.710554:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094711880 00000100:00100000:2.0:1746147216.714751:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2002:x1830967310518784:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12412us (12600us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147216.714764:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7473 00002000:00100000:2.0:1746147216.714777:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880096898000 x1830967310518784/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.714793:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096898000 with x1830967310518784 ext(1048576->2097151) 00002000:00010000:2.0:1746147216.714799:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096898000 00000100:00100000:0.0:1746147216.718268:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.718802:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.719191:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310518912 00000100:00100000:1.0:1746147216.719201:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310518912 00000100:00100000:1.0:1746147216.719249:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310519040 00000100:00100000:1.0:1746147216.719252:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310519040 00000100:00100000:1.0:1746147216.719954:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20422 00000100:00100000:1.0:1746147216.719964:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+7:2000:x1830967310518912:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147216.719984:0:17600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147216.720009:0:17600:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33c00/0x3139939425063988 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f7d9 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.720110:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20423 00000100:00100000:3.0:1746147216.720119:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310519040:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147216.720128:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.720141:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a1fc00/0x313993942506398f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f7e0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.720179:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311548160:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147216.720263:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147216.720603:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311548288:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147216.720634:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746147216.720798:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.721066:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310519168 00000100:00100000:2.0:1746147216.721072:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310519168 00000100:00100000:2.0:1746147216.721122:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20424 00000100:00100000:2.0:1746147216.721129:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:3005:x1830967310519168:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147216.721135:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.721145:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990cd400/0x3139939425063996 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f7e7 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.721162:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x313993942506397a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7cb expref: 10 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.721170:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063981 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7d2 expref: 20 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.721176:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.721178:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.721182:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990cd400/0x3139939425063996 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1228800->2097151] (req 1228800->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7e7 expref: 10 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.721203:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063981 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7d2 expref: 20 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.721214:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063981 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7d2 expref: 20 pid: 9585 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.721227:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096899180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311548416:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.721285:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x313993942506397a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7cb expref: 10 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.721292:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x313993942506397a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7cb expref: 10 pid: 1853 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.721300:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096899880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311548544:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.721317:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00010000:00010000:1.0:1746147216.724276:0:17600:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff88009822b000/0x313993942506385b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f715 expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147216.724306:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311548288:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147216.724338:0:17600:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33c00/0x3139939425063988 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7d9 expref: 10 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147216.724351:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33c00/0x3139939425063988 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7d9 expref: 10 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147216.724378:0:17600:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33c00, rc 0) 00000100:00100000:2.0:1746147216.724464:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096899180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311548416:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.724472:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096899880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9585:1830967311548544:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.724494:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990cd400/0x3139939425063996 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1228800->2097151] (req 1228800->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7e7 expref: 9 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.724506:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990cd400, rc 0) 00010000:00010000:3.0:1746147216.724679:0:9584:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x3139939425063862 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f71c expref: 19 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.724698:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9584:1830967311548160:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147216.724719:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a1fc00/0x313993942506398f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7e0 expref: 16 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.724727:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a1fc00/0x313993942506398f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7e0 expref: 16 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.724740:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a1fc00, rc 0) 00000100:00100000:1.0:1746147216.725118:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2000:x1830967310518912:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5128us (6832us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147216.725127:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20422 00000100:00100000:2.0:1746147216.725200:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:3005:x1830967310519168:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 4070us (4402us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.725206:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20424 00000100:00100000:3.0:1746147216.725418:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2000:x1830967310519040:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5299us (6615us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147216.725423:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20423 00000100:00100000:0.0:1746147216.726748:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.726987:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.727013:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.727025:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.727053:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.727113:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310519424 00000100:00100000:2.0:1746147216.727120:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310519424 00000100:00100000:0.0:1746147216.727330:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.727365:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310519296 00000100:00100000:3.0:1746147216.727368:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310519296 00010000:00010000:3.0:1746147216.727390:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x313993942506397a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7cb expref: 8 pid: 1853 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.727416:0:7227:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310519808 00000100:00100000:3.0:1746147216.727419:0:7227:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310519808 00010000:00010000:3.0:1746147216.727428:0:7227:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063981 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7d2 expref: 22 pid: 9585 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.727444:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9261 00000100:00100000:3.0:1746147216.727450:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310519296:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.727463:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.727480:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x313993942506397a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7cb expref: 8 pid: 1853 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.727489:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x313993942506397a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7cb expref: 8 pid: 1853 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.727622:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20425 00000100:00100000:2.0:1746147216.727630:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967310519424:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147216.727644:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.727658:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098887c00/0x313993942506399d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f7ee expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147216.727736:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9262 00000100:00100000:0.0:1746147216.727742:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967310519808:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147216.727750:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147216.727769:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310519552 00000100:00100000:1.0:1746147216.727773:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310519552 00000100:00100000:1.0:1746147216.727797:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310519680 00000100:00100000:1.0:1746147216.727799:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310519680 00000100:00100000:1.0:1746147216.727811:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310519936 00000100:00100000:1.0:1746147216.727812:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310519936 00000100:00100000:1.0:1746147216.727823:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20426 00000100:00100000:1.0:1746147216.727827:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310519552:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147216.727833:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147216.727840:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x31399394250639a4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f7f5 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147216.727880:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311548672:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147216.727941:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746147216.727963:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20427 00000100:00100000:1.0:1746147216.727968:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310519680:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147216.727978:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147216.727987:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x31399394250639ab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f7fc expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147216.728009:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311548800:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147216.728029:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8240 going to sleep for 11 seconds 00000100:00100000:1.0:1746147216.728045:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20428 00000100:00100000:1.0:1746147216.728050:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:3010:x1830967310519936:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147216.728056:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147216.728061:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x31399394250639b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f803 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.728075:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009822b000/0x313993942506385b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f715 expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.728082:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147216.728084:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147216.728102:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x31399394250639b2 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f803 expref: 10 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.728119:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009822b000/0x313993942506385b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f715 expref: 12 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.728128:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009822b000/0x313993942506385b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f715 expref: 12 pid: 1398 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746147216.728136:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311548928:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147216.728157:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8d80 going to sleep for 11 seconds 00010000:00010000:2.0:1746147216.728726:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.728736:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098887c00/0x313993942506399d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7ee expref: 25 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.728745:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098887c00/0x313993942506399d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7ee expref: 25 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.728759:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098887c00, rc 0) 00000100:00100000:2.0:1746147216.728792:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310519424:12345-192.168.204.25@tcp:101:cat.0 Request processed in 1163us (1805us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147216.728797:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20425 00010000:00010000:0.0:1746147216.728968:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063981 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7d2 expref: 23 pid: 9585 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.728977:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063981 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7d2 expref: 23 pid: 9585 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.728991:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063981 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7d2 expref: 23 pid: 9585 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.729012:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147216.729027:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967310519808:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1286us (1973us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147216.729033:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9262 00010000:00010000:3.0:1746147216.729106:0:7227:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32c00/0x313993942506397a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7cb expref: 10 pid: 1853 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.729113:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.729115:0:7227:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.729120:0:7227:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990cd400/0x3139939425063996 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7e7 expref: 9 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.729126:0:7227:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990cd400/0x3139939425063996 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7e7 expref: 9 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.729145:0:7227:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800990cd400/0x3139939425063996 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7e7 expref: 9 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.729151:0:7227:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311549056:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147216.729184:0:7227:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746147216.732375:0:1854:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff88009822b000/0x313993942506385b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f715 expref: 12 pid: 1398 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746147216.732410:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311548672:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147216.732421:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147216.732438:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x31399394250639a4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7f5 expref: 21 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746147216.732441:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310520064 00000100:00100000:0.0:1746147216.732446:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310520064 00010000:00010000:1.0:1746147216.732450:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c32200/0x31399394250639a4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7f5 expref: 21 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147216.732463:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32200, rc 0) 00010000:00010000:0.0:1746147216.732470:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009822b000/0x313993942506385b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f715 expref: 13 pid: 1398 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746147216.732503:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+20:2000:x1830967310519552:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4674us (5489us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147216.732511:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20426 00000100:00100000:1.0:1746147216.732566:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311548928:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147216.732580:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x31399394250639b2 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f803 expref: 9 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.732590:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c33e00, rc 0) 00000100:00100000:1.0:1746147216.732605:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:3010:x1830967310519936:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4555us (5275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.732610:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20428 00010000:00010000:2.0:1746147216.732678:0:12201:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x3139939425063862 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f71c expref: 19 pid: 1398 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147216.732697:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311548800:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147216.732713:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x31399394250639ab lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7fc expref: 31 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.732721:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32400/0x31399394250639ab lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7fc expref: 31 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147216.732731:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32400, rc 0) 00000100:00100000:2.0:1746147216.732749:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310519680:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4781us (5722us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147216.732758:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20427 00000100:00100000:0.0:1746147216.732812:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9263 00000100:00100000:0.0:1746147216.732820:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+13:2000:x1830967310520064:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147216.732832:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147216.732841:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009822b000/0x313993942506385b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f715 expref: 13 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.732851:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009822b000/0x313993942506385b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f715 expref: 13 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.732868:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009822b000/0x313993942506385b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f715 expref: 13 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746147216.732875:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147216.732877:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147216.732883:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x31399394250639b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f803 expref: 8 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.732889:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x31399394250639b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f803 expref: 8 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147216.732915:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x31399394250639b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f803 expref: 8 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147216.732926:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769da300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311549184:192.168.204.25@tcp:105: 00000100:00100000:0.0:1746147216.732967:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e300 going to sleep for 11 seconds 00000100:00100000:1.0:1746147216.733722:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.733776:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310520320 00000100:00100000:2.0:1746147216.733780:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310520320 00002000:00100000:2.0:1746147216.733807:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1228800->1232895) req@ffff8800947e7800 x1830967310520320/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.733816:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e7800 with x1830967310520320 ext(1228800->1232895) 00002000:00010000:2.0:1746147216.733820:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947e7800 00000100:00100000:2.0:1746147216.733832:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7474 00000100:00100000:2.0:1746147216.733836:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967310520320:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147216.734001:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967310520320:12345-192.168.204.25@tcp:3:cat.0 Request processed in 163us (279us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147216.734007:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7474 00002000:00100000:2.0:1746147216.734013:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1228800->1232895) req@ffff8800947e7800 x1830967310520320/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/4536 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.734020:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e7800 with x1830967310520320 ext(1228800->1232895) 00002000:00010000:2.0:1746147216.734022:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947e7800 00000100:00100000:3.0:1746147216.734238:0:7227:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7227:1830967311549056:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147216.734254:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147216.734276:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310519296:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6826us (7533us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.734283:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9261 00000100:00100000:0.0:1746147216.738148:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.738198:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.738335:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769da300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311549184:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147216.738358:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147216.738405:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+12:2000:x1830967310520064:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5581us (5979us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.738416:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9263 00000100:00100000:2.0:1746147216.738487:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310520448 00000100:00100000:2.0:1746147216.738495:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310520448 00000100:00100000:2.0:1746147216.738526:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20429 00000100:00100000:2.0:1746147216.738533:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+20:3011:x1830967310520448:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147216.738561:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.738580:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x31399394250639b9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f80a expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.738610:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.738612:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.738620:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x31399394250639b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f80a expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.738636:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x31399394250639b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f80a expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.738646:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098886a00, rc 0) 00000100:00100000:2.0:1746147216.738665:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:3011:x1830967310520448:12345-192.168.204.25@tcp:101:cat.0 Request processed in 133us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.738670:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20429 00000100:00100000:3.0:1746147216.741182:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310520704 00000100:00100000:3.0:1746147216.741197:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310520704 00002000:00100000:3.0:1746147216.741244:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff8800769da680 x1830967310520704/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147216.741254:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769da680 with x1830967310520704 ext(2097152->3145727) 00002000:00010000:3.0:1746147216.741260:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769da680 00000100:00100000:3.0:1746147216.741295:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7475 00000100:00100000:3.0:1746147216.741303:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2002:x1830967310520704:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147216.752194:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.752298:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310520960 00000100:00100000:1.0:1746147216.752309:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310520960 00002000:00100000:1.0:1746147216.752354:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff8800769db480 x1830967310520960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147216.752364:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769db480 with x1830967310520960 ext(2097152->3145727) 00002000:00010000:1.0:1746147216.752370:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769db480 00000100:00100000:1.0:1746147216.752402:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7476 00000100:00100000:1.0:1746147216.752410:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310520960:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147216.756106:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2002:x1830967310520704:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14774us (17876us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147216.756120:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7475 00002000:00100000:3.0:1746147216.756133:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff8800769da680 x1830967310520704/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147216.756142:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769da680 with x1830967310520704 ext(2097152->3145727) 00002000:00010000:3.0:1746147216.756148:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769da680 00000100:00100000:1.0:1746147216.762615:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310520960:12345-192.168.204.25@tcp:3:cat.0 Request processed in 10193us (10421us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147216.762629:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7476 00002000:00100000:1.0:1746147216.762641:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff8800769db480 x1830967310520960/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147216.762650:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769db480 with x1830967310520960 ext(2097152->3145727) 00002000:00010000:1.0:1746147216.762655:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769db480 00000100:00100000:0.0:1746147216.764668:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.766362:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.766380:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310521088 00000100:00100000:1.0:1746147216.766389:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310521088 00000100:00100000:1.0:1746147216.766516:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20430 00000100:00100000:1.0:1746147216.766525:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:3010:x1830967310521088:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147216.766554:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147216.766574:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x31399394250639c0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f811 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.766603:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x3139939425063862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f71c expref: 19 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.766611:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147216.766612:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147216.766616:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x31399394250639c0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f811 expref: 16 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.766646:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x3139939425063862 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f71c expref: 19 pid: 1398 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.766658:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x3139939425063862 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f71c expref: 19 pid: 1398 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746147216.766669:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311549312:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147216.766757:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147216.766937:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310521216 00000100:00100000:2.0:1746147216.766941:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310521216 00000100:00100000:2.0:1746147216.766963:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20431 00000100:00100000:2.0:1746147216.766968:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:3005:x1830967310521216:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147216.766975:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147216.766986:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098887600/0x31399394250639c7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f818 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.767000:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x31399394250639b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f803 expref: 9 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.767007:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x31399394250639b9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f80a expref: 20 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.767017:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.767018:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.767021:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098887600/0x31399394250639c7 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2138111] (req 2097152->2138111) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f818 expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.767037:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x31399394250639b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f80a expref: 20 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.767045:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x31399394250639b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f80a expref: 20 pid: 12201 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.767054:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096899880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311549440:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147216.767104:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x31399394250639b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f803 expref: 9 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.767112:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x31399394250639b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f803 expref: 9 pid: 9586 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.767120:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096899180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311549568:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147216.767152:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147216.776804:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311549312:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147216.776838:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x31399394250639c0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f811 expref: 16 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.776858:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49600, rc 0) 00000100:00100000:1.0:1746147216.776913:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:3010:x1830967310521088:12345-192.168.204.25@tcp:101:cat.0 Request processed in 10388us (12253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.776922:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20430 00000100:00100000:2.0:1746147216.777415:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.777441:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.777463:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.777486:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.777502:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310521344 00000100:00100000:2.0:1746147216.777507:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310521344 00010000:00010000:2.0:1746147216.777532:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x3139939425063862 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f71c expref: 20 pid: 1398 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.777558:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310521600 00000100:00100000:2.0:1746147216.777560:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310521600 00010000:00010000:2.0:1746147216.777572:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x31399394250639b2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f803 expref: 10 pid: 9586 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.777583:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310521728 00000100:00100000:2.0:1746147216.777585:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310521728 00010000:00010000:2.0:1746147216.777592:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x31399394250639b9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f80a expref: 21 pid: 12201 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.777603:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9264 00000100:00100000:2.0:1746147216.777609:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+20:2003:x1830967310521344:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147216.777621:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147216.777645:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x3139939425063862 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f71c expref: 20 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.777655:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x3139939425063862 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f71c expref: 20 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.777677:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009822a000/0x3139939425063862 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f71c expref: 20 pid: 1398 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.777692:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.777694:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.777701:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x31399394250639c0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f811 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.777709:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x31399394250639c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f811 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.777738:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x31399394250639c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f811 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147216.777750:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095127480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311549696:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147216.777803:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1c4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147216.777820:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9265 00000100:00100000:2.0:1746147216.777826:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2003:x1830967310521600:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147216.777834:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147216.777846:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x31399394250639b2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f803 expref: 10 pid: 9586 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.777854:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x31399394250639b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f803 expref: 10 pid: 9586 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.777867:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147216.777882:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2003:x1830967310521600:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 56us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.777887:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9265 00000100:00100000:2.0:1746147216.777898:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9266 00000100:00100000:2.0:1746147216.777903:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2000:x1830967310521728:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147216.777911:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147216.777916:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x31399394250639b9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f80a expref: 21 pid: 12201 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.777925:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x31399394250639b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f80a expref: 21 pid: 12201 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.777934:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.777936:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.777939:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098887600/0x31399394250639c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f818 expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.777946:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098887600/0x31399394250639c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x50080000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f818 expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.777962:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098887600/0x31399394250639c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f818 expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147216.777971:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095126680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311549824:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147216.777988:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147216.779651:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310521472 00000100:00100000:1.0:1746147216.779659:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310521472 00000100:00100000:1.0:1746147216.779692:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20432 00000100:00100000:1.0:1746147216.779699:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:3011:x1830967310521472:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147216.779714:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147216.779728:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x31399394250639ce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f81f expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.779746:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147216.779747:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147216.779752:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x31399394250639ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f81f expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.779763:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x31399394250639ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f81f expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147216.779772:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d49800, rc 0) 00000100:00100000:1.0:1746147216.779798:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:3011:x1830967310521472:12345-192.168.204.25@tcp:101:cat.0 Request processed in 100us (2384us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147216.779804:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20432 00010000:00010000:3.0:1746147216.780032:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098886a00/0x31399394250639b9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f80a expref: 21 pid: 12201 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.780048:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096899880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311549440:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.780067:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c33e00/0x31399394250639b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f803 expref: 9 pid: 9586 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.780074:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096899180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311549568:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.780113:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098887600/0x31399394250639c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f818 expref: 8 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.780120:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098887600, rc 0) 00000100:00100000:3.0:1746147216.780140:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:3005:x1830967310521216:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 13171us (13784us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.780145:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20431 00000100:00100000:3.0:1746147216.783321:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095126680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311549824:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147216.783349:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147216.784014:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+20:2000:x1830967310521728:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6107us (6523us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.784026:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9266 00000100:00100000:3.0:1746147216.784617:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.784689:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095127480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311549696:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147216.784703:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147216.784725:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+19:2003:x1830967310521344:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 7116us (7282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.784732:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9264 00000100:00100000:3.0:1746147216.785130:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.785221:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310521984 00000100:00100000:2.0:1746147216.785228:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310521984 00002000:00100000:2.0:1746147216.785265:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2134016->2138111) req@ffff88009514aa00 x1830967310521984/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.785275:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514aa00 with x1830967310521984 ext(2134016->2138111) 00002000:00010000:2.0:1746147216.785279:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514aa00 00000100:00100000:2.0:1746147216.785291:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310522240 00000100:00100000:2.0:1746147216.785293:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310522240 00002000:00100000:2.0:1746147216.785303:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3145727) req@ffff880095148700 x1830967310522240/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.785310:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095148700 with x1830967310522240 ext(2097152->3145727) 00002000:00010000:2.0:1746147216.785313:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095148700 00000100:00100000:2.0:1746147216.785321:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7477 00000100:00100000:2.0:1746147216.785327:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2003:x1830967310521984:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147216.785439:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2003:x1830967310521984:12345-192.168.204.25@tcp:3:cat.0 Request processed in 113us (824us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147216.785445:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7477 00002000:00100000:2.0:1746147216.785449:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2134016->2138111) req@ffff88009514aa00 x1830967310521984/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/4536 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.785455:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514aa00 with x1830967310521984 ext(2134016->2138111) 00002000:00010000:2.0:1746147216.785458:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514aa00 00000100:00100000:2.0:1746147216.785467:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7478 00000100:00100000:2.0:1746147216.785472:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967310522240:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147216.792162:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.793179:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310522496 00000100:00100000:2.0:1746147216.793189:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310522496 00000100:00100000:2.0:1746147216.793254:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6197 00000100:00100000:2.0:1746147216.793263:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:3005:x1830967310522496:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147216.793836:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:3005:x1830967310522496:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 573us (1683us total) trans 8589937450 rc 0/0 00000100:00100000:2.0:1746147216.793842:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6197 00000100:00100000:0.0:1746147216.799164:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.799224:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310522752 00000100:00100000:1.0:1746147216.799234:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310522752 00002000:00100000:1.0:1746147216.799280:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff8800769dad80 x1830967310522752/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147216.799290:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769dad80 with x1830967310522752 ext(2097152->4194303) 00002000:00010000:1.0:1746147216.799296:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769dad80 00000100:00100000:1.0:1746147216.799327:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7479 00000100:00100000:1.0:1746147216.799335:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310522752:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147216.800105:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2003:x1830967310522240:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14617us (14959us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147216.800114:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7478 00002000:00100000:2.0:1746147216.800120:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->3145727) req@ffff880095148700 x1830967310522240/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.800127:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095148700 with x1830967310522240 ext(2097152->3145727) 00002000:00010000:2.0:1746147216.800130:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095148700 00000100:00100000:0.0:1746147216.800264:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.800279:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310523008 00000100:00100000:0.0:1746147216.800282:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310523008 00002000:00100000:0.0:1746147216.800303:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800769da300 x1830967310523008/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147216.800309:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769da300 with x1830967310523008 ext(3145728->4194303) 00002000:00010000:0.0:1746147216.800312:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769da300 00000100:00100000:0.0:1746147216.800326:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7480 00000100:00100000:0.0:1746147216.800330:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310523008:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147216.808324:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.808439:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310523136 00000100:00100000:3.0:1746147216.808449:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310523136 00000100:00100000:3.0:1746147216.808504:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20433 00000100:00100000:3.0:1746147216.808511:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+20:3011:x1830967310523136:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147216.808530:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.808557:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x31399394250639d5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f826 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.808591:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098887600/0x31399394250639c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f818 expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.808597:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147216.808599:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147216.808602:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x31399394250639d5 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f826 expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.808634:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098887600/0x31399394250639c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f818 expref: 9 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.808645:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098887600/0x31399394250639c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f818 expref: 9 pid: 12201 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.808656:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311549952:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.811451:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147216.820286:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2000:x1830967310523008:12345-192.168.204.25@tcp:3:cat.0 Request processed in 19943us (20010us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147216.820299:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7480 00002000:00100000:2.0:1746147216.820311:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800769da300 x1830967310523008/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.820321:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769da300 with x1830967310523008 ext(3145728->4194303) 00010000:00010000:2.0:1746147216.820331:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098887600/0x31399394250639c7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f818 expref: 8 pid: 12201 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.820347:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098887600/0x31399394250639c7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f818 expref: 8 pid: 12201 timeout: 854 lvb_type: 0 00002000:00010000:2.0:1746147216.820355:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800769da300 00010000:00010000:0.0:1746147216.825128:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746147216.825765:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.826493:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311549952:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.826528:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x31399394250639d5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f826 expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.826555:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e261c00, rc 0) 00000100:00100000:3.0:1746147216.826607:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:3011:x1830967310523136:12345-192.168.204.25@tcp:101:cat.0 Request processed in 18094us (18292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.826616:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20433 00000100:00100000:2.0:1746147216.826929:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310523264 00000100:00100000:2.0:1746147216.826937:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310523264 00002000:00100000:2.0:1746147216.826973:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2138111) req@ffff8800947e4000 x1830967310523264/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.826982:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e4000 with x1830967310523264 ext(2097152->2138111) 00010000:00010000:2.0:1746147216.826989:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098887600/0x31399394250639c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f818 expref: 8 pid: 12201 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.827000:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098887600/0x31399394250639c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f818 expref: 8 pid: 12201 timeout: 854 lvb_type: 0 00002000:00010000:2.0:1746147216.827007:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947e4000 00000100:00100000:2.0:1746147216.827025:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1767 00000100:00100000:2.0:1746147216.827031:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2001:x1830967310523264:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:1.0:1746147216.830779:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.830956:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310523520 00000100:00100000:3.0:1746147216.830964:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310523520 00000100:00100000:3.0:1746147216.831009:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16542 00000100:00100000:3.0:1746147216.831017:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013682c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:3015:x1830967310523520:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147216.831039:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.831058:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250639dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f82d expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.831144:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x31399394250639e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.831157:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x31399394250639e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.831168:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x31399394250639e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.831178:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x31399394250639ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.831183:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x31399394250639ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.831188:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x31399394250639ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.831277:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x31399394250639f1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.831286:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x31399394250639f1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.831292:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x31399394250639f1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:3.0:1746147216.831304:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147216.831498:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x31399394250639e3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.831505:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x31399394250639e3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.831509:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x31399394250639e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.831514:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x31399394250639e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.831518:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f12d000 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147216.831521:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x31399394250639e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.831526:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x31399394250639e3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.831535:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147216.831544:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147216.831548:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x31399394250639e3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.831552:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x31399394250639e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.832048:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x31399394250639ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.832054:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x31399394250639ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.832062:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x31399394250639ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.832066:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f12da00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147216.832068:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x31399394250639ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.832072:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x31399394250639ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.832077:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094553f00) 00010000:00010000:3.0:1746147216.832079:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147216.832081:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x31399394250639ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.832084:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x31399394250639ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.832140:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12ca00/0x31399394250639dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f82d expref: 32 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.832151:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x31399394250639f1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f82d expref: 31 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.832157:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147216.832159:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147216.832161:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12d800, rc 0) 00000100:00100000:3.0:1746147216.832281:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013682c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:3015:x1830967310523520:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1263us (1512us total) trans 8589937451 rc 0/0 00000100:00100000:0.0:1746147216.832282:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2000:x1830967310522752:12345-192.168.204.25@tcp:3:cat.0 Request processed in 32947us (33307us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147216.832289:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16542 00000100:00100000:0.0:1746147216.832291:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7479 00002000:00100000:0.0:1746147216.832299:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff8800769dad80 x1830967310522752/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147216.832307:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769dad80 with x1830967310522752 ext(2097152->4194303) 00002000:00010000:0.0:1746147216.832311:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800769dad80 00000100:00100000:2.0:1746147216.832407:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310523264:12345-192.168.204.25@tcp:4:cat.0 Request processed in 5375us (6649us total) trans 21474842751 rc 0/0 00000100:00100000:2.0:1746147216.832413:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1767 00002000:00100000:2.0:1746147216.832418:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2138111) req@ffff8800947e4000 x1830967310523264/t21474842751(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/448 e 0 to 0 dl 1746147227 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.832424:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e4000 with x1830967310523264 ext(2097152->2138111) 00010000:00010000:2.0:1746147216.832431:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098887600/0x31399394250639c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f818 expref: 10 pid: 12201 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.832444:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098887600/0x31399394250639c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f818 expref: 10 pid: 12201 timeout: 854 lvb_type: 0 00002000:00010000:2.0:1746147216.832455:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800947e4000 00000100:00100000:0.0:1746147216.836732:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.836790:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.836946:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310523776 00000100:00100000:3.0:1746147216.836958:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310523776 00000100:00100000:2.0:1746147216.836996:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310523648 00000100:00100000:2.0:1746147216.837000:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310523648 00010000:00010000:2.0:1746147216.837028:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098887600/0x31399394250639c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f818 expref: 11 pid: 12201 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.837059:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9267 00000100:00100000:2.0:1746147216.837066:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2003:x1830967310523648:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147216.837079:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746147216.837123:0:4349:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147215 -> 1746147216 00010000:00010000:2.0:1746147216.837130:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098887600/0x31399394250639c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f818 expref: 11 pid: 12201 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.837141:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098887600/0x31399394250639c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f818 expref: 11 pid: 12201 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.837164:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098887600/0x31399394250639c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f818 expref: 11 pid: 12201 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.837217:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.837219:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.837226:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x31399394250639d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f826 expref: 20 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.837234:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x31399394250639d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f826 expref: 20 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.837269:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x31399394250639d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f826 expref: 20 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147216.837281:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095127480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311550080:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147216.837398:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20434 00000100:00100000:2.0:1746147216.837402:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1500c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147216.837404:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:3010:x1830967310523776:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147216.837416:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.837436:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x31399394250639ff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f834 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.837696:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.837698:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746147216.837701:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147216.837703:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x31399394250639ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f834 expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.837714:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x31399394250639ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f834 expref: 11 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.837722:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12d200, rc 0) 00000100:00100000:3.0:1746147216.837747:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:3010:x1830967310523776:12345-192.168.204.25@tcp:101:cat.0 Request processed in 344us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.837753:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20434 00000100:00100000:3.0:1746147216.837767:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310523904 00000100:00100000:3.0:1746147216.837770:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310523904 00000100:00100000:3.0:1746147216.837783:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20435 00000100:00100000:3.0:1746147216.837787:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:3015:x1830967310523904:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147216.837793:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.837800:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425063a06 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f83b expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.837817:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x31399394250638e7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f754 expref: 10 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.837824:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009504e600/0x313993942506391f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f770 expref: 22 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.837829:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.837830:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.837833:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425063a06 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [245760->331775] (req 245760->331775) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f83b expref: 22 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.837850:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009504e600/0x313993942506391f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f770 expref: 22 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.837934:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009504e600/0x313993942506391f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f770 expref: 22 pid: 9585 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746147216.837943:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095149880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311550208:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.837986:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x31399394250638e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f754 expref: 10 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.837994:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x31399394250638e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f754 expref: 10 pid: 12201 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.838002:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311550336:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.838024:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147216.841325:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095127480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:4349:1830967311550080:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147216.841377:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147216.841427:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2003:x1830967310523648:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 4360us (4706us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.841438:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9267 00000100:00100000:0.0:1746147216.843272:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.843719:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310524160 00000100:00100000:2.0:1746147216.843726:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310524160 00002000:00100000:2.0:1746147216.843771:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8801312ed500 x1830967310524160/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.843781:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ed500 with x1830967310524160 ext(3145728->4194303) 00002000:00010000:2.0:1746147216.843786:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312ed500 00000100:00100000:2.0:1746147216.843819:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7481 00000100:00100000:2.0:1746147216.843825:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310524160:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147216.844318:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095149880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311550208:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.844329:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311550336:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.844360:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425063a06 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [245760->331775] (req 245760->331775) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f83b expref: 22 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.844985:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12cc00, rc 0) 00000100:00100000:3.0:1746147216.845041:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:3015:x1830967310523904:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 7251us (7338us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.845049:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20435 00000100:00100000:0.0:1746147216.845348:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.845813:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310524288 00000100:00100000:3.0:1746147216.845822:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310524288 00010000:00010000:3.0:1746147216.845849:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x31399394250638e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f754 expref: 12 pid: 12201 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.845870:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9268 00000100:00100000:3.0:1746147216.845876:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967310524288:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.845887:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.845906:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x31399394250638e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f754 expref: 12 pid: 12201 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.845915:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x31399394250638e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f754 expref: 12 pid: 12201 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.845937:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092543a00/0x31399394250638e7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f754 expref: 12 pid: 12201 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.845968:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147216.845988:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2000:x1830967310524288:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 113us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.845993:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9268 00000100:00100000:0.0:1746147216.849645:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.849684:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.849703:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.849725:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310524672 00000100:00100000:0.0:1746147216.849733:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310524672 00002000:00100000:0.0:1746147216.849775:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800909fa680 x1830967310524672/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147216.849784:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fa680 with x1830967310524672 ext(3145728->4194303) 00002000:00010000:0.0:1746147216.849789:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909fa680 00000100:00100000:0.0:1746147216.849814:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310524928 00000100:00100000:0.0:1746147216.849816:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310524928 00002000:00100000:0.0:1746147216.849828:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff8800909f9180 x1830967310524928/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147216.849833:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f9180 with x1830967310524928 ext(3145728->4194303) 00002000:00010000:0.0:1746147216.849837:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909f9180 00000100:00100000:0.0:1746147216.849848:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7482 00000100:00100000:0.0:1746147216.849854:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967310524672:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147216.851039:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310524416 00000100:00100000:2.0:1746147216.851046:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310524416 00010000:00010000:2.0:1746147216.851078:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009504e600/0x313993942506391f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f770 expref: 24 pid: 9585 timeout: 854 lvb_type: 1 00000100:00100000:2.0:1746147216.851125:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9269 00000100:00100000:2.0:1746147216.851132:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310524416:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147216.851142:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147216.851161:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009504e600/0x313993942506391f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f770 expref: 24 pid: 9585 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746147216.851174:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009504e600/0x313993942506391f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f770 expref: 24 pid: 9585 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746147216.851197:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009504e600/0x313993942506391f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f770 expref: 24 pid: 9585 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746147216.851216:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.851219:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147216.851227:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425063a06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->331775) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f83b expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.851235:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425063a06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->331775) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f83b expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147216.851269:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425063a06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->331775) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f83b expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147216.851281:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095127480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311550464:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147216.851350:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1500c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147216.851451:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7483 00000100:00100000:1.0:1746147216.851461:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967310524928:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147216.854882:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310524160:12345-192.168.204.25@tcp:3:cat.0 Request processed in 11043us (11604us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147216.854895:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7481 00002000:00100000:2.0:1746147216.854908:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8801312ed500 x1830967310524160/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.854918:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312ed500 with x1830967310524160 ext(3145728->4194303) 00002000:00010000:2.0:1746147216.854923:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312ed500 00000100:00100000:2.0:1746147216.856258:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095127480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311550464:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147216.856280:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147216.856432:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967310524416:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5297us (6795us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.856440:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9269 00000100:00100000:0.0:1746147216.857363:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.857412:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310525184 00000100:00100000:2.0:1746147216.857418:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310525184 00002000:00100000:2.0:1746147216.857452:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x93:0x0] (245760->249855) req@ffff8800909fb800 x1830967310525184/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.857461:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fb800 with x1830967310525184 ext(245760->249855) 00002000:00010000:2.0:1746147216.857465:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909fb800 00000100:00100000:2.0:1746147216.857485:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7484 00000100:00100000:2.0:1746147216.857492:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967310525184:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147216.857613:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967310525184:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 121us (252us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147216.857618:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7484 00002000:00100000:2.0:1746147216.857623:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x93:0x0] (245760->249855) req@ffff8800909fb800 x1830967310525184/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/4536 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.857630:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fb800 with x1830967310525184 ext(245760->249855) 00002000:00010000:2.0:1746147216.857632:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909fb800 00000100:00100000:2.0:1746147216.861377:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310524672:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 11511us (11680us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147216.861390:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7482 00002000:00100000:2.0:1746147216.861402:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800909fa680 x1830967310524672/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.861411:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fa680 with x1830967310524672 ext(3145728->4194303) 00002000:00010000:2.0:1746147216.861416:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909fa680 00000100:00100000:0.0:1746147216.862618:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.862769:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310525312 00000100:00100000:3.0:1746147216.862778:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310525312 00000100:00100000:3.0:1746147216.862876:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20436 00000100:00100000:3.0:1746147216.862884:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310525312:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147216.862903:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.862922:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f12ca00/0x3139939425063a0d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f842 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.862975:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311550592:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147216.863050:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147216.863266:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967310524928:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 11805us (13559us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147216.863275:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7483 00002000:00100000:1.0:1746147216.863283:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (3145728->4194303) req@ffff8800909f9180 x1830967310524928/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147216.863292:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f9180 with x1830967310524928 ext(3145728->4194303) 00002000:00010000:1.0:1746147216.863296:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800909f9180 00002000:00010000:3.0:1746147216.865056:0:12201:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime: 1746147215 -> 1746147216 00000100:00100000:0.0:1746147216.865061:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.865079:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311550592:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147216.865140:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f12ca00/0x3139939425063a0d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f842 expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.865153:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f12ca00/0x3139939425063a0d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f842 expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.865169:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12ca00, rc 0) 00000100:00100000:3.0:1746147216.865264:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310525312:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2380us (2650us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147216.865274:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20436 00000100:00100000:1.0:1746147216.865352:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310525568 00000100:00100000:1.0:1746147216.865359:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310525568 00002000:00100000:1.0:1746147216.865404:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x93:0x0] (327680->331775) req@ffff8800909fad80 x1830967310525568/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147216.865413:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fad80 with x1830967310525568 ext(327680->331775) 00002000:00010000:1.0:1746147216.865417:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909fad80 00000100:00100000:1.0:1746147216.865656:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7485 00000100:00100000:1.0:1746147216.865666:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310525568:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147216.866024:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310525568:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 361us (971us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147216.866035:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7485 00002000:00100000:1.0:1746147216.866041:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x93:0x0] (327680->331775) req@ffff8800909fad80 x1830967310525568/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/4536 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147216.866049:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fad80 with x1830967310525568 ext(327680->331775) 00002000:00010000:1.0:1746147216.866051:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909fad80 00000100:00100000:0.0:1746147216.869318:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.869388:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310525824 00000100:00100000:1.0:1746147216.869398:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310525824 00002000:00100000:1.0:1746147216.869823:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff8800909f9880 x1830967310525824/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147216.869832:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f9880 with x1830967310525824 ext(4194304->4890623) 00002000:00010000:1.0:1746147216.869837:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909f9880 00000100:00100000:1.0:1746147216.869915:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7486 00000100:00100000:1.0:1746147216.869924:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2002:x1830967310525824:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147216.870751:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.870831:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.870878:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310526208 00000100:00100000:2.0:1746147216.870883:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310526208 00000100:00100000:2.0:1746147216.870914:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6198 00000100:00100000:2.0:1746147216.870920:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:3015:x1830967310526208:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:3.0:1746147216.871027:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310525952 00000100:00100000:3.0:1746147216.871031:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310525952 00000100:00100000:3.0:1746147216.871055:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20437 00000100:00100000:3.0:1746147216.871060:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310525952:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147216.871070:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.871103:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425063a14 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f849 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.871175:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311550720:192.168.204.25@tcp:106: 00000100:00100000:2.0:1746147216.871218:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:3015:x1830967310526208:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 297us (386us total) trans 8589937452 rc 0/0 00000100:00100000:2.0:1746147216.871224:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6198 00000100:00100000:3.0:1746147216.871230:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147216.875343:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2002:x1830967310525824:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5410us (6023us total) trans 0 rc 696320/696320 00000100:00100000:1.0:1746147216.875356:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7486 00002000:00100000:1.0:1746147216.875368:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff8800909f9880 x1830967310525824/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147216.875377:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909f9880 with x1830967310525824 ext(4194304->4890623) 00002000:00010000:1.0:1746147216.875383:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909f9880 00002000:00010000:3.0:1746147216.876850:0:12201:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746147215 -> 1746147216 00000100:00100000:3.0:1746147216.876871:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311550720:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147216.876906:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425063a14 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f849 expref: 22 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.876920:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f12c400/0x3139939425063a14 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f849 expref: 22 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.876933:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12c400, rc 0) 00000100:00100000:3.0:1746147216.876963:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310525952:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5902us (6211us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147216.876970:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20437 00000100:00100000:0.0:1746147216.879648:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.879738:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310526336 00000100:00100000:3.0:1746147216.879746:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310526336 00000100:00100000:3.0:1746147216.880010:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20438 00000100:00100000:3.0:1746147216.880018:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967310526336:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147216.880036:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.880055:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425063a1b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f850 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.880321:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311550848:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147216.880801:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147216.882000:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.882130:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310526592 00000100:00100000:1.0:1746147216.882137:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310526592 00002000:00100000:1.0:1746147216.882171:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff8800909fb100 x1830967310526592/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147216.882186:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fb100 with x1830967310526592 ext(4194304->4890623) 00002000:00010000:1.0:1746147216.882191:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909fb100 00000100:00100000:1.0:1746147216.882219:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7487 00000100:00100000:1.0:1746147216.882227:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2003:x1830967310526592:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147216.882419:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311550848:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147216.882445:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425063a1b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f850 expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.882456:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38ce00/0x3139939425063a1b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f850 expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.882465:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38ce00, rc 0) 00000100:00100000:3.0:1746147216.882505:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967310526336:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2488us (2868us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147216.882511:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20438 00000100:00100000:0.0:1746147216.885872:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.886946:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310526720 00000100:00100000:3.0:1746147216.886957:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310526720 00000100:00100000:3.0:1746147216.887016:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20439 00000100:00100000:3.0:1746147216.887024:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310526720:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147216.887042:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.887060:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x3139939425063a22 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f857 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.887205:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311550976:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147216.887416:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147216.887692:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2003:x1830967310526592:12345-192.168.204.25@tcp:3:cat.0 Request processed in 5464us (5693us total) trans 0 rc 696320/696320 00000100:00100000:1.0:1746147216.887705:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7487 00002000:00100000:1.0:1746147216.887716:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff8800909fb100 x1830967310526592/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:592/0 lens 488/440 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147216.887726:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800909fb100 with x1830967310526592 ext(4194304->4890623) 00002000:00010000:1.0:1746147216.887735:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800909fb100 00000100:00100000:3.0:1746147216.889067:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311550976:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147216.889133:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x3139939425063a22 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f857 expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.889148:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c800/0x3139939425063a22 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f857 expref: 10 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.889158:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38c800, rc 0) 00000100:00100000:3.0:1746147216.889193:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2001:x1830967310526720:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2168us (3331us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147216.889200:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20439 00000100:00100000:0.0:1746147216.890637:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.890793:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310526848 00000100:00100000:3.0:1746147216.890800:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310526848 00000100:00100000:3.0:1746147216.890915:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20440 00000100:00100000:3.0:1746147216.890923:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2002:x1830967310526848:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147216.890938:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.890957:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425063a29 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f85e expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.891008:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311551104:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147216.891678:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147216.893163:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311551104:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147216.893201:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425063a29 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f85e expref: 22 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.893216:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38c200/0x3139939425063a29 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f85e expref: 22 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.893228:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38c200, rc 0) 00000100:00100000:3.0:1746147216.893286:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2002:x1830967310526848:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2359us (2653us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147216.893295:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20440 00000100:00100000:0.0:1746147216.895743:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.895838:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310527104 00000100:00100000:0.0:1746147216.895840:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147216.895846:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310527104 00000100:00100000:1.0:1746147216.895904:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6199 00000100:00100000:1.0:1746147216.895912:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f8a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:3010:x1830967310527104:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:3.0:1746147216.895964:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310527232 00000100:00100000:3.0:1746147216.895969:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310527232 00000100:00100000:3.0:1746147216.895995:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20441 00000100:00100000:3.0:1746147216.896000:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2000:x1830967310527232:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147216.896012:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.896040:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425063a30 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f865 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.896117:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311551232:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147216.896152:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f8a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:3010:x1830967310527104:12345-192.168.204.25@tcp:35:cat.0 Request processed in 241us (416us total) trans 8589937453 rc 0/0 00000100:00100000:1.0:1746147216.896159:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6199 00000100:00100000:3.0:1746147216.896173:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147216.901331:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311551232:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147216.901372:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425063a30 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f865 expref: 22 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.901387:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d800/0x3139939425063a30 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f865 expref: 22 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147216.902842:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38d800, rc 0) 00000100:00100000:3.0:1746147216.902920:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2000:x1830967310527232:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6915us (7074us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147216.902929:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20441 00000100:00100000:0.0:1746147216.910160:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.910475:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310527488 00000100:00100000:2.0:1746147216.910485:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310527488 00000100:00100000:2.0:1746147216.910543:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6200 00000100:00100000:2.0:1746147216.910551:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+32:3011:x1830967310527488:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147216.912334:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:3011:x1830967310527488:12345-192.168.204.25@tcp:35:cat.0 Request processed in 1776us (2178us total) trans 8589937454 rc 0/0 00000100:00100000:2.0:1746147216.912344:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6200 00000100:00100000:0.0:1746147216.926709:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.927001:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310527744 00000100:00100000:3.0:1746147216.927010:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310527744 00000100:00100000:3.0:1746147216.927180:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16543 00000100:00100000:3.0:1746147216.927189:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:3020:x1830967310527744:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147216.927297:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.927318:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38de00/0x3139939425063a37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f86c expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.927398:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425063a3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927412:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425063a3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927423:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425063a3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927437:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927443:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927447:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927570:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425063a4c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927580:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425063a4c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927585:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425063a4c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:3.0:1746147216.927592:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147216.927665:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425063a3e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927671:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425063a3e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927678:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425063a3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927684:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425063a3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927689:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38c800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147216.927692:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425063a3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927698:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425063a3e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927709:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147216.927712:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147216.927716:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425063a3e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927725:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38c800/0x3139939425063a3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927751:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927757:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a45 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927761:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927765:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f38ce00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147216.927768:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927772:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927778:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094553e00) 00010000:00010000:3.0:1746147216.927780:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147216.927783:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a45 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927787:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147216.927823:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38de00/0x3139939425063a37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f86c expref: 13 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.927836:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425063a4c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f86c expref: 12 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.927846:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147216.927848:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147216.927850:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38d800, rc 0) 00000100:00100000:3.0:1746147216.927893:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:3020:x1830967310527744:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 705us (1194us total) trans 8589937455 rc 0/0 00000100:00100000:3.0:1746147216.927899:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16543 00000100:00100000:0.0:1746147216.937761:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.937883:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310527872 00000100:00100000:3.0:1746147216.937893:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310527872 00000100:00100000:3.0:1746147216.937949:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20442 00000100:00100000:3.0:1746147216.937958:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:3020:x1830967310527872:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147216.937977:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147216.937998:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425063a5a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f873 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.938026:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x31399394250639c0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f811 expref: 17 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.938034:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x31399394250639ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f81f expref: 30 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.938039:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.938040:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.938043:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425063a5a lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2883584->3145727] (req 2883584->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f873 expref: 17 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.938075:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x31399394250639ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f81f expref: 30 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.938112:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x31399394250639ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f81f expref: 30 pid: 9586 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.938126:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311551360:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.938814:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x31399394250639c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f811 expref: 17 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.938822:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x31399394250639c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f811 expref: 17 pid: 9586 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.938830:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095149880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311551488:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.939506:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147216.940112:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311551360:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147216.943153:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095149880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12201:1830967311551488:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147216.943193:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425063a5a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [2883584->3145727] (req 2883584->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f873 expref: 17 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.943211:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38de00, rc 0) 00000100:00100000:3.0:1746147216.943271:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:3020:x1830967310527872:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 5313us (5520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.943281:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20442 00000100:00100000:0.0:1746147216.943432:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.943995:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310528000 00000100:00100000:2.0:1746147216.944002:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310528000 00010000:00010000:2.0:1746147216.944030:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x31399394250639ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f81f expref: 31 pid: 9586 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746147216.944068:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9270 00000100:00100000:2.0:1746147216.944074:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967310528000:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147216.944115:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147216.944135:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x31399394250639ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f81f expref: 31 pid: 9586 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.944145:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x31399394250639ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f81f expref: 31 pid: 9586 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.944166:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d49800/0x31399394250639ce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f81f expref: 31 pid: 9586 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746147216.944179:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147216.944197:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310528000:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 124us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147216.944203:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9270 00000100:00100000:0.0:1746147216.944466:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147216.944479:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310528128 00000100:00100000:3.0:1746147216.944482:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310528128 00010000:00010000:3.0:1746147216.944582:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x31399394250639c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f811 expref: 17 pid: 9586 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746147216.944597:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9271 00000100:00100000:3.0:1746147216.944602:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2002:x1830967310528128:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147216.944608:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147216.944616:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x31399394250639c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f811 expref: 17 pid: 9586 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.944624:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x31399394250639c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f811 expref: 17 pid: 9586 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.944635:0:4349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d49600/0x31399394250639c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f811 expref: 17 pid: 9586 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746147216.945043:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.945046:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147216.945054:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425063a5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f873 expref: 16 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.945063:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425063a5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f873 expref: 16 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147216.945114:0:4349:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425063a5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f873 expref: 16 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147216.945127:0:4349:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095149880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311551616:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147216.945695:0:4349:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a897a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147216.946250:0:4349:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095149880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:4349:1830967311551616:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147216.946264:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147216.946288:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967310528128:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1685us (1822us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147216.946296:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9271 00000100:00100000:1.0:1746147216.948125:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.948204:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310528384 00000100:00100000:2.0:1746147216.948212:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310528384 00002000:00100000:2.0:1746147216.948256:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (2883584->2887679) req@ffff8800947e4700 x1830967310528384/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.948267:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e4700 with x1830967310528384 ext(2883584->2887679) 00002000:00010000:2.0:1746147216.948273:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947e4700 00000100:00100000:2.0:1746147216.948435:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7488 00000100:00100000:2.0:1746147216.948443:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967310528384:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147216.948838:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2001:x1830967310528384:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 394us (721us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147216.948844:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7488 00002000:00100000:2.0:1746147216.948851:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (2883584->2887679) req@ffff8800947e4700 x1830967310528384/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/4536 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147216.948858:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e4700 with x1830967310528384 ext(2883584->2887679) 00002000:00010000:2.0:1746147216.948862:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800947e4700 00000100:00100000:2.0:1746147216.955153:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147216.955196:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310528640 00000100:00100000:0.0:1746147216.955206:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310528640 00002000:00100000:0.0:1746147216.955255:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (3141632->3145727) req@ffff880095127480 x1830967310528640/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/0 e 0 to 0 dl 1746147227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147216.955265:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095127480 with x1830967310528640 ext(3141632->3145727) 00002000:00010000:0.0:1746147216.955271:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095127480 00000100:00100000:0.0:1746147216.955308:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7489 00000100:00100000:0.0:1746147216.955316:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2003:x1830967310528640:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147216.955485:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2003:x1830967310528640:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 170us (343us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746147216.955492:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7489 00002000:00100000:0.0:1746147216.955497:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (3141632->3145727) req@ffff880095127480 x1830967310528640/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:592/0 lens 488/4536 e 0 to 0 dl 1746147227 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147216.955503:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095127480 with x1830967310528640 ext(3141632->3145727) 00002000:00010000:0.0:1746147216.955506:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095127480 00000100:00100000:0.0:1746147216.957931:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147216.958048:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310528896 00000100:00100000:2.0:1746147216.958057:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310528896 00000100:00100000:2.0:1746147216.958148:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6201 00000100:00100000:2.0:1746147216.958156:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:3020:x1830967310528896:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:2.0:1746147216.958370:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:3020:x1830967310528896:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 214us (448us total) trans 8589937456 rc 0/0 00000100:00100000:2.0:1746147216.958377:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6201 00000100:00100000:0.0:1746147217.047608:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.047707:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310529152 00000100:00100000:3.0:1746147217.047717:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310529152 00000100:00100000:3.0:1746147217.047777:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16544 00000100:00100000:3.0:1746147217.047785:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+33:3025:x1830967310529152:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147217.047807:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147217.047826:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x3139939425063a61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f87a expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.047925:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x3139939425063a68 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147217.047939:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x3139939425063a68 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147217.047956:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x3139939425063a68 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:3.0:1746147217.047966:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000100:00080000:1.0:1746147217.050262:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746147217.050411:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12da00/0x3139939425063a61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f87a expref: 36 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.050453:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x3139939425063a68 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f87a expref: 35 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.050467:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147217.050469:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746147217.050473:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f12d000, rc 0) 00000100:00100000:3.0:1746147217.050530:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:3025:x1830967310529152:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2745us (2932us total) trans 8589937457 rc 0/0 00000100:00100000:3.0:1746147217.050552:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16544 00000100:00100000:0.0:1746147217.056168:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147217.056225:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.056312:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310529280 00000100:00100000:3.0:1746147217.056321:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310529280 00000100:00100000:3.0:1746147217.056362:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310529408 00000100:00100000:3.0:1746147217.056364:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310529408 00000100:00100000:3.0:1746147217.056382:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20443 00000100:00100000:3.0:1746147217.056390:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310529280:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147217.056409:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147217.056429:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x3139939425063a76 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f881 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147217.056485:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095149880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311551744:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147217.056507:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20444 00000100:00100000:1.0:1746147217.056516:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310529408:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147217.056529:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147217.056548:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x3139939425063a7d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f888 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147217.056577:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311551872:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147217.058749:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1500c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147217.059383:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c83c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746147217.064323:0:1854:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime: 1746147215 -> 1746147216 00000100:00100000:1.0:1746147217.064353:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311551872:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147217.064385:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x3139939425063a7d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f888 expref: 31 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147217.064398:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c32000/0x3139939425063a7d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f888 expref: 31 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746147217.064505:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095149880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311551744:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147217.064521:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x3139939425063a76 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f881 expref: 22 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147217.064530:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f38d200/0x3139939425063a76 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f881 expref: 22 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147217.064554:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38d200, rc 0) 00000100:00100000:3.0:1746147217.064598:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310529280:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8209us (8441us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147217.064607:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20443 00010000:00010000:1.0:1746147217.065033:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c32000, rc 0) 00000100:00100000:1.0:1746147217.065429:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310529408:12345-192.168.204.25@tcp:101:cat.0 Request processed in 8912us (9201us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147217.065435:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20444 00000100:00100000:0.0:1746147217.074531:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147217.074739:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310529664 00000100:00100000:2.0:1746147217.074749:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310529664 00002000:00100000:2.0:1746147217.074794:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880096cfbb80 x1830967310529664/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 504/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147217.074805:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfbb80 with x1830967310529664 ext(0->1048575) 00002000:00010000:2.0:1746147217.074812:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cfbb80 00000100:00100000:2.0:1746147217.074831:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7490 00000100:00100000:2.0:1746147217.074837:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310529664:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147217.087450:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310529664:12345-192.168.204.25@tcp:3:cat.0 Request processed in 12600us (12916us total) trans 0 rc 962560/962560 00000100:00100000:2.0:1746147217.087465:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7490 00002000:00100000:2.0:1746147217.087477:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff880096cfbb80 x1830967310529664/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 504/440 e 0 to 0 dl 1746147228 ref 1 fl Complete:/200/0 rc 962560/962560 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147217.087487:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfbb80 with x1830967310529664 ext(0->1048575) 00002000:00010000:2.0:1746147217.087493:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096cfbb80 00000100:00100000:0.0:1746147217.102178:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.102246:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310529920 00000100:00100000:3.0:1746147217.102259:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310529920 00000100:00100000:3.0:1746147217.102307:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16545 00000100:00100000:3.0:1746147217.102315:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:3027:x1830967310529920:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147217.102339:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147217.102360:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x3139939425063a84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f88f expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.102461:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147217.102475:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f74d expref: 36 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.102482:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x31399394250639f1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f82d expref: 36 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.102489:0:7237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425063a4c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f86c expref: 12 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.102496:0:7237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 6/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147217.102525:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425063a4c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f86c expref: 12 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.102550:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425063a4c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f86c expref: 12 pid: 7237 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746147217.102562:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095149880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311552000:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147217.102664:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x31399394250639f1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f82d expref: 36 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.102672:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x31399394250639f1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f82d expref: 36 pid: 7237 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746147217.102680:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311552128:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147217.102704:0:7237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f74d expref: 36 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.102710:0:7237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f74d expref: 36 pid: 7237 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746147217.102717:0:7237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311552256:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147217.102731:0:7237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa1503c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147217.108831:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147217.108921:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147217.108948:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147217.108980:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147217.109021:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310530432 00000100:00100000:0.0:1746147217.109028:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310530432 00000100:00100000:0.0:1746147217.109069:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20445 00000100:00100000:0.0:1746147217.109078:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:3025:x1830967310530432:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147217.109121:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147217.109141:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063a92 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f896 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147217.109169:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990cd400/0x3139939425063996 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7e7 expref: 8 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147217.109176:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147217.109178:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746147217.109181:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063a92 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f896 expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147217.109212:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800990cd400/0x3139939425063996 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7e7 expref: 8 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147217.109223:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800990cd400/0x3139939425063996 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7e7 expref: 8 pid: 9585 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746147217.109241:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311552384:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147217.109318:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147217.109404:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310530048 00000100:00100000:0.0:1746147217.109407:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310530048 00010000:00010000:0.0:1746147217.109425:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425063a4c lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f86c expref: 13 pid: 7237 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746147217.109441:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310530304 00000100:00100000:0.0:1746147217.109443:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310530304 00010000:00010000:0.0:1746147217.109452:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f74d expref: 37 pid: 7237 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746147217.109462:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310530176 00000100:00100000:0.0:1746147217.109464:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310530176 00010000:00010000:0.0:1746147217.109470:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x31399394250639f1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f82d expref: 38 pid: 7237 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746147217.111207:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9272 00000100:00100000:3.0:1746147217.111222:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2003:x1830967310530048:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147217.111241:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147217.111251:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425063a4c lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f86c expref: 13 pid: 7237 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746147217.111268:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425063a4c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f86c expref: 13 pid: 7237 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746147217.111290:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147217.111295:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147217.111303:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147217.111308:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147217.111312:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9273 00000100:00100000:0.0:1746147217.111322:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967310530304:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147217.111331:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147217.111353:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2003:x1830967310530048:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 136us (2531us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147217.111360:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9272 00000100:00100000:3.0:1746147217.111423:0:7227:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9274 00000100:00100000:3.0:1746147217.111429:0:7227:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967310530176:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147217.111436:0:7227:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147217.111439:0:7227:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x31399394250639f1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f82d expref: 38 pid: 7237 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746147217.111446:0:7227:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x31399394250639f1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f82d expref: 38 pid: 7237 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746147217.111456:0:7227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147217.111459:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147217.111463:0:7227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147217.111468:0:7227:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147217.111481:0:7227:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2003:x1830967310530176:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 53us (2533us total) trans 0 rc 0/0 00010000:00010000:2.0:1746147217.111481:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d800/0x3139939425063a4c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f86c expref: 12 pid: 7237 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746147217.111486:0:7227:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9274 00000100:00100000:2.0:1746147217.111500:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095149880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311552000:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147217.111513:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d800/0x31399394250639f1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f82d expref: 37 pid: 7237 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746147217.111521:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311552128:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147217.111530:0:7237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7237:1830967311552256:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147217.111561:0:7237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147217.111599:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f74d expref: 38 pid: 7237 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746147217.111609:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f74d expref: 36 pid: 7237 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746147217.111620:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093730c00/0x3139939425063903 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f74d expref: 36 pid: 7237 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746147217.111634:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147217.111637:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147217.111644:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147217.111650:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147217.111894:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147217.111944:0:7237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:3.0:1746147217.111950:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:3.0:1746147217.111971:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147217.112119:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38d200/0x3139939425063a84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f88f expref: 37 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.112136:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f88f expref: 36 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.112143:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147217.112145:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147217.112147:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f38ce00, rc 0) 00000100:00100000:3.0:1746147217.112173:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:3027:x1830967310529920:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 9859us (10009us total) trans 8589937458 rc 0/0 00000100:00100000:3.0:1746147217.112179:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16545 00000100:00100000:1.0:1746147217.112326:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:2003:x1830967310530304:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1006us (3404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147217.112333:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9273 00000100:00100000:0.0:1746147217.114046:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147217.114163:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311552384:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147217.114195:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063a92 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f896 expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.114211:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990cc600, rc 0) 00000100:00100000:2.0:1746147217.114258:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:3025:x1830967310530432:12345-192.168.204.25@tcp:101:cat.0 Request processed in 5180us (5275us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147217.114269:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20445 00000100:00100000:3.0:1746147217.114375:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310530560 00000100:00100000:3.0:1746147217.114381:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310530560 00002000:00100000:3.0:1746147217.114418:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1228800->2097151) req@ffff880096cfa300 x1830967310530560/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147217.114428:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfa300 with x1830967310530560 ext(1228800->2097151) 00010000:00010000:3.0:1746147217.114435:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800990cd400/0x3139939425063996 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7e7 expref: 9 pid: 9585 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746147217.114446:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800990cd400/0x3139939425063996 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7e7 expref: 9 pid: 9585 timeout: 855 lvb_type: 0 00002000:00010000:3.0:1746147217.114453:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096cfa300 00000100:00100000:3.0:1746147217.114554:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1768 00000100:00100000:3.0:1746147217.114561:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2002:x1830967310530560:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147217.115869:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147217.118545:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310530688 00000100:00100000:2.0:1746147217.118560:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310530688 00000100:00100000:2.0:1746147217.118612:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20446 00000100:00100000:2.0:1746147217.118621:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:3027:x1830967310530688:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147217.118638:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147217.118657:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f89d expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.118687:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x31399394250639d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f826 expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.118695:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x31399394250639ff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f834 expref: 10 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.118702:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147217.118704:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147217.118707:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3284992->3313663] (req 3284992->3313663) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.118740:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x31399394250639ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f834 expref: 10 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.118751:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x31399394250639ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f834 expref: 10 pid: 12201 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746147217.118764:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095127b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311552512:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147217.118867:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x31399394250639d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f826 expref: 23 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.118875:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x31399394250639d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f826 expref: 23 pid: 12201 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746147217.118883:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095125880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311552640:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147217.118903:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d180 going to sleep for 11 seconds 00000100:00100000:2.0:1746147217.127517:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095127b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311552512:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147217.127530:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095125880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830967311552640:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147217.127574:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3284992->3313663] (req 3284992->3313663) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.127591:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbed600, rc 0) 00000100:00100000:2.0:1746147217.127636:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:3027:x1830967310530688:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 9016us (11770us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147217.127645:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20446 00000100:00100000:1.0:1746147217.130036:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147217.130275:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147217.130297:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310531072 00000100:00100000:1.0:1746147217.130305:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310531072 00010000:00010000:1.0:1746147217.130353:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x31399394250639ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f834 expref: 11 pid: 12201 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746147217.130384:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310531200 00000100:00100000:1.0:1746147217.130387:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310531200 00010000:00010000:1.0:1746147217.130396:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x31399394250639d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f826 expref: 23 pid: 12201 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746147217.130408:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9275 00000100:00100000:1.0:1746147217.130413:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310531072:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147217.130427:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147217.130447:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x31399394250639ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f834 expref: 11 pid: 12201 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746147217.130457:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x31399394250639ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f834 expref: 11 pid: 12201 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746147217.130482:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f12d200/0x31399394250639ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f834 expref: 11 pid: 12201 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746147217.130502:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147217.130549:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310531072:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 135us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147217.130555:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9275 00000100:00100000:1.0:1746147217.130569:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9276 00000100:00100000:1.0:1746147217.130574:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967310531200:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147217.130580:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147217.130588:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x31399394250639d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f826 expref: 23 pid: 12201 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746147217.130595:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x31399394250639d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f826 expref: 23 pid: 12201 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746147217.130607:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e261c00/0x31399394250639d5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f826 expref: 23 pid: 12201 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746147217.130615:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147217.130617:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147217.130623:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3313663) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147217.130631:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3313663) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147217.130662:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3313663) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147217.130674:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800947e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311552768:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147217.130731:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147217.130787:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147217.131051:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310530944 00000100:00100000:2.0:1746147217.131056:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310530944 00000100:00100000:2.0:1746147217.131086:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16546 00000100:00100000:2.0:1746147217.131109:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:3030:x1830967310530944:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147217.131129:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147217.131144:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc200/0x3139939425063aa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f8a4 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.131212:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131224:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131233:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131245:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed800/0x3139939425063ab5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131250:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed800/0x3139939425063ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131255:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed800/0x3139939425063ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131352:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbec200/0x3139939425063abc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131362:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbec200/0x3139939425063abc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131373:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbec200/0x3139939425063abc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00200000:2.0:1746147217.131380:0:7237:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147217.131456:0:7237:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131462:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131471:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131477:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131482:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800990cda00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147217.131486:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131492:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aae lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131500:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147217.131503:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147217.131507:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aae lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131511:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131543:0:7237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed800/0x3139939425063ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131548:0:7237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed800/0x3139939425063ab5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131552:0:7237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed800/0x3139939425063ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131557:0:7237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbed800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147217.131559:0:7237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed800/0x3139939425063ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131567:0:7237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed800/0x3139939425063ab5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131572:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094fbdf00) 00010000:00010000:2.0:1746147217.131574:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147217.131576:0:7237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed800/0x3139939425063ab5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131581:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbed800/0x3139939425063ab5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147217.131615:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc200/0x3139939425063aa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8a4 expref: 15 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.131625:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbec200/0x3139939425063abc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8a4 expref: 14 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.131631:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147217.131633:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147217.131635:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbec200, rc 0) 00000100:00100000:2.0:1746147217.131661:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:3030:x1830967310530944:12345-192.168.204.25@tcp:101:cat.0 Request processed in 553us (874us total) trans 8589937459 rc 0/0 00000100:00100000:2.0:1746147217.131666:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16546 00000100:00100000:3.0:1746147217.136848:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2002:x1830967310530560:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 22274us (22796us total) trans 21474842752 rc 0/0 00000100:00100000:3.0:1746147217.136862:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1768 00002000:00100000:3.0:1746147217.136875:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1228800->2097151) req@ffff880096cfa300 x1830967310530560/t21474842752(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/448 e 0 to 0 dl 1746147228 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147217.136885:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096cfa300 with x1830967310530560 ext(1228800->2097151) 00010000:00010000:3.0:1746147217.136895:0:9589:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800990cd400/0x3139939425063996 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7e7 expref: 10 pid: 9585 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746147217.136908:0:9589:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800990cd400/0x3139939425063996 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7e7 expref: 10 pid: 9585 timeout: 855 lvb_type: 0 00002000:00010000:3.0:1746147217.136915:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096cfa300 00000100:00100000:3.0:1746147217.136987:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800947e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311552768:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147217.137006:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147217.137027:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967310531200:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6452us (6751us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147217.137036:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9276 00000100:00100000:1.0:1746147217.137791:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.137974:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310531456 00000100:00100000:3.0:1746147217.137981:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310531456 00002000:00100000:3.0:1746147217.138013:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3284992->3289087) req@ffff8800947e4380 x1830967310531456/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147217.138022:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e4380 with x1830967310531456 ext(3284992->3289087) 00002000:00010000:3.0:1746147217.138026:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947e4380 00000100:00100000:3.0:1746147217.138043:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7491 00000100:00100000:3.0:1746147217.138050:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2000:x1830967310531456:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:3.0:1746147217.138191:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2000:x1830967310531456:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 141us (401us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147217.138197:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7491 00002000:00100000:3.0:1746147217.138202:0:9589:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3284992->3289087) req@ffff8800947e4380 x1830967310531456/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 488/4536 e 0 to 0 dl 1746147228 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147217.138209:0:9589:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e4380 with x1830967310531456 ext(3284992->3289087) 00002000:00010000:3.0:1746147217.138212:0:9589:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947e4380 00000100:00100000:0.0:1746147217.140762:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147217.140879:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147217.140898:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147217.140936:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147217.140962:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310531712 00000100:00100000:0.0:1746147217.140969:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310531712 00000100:00100000:0.0:1746147217.141005:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310531584 00000100:00100000:0.0:1746147217.141007:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310531584 00000100:00100000:0.0:1746147217.141017:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310531840 00000100:00100000:0.0:1746147217.141019:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310531840 00000100:00100000:0.0:1746147217.141031:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20447 00000100:00100000:0.0:1746147217.141037:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2000:x1830967310531712:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147217.141053:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147217.141073:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e04000/0x3139939425063aca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f8b2 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147217.141155:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311552896:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147217.141228:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147217.141250:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20448 00000100:00100000:0.0:1746147217.141255:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310531584:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147217.141262:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147217.141270:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x3139939425063ad1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f8ab expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147217.141293:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311553024:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147217.141314:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147217.141436:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20449 00000100:00100000:3.0:1746147217.141443:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310531840:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147217.141451:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147217.141459:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f03d600/0x3139939425063ad8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f8b9 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147217.141482:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311553152:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147217.141523:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1c4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746147217.141669:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310531968 00000100:00100000:2.0:1746147217.141674:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310531968 00010000:00010000:2.0:1746147217.141692:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800990cd400/0x3139939425063996 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1228800->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7e7 expref: 16 pid: 9585 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746147217.141709:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9277 00000100:00100000:2.0:1746147217.141714:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2003:x1830967310531968:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147217.141722:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147217.141739:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800990cd400/0x3139939425063996 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1228800->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7e7 expref: 16 pid: 9585 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746147217.141750:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800990cd400/0x3139939425063996 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1228800->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7e7 expref: 16 pid: 9585 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746147217.141769:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147217.141770:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147217.141778:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063a92 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f896 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.141786:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063a92 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f896 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.141806:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063a92 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f896 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147217.141815:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095125880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311553280:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147217.141839:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1dc00 going to sleep for 11 seconds 00002000:00010000:0.0:1746147217.143629:0:9586:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime: 1746147216 -> 1746147217 00010000:00010000:1.0:1746147217.143631:0:13695:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.25@tcp) returned -22 from glimpse AST (req@ffff8800968a3b80 x1830967311552896) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800990cd400/0x3139939425063996 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1228800->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7e7 expref: 16 pid: 9585 timeout: 855 lvb_type: 0 00002000:00010000:0.0:1746147217.143635:0:9586:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime: 1746147216 -> 1746147217 00002000:00010000:0.0:1746147217.143637:0:9586:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime: 1746147216 -> 1746147217 00000100:00100000:0.0:1746147217.143654:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311553024:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147217.143658:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990cd400/0x3139939425063996 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1228800->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7e7 expref: 16 pid: 9585 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746147217.143675:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311552896:192.168.204.25@tcp:106: 00010000:00010000:0.0:1746147217.143679:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x3139939425063ad1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ab expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147217.143691:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e05200/0x3139939425063ad1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ab expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147217.143692:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e04000/0x3139939425063aca lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8b2 expref: 15 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147217.143700:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e04000/0x3139939425063aca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8b2 expref: 14 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147217.143708:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e04000, rc 0) 00010000:00010000:0.0:1746147217.143714:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e05200, rc 0) 00000100:00100000:0.0:1746147217.143741:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310531584:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2485us (2841us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147217.143746:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310531712:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2709us (2866us total) trans 0 rc 301/301 00000100:00100000:0.0:1746147217.143748:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20448 00000100:00100000:1.0:1746147217.143753:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20447 00002000:00010000:3.0:1746147217.143867:0:1853:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746147216 -> 1746147217 00002000:00010000:3.0:1746147217.143870:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746147216 -> 1746147217 00002000:00010000:3.0:1746147217.143871:0:1853:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime: 1746147216 -> 1746147217 00000100:00100000:3.0:1746147217.143880:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311553152:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147217.143897:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f03d600/0x3139939425063ad8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8b9 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147217.143906:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f03d600/0x3139939425063ad8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8b9 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147217.143925:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03d600, rc 0) 00000100:00100000:3.0:1746147217.143954:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2000:x1830967310531840:12345-192.168.204.25@tcp:101:cat.0 Request processed in 2512us (3017us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147217.143960:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20449 00000100:00100000:0.0:1746147217.147120:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.147322:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095125880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311553280:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147217.147348:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147217.147393:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2003:x1830967310531968:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5676us (6638us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147217.147404:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9277 00000100:00100000:1.0:1746147217.147692:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310532224 00000100:00100000:1.0:1746147217.147699:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310532224 00002000:00100000:1.0:1746147217.147739:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3309568->3313663) req@ffff8800968a0e00 x1830967310532224/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147217.147749:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a0e00 with x1830967310532224 ext(3309568->3313663) 00002000:00010000:1.0:1746147217.147755:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968a0e00 00000100:00100000:1.0:1746147217.147771:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7492 00000100:00100000:1.0:1746147217.147777:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967310532224:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147217.148497:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967310532224:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 718us (1417us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147217.148505:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7492 00002000:00100000:1.0:1746147217.148510:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3309568->3313663) req@ffff8800968a0e00 x1830967310532224/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 488/4536 e 0 to 0 dl 1746147228 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147217.148517:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a0e00 with x1830967310532224 ext(3309568->3313663) 00002000:00010000:1.0:1746147217.148521:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968a0e00 00000100:00100000:0.0:1746147217.148727:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.148955:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310532352 00000100:00100000:3.0:1746147217.148959:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310532352 00000100:00100000:3.0:1746147217.148992:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20450 00000100:00100000:3.0:1746147217.148997:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:3030:x1830967310532352:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147217.149006:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147217.149025:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f03cc00/0x3139939425063adf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f8c0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.149047:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425063a06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->331775) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f83b expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.149054:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147217.149055:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147217.149058:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03cc00/0x3139939425063adf lrc: 4/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8c0 expref: 10 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.149083:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425063a06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->331775) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f83b expref: 21 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.149106:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425063a06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->331775) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f83b expref: 21 pid: 12201 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746147217.149118:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311553408:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147217.149181:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1c4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746147217.151826:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.152314:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830967311553408:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147217.152343:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f03cc00/0x3139939425063adf lrc: 3/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8c0 expref: 10 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.152360:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03cc00, rc 0) 00000100:00100000:3.0:1746147217.152401:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:3030:x1830967310532352:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3402us (3673us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147217.152408:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20450 00000100:00100000:0.0:1746147217.152557:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147217.152737:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310532608 00000100:00100000:2.0:1746147217.152744:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310532608 00002000:00100000:2.0:1746147217.152781:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800947e7b80 x1830967310532608/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147217.152789:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e7b80 with x1830967310532608 ext(1048576->2097151) 00002000:00010000:2.0:1746147217.152793:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947e7b80 00000100:00100000:2.0:1746147217.152817:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310532736 00000100:00100000:2.0:1746147217.152819:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310532736 00002000:00100000:2.0:1746147217.152829:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x93:0x0] (245760->331775) req@ffff8800968a2680 x1830967310532736/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147217.152835:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a2680 with x1830967310532736 ext(245760->331775) 00010000:00010000:2.0:1746147217.152840:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425063a06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->331775) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f83b expref: 23 pid: 12201 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746147217.152851:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425063a06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->331775) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f83b expref: 23 pid: 12201 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746147217.152857:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800968a2680 00000100:00100000:2.0:1746147217.152868:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1769 00000100:00100000:2.0:1746147217.152873:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967310532736:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:2.0:1746147217.152978:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7493 00000100:00100000:2.0:1746147217.152984:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310532608:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147217.160947:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310532608:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 7950us (9116us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147217.160961:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7493 00002000:00100000:2.0:1746147217.160972:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800947e7b80 x1830967310532608/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 488/440 e 0 to 0 dl 1746147228 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147217.160982:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800947e7b80 with x1830967310532608 ext(1048576->2097151) 00002000:00010000:2.0:1746147217.160987:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800947e7b80 00000100:00100000:3.0:1746147217.161123:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310532736:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 8247us (8565us total) trans 21474842753 rc 0/0 00000100:00100000:3.0:1746147217.161131:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1769 00002000:00100000:3.0:1746147217.161136:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x93:0x0] (245760->331775) req@ffff8800968a2680 x1830967310532736/t21474842753(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 488/448 e 0 to 0 dl 1746147228 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746147217.161142:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a2680 with x1830967310532736 ext(245760->331775) 00010000:00010000:3.0:1746147217.161151:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425063a06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->331775) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f83b expref: 24 pid: 12201 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746147217.161165:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425063a06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->331775) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f83b expref: 24 pid: 12201 timeout: 855 lvb_type: 0 00002000:00010000:3.0:1746147217.161171:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800968a2680 00000100:00100000:0.0:1746147217.165212:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.165340:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310532864 00000100:00100000:3.0:1746147217.165349:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310532864 00010000:00010000:3.0:1746147217.165387:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425063a06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->331775) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f83b expref: 24 pid: 12201 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746147217.165424:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9278 00000100:00100000:3.0:1746147217.165431:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310532864:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147217.165446:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147217.165465:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425063a06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 245760->331775) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f83b expref: 24 pid: 12201 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746147217.165476:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425063a06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 245760->331775) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f83b expref: 24 pid: 12201 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746147217.165503:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f12cc00/0x3139939425063a06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 245760->331775) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f83b expref: 24 pid: 12201 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746147217.165524:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147217.165526:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147217.165542:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f03cc00/0x3139939425063adf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8c0 expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.165550:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03cc00/0x3139939425063adf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8c0 expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.165581:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f03cc00/0x3139939425063adf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8c0 expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147217.165592:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311553536:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147217.165672:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1c4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147217.170962:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311553536:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147217.170997:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147217.171065:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2000:x1830967310532864:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 5633us (5861us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147217.171079:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9278 00000100:00100000:0.0:1746147217.171386:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.171871:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310533120 00000100:00100000:3.0:1746147217.171878:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310533120 00002000:00100000:3.0:1746147217.171915:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff8800968a3b80 x1830967310533120/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147217.171930:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a3b80 with x1830967310533120 ext(0->1048575) 00002000:00010000:3.0:1746147217.171934:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968a3b80 00000100:00100000:3.0:1746147217.171959:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7494 00000100:00100000:3.0:1746147217.171965:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310533120:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:0.0:1746147217.173243:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147217.173288:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310533376 00000100:00100000:2.0:1746147217.173293:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310533376 00002000:00100000:2.0:1746147217.173318:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff8800769ac380 x1830967310533376/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147217.173326:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ac380 with x1830967310533376 ext(2097152->3145727) 00002000:00010000:2.0:1746147217.173330:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769ac380 00000100:00100000:2.0:1746147217.173351:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7495 00000100:00100000:2.0:1746147217.173355:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2003:x1830967310533376:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:2.0:1746147217.188284:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2003:x1830967310533376:12345-192.168.204.25@tcp:3:cat.0 Request processed in 14916us (15031us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147217.188297:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7495 00002000:00100000:2.0:1746147217.188309:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff8800769ac380 x1830967310533376/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 488/440 e 0 to 0 dl 1746147228 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147217.188318:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ac380 with x1830967310533376 ext(2097152->3145727) 00002000:00010000:2.0:1746147217.188323:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769ac380 00000100:00100000:0.0:1746147217.191409:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.191539:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2001:x1830967310533120:12345-192.168.204.25@tcp:3:cat.0 Request processed in 19564us (20145us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147217.191551:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7494 00002000:00100000:3.0:1746147217.191562:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x93:0x0] (0->1048575) req@ffff8800968a3b80 x1830967310533120/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/440 e 0 to 0 dl 1746147228 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147217.191571:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968a3b80 with x1830967310533120 ext(0->1048575) 00002000:00010000:3.0:1746147217.191577:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968a3b80 00000100:00100000:2.0:1746147217.191984:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310533632 00000100:00100000:2.0:1746147217.191993:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310533632 00000100:00100000:2.0:1746147217.192045:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16547 00000100:00100000:2.0:1746147217.192052:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:3033:x1830967310533632:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:2.0:1746147217.192075:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147217.192111:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc200/0x3139939425063ae6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f8c7 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.192192:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192206:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192218:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192230:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a800/0x3139939425063af4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192234:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a800/0x3139939425063af4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192239:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a800/0x3139939425063af4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192344:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425063afb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192353:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425063afb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192359:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425063afb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:2.0:1746147217.192366:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:2.0:1746147217.192452:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192459:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192465:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192471:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192478:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800990cda00 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147217.192482:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192489:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aed lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192501:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:2.0:1746147217.192504:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147217.192508:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aed lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192513:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063aed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192547:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a800/0x3139939425063af4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192552:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a800/0x3139939425063af4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192557:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a800/0x3139939425063af4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192562:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2a800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:2.0:1746147217.192564:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a800/0x3139939425063af4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192570:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a800/0x3139939425063af4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192576:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094fbda00) 00010000:00010000:2.0:1746147217.192578:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746147217.192580:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a800/0x3139939425063af4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192589:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a800/0x3139939425063af4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147217.192630:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc200/0x3139939425063ae6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8c7 expref: 17 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.192642:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425063afb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8c7 expref: 16 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.192648:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147217.192650:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746147217.192652:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2a400, rc 0) 00000100:00100000:2.0:1746147217.192690:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:3033:x1830967310533632:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 638us (1291us total) trans 8589937460 rc 0/0 00000100:00100000:2.0:1746147217.192697:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16547 00000100:00100000:1.0:1746147217.195526:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.195630:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310533760 00000100:00100000:3.0:1746147217.195640:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310533760 00000100:00100000:3.0:1746147217.195836:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20451 00000100:00100000:3.0:1746147217.195844:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:3025:x1830967310533760:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147217.195861:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147217.195881:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f03d600/0x3139939425063b09 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f8ce expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.195909:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425063a5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f873 expref: 15 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.195916:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147217.195918:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746147217.195922:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03d600/0x3139939425063b09 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ce expref: 31 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.195951:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425063a5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f873 expref: 15 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.195963:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425063a5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f873 expref: 15 pid: 12201 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746147217.195975:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311553664:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147217.196064:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1c4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746147217.201323:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.201559:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310533888 00000100:00100000:3.0:1746147217.201570:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310533888 00000100:00100000:0.0:1746147217.202048:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147217.202211:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311553664:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147217.202251:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f03d600/0x3139939425063b09 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ce expref: 31 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.202271:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03d600, rc 0) 00000100:00100000:2.0:1746147217.202351:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:3025:x1830967310533760:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6506us (6835us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147217.202360:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20451 00000100:00100000:2.0:1746147217.202401:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310534016 00000100:00100000:2.0:1746147217.202404:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310534016 00002000:00100000:2.0:1746147217.202448:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (2883584->3145727) req@ffff8800769aed80 x1830967310534016/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147217.202463:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769aed80 with x1830967310534016 ext(2883584->3145727) 00010000:00010000:2.0:1746147217.202470:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425063a5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f873 expref: 16 pid: 12201 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746147217.202482:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425063a5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f873 expref: 16 pid: 12201 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746147217.202488:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800769aed80 00000100:00100000:2.0:1746147217.202505:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1770 00000100:00100000:2.0:1746147217.202511:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967310534016:12345-192.168.204.25@tcp:4:cat.0 00000100:00080000:0.0:1746147217.203007:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147217.203116:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1007 00000100:00100000:3.0:1746147217.203124:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2002:x1830967310533888:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147217.203136:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147217.203160:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095a2a400/0x3139939425063afb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8c7 expref: 16 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.203185:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147217.203189:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147217.203216:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2002:x1830967310533888:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 93us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147217.203222:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1007 00000100:00100000:1.0:1746147217.208599:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.208825:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310534144 00000100:00100000:3.0:1746147217.208837:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310534144 00000100:00100000:3.0:1746147217.208892:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20452 00000100:00100000:3.0:1746147217.208903:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:3030:x1830967310534144:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147217.208926:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147217.208948:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f03dc00/0x3139939425063b10 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f8d5 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.208976:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147217.208978:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147217.208987:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f03dc00/0x3139939425063b10 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8d5 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.209002:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f03dc00/0x3139939425063b10 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8d5 expref: 11 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.209013:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f03dc00, rc 0) 00000100:00100000:3.0:1746147217.209073:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:3030:x1830967310534144:12345-192.168.204.25@tcp:101:cat.0 Request processed in 170us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147217.209079:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20452 00000100:00100000:2.0:1746147217.215754:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310534016:12345-192.168.204.25@tcp:4:cat.0 Request processed in 13226us (13692us total) trans 17179875357 rc 0/0 00000100:00100000:2.0:1746147217.215771:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1770 00002000:00100000:2.0:1746147217.215787:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (2883584->3145727) req@ffff8800769aed80 x1830967310534016/t17179875357(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/448 e 0 to 0 dl 1746147228 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147217.215797:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769aed80 with x1830967310534016 ext(2883584->3145727) 00010000:00010000:2.0:1746147217.215809:0:13334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425063a5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f873 expref: 18 pid: 12201 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746147217.215828:0:13334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425063a5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f873 expref: 18 pid: 12201 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746147217.215835:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800769aed80 00000100:00100000:0.0:1746147217.225222:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147217.225593:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310534400 00000100:00100000:2.0:1746147217.225603:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310534400 00002000:00100000:2.0:1746147217.225651:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800769ad500 x1830967310534400/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147217.225660:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ad500 with x1830967310534400 ext(1048576->2097151) 00002000:00010000:2.0:1746147217.225666:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769ad500 00000100:00100000:2.0:1746147217.225688:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7496 00000100:00100000:2.0:1746147217.225695:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310534400:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147217.226079:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.226221:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310534528 00000100:00100000:3.0:1746147217.226225:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310534528 00010000:00010000:3.0:1746147217.226247:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425063a5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f873 expref: 18 pid: 12201 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746147217.226667:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9279 00000100:00100000:3.0:1746147217.226673:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310534528:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147217.226684:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746147217.226700:0:13715:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147216 -> 1746147217 00010000:00010000:3.0:1746147217.226706:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425063a5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f873 expref: 18 pid: 12201 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746147217.226724:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425063a5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f873 expref: 18 pid: 12201 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746147217.226748:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f38de00/0x3139939425063a5a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2883584->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f873 expref: 18 pid: 12201 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746147217.226767:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147217.226768:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147217.226775:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f03d600/0x3139939425063b09 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ce expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.226782:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03d600/0x3139939425063b09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ce expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.226813:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f03d600/0x3139939425063b09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ce expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147217.226825:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311553792:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147217.226898:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147217.232757:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311553792:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147217.232786:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147217.232864:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2002:x1830967310534528:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 6190us (6784us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147217.232877:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9279 00000100:00100000:0.0:1746147217.240201:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147217.240240:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147217.240315:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310534784 00000100:00100000:1.0:1746147217.240324:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310534784 00002000:00100000:1.0:1746147217.240367:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff8800975a5c00 x1830967310534784/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147217.240377:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a5c00 with x1830967310534784 ext(2097152->4194303) 00002000:00010000:1.0:1746147217.240383:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800975a5c00 00000100:00100000:1.0:1746147217.240409:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310535040 00000100:00100000:1.0:1746147217.240411:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310535040 00002000:00100000:1.0:1746147217.240424:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800975a6680 x1830967310535040/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 504/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147217.240431:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a6680 with x1830967310535040 ext(3145728->4194303) 00002000:00010000:1.0:1746147217.240434:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800975a6680 00000100:00100000:1.0:1746147217.240448:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7497 00000100:00100000:1.0:1746147217.240455:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967310534784:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147217.241924:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7498 00000100:00100000:3.0:1746147217.241934:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967310535040:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147217.254410:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310534400:12345-192.168.204.25@tcp:3:cat.0 Request processed in 28700us (29185us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147217.254423:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7496 00002000:00100000:3.0:1746147217.254436:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800769ad500 x1830967310534400/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/440 e 0 to 0 dl 1746147228 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147217.254447:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800769ad500 with x1830967310534400 ext(1048576->2097151) 00002000:00010000:3.0:1746147217.254453:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800769ad500 00000100:00100000:0.0:1746147217.264569:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147217.264605:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147217.264641:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147217.264657:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147217.264725:0:8099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310535168 00000100:00100000:0.0:1746147217.264733:0:8099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310535168 00000100:00100000:0.0:1746147217.264790:0:8099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 239 00000100:00100000:0.0:1746147217.264797:0:8099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2001:x1830967310535168:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1746147217.264859:0:8099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2001:x1830967310535168:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 63us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147217.264865:0:8099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 239 00000100:00100000:0.0:1746147217.264893:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310535296 00000100:00100000:0.0:1746147217.264896:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310535296 00000100:00100000:0.0:1746147217.264922:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310535552 00000100:00100000:0.0:1746147217.264923:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310535552 00000100:00100000:0.0:1746147217.264938:0:7238:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310535424 00000100:00100000:0.0:1746147217.264940:0:7238:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310535424 00000100:00100000:0.0:1746147217.264952:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 997 00000100:00100000:0.0:1746147217.264957:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+375:2001:x1830967310535296:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1746147217.264984:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+375:2001:x1830967310535296:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 26us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147217.264989:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 997 00000100:00100000:0.0:1746147217.264997:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 998 00000100:00100000:0.0:1746147217.265001:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+5:2001:x1830967310535552:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1746147217.265016:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+5:2001:x1830967310535552:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 15us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147217.265020:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 998 00000100:00100000:0.0:1746147217.265027:0:7238:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 999 00000100:00100000:0.0:1746147217.265030:0:7238:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+5:2001:x1830967310535424:12345-192.168.204.25@tcp:400:kworker.0 00000100:00100000:0.0:1746147217.265043:0:7238:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+5:2001:x1830967310535424:12345-192.168.204.25@tcp:400:kworker.0 Request processed in 12us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147217.265046:0:7238:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 999 00000100:00080000:0.0:1746147217.265058:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1746147217.278599:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967310534784:12345-192.168.204.25@tcp:3:cat.0 Request processed in 38128us (38391us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147217.278619:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7497 00002000:00100000:1.0:1746147217.278632:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4194303) req@ffff8800975a5c00 x1830967310534784/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 488/440 e 0 to 0 dl 1746147228 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147217.278641:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a5c00 with x1830967310534784 ext(2097152->4194303) 00002000:00010000:1.0:1746147217.278648:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800975a5c00 00000100:00100000:1.0:1746147217.279278:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147217.279430:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310535680 00000100:00100000:0.0:1746147217.279440:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310535680 00000100:00100000:0.0:1746147217.279485:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20453 00000100:00100000:0.0:1746147217.279493:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800947e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310535680:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:0.0:1746147217.279510:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147217.279539:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x3139939425063b17 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f8dc expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147217.279599:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009689b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311553920:192.168.204.25@tcp:106: 00000100:00100000:0.0:1746147217.279677:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1e300 going to sleep for 11 seconds 00000100:00100000:3.0:1746147217.279738:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967310535040:12345-192.168.204.25@tcp:3:cat.0 Request processed in 37805us (39496us total) trans 0 rc 1019904/1019904 00000100:00100000:3.0:1746147217.279746:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7498 00002000:00100000:3.0:1746147217.279751:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800975a6680 x1830967310535040/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 504/440 e 0 to 0 dl 1746147228 ref 1 fl Complete:/200/0 rc 1019904/1019904 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147217.279758:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800975a6680 with x1830967310535040 ext(3145728->4194303) 00002000:00010000:3.0:1746147217.279762:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800975a6680 00000100:00100000:0.0:1746147217.280321:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147217.281340:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310535808 00000100:00100000:2.0:1746147217.281347:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310535808 00000100:00100000:2.0:1746147217.281409:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20454 00000100:00100000:2.0:1746147217.281417:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:2001:x1830967310535808:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147217.281430:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147217.281449:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425063b1e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f8e3 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.281470:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147217.281472:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147217.281483:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425063b1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8e3 expref: 18 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147217.281499:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425063b1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8e3 expref: 18 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147217.281510:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2bc00, rc 0) 00000100:00100000:2.0:1746147217.281559:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310535808:12345-192.168.204.25@tcp:101:cat.0 Request processed in 143us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147217.281564:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20454 00000100:00100000:2.0:1746147217.284149:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009689b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311553920:192.168.204.25@tcp:106: 00010000:00010000:2.0:1746147217.284190:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x3139939425063b17 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8dc expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147217.284203:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a30400/0x3139939425063b17 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8dc expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147217.284234:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a30400, rc 0) 00000100:00100000:2.0:1746147217.284286:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800947e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:2001:x1830967310535680:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4793us (5010us total) trans 0 rc 301/301 00000100:00100000:2.0:1746147217.284294:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20453 00000100:00100000:0.0:1746147217.290289:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147217.290668:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310535936 00000100:00100000:2.0:1746147217.290678:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310535936 00000100:00100000:2.0:1746147217.290737:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20455 00000100:00100000:2.0:1746147217.290746:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2000:x1830967310535936:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:2.0:1746147217.290766:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147217.290785:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2ba00/0x3139939425063b25 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f8ea expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.290807:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147217.290809:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147217.290817:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2ba00/0x3139939425063b25 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ea expref: 24 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147217.290833:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2ba00/0x3139939425063b25 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ea expref: 24 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147217.290848:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2ba00, rc 0) 00000100:00100000:2.0:1746147217.290905:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310535936:12345-192.168.204.25@tcp:101:cat.0 Request processed in 161us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147217.290911:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20455 00000100:00100000:0.0:1746147217.292667:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147217.292748:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310536064 00000100:00100000:1.0:1746147217.292755:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310536064 00000100:00100000:1.0:1746147217.292801:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20456 00000100:00100000:1.0:1746147217.292808:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+11:3030:x1830967310536064:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147217.292821:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147217.292837:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063b2c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f8f1 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147217.293012:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3313663) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147217.293019:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147217.293020:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147217.293023:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063b2c lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f1 expref: 12 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147217.293055:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3313663) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147217.293068:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3313663) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 23 pid: 1854 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746147217.293081:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311554048:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147217.293966:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147217.294418:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.294460:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310536192 00000100:00100000:0.0:1746147217.294460:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.294465:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310536192 00000100:00100000:3.0:1746147217.294610:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20457 00000100:00100000:3.0:1746147217.294618:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:3033:x1830967310536192:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:3.0:1746147217.294629:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147217.294642:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a55cca00/0x3139939425063b33 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f8f8 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.294662:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f03d600/0x3139939425063b09 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ce expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.294671:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425063b1e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8e3 expref: 19 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147217.294677:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147217.294678:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147217.294681:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55cca00/0x3139939425063b33 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [4046848->4194303] (req 4046848->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f8 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.294701:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425063b1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8e3 expref: 19 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147217.294704:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310536448 00000100:00100000:2.0:1746147217.294708:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310536448 00010000:00010000:3.0:1746147217.294709:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425063b1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8e3 expref: 19 pid: 1853 timeout: 855 lvb_type: 1 00000100:00100000:3.0:1746147217.294719:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311554176:192.168.204.25@tcp:104: 00002000:00100000:2.0:1746147217.294736:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880096899180 x1830967310536448/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147217.294745:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096899180 with x1830967310536448 ext(4194304->4890623) 00010000:00010000:2.0:1746147217.294750:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 24 pid: 1854 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746147217.294760:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 24 pid: 1854 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746147217.294766:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096899180 00000100:00100000:2.0:1746147217.294779:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1771 00010000:00010000:3.0:1746147217.294780:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f03d600/0x3139939425063b09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ce expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147217.294784:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310536448:12345-192.168.204.25@tcp:3:cat.0 00010000:00010000:3.0:1746147217.294788:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f03d600/0x3139939425063b09 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ce expref: 30 pid: 1853 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746147217.294795:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311554304:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147217.294811:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:1.0:1746147217.296365:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311554048:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147217.296391:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063b2c lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f1 expref: 12 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147217.296405:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a0e00, rc 0) 00000100:00100000:1.0:1746147217.296435:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:3030:x1830967310536064:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3627us (3771us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147217.296442:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20456 00000100:00100000:0.0:1746147217.298250:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.298418:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310536576 00000100:00100000:3.0:1746147217.298426:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310536576 00002000:00100000:3.0:1746147217.298545:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3284992->3313663) req@ffff880096899880 x1830967310536576/t0(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147217.298556:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096899880 with x1830967310536576 ext(3284992->3313663) 00010000:00010000:3.0:1746147217.298565:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 26 pid: 1854 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746147217.298577:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 26 pid: 1854 timeout: 855 lvb_type: 0 00002000:00010000:3.0:1746147217.298583:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096899880 00000100:00100000:3.0:1746147217.298616:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1772 00000100:00100000:3.0:1746147217.298624:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310536576:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:0.0:1746147217.300329:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147217.300397:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310536704 00000100:00100000:2.0:1746147217.300402:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310536704 00010000:00010000:2.0:1746147217.300432:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425063b1e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8e3 expref: 20 pid: 1853 timeout: 855 lvb_type: 1 00000100:00100000:2.0:1746147217.300498:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9280 00000100:00100000:2.0:1746147217.300507:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009689b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2000:x1830967310536704:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147217.300519:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746147217.300540:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311554176:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147217.300548:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425063b1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8e3 expref: 20 pid: 1853 timeout: 855 lvb_type: 1 00000100:00100000:3.0:1746147217.300551:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311554304:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147217.300558:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425063b1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8e3 expref: 20 pid: 1853 timeout: 855 lvb_type: 1 00010000:00010000:2.0:1746147217.300578:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a2bc00/0x3139939425063b1e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8e3 expref: 20 pid: 1853 timeout: 855 lvb_type: 1 00010000:00010000:2.0:1746147217.300737:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147217.300741:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a55cca00/0x3139939425063b33 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [4046848->4194303] (req 4046848->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f8 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.300750:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55cca00, rc 0) 00000100:00100000:2.0:1746147217.300803:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+19:2000:x1830967310536704:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 297us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147217.300809:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9280 00000100:00100000:3.0:1746147217.300928:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009689a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:3033:x1830967310536192:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 6311us (6511us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147217.300935:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20457 00000100:00100000:2.0:1746147217.301012:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310536448:12345-192.168.204.25@tcp:3:cat.0 Request processed in 6226us (6551us total) trans 0 rc 696320/696320 00000100:00100000:2.0:1746147217.301019:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1771 00002000:00100000:2.0:1746147217.301026:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4890623) req@ffff880096899180 x1830967310536448/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 488/440 e 0 to 0 dl 1746147228 ref 1 fl Complete:H/200/0 rc 696320/696320 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746147217.301034:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096899180 with x1830967310536448 ext(4194304->4890623) 00010000:00010000:2.0:1746147217.301040:0:29478:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 26 pid: 1854 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746147217.301048:0:29478:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 26 pid: 1854 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746147217.301058:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096899180 00000100:00100000:0.0:1746147217.302747:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310536576:12345-192.168.204.25@tcp:4:cat.0 Request processed in 4118us (4497us total) trans 21474842754 rc 0/0 00000100:00100000:0.0:1746147217.302756:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1772 00002000:00100000:0.0:1746147217.302765:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3284992->3313663) req@ffff880096899880 x1830967310536576/t21474842754(0) o4->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 488/448 e 0 to 0 dl 1746147228 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746147217.302774:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096899880 with x1830967310536576 ext(3284992->3313663) 00010000:00010000:0.0:1746147217.302782:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 26 pid: 1854 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746147217.302794:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 26 pid: 1854 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746147217.302797:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00002000:00010000:0.0:1746147217.302801:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096899880 00000100:00100000:3.0:1746147217.303058:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310536832 00000100:00100000:3.0:1746147217.303065:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310536832 00010000:00010000:3.0:1746147217.303174:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f03d600/0x3139939425063b09 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ce expref: 31 pid: 1853 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746147217.303210:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9281 00000100:00100000:3.0:1746147217.303217:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2000:x1830967310536832:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147217.303228:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147217.303611:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f03d600/0x3139939425063b09 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ce expref: 31 pid: 1853 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746147217.303624:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f03d600/0x3139939425063b09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ce expref: 31 pid: 1853 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746147217.303644:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f03d600/0x3139939425063b09 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ce expref: 31 pid: 1853 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746147217.303673:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147217.303675:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147217.303682:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a55cca00/0x3139939425063b33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f8 expref: 17 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.303690:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55cca00/0x3139939425063b33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f8 expref: 17 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.303722:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a55cca00/0x3139939425063b33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f8 expref: 17 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147217.303734:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311554432:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147217.303801:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147217.305173:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147217.305277:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13715:1830967311554432:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147217.305289:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310536960 00000100:00100000:3.0:1746147217.305295:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310536960 00010000:00010000:2.0:1746147217.305297:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147217.305322:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310536832:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2106us (2531us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147217.305330:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9281 00000100:00100000:3.0:1746147217.305340:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20458 00000100:00100000:3.0:1746147217.305346:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310536960:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147217.305361:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147217.305477:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55cdc00/0x3139939425063b3a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f8ff expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147217.305516:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311554560:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147217.305744:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:0.0:1746147217.306543:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147217.306934:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147217.307006:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310537344 00000100:00100000:2.0:1746147217.307011:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310537344 00002000:00100000:2.0:1746147217.307046:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (4046848->4050943) req@ffff8801349a2680 x1830967310537344/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147217.307057:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2680 with x1830967310537344 ext(4046848->4050943) 00002000:00010000:2.0:1746147217.307061:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a2680 00000100:00100000:2.0:1746147217.307344:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7499 00000100:00100000:2.0:1746147217.307352:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310537344:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:2.0:1746147217.307486:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2001:x1830967310537344:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 134us (551us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746147217.307491:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7499 00002000:00100000:2.0:1746147217.307497:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (4046848->4050943) req@ffff8801349a2680 x1830967310537344/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/4536 e 0 to 0 dl 1746147228 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147217.307505:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349a2680 with x1830967310537344 ext(4046848->4050943) 00002000:00010000:2.0:1746147217.307508:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349a2680 00000100:00100000:1.0:1746147217.307598:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310537088 00000100:00100000:1.0:1746147217.307603:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310537088 00000100:00100000:1.0:1746147217.307627:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20459 00000100:00100000:1.0:1746147217.307632:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310537088:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147217.307641:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147217.307655:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009400a600/0x3139939425063b41 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f906 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147217.307695:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311554688:192.168.204.25@tcp:106: 00000100:00100000:1.0:1746147217.307747:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746147217.311346:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.311414:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311554560:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147217.311460:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55cdc00/0x3139939425063b3a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ff expref: 27 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147217.312006:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55cdc00/0x3139939425063b3a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ff expref: 27 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147217.312033:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55cdc00, rc 0) 00000100:00100000:3.0:1746147217.312080:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310536960:12345-192.168.204.25@tcp:101:cat.0 Request processed in 6733us (6911us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147217.312116:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20458 00000100:00100000:0.0:1746147217.312161:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147217.312209:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310537472 00000100:00100000:2.0:1746147217.312217:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310537472 00002000:00010000:1.0:1746147217.312235:0:13695:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime: 1746147216 -> 1746147217 00002000:00010000:1.0:1746147217.312239:0:13695:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime: 1746147216 -> 1746147217 00010000:00010000:2.0:1746147217.312246:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3284992->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 26 pid: 1854 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746147217.312254:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13695:1830967311554688:192.168.204.25@tcp:106: 00010000:00010000:1.0:1746147217.312277:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009400a600/0x3139939425063b41 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f906 expref: 31 pid: 13695 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746147217.312279:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9282 00000100:00100000:2.0:1746147217.312287:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310537472:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147217.312291:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009400a600/0x3139939425063b41 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f906 expref: 31 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147217.312302:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147217.312304:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400a600, rc 0) 00010000:00010000:2.0:1746147217.312311:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3284992->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 26 pid: 1854 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746147217.312325:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3284992->3313663) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 26 pid: 1854 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746147217.312335:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310537088:12345-192.168.204.25@tcp:101:cat.0 Request processed in 4702us (5794us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147217.312340:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20459 00010000:00010000:2.0:1746147217.312343:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbed600/0x3139939425063aa0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3284992->3313663) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f89d expref: 26 pid: 1854 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746147217.312360:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147217.312362:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147217.312370:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063b2c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f1 expref: 11 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.312378:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063b2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f1 expref: 11 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147217.312609:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310537600 00000100:00100000:1.0:1746147217.312613:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310537600 00000100:00100000:1.0:1746147217.312631:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20460 00000100:00100000:1.0:1746147217.312636:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:3033:x1830967310537600:12345-192.168.204.25@tcp:101:multiop.0 00010000:00010000:1.0:1746147217.312649:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147217.312659:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x3139939425063b48 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f90d expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147217.312676:0:13695:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063b2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f1 expref: 13 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147217.312682:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147217.312683:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147217.312686:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x3139939425063b48 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [4194304->4767743] (req 4194304->4767743) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f90d expref: 13 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147217.312702:0:13695:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063b2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f1 expref: 13 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.312711:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063b2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f1 expref: 11 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147217.312713:0:13695:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063b2c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f1 expref: 13 pid: 13695 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746147217.312723:0:13715:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063b2c lrc: 6/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f1 expref: 13 pid: 13695 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746147217.312724:0:13695:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311554944:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147217.312733:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095127b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311554816:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147217.312789:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:1.0:1746147217.312791:0:13695:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746147217.314384:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095127b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311554816:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147217.314401:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147217.314430:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310537472:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2144us (3095us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147217.314439:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9282 00000100:00100000:1.0:1746147217.314519:0:13695:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13695:1830967311554944:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147217.314546:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x3139939425063b48 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [4194304->4767743] (req 4194304->4767743) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f90d expref: 13 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147217.314559:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400b800, rc 0) 00000100:00100000:1.0:1746147217.314579:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:3033:x1830967310537600:12345-192.168.204.25@tcp:101:multiop.0 Request processed in 1942us (2417us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147217.314585:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20460 00000100:00100000:0.0:1746147217.314869:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147217.315148:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310537728 00000100:00100000:1.0:1746147217.315154:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310537728 00000100:00100000:1.0:1746147217.315191:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20461 00000100:00100000:1.0:1746147217.315197:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:3025:x1830967310537728:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147217.315211:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147217.315225:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009400ba00/0x3139939425063b4f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f914 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147217.315242:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147217.315244:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147217.315250:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009400ba00/0x3139939425063b4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4767744->18446744073709551615] (req 4886528->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f914 expref: 26 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147217.315265:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009400ba00/0x3139939425063b4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4767744->18446744073709551615] (req 4886528->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f914 expref: 26 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147217.315273:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009400ba00, rc 0) 00000100:00100000:1.0:1746147217.315300:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:3025:x1830967310537728:12345-192.168.204.25@tcp:101:cat.0 Request processed in 103us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147217.315305:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20461 00000100:00100000:0.0:1746147217.317795:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147217.317845:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.317937:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310537856 00000100:00100000:3.0:1746147217.317946:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310537856 00000100:00100000:3.0:1746147217.317995:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310537984 00000100:00100000:3.0:1746147217.317997:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310537984 00000100:00100000:3.0:1746147217.318017:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20462 00000100:00100000:3.0:1746147217.318024:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310537856:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147217.318043:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147217.318062:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x3139939425063b56 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f91b expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.318084:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147217.318117:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x3139939425063b56 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f91b expref: 27 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147217.318128:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4800/0x3139939425063b56 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f91b expref: 27 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147217.318140:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9b4800, rc 0) 00000100:00100000:3.0:1746147217.318178:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310537856:12345-192.168.204.25@tcp:101:cat.0 Request processed in 154us (392us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147217.318184:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20462 00000100:00100000:3.0:1746147217.318197:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20463 00000100:00100000:3.0:1746147217.318201:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310537984:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147217.318209:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147217.318218:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4c00/0x3139939425063b5d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f922 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147217.318258:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311555072:192.168.204.25@tcp:106: 00000100:00100000:3.0:1746147217.318321:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009f1cc900 going to sleep for 11 seconds 00000100:00100000:3.0:1746147217.320754:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311555072:192.168.204.25@tcp:106: 00010000:00010000:3.0:1746147217.320792:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4c00/0x3139939425063b5d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f922 expref: 31 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147217.320810:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9b4c00/0x3139939425063b5d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f922 expref: 31 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147217.320821:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9b4c00, rc 0) 00000100:00100000:3.0:1746147217.321423:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310537984:12345-192.168.204.25@tcp:101:cat.0 Request processed in 3218us (3574us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147217.321432:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20463 00000100:00100000:0.0:1746147217.323063:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.324406:0:29478:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310538240 00000100:00100000:3.0:1746147217.324417:0:29478:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310538240 00002000:00100000:3.0:1746147217.324463:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (4886528->4890623) req@ffff88009514fb80 x1830967310538240/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147217.324473:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514fb80 with x1830967310538240 ext(4886528->4890623) 00002000:00010000:3.0:1746147217.324478:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514fb80 00000100:00100000:3.0:1746147217.324510:0:29478:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7500 00000100:00100000:3.0:1746147217.324517:0:29478:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310538240:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:3.0:1746147217.324683:0:29478:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2003:x1830967310538240:12345-192.168.204.25@tcp:3:cat.0 Request processed in 165us (1625us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746147217.324689:0:29478:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7500 00002000:00100000:3.0:1746147217.324694:0:29478:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (4886528->4890623) req@ffff88009514fb80 x1830967310538240/t0(0) o3->b52e0b40-fb04-4c4c-8912-aa690ee7230d@192.168.204.25@tcp:593/0 lens 488/4536 e 0 to 0 dl 1746147228 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746147217.324701:0:29478:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514fb80 with x1830967310538240 ext(4886528->4890623) 00002000:00010000:3.0:1746147217.324704:0:29478:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514fb80 00000100:00100000:2.0:1746147217.332177:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147217.332223:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147217.332313:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310538496 00000100:00100000:0.0:1746147217.332323:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310538496 00002000:00100000:0.0:1746147217.332375:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880095127b80 x1830967310538496/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147217.332385:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095127b80 with x1830967310538496 ext(2097152->4194303) 00010000:00010000:0.0:1746147217.332394:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063b2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f1 expref: 13 pid: 13695 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746147217.332409:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063b2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f1 expref: 13 pid: 13695 timeout: 855 lvb_type: 0 00002000:00010000:0.0:1746147217.332416:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095127b80 00000100:00100000:0.0:1746147217.332446:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310538752 00000100:00100000:0.0:1746147217.332448:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310538752 00002000:00100000:0.0:1746147217.332460:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4046847) req@ffff880095124380 x1830967310538752/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746147217.332467:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095124380 with x1830967310538752 ext(2097152->4046847) 00002000:00010000:0.0:1746147217.332469:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095124380 00000100:00100000:0.0:1746147217.332489:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1773 00000100:00100000:0.0:1746147217.332496:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310538496:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147217.332721:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7501 00000100:00100000:1.0:1746147217.332730:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310538752:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147217.352726:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310538496:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 20217us (20546us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746147217.352740:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1773 00002000:00100000:1.0:1746147217.352754:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880095127b80 x1830967310538496/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/440 e 0 to 0 dl 1746147228 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147217.352764:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095127b80 with x1830967310538496 ext(2097152->4194303) 00010000:00010000:1.0:1746147217.352774:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063b2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f1 expref: 13 pid: 13695 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746147217.352788:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063b2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f1 expref: 13 pid: 13695 timeout: 855 lvb_type: 0 00002000:00010000:1.0:1746147217.352795:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095127b80 00000100:00100000:0.0:1746147217.363461:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147217.363639:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310538880 00000100:00100000:1.0:1746147217.364633:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2000:x1830967310538752:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 31900us (32404us total) trans 0 rc 1949696/1949696 00000100:00100000:1.0:1746147217.364646:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7501 00002000:00100000:1.0:1746147217.364659:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (2097152->4046847) req@ffff880095124380 x1830967310538752/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/440 e 0 to 0 dl 1746147228 ref 1 fl Complete:/200/0 rc 1949696/1949696 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147217.364669:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095124380 with x1830967310538752 ext(2097152->4046847) 00002000:00010000:1.0:1746147217.364676:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095124380 00000100:00100000:2.0:1746147217.364885:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310538880 00010000:00010000:2.0:1746147217.364920:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063b2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f1 expref: 13 pid: 13695 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746147217.365649:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9283 00000100:00100000:2.0:1746147217.365658:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2000:x1830967310538880:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147217.365673:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147217.365692:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063b2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f1 expref: 13 pid: 13695 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746147217.365704:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063b2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f1 expref: 13 pid: 13695 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746147217.365727:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063b2c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f1 expref: 13 pid: 13695 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746147217.365748:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147217.365750:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147217.365756:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x3139939425063b48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4194304->4767743] (req 4194304->4767743) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f90d expref: 12 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.365764:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x3139939425063b48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4194304->4767743] (req 4194304->4767743) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f90d expref: 12 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147217.365794:0:13715:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x3139939425063b48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4194304->4767743] (req 4194304->4767743) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f90d expref: 12 pid: 13695 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147217.365804:0:13715:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095125500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311555200:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147217.365880:0:13715:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:0.0:1746147217.376321:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.376396:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310539008 00000100:00100000:3.0:1746147217.376407:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310539008 00000100:00100000:2.0:1746147217.376451:0:13715:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095125500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13715:1830967311555200:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147217.376472:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20464 00010000:00010000:2.0:1746147217.376477:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147217.376481:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:3030:x1830967310539008:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147217.376500:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147217.376520:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55cdc00/0x3139939425063b64 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f929 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.376559:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147217.376561:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147217.376569:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55cdc00/0x3139939425063b64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f929 expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.376584:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55cdc00/0x3139939425063b64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f929 expref: 14 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.376595:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55cdc00, rc 0) 00000100:00100000:2.0:1746147217.376805:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310538880:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 11147us (13354us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147217.376815:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9283 00000100:00100000:3.0:1746147217.376884:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:3030:x1830967310539008:12345-192.168.204.25@tcp:101:cat.0 Request processed in 403us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147217.376889:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20464 00000100:00100000:0.0:1746147217.378300:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147217.378379:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310539264 00000100:00100000:1.0:1746147217.378385:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310539264 00002000:00100000:1.0:1746147217.378421:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (4763648->4767743) req@ffff880093145500 x1830967310539264/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147217.378431:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093145500 with x1830967310539264 ext(4763648->4767743) 00002000:00010000:1.0:1746147217.378436:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093145500 00000100:00100000:1.0:1746147217.378467:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7502 00000100:00100000:1.0:1746147217.378474:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2003:x1830967310539264:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:1.0:1746147217.378600:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2003:x1830967310539264:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 127us (303us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746147217.378606:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7502 00002000:00100000:1.0:1746147217.378611:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (4763648->4767743) req@ffff880093145500 x1830967310539264/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/4536 e 0 to 0 dl 1746147228 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147217.378617:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093145500 with x1830967310539264 ext(4763648->4767743) 00002000:00010000:1.0:1746147217.378620:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093145500 00000100:00100000:0.0:1746147217.381037:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147217.381211:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310539520 00000100:00100000:2.0:1746147217.381220:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310539520 00002000:00100000:2.0:1746147217.381293:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880093147800 x1830967310539520/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147217.381304:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093147800 with x1830967310539520 ext(3145728->4194303) 00002000:00010000:2.0:1746147217.381310:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093147800 00000100:00100000:2.0:1746147217.381346:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7503 00000100:00100000:2.0:1746147217.381355:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2002:x1830967310539520:12345-192.168.204.25@tcp:3:multiop.0 00000100:00100000:0.0:1746147217.385418:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147217.387718:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310539648 00000100:00100000:1.0:1746147217.387732:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310539648 00002000:00100000:1.0:1746147217.387785:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (4046848->4194303) req@ffff880093145180 x1830967310539648/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147217.387802:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093145180 with x1830967310539648 ext(4046848->4194303) 00002000:00010000:1.0:1746147217.387808:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093145180 00000100:00100000:1.0:1746147217.387850:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7504 00000100:00100000:1.0:1746147217.387858:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2002:x1830967310539648:12345-192.168.204.25@tcp:4:multiop.0 00000100:00100000:0.0:1746147217.390925:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147217.392378:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310539904 00000100:00100000:1.0:1746147217.392391:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310539904 00000100:00100000:1.0:1746147217.392450:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6202 00000100:00100000:1.0:1746147217.392459:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:3033:x1830967310539904:12345-192.168.204.25@tcp:35:multiop.0 00000100:00100000:1.0:1746147217.392732:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:3033:x1830967310539904:12345-192.168.204.25@tcp:35:multiop.0 Request processed in 273us (1817us total) trans 8589937461 rc 0/0 00000100:00100000:1.0:1746147217.392739:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6202 00000100:00100000:2.0:1746147217.394466:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2002:x1830967310539520:12345-192.168.204.25@tcp:3:multiop.0 Request processed in 13103us (13431us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147217.394476:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7503 00002000:00100000:2.0:1746147217.394486:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880093147800 x1830967310539520/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/440 e 0 to 0 dl 1746147228 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746147217.394495:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093147800 with x1830967310539520 ext(3145728->4194303) 00002000:00010000:2.0:1746147217.394504:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093147800 00000100:00100000:1.0:1746147217.395258:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+20:2002:x1830967310539648:12345-192.168.204.25@tcp:4:multiop.0 Request processed in 7399us (9849us total) trans 17179875358 rc 0/0 00000100:00100000:1.0:1746147217.395266:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7504 00002000:00100000:1.0:1746147217.395272:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x98:0x0] (4046848->4194303) req@ffff880093145180 x1830967310539648/t17179875358(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/448 e 0 to 0 dl 1746147228 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746147217.395280:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093145180 with x1830967310539648 ext(4046848->4194303) 00002000:00010000:1.0:1746147217.395284:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093145180 00000100:00100000:0.0:1746147217.401225:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.401535:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310540032 00000100:00100000:3.0:1746147217.401547:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310540032 00000100:00100000:3.0:1746147217.403645:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20465 00000100:00100000:3.0:1746147217.403663:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2002:x1830967310540032:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147217.403684:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147217.403707:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425063b6b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f930 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.403742:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425063b6b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f930 expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147217.403754:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55cc800/0x3139939425063b6b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f930 expref: 14 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147217.403778:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55cc800, rc 0) 00000100:00100000:3.0:1746147217.403838:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2002:x1830967310540032:12345-192.168.204.25@tcp:101:cat.0 Request processed in 182us (2623us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147217.403843:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20465 00000100:00100000:0.0:1746147217.409568:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147217.409670:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310540160 00000100:00100000:1.0:1746147217.409679:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310540160 00000100:00100000:1.0:1746147217.409742:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20466 00000100:00100000:1.0:1746147217.409751:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:3030:x1830967310540160:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147217.409772:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147217.409793:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425063b72 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f937 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147217.409821:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147217.409822:0:13695:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147217.409831:0:13695:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425063b72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [4767744->18446744073709551615] (req 4767744->4890623) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f937 expref: 14 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147217.409845:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425063b72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [4767744->18446744073709551615] (req 4767744->4890623) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f937 expref: 14 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147217.409855:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b0a00, rc 0) 00000100:00100000:1.0:1746147217.410661:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:3030:x1830967310540160:12345-192.168.204.25@tcp:101:cat.0 Request processed in 909us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147217.410668:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20466 00000100:00100000:3.0:1746147217.413242:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147217.413360:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310540416 00000100:00100000:1.0:1746147217.413368:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310540416 00002000:00100000:1.0:1746147217.413413:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (4767744->4890623) req@ffff88009514a300 x1830967310540416/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/0 e 0 to 0 dl 1746147228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147217.413422:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514a300 with x1830967310540416 ext(4767744->4890623) 00002000:00010000:1.0:1746147217.413427:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514a300 00000100:00100000:1.0:1746147217.413459:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7505 00000100:00100000:1.0:1746147217.413465:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310540416:12345-192.168.204.25@tcp:3:cat.0 00000100:00100000:1.0:1746147217.417635:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2000:x1830967310540416:12345-192.168.204.25@tcp:3:cat.0 Request processed in 4155us (4387us total) trans 0 rc 122880/122880 00000100:00100000:1.0:1746147217.417649:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7505 00002000:00100000:1.0:1746147217.417661:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (4767744->4890623) req@ffff88009514a300 x1830967310540416/t0(0) o3->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:593/0 lens 488/440 e 0 to 0 dl 1746147228 ref 1 fl Complete:/200/0 rc 122880/122880 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147217.417672:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009514a300 with x1830967310540416 ext(4767744->4890623) 00002000:00010000:1.0:1746147217.417678:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009514a300 00000100:00100000:0.0:1746147217.423251:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147217.423923:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310540544 00000100:00100000:3.0:1746147217.423933:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310540544 00000100:00100000:3.0:1746147217.423994:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20467 00000100:00100000:3.0:1746147217.424002:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310540544:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:3.0:1746147217.424021:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147217.424044:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4c00/0x3139939425063b79 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f93e expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147217.424076:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4c00/0x3139939425063b79 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f93e expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147217.424086:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9b4c00/0x3139939425063b79 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f93e expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147217.424157:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9b4c00, rc 0) 00000100:00100000:3.0:1746147217.424209:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2001:x1830967310540544:12345-192.168.204.25@tcp:101:cat.0 Request processed in 206us (967us total) trans 0 rc 301/301 00000100:00100000:3.0:1746147217.424220:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20467 00000100:00100000:0.0:1746147217.428436:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147217.429043:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310540672 00000100:00100000:1.0:1746147217.429053:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310540672 00000100:00100000:1.0:1746147217.429144:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20468 00000100:00100000:1.0:1746147217.429152:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2003:x1830967310540672:12345-192.168.204.25@tcp:101:cat.0 00010000:00010000:1.0:1746147217.429171:0:13695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147217.429192:0:13695:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b1000/0x3139939425063b80 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f945 expref: -99 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147217.429224:0:13695:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1000/0x3139939425063b80 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f945 expref: 15 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147217.429235:0:13695:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1000/0x3139939425063b80 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f945 expref: 15 pid: 13695 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147217.429252:0:13695:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800993b1000, rc 0) 00000100:00100000:1.0:1746147217.429300:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2003:x1830967310540672:12345-192.168.204.25@tcp:101:cat.0 Request processed in 148us (876us total) trans 0 rc 301/301 00000100:00100000:1.0:1746147217.429305:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20468 00000100:00100000:0.0:1746147217.437262:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147217.439524:0:7240:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310540928 00000100:00100000:2.0:1746147217.439545:0:7240:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310540928 00000100:00100000:2.0:1746147217.439617:0:7240:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6203 00000100:00100000:2.0:1746147217.439626:0:7240:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:3030:x1830967310540928:12345-192.168.204.25@tcp:35:cat.0 00000100:00100000:2.0:1746147217.439858:0:7240:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:3030:x1830967310540928:12345-192.168.204.25@tcp:35:cat.0 Request processed in 232us (2608us total) trans 8589937462 rc 0/0 00000100:00100000:2.0:1746147217.439865:0:7240:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6203 00010000:00010000:1.0:1746147217.825384:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147218.113083:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.113148:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.113172:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.113191:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310541056 00000100:00100000:1.0:1746147218.113198:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310541312 00000100:00100000:0.0:1746147218.113199:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310541056 00000100:00100000:1.0:1746147218.113208:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310541312 00000100:00100000:0.0:1746147218.113252:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310541184 00000100:00100000:0.0:1746147218.113255:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310541184 00000100:00100000:1.0:1746147218.113269:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20469 00000100:00100000:1.0:1746147218.113277:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2002:x1830967310541056:12345-192.168.204.25@tcp:16:kworker.0 00000100:00100000:0.0:1746147218.113560:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20470 00000100:00100000:0.0:1746147218.113568:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310541312:12345-192.168.204.25@tcp:16:kworker.0 00000100:00080000:1.0:1746147218.113572:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147218.113597:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20471 00000100:00100000:1.0:1746147218.113603:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+21:2002:x1830967310541184:12345-192.168.204.25@tcp:16:kworker.0 00000100:00100000:0.0:1746147218.113660:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.113805:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310541440 00000100:00100000:0.0:1746147218.113808:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310541440 00000100:00100000:0.0:1746147218.113835:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20472 00000100:00100000:0.0:1746147218.113839:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+15:2002:x1830967310541440:12345-192.168.204.25@tcp:16:kworker.0 00000100:00100000:0.0:1746147218.114824:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.114855:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.114884:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147218.114913:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310541568 00000100:00100000:1.0:1746147218.114920:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310541568 00002000:00100000:1.0:1746147218.114952:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4767743) req@ffff880093144380 x1830967310541568/t0(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:594/0 lens 488/0 e 0 to 0 dl 1746147229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147218.114961:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093144380 with x1830967310541568 ext(4194304->4767743) 00002000:00010000:1.0:1746147218.114968:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093144380 00000100:00100000:1.0:1746147218.114987:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7506 00000100:00100000:2.0:1746147218.114989:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310541696 00000100:00100000:1.0:1746147218.114992:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:2003:x1830967310541568:12345-192.168.204.25@tcp:4:cat.0 00000100:00100000:2.0:1746147218.114994:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310541696 00000100:00100000:2.0:1746147218.115031:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310541824 00000100:00100000:2.0:1746147218.115034:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310541824 00000100:00100000:3.0:1746147218.115159:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20473 00000100:00100000:2.0:1746147218.115169:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20474 00000100:00100000:3.0:1746147218.115170:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+18:2003:x1830967310541696:12345-192.168.204.25@tcp:16:kworker.0 00000100:00100000:2.0:1746147218.115176:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+22:2003:x1830967310541824:12345-192.168.204.25@tcp:16:kworker.0 00000001:00080000:0.0:1746147218.119654:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842754 is committed 00000001:00080000:0.0:1746147218.119677:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842752 is committed 00000001:00080000:0.0:1746147218.119686:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842750 is committed 00000001:00080000:0.0:1746147218.119726:0:30382:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474842732 is committed 00000100:00100000:0.0:1746147218.119913:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:27888ca4-3347-429c-8b24-1b5eba1f59cf+14:2002:x1830967310541056:12345-192.168.204.25@tcp:16:kworker.0 Request processed in 6628us (6828us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147218.119925:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20469 00000100:00100000:1.0:1746147218.120068:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:27888ca4-3347-429c-8b24-1b5eba1f59cf+13:2002:x1830967310541440:12345-192.168.204.25@tcp:16:kworker.0 Request processed in 6226us (6406us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147218.120076:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20472 00000100:00100000:3.0:1746147218.120673:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2003:x1830967310541696:12345-192.168.204.25@tcp:16:kworker.0 Request processed in 5504us (5850us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147218.120681:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20473 00000001:00080000:3.0:1746147218.122164:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875358 is committed 00000001:00080000:3.0:1746147218.122185:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875356 is committed 00000001:00080000:3.0:1746147218.122194:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875355 is committed 00000001:00080000:3.0:1746147218.122232:0:32001:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179875339 is committed 00000100:00100000:1.0:1746147218.122586:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:2002:x1830967310541184:12345-192.168.204.25@tcp:16:kworker.0 Request processed in 8977us (9406us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147218.122596:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20471 00000100:00100000:3.0:1746147218.122699:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:27888ca4-3347-429c-8b24-1b5eba1f59cf+9:2002:x1830967310541312:12345-192.168.204.25@tcp:16:kworker.0 Request processed in 9130us (9548us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147218.122706:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20470 00000100:00100000:0.0:1746147218.123050:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:2003:x1830967310541824:12345-192.168.204.25@tcp:16:kworker.0 Request processed in 7874us (8163us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147218.123057:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20474 00000100:00100000:1.0:1746147218.131364:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:2003:x1830967310541568:12345-192.168.204.25@tcp:4:cat.0 Request processed in 16358us (16494us total) trans 21474842755 rc 0/0 00000100:00100000:1.0:1746147218.131379:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7506 00002000:00100000:1.0:1746147218.131395:0:13334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (4194304->4767743) req@ffff880093144380 x1830967310541568/t21474842755(0) o4->27888ca4-3347-429c-8b24-1b5eba1f59cf@192.168.204.25@tcp:594/0 lens 488/448 e 0 to 0 dl 1746147229 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746147218.131404:0:13334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093144380 with x1830967310541568 ext(4194304->4767743) 00002000:00010000:1.0:1746147218.131410:0:13334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093144380 00000100:00100000:0.0:1746147218.148755:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.148944:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310542336 00000100:00100000:2.0:1746147218.148954:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310542336 00000100:00100000:2.0:1746147218.149015:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20475 00000100:00100000:2.0:1746147218.149022:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+8:1999:x1830967310542336:12345-192.168.204.25@tcp:9:umount.0 00000020:00000080:2.0:1746147218.149054:0:1853:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x313993942505833b 00000020:00010000:2.0:1746147218.149061:0:1853:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800969c4000: total 0 00000100:00080000:2.0:1746147218.149066:0:1853:0:(import.c:66:import_set_state_nolock()) ffff8800969c3000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746147218.150906:0:1853:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179875358 00000100:00100000:2.0:1746147218.151114:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+6:1999:x1830967310542336:12345-192.168.204.25@tcp:9:umount.0 Request processed in 2087us (2364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147218.151124:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20475 00000020:00010000:1.0:1746147218.151826:0:7228:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800969c4000: total 0 00010000:00010000:1.0:1746147218.151831:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746147218.151881:0:7228:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800969c4000, canceled 0 locks, left on hash table 3. 00010000:00010000:1.0:1746147218.151947:0:7228:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cd3800/0x313993942506396c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7bd expref: 5 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.151993:0:7228:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009256f400/0x3139939425063949 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f79a expref: 4 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.152012:0:7228:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a55cca00/0x3139939425063b33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4046848->4194303) gid 0 flags: 0x44801000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8f8 expref: 3 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.152031:0:7228:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800969c4000, canceled 3 locks, left on hash table 0. 00010000:00010000:1.0:1746147218.152041:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746147218.152042:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746147218.152044:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147218.153243:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.153285:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.153316:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.153385:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310542592 00000100:00100000:0.0:1746147218.153394:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310542592 00000100:00100000:0.0:1746147218.153438:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310542464 00000100:00100000:0.0:1746147218.153440:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310542464 00000100:00100000:0.0:1746147218.153454:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310542720 00000100:00100000:0.0:1746147218.153456:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310542720 00000100:00100000:0.0:1746147218.153474:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1008 00000100:00100000:0.0:1746147218.153481:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+17:2000:x1830967310542592:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147218.153496:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147218.153511:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880136348800/0x3139939425058318 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78f88 expref: 17 pid: 8099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.153541:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147218.153580:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+16:2000:x1830967310542592:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 98us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147218.153586:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1008 00000100:00100000:0.0:1746147218.153601:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1009 00000100:00100000:0.0:1746147218.153605:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+15:2000:x1830967310542464:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147218.153612:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147218.153619:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880136348c00/0x3139939425058311 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78f57 expref: 15 pid: 8098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.153626:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147218.153639:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+14:2000:x1830967310542464:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 34us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147218.153644:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1009 00000100:00100000:0.0:1746147218.153688:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1010 00000100:00100000:0.0:1746147218.153692:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+13:2000:x1830967310542720:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147218.153698:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147218.153705:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880136348000/0x313993942505831f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78f8f expref: 13 pid: 8098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.153711:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147218.153723:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+12:2000:x1830967310542720:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 30us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147218.153728:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1010 00000100:00100000:0.0:1746147218.176862:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.177009:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310543232 00000100:00100000:2.0:1746147218.177018:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310543232 00000100:00100000:2.0:1746147218.177079:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20476 00000100:00100000:2.0:1746147218.177125:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+12:1999:x1830967310543232:12345-192.168.204.25@tcp:9:umount.0 00000020:00000080:2.0:1746147218.177157:0:1853:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x3139939425058334 00000020:00010000:2.0:1746147218.177165:0:1853:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800969c0800: total 0 00000100:00080000:2.0:1746147218.177170:0:1853:0:(import.c:66:import_set_state_nolock()) ffff8800969c0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746147218.178485:0:1853:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474842755 00000100:00100000:2.0:1746147218.178662:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:27888ca4-3347-429c-8b24-1b5eba1f59cf+10:1999:x1830967310543232:12345-192.168.204.25@tcp:9:umount.0 Request processed in 1570us (1809us total) trans 0 rc 0/0 00000020:00010000:1.0:1746147218.179698:0:10927:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800969c0800: total 0 00010000:00010000:1.0:1746147218.180405:0:10927:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800969c0800, canceled 0 locks, left on hash table 5. 00010000:00010000:1.0:1746147218.180468:0:10927:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f03dc00/0x3139939425063b10 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8d5 expref: 10 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.180511:0:10927:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f03cc00/0x3139939425063adf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8c0 expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.180539:0:10927:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009400b800/0x3139939425063b48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [4194304->4767743] (req 4194304->4767743) gid 0 flags: 0x44801000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f90d expref: 8 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.180557:0:10927:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55cdc00/0x3139939425063b64 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f929 expref: 7 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.180569:0:10927:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b0a00/0x3139939425063b72 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [4767744->18446744073709551615] (req 4767744->4890623) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f937 expref: 6 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.180577:0:10927:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800969c0800, canceled 5 locks, left on hash table 0. 00010000:00010000:1.0:1746147218.180588:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746147218.180590:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746147218.180592:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746147218.180753:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20476 00000100:00100000:0.0:1746147218.189144:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147218.189329:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310543616 00000100:00100000:3.0:1746147218.189338:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310543616 00000100:00100000:3.0:1746147218.189410:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16548 00000100:00080000:1.0:1746147218.189418:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147218.189419:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+17:1999:x1830967310543616:12345-192.168.204.25@tcp:39:umount.0 00000020:00000080:3.0:1746147218.189589:0:9138:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x3139939425058326 00000020:00010000:3.0:1746147218.189596:0:9138:0:(genops.c:1938:obd_stale_export_put()) Put export ffff880131081800: total 0 00000100:00080000:3.0:1746147218.189601:0:9138:0:(import.c:66:import_set_state_nolock()) ffff880131087800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746147218.189621:0:9138:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589937462 00000100:00100000:3.0:1746147218.189767:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+16:1999:x1830967310543616:12345-192.168.204.25@tcp:39:umount.0 Request processed in 349us (634us total) trans 8589937463 rc 0/0 00000100:00100000:3.0:1746147218.189774:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16548 00000020:00010000:0.0:1746147218.190173:0:12215:0:(genops.c:1924:obd_stale_export_get()) Get export ffff880131081800: total 0 00010000:00010000:0.0:1746147218.193664:0:12215:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff880131081800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1746147218.193713:0:12215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147218.193717:0:12215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746147218.193729:0:12215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbec200/0x3139939425063abc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8a4 expref: 15 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.193770:0:12215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147218.193772:0:12215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1746147218.193775:0:12215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a56200/0x313993942505cbf7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7b81c expref: 14 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.193786:0:12215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147218.193787:0:12215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147218.193790:0:12215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7c00/0x313993942506390a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f75b expref: 13 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.193804:0:12215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147218.193805:0:12215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746147218.193808:0:12215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12c000/0x31399394250583ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7904c expref: 12 pid: 7239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.193817:0:12215:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff880131081800, canceled 4 locks, left on hash table 0. 00010000:00010000:0.0:1746147218.193828:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147218.193830:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147218.193833:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147218.201879:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147218.201966:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310543744 00000100:00100000:3.0:1746147218.201982:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310543744 00000100:00100000:3.0:1746147218.202053:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16549 00000100:00100000:3.0:1746147218.202069:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+5:1999:x1830967310543744:12345-192.168.204.25@tcp:39:umount.0 00000020:00000080:3.0:1746147218.202139:0:9138:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x313993942505832d 00000100:00080000:3.0:1746147218.202148:0:9138:0:(import.c:66:import_set_state_nolock()) ffff880099035800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746147218.202180:0:9138:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294977419 00010000:00010000:1.0:1746147218.202197:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147218.202341:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:27888ca4-3347-429c-8b24-1b5eba1f59cf+3:1999:x1830967310543744:12345-192.168.204.25@tcp:39:umount.0 Request processed in 280us (472us total) trans 4294977420 rc 0/0 00000100:00100000:3.0:1746147218.202349:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16549 00000100:00100000:0.0:1746147218.783894:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.787556:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147218.787595:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310544000 00000100:00100000:1.0:1746147218.787606:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310544000 00000100:00100000:1.0:1746147218.787674:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1011 00000100:00100000:1.0:1746147218.787682:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+12:2000:x1830967310544000:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147218.787696:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147218.787717:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008f390000/0x3139939425058349 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ff1 expref: 12 pid: 8098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.787749:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147218.787799:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+11:2000:x1830967310544000:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 118us (3917us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147218.787806:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1011 00000100:00100000:0.0:1746147218.788594:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.789260:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147218.789313:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310544512 00000100:00100000:3.0:1746147218.789319:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310544512 00000100:00100000:2.0:1746147218.789386:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310544128 00000100:00100000:2.0:1746147218.789391:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310544128 00000100:00100000:2.0:1746147218.789432:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310543872 00000100:00100000:2.0:1746147218.789434:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310543872 00000100:00100000:2.0:1746147218.789454:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1012 00000100:00100000:2.0:1746147218.789461:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+12:2000:x1830967310544128:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746147218.789462:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 1013 00000100:00100000:1.0:1746147218.789470:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+12:2003:x1830967310543872:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147218.789472:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147218.789479:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147218.789485:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008f390c00/0x3139939425058350 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78ff8 expref: 12 pid: 8098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.789488:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008f12d400/0x3139939425058342 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e78fc0 expref: 12 pid: 8099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.789499:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147218.789511:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147218.789542:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+10:2003:x1830967310543872:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 72us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147218.789548:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1013 00000100:00100000:2.0:1746147218.789802:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68fe9b0e-eb4c-44cb-92aa-f519f5524e78+9:2000:x1830967310544128:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 340us (2256us total) trans 0 rc 0/0 00000100:00080000:1.0:1746147218.789808:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746147218.789809:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20477 00000100:00100000:2.0:1746147218.789809:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 1012 00000100:00100000:3.0:1746147218.789817:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+7:1999:x1830967310544512:12345-192.168.204.25@tcp:9:umount.0 00000020:00000080:3.0:1746147218.789842:0:1853:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x3139939425058365 00000020:00010000:3.0:1746147218.789849:0:1853:0:(genops.c:1938:obd_stale_export_put()) Put export ffff880098ba1800: total 0 00000100:00080000:3.0:1746147218.789853:0:1853:0:(import.c:66:import_set_state_nolock()) ffff8800a5781800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1746147218.789873:0:7228:0:(genops.c:1924:obd_stale_export_get()) Get export ffff880098ba1800: total 0 00000001:00000004:3.0:1746147218.789903:0:1853:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179875358 00010000:00010000:1.0:1746147218.789916:0:7228:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff880098ba1800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1746147218.789956:0:7228:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a57600/0x313993942505cd32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7b8c4 expref: 6 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.789982:0:7228:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e260400/0x31399394250595e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3813376->4145151) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e799ec expref: 6 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.789995:0:7228:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff880098ba1800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1746147218.790004:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746147218.790006:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746147218.790008:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147218.790017:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+2:1999:x1830967310544512:12345-192.168.204.25@tcp:9:umount.0 Request processed in 200us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147218.790023:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20477 00000100:00100000:0.0:1746147218.801762:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147218.801872:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310545024 00000100:00100000:3.0:1746147218.801883:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310545024 00000100:00100000:3.0:1746147218.801961:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20478 00000100:00100000:3.0:1746147218.801970:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+8:1999:x1830967310545024:12345-192.168.204.25@tcp:9:umount.0 00000020:00000080:3.0:1746147218.802004:0:1853:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x313993942505836c 00000020:00010000:3.0:1746147218.802012:0:1853:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009a981000: total 0 00000100:00080000:3.0:1746147218.802016:0:1853:0:(import.c:66:import_set_state_nolock()) ffff88009a980000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746147218.802076:0:1853:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474842755 00000020:00010000:0.0:1746147218.802419:0:10927:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009a981000: total 0 00010000:00010000:0.0:1746147218.802424:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147218.802464:0:10927:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009a981000, canceled 0 locks, left on hash table 3. 00000100:00080000:1.0:1746147218.802517:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746147218.802692:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+6:1999:x1830967310545024:12345-192.168.204.25@tcp:9:umount.0 Request processed in 722us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147218.802700:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20478 00010000:00010000:0.0:1746147218.804873:0:10927:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098887e00/0x313993942505c758 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 5488640->5550079) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7b58a expref: 5 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.804960:0:10927:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a1ec00/0x313993942505ca22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7b751 expref: 4 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.804980:0:10927:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098886c00/0x313993942505c751 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2342912->2404351) gid 0 flags: 0x44801000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7b583 expref: 3 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.804993:0:10927:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009a981000, canceled 3 locks, left on hash table 0. 00010000:00010000:0.0:1746147218.805037:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147218.805038:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147218.805041:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147218.810847:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147218.810969:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310545280 00000100:00100000:3.0:1746147218.810978:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310545280 00000100:00080000:1.0:1746147218.811266:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746147218.811293:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16550 00000100:00100000:3.0:1746147218.811302:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+6:1999:x1830967310545280:12345-192.168.204.25@tcp:39:umount.0 00000020:00000080:3.0:1746147218.811340:0:9138:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x313993942505835e 00000020:00010000:3.0:1746147218.811348:0:9138:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800b42a5800: total 0 00000100:00080000:3.0:1746147218.811352:0:9138:0:(import.c:66:import_set_state_nolock()) ffff8800b42a6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746147218.811380:0:9138:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589937463 00000020:00010000:0.0:1746147218.811391:0:12215:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800b42a5800: total 0 00010000:00010000:0.0:1746147218.811445:0:12215:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800b42a5800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1746147218.811477:0:12215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:0.0:1746147218.811480:0:12215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746147218.811487:0:12215:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2ee200/0x313993942505837a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e79029 expref: 5 pid: 7238 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147218.811524:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+4:1999:x1830967310545280:12345-192.168.204.25@tcp:39:umount.0 Request processed in 222us (687us total) trans 8589937464 rc 0/0 00000100:00100000:3.0:1746147218.811532:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16550 00010000:00010000:0.0:1746147218.811827:0:12215:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800b42a5800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1746147218.811842:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147218.811844:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746147218.811846:0:12215:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147218.818474:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147218.818833:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310545408 00000100:00100000:3.0:1746147218.818843:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310545408 00000100:00100000:3.0:1746147218.819670:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16551 00000100:00100000:3.0:1746147218.819681:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+5:1999:x1830967310545408:12345-192.168.204.25@tcp:39:umount.0 00000020:00000080:3.0:1746147218.819719:0:9138:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x3139939425058357 00000100:00080000:3.0:1746147218.819727:0:9138:0:(import.c:66:import_set_state_nolock()) ffff880131080800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746147218.819756:0:9138:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294977420 00010000:00010000:1.0:1746147218.819779:0:7229:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147218.819902:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097eb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4b43ad24-8860-49d9-a9ff-4a4a0414ff18+3:1999:x1830967310545408:12345-192.168.204.25@tcp:39:umount.0 Request processed in 222us (1438us total) trans 4294977421 rc 0/0 00000100:00100000:3.0:1746147218.819909:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16551 00010000:00010000:1.0:1746147218.828977:0:7228:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746147218.844619:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147218.844752:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310545536 00000100:00100000:3.0:1746147218.844763:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310545536 00000100:00100000:3.0:1746147218.844829:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16552 00000100:00100000:3.0:1746147218.844838:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+35:3078:x1830967310545536:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147218.844865:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147218.844887:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425063b87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f94c expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.844951:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f213800/0x3139939425063b8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.844964:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011f213800/0x3139939425063b8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.844974:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f213800/0x3139939425063b8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.844988:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063b95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.844993:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.844997:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.845067:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063b9c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.845077:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f88f expref: 36 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.845083:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063b9c lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.845143:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f88f expref: 36 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.845155:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f88f expref: 36 pid: 7237 timeout: 856 lvb_type: 0 00000100:00100000:3.0:1746147218.845166:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311555328:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147218.845256:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147218.850545:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147218.850643:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310545792 00000100:00100000:1.0:1746147218.850652:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310545792 00000100:00100000:1.0:1746147218.851925:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6204 00000100:00100000:1.0:1746147218.851940:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:30601:x1830967310545792:12345-192.168.204.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746147218.852191:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:30601:x1830967310545792:12345-192.168.204.25@tcp:35:ldlm_bl.0 Request processed in 255us (1656us total) trans 8589937465 rc 0/0 00000100:00100000:3.0:1746147218.852564:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311555328:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147218.852593:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063b9c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:1.0:1746147218.853869:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6204 00000100:00100000:0.0:1746147218.854947:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.855066:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310545920 00000100:00100000:2.0:1746147218.855073:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310545920 00010000:00010000:2.0:1746147218.855131:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f88f expref: 38 pid: 7237 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746147218.855166:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9284 00000100:00100000:2.0:1746147218.855173:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2002:x1830967310545920:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147218.855185:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147218.855190:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f88f expref: 38 pid: 7237 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746147218.855200:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f88f expref: 38 pid: 7237 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746147218.855222:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f38ce00/0x3139939425063a8b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f88f expref: 38 pid: 7237 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746147218.855253:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147218.855258:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063b9c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147218.855271:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063b9c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147218.855277:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063b9c lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147218.855302:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147218.855339:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2002:x1830967310545920:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 166us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147218.855344:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9284 00010000:00010000:3.0:1746147218.855392:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063b9c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.855400:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063b9c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147218.855448:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147218.855451:0:9138:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147218.855466:0:9138:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063b9c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.855474:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063b9c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.855485:0:9138:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f213800/0x3139939425063b8e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.855491:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011f213800/0x3139939425063b8e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.855496:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011f213800/0x3139939425063b8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.855519:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011f213800/0x3139939425063b8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.855524:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f213800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147218.855527:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f213800/0x3139939425063b8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.855534:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011f213800/0x3139939425063b8e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.855546:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a89def00) 00010000:00010000:3.0:1746147218.855548:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147218.855552:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011f213800/0x3139939425063b8e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.855557:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f213800/0x3139939425063b8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.855574:0:9138:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.855579:0:9138:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063b95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.855583:0:9138:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063b95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.855588:0:9138:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958e1400 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:3.0:1746147218.855590:0:9138:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063b95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.855595:0:9138:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063b95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.855604:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88013362d300) 00010000:00010000:3.0:1746147218.855606:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746147218.855608:0:9138:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063b95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.855612:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063b95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.855641:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425063b87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f94c expref: 37 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.855653:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063b9c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f94c expref: 36 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.855659:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147218.855661:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147218.855663:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0c00, rc 0) 00000100:00100000:3.0:1746147218.855691:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:3078:x1830967310545536:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 10855us (11084us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147218.855698:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16552 00000100:00100000:0.0:1746147218.857789:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.858152:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.858204:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310546048 00000100:00100000:2.0:1746147218.858212:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310546048 00000100:00080000:1.0:1746147218.858259:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746147218.858279:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310546176 00000100:00100000:2.0:1746147218.858282:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310546176 00000100:00080000:1.0:1746147218.858297:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746147218.858548:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20479 00000100:00100000:3.0:1746147218.858555:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20480 00000100:00100000:3.0:1746147218.858565:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2002:x1830967310546176:12345-192.168.204.25@tcp:101:lfs.0 00000100:00100000:2.0:1746147218.858567:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2002:x1830967310546048:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147218.858581:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147218.858581:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147218.858599:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2ae00/0x3139939425063ba3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f953 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.858600:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425063baa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f95a expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.858622:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1746147218.858624:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x98:0x0] initial LVB size: 4194304, mtime: 0x68141791, atime: 0x68141791, ctime: 0x68141791, blocks: 0x1008 00010000:00010000:2.0:1746147218.858624:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147218.858634:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2ae00/0x3139939425063ba3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f953 expref: 23 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147218.858638:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147218.858640:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147218.858645:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425063baa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f95a expref: 25 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147218.858648:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095a2ae00/0x3139939425063ba3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f953 expref: 23 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147218.858655:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425063baa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f95a expref: 25 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147218.858659:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095a2ae00, rc 0) 00010000:00010000:3.0:1746147218.858662:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011f212c00, rc 0) 00000100:00100000:3.0:1746147218.858704:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2002:x1830967310546176:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 142us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147218.858704:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2002:x1830967310546048:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 149us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147218.858710:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20479 00000100:00100000:3.0:1746147218.858713:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20480 00000100:00100000:0.0:1746147218.863330:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147218.863388:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310546432 00000100:00100000:3.0:1746147218.863398:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310546432 00000100:00100000:3.0:1746147218.863455:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16553 00000100:00100000:3.0:1746147218.863464:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+36:3078:x1830967310546432:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147218.863490:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147218.863519:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f213800/0x3139939425063bb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f961 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.863633:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063bb8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.863647:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063b9c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f94c expref: 37 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.863654:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063bb8 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.863692:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063b9c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f94c expref: 37 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.863706:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063b9c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f94c expref: 37 pid: 9138 timeout: 856 lvb_type: 0 00000100:00100000:3.0:1746147218.863718:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311555456:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147218.865794:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962840 going to sleep for 11 seconds 00000100:00100000:0.0:1746147218.866856:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147218.866916:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311555456:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147218.866942:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063bb8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:2.0:1746147218.866946:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310546560 00000100:00100000:2.0:1746147218.866954:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310546560 00010000:00010000:2.0:1746147218.866986:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063b9c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f94c expref: 38 pid: 9138 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746147218.867024:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9285 00000100:00100000:2.0:1746147218.867031:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2000:x1830967310546560:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147218.867044:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147218.867050:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063b9c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f94c expref: 38 pid: 9138 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746147218.867060:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063b9c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f94c expref: 38 pid: 9138 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746147218.867161:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063b9c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f94c expref: 38 pid: 9138 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746147218.867218:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147218.867223:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063bb8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147218.867231:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063bb8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147218.867237:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063bb8 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147218.867972:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147218.868019:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:2000:x1830967310546560:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 987us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147218.868026:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9285 00010000:00010000:3.0:1746147218.868114:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063bb8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.868121:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063bb8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147218.868139:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147218.868279:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f213800/0x3139939425063bb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f961 expref: 38 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.868312:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063bb8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f961 expref: 37 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.868319:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147218.868321:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746147218.868324:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e1400, rc 0) 00000100:00100000:3.0:1746147218.868583:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:3078:x1830967310546432:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5119us (5264us total) trans 8589937466 rc 0/0 00000100:00100000:3.0:1746147218.868590:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16553 00000100:00100000:0.0:1746147218.870568:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147218.870619:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310546688 00000100:00100000:3.0:1746147218.870628:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310546688 00000100:00100000:3.0:1746147218.870680:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16554 00000100:00100000:3.0:1746147218.870687:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:3078:x1830967310546688:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147218.870707:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147218.870723:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063bc6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f968 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.870809:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425063bcd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.870821:0:9138:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063bb8 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f961 expref: 38 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.870827:0:9138:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425063bcd lrc: 4/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.870859:0:9138:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063bb8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f961 expref: 38 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.870871:0:9138:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063bb8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f961 expref: 38 pid: 9138 timeout: 856 lvb_type: 0 00000100:00100000:3.0:1746147218.870883:0:9138:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311555584:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147218.870969:0:9138:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9623c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746147218.873184:0:9138:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9138:1830967311555584:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147218.873210:0:9138:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425063bcd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000100:00100000:0.0:1746147218.873808:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.873870:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310546816 00000100:00100000:2.0:1746147218.873876:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310546816 00010000:00010000:2.0:1746147218.873906:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063bb8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f961 expref: 39 pid: 9138 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746147218.873939:0:8909:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9286 00000100:00100000:2.0:1746147218.873947:0:8909:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:2001:x1830967310546816:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147218.873959:0:8909:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147218.873964:0:8909:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063bb8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f961 expref: 39 pid: 9138 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746147218.873974:0:8909:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063bb8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f961 expref: 39 pid: 9138 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746147218.873997:0:8909:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e1400/0x3139939425063bb8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x30:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f961 expref: 39 pid: 9138 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746147218.874021:0:8909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147218.874025:0:8909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425063bcd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147218.874032:0:8909:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425063bcd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147218.874042:0:8909:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425063bcd lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9138 initiator: MDT0 00010000:00010000:2.0:1746147218.874057:0:8909:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147218.874112:0:8909:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:2001:x1830967310546816:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 165us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147218.874118:0:8909:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9286 00010000:00010000:3.0:1746147218.874157:0:9138:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425063bcd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.874164:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425063bcd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147218.874210:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147218.874214:0:9138:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147218.874230:0:9138:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425063bcd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.874514:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0c00/0x3139939425063bc6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f968 expref: 38 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.874527:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425063bcd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f968 expref: 37 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.874532:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147218.874535:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147218.874537:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0800, rc 0) 00000100:00100000:3.0:1746147218.874571:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:3078:x1830967310546688:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 3885us (4010us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147218.874577:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16554 00000100:00100000:0.0:1746147218.876362:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.876420:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310547072 00000100:00100000:2.0:1746147218.876429:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310547072 00000100:00100000:2.0:1746147218.876476:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6205 00000100:00100000:2.0:1746147218.876483:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f8a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+37:3078:x1830967310547072:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:2.0:1746147218.876735:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f8a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:3078:x1830967310547072:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 250us (378us total) trans 8589937467 rc 0/0 00000100:00100000:2.0:1746147218.876741:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6205 00000100:00100000:0.0:1746147218.878464:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147218.878664:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310547328 00000100:00100000:3.0:1746147218.878672:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310547328 00000100:00100000:3.0:1746147218.878730:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16555 00000100:00100000:3.0:1746147218.878737:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+38:3078:x1830967310547328:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147218.878758:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147218.878762:0:9138:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746147218.878791:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f12d000/0x3139939425063a68 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f87a expref: 38 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.878806:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147218.878811:0:9138:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746147218.878823:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425063bd4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f96f expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.879032:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425063bdb lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.879045:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425063bdb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.879053:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425063bdb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147218.879063:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00010000:00010000:3.0:1746147218.879179:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d000/0x3139939425063bd4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f96f expref: 40 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.879190:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425063bdb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f96f expref: 39 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.879196:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147218.879198:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746147218.879200:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da0d800, rc 0) 00000100:00100000:3.0:1746147218.879255:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:3078:x1830967310547328:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 517us (797us total) trans 8589937468 rc 0/0 00000100:00100000:3.0:1746147218.879261:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16555 00000100:00100000:0.0:1746147218.881004:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.881041:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147218.881064:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310547584 00000100:00100000:0.0:1746147218.881067:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147218.881072:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310547584 00000100:00100000:2.0:1746147218.881110:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310547840 00000100:00100000:2.0:1746147218.881115:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310547840 00000100:00100000:0.0:1746147218.881116:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.881131:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310548096 00000100:00100000:0.0:1746147218.881133:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310548096 00000100:00100000:1.0:1746147218.881164:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310547456 00000100:00100000:1.0:1746147218.881167:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310547456 00000100:00100000:3.0:1746147218.881284:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20481 00000100:00100000:3.0:1746147218.881292:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310547584:12345-192.168.204.25@tcp:1:lfs.0 00000100:00100000:0.0:1746147218.881297:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20482 00000100:00100000:0.0:1746147218.881301:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310548096:12345-192.168.204.25@tcp:1:lfs.0 00000100:00100000:2.0:1746147218.881309:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20483 00000100:00100000:2.0:1746147218.881316:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ca11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310547840:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147218.881326:0:1853:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425063bf0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.881326:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425063be9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.881337:0:12201:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425063bf7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.881341:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x3139939425063950 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7a1 expref: 26 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147218.881341:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425063baa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f95a expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147218.881348:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147218.881348:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147218.881349:0:12201:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063a92 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f896 expref: 24 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.881350:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147218.881350:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147218.881353:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425063bf0 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.881353:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425063be9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.881355:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147218.881356:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147218.881358:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425063bf7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.881378:0:12201:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063a92 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f896 expref: 24 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.881379:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x3139939425063950 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7a1 expref: 26 pid: 17600 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147218.881382:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425063baa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f95a expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147218.881389:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x3139939425063950 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7a1 expref: 26 pid: 17600 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746147218.881389:0:12201:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063a92 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f896 expref: 24 pid: 1854 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746147218.881390:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425063baa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f95a expref: 26 pid: 1853 timeout: 856 lvb_type: 1 00000100:00100000:3.0:1746147218.881401:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311555712:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147218.881401:0:12201:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095126d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311555840:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147218.881401:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801349a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311555968:192.168.204.25@tcp:104: 00000100:00100000:3.0:1746147218.881472:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20484 00000100:00100000:0.0:1746147218.881472:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c1ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746147218.881477:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310547456:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:3.0:1746147218.881492:0:17600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425063bfe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147218.881496:0:12201:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42e03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147218.881510:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:3.0:1746147218.881515:0:17600:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a2ba00/0x3139939425063b25 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ea expref: 24 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147218.881522:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147218.881523:0:17600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746147218.881523:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310547712 00010000:00010000:3.0:1746147218.881525:0:17600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425063bfe lrc: 4/0,1 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147218.881526:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310547712 00010000:00010000:3.0:1746147218.881539:0:17600:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a2ba00/0x3139939425063b25 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ea expref: 24 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746147218.881546:0:17600:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a2ba00/0x3139939425063b25 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ea expref: 24 pid: 9586 timeout: 856 lvb_type: 1 00000100:00100000:3.0:1746147218.881553:0:17600:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311556096:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147218.881567:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147218.881572:0:17600:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9620c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147218.881579:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310547968 00000100:00100000:3.0:1746147218.881582:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a9623c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147218.881582:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310547968 00000100:00100000:1.0:1746147218.881602:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20485 00000100:00100000:1.0:1746147218.881607:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310547968:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:1.0:1746147218.881622:0:9584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425063c05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.881632:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a2ae00/0x3139939425063ba3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f953 expref: 25 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147218.881639:0:9584:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009400ba00/0x3139939425063b4f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4767744->18446744073709551615] (req 4886528->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f914 expref: 25 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.881644:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147218.881645:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746147218.881647:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425063c05 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.881664:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009400ba00/0x3139939425063b4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4767744->18446744073709551615] (req 4886528->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f914 expref: 25 pid: 13695 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.881680:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009400ba00/0x3139939425063b4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4767744->18446744073709551615] (req 4886528->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f914 expref: 25 pid: 13695 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746147218.881688:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311556224:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147218.881718:0:9584:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095a2ae00/0x3139939425063ba3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f953 expref: 25 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147218.881726:0:9584:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095a2ae00/0x3139939425063ba3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f953 expref: 25 pid: 12201 timeout: 856 lvb_type: 1 00000100:00100000:1.0:1746147218.881734:0:9584:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311556352:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147218.881748:0:9584:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801304c8240 going to sleep for 11 seconds 00000100:00100000:2.0:1746147218.881800:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20486 00000100:00100000:2.0:1746147218.881806:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310547712:12345-192.168.204.25@tcp:1:lfs.0 00010000:00010000:2.0:1746147218.881822:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b1aeea00/0x3139939425063c0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.881832:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425063973 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7c4 expref: 27 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.881837:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147218.881838:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147218.881840:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1aeea00/0x3139939425063c0c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.881855:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425063973 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7c4 expref: 27 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.881866:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425063973 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7c4 expref: 27 pid: 1853 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746147218.881872:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095124a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311556480:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147218.882474:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42e0840 going to sleep for 11 seconds 00000100:00100000:2.0:1746147218.887576:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801349a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9585:1830967311555968:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147218.887610:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425063be9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147218.887635:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.887640:0:12201:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095126d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12201:1830967311555840:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147218.887649:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311556224:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147218.887651:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:2.0:1746147218.887656:0:12201:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425063bf7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147218.887659:0:9584:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9584:1830967311556352:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147218.887665:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.887678:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147218.887679:0:9584:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425063c05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147218.887688:0:8909:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310548352 00000100:00100000:0.0:1746147218.887692:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.887695:0:8909:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310548352 00000100:00100000:1.0:1746147218.887698:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310548224 00000100:00100000:1.0:1746147218.887701:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310548224 00000100:00100000:0.0:1746147218.887707:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310548608 00000100:00100000:0.0:1746147218.887710:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310548608 00010000:00010000:2.0:1746147218.887724:0:8909:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2ba00/0x3139939425063b25 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ea expref: 27 pid: 9586 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746147218.887724:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425063baa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f95a expref: 28 pid: 1853 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746147218.887724:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2ae00/0x3139939425063ba3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f953 expref: 27 pid: 12201 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746147218.887746:0:4349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310548736 00000100:00100000:0.0:1746147218.887749:0:4349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310548736 00000100:00100000:2.0:1746147218.887751:0:13715:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310548864 00000100:00100000:2.0:1746147218.887752:0:13715:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310548864 00010000:00010000:0.0:1746147218.887757:0:4349:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x3139939425063950 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7a1 expref: 30 pid: 17600 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746147218.887761:0:13715:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425063973 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7c4 expref: 30 pid: 1853 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746147218.887767:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9287 00000100:00100000:0.0:1746147218.887773:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310548352:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147218.887774:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9288 00000100:00100000:2.0:1746147218.887778:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310548608:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147218.887786:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147218.887786:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147218.887806:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a2ae00/0x3139939425063ba3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f953 expref: 27 pid: 12201 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746147218.887806:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095a2ba00/0x3139939425063b25 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ea expref: 27 pid: 9586 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746147218.887815:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a2ae00/0x3139939425063ba3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f953 expref: 27 pid: 12201 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746147218.887815:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095a2ba00/0x3139939425063b25 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ea expref: 27 pid: 9586 timeout: 856 lvb_type: 1 00000100:00100000:1.0:1746147218.887820:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9289 00000100:00100000:1.0:1746147218.887827:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310548224:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147218.887837:0:13715:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2ae00/0x3139939425063ba3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f953 expref: 27 pid: 12201 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746147218.887837:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147218.887842:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147218.887843:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147218.887848:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147218.887849:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425063bfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.887852:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425063baa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f95a expref: 30 pid: 1853 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746147218.887855:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425063bfe lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.887861:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425063baa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f95a expref: 30 pid: 1853 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746147218.887869:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147218.887874:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f212c00/0x3139939425063baa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f95a expref: 30 pid: 1853 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746147218.887888:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310548352:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 115us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147218.887895:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310548608:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 117us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147218.887899:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9287 00000100:00100000:2.0:1746147218.887901:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9288 00000100:00100000:0.0:1746147218.887912:0:4349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9290 00000100:00100000:2.0:1746147218.887914:0:13715:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9291 00000100:00100000:0.0:1746147218.887916:0:4349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310548736:12345-192.168.204.25@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746147218.887918:0:13715:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967310548864:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746147218.887922:0:4349:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746147218.887923:0:13715:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746147218.887930:0:4349:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x3139939425063950 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7a1 expref: 29 pid: 17600 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746147218.887931:0:13715:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425063973 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7c4 expref: 29 pid: 1853 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746147218.887938:0:13715:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425063973 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7c4 expref: 29 pid: 1853 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746147218.887938:0:4349:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x3139939425063950 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7a1 expref: 29 pid: 17600 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746147218.887948:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147218.887948:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147218.887949:0:13715:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147218.887950:0:4349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147218.887952:0:13715:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1aeea00/0x3139939425063c0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.887953:0:4349:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425063bf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.887958:0:13715:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1aeea00/0x3139939425063c0c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.887959:0:4349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425063bf0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.887966:0:4349:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147218.887967:0:13715:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147218.887978:0:13715:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2002:x1830967310548864:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 60us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147218.887978:0:4349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310548736:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 62us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147218.887982:0:4349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9290 00000100:00100000:2.0:1746147218.887984:0:13715:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9291 00010000:00010000:0.0:1746147218.888018:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984ee800/0x3139939425063973 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7c4 expref: 27 pid: 1853 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746147218.888022:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2ba00/0x3139939425063b25 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f8ea expref: 24 pid: 9586 timeout: 856 lvb_type: 1 00000100:00100000:2.0:1746147218.888029:0:17600:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17600:1830967311556096:192.168.204.25@tcp:104: 00000100:00100000:0.0:1746147218.888031:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095124a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830967311556480:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147218.888039:0:17600:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425063bfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.888041:0:1854:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800b1aeea00/0x3139939425063c0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.888047:0:17600:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425063bfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.888047:0:1854:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800b1aeea00/0x3139939425063c0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.888053:0:17600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425063bfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.888053:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1aeea00/0x3139939425063c0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.888067:0:17600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425063bfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.888067:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b1aeea00/0x3139939425063c0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.888075:0:17600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425063bfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.888075:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1aeea00/0x3139939425063c0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.888082:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b1aeea00/0x3139939425063c0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.888084:0:17600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425063bfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.888086:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312e7200/0x3139939425063950 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f7a1 expref: 26 pid: 17600 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746147218.888114:0:17600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0dc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147218.888118:0:17600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425063bfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147218.888122:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095149f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830967311555712:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147218.888125:0:17600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425063bfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.888134:0:17600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425063bfe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.888136:0:1853:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425063bf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.888139:0:17600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da0dc00/0x3139939425063bfe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.888143:0:1853:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425063bf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.888149:0:1853:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425063bf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.888162:0:1853:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425063bf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.888168:0:1853:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425063bf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.888173:0:1853:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425063bf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.888178:0:1853:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da0de00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147218.888181:0:1853:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425063bf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147218.888181:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967310547456:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 6703us (7064us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147218.888188:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20484 00010000:00010000:3.0:1746147218.888196:0:1853:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425063bf0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.888206:0:1853:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425063bf0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.888211:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da0de00/0x3139939425063bf0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147218.888246:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310547584:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 6955us (7249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147218.888251:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20481 00010000:00010000:0.0:1746147218.888269:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b1aeea00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746147218.888272:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b1aeea00/0x3139939425063c0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.888278:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b1aeea00/0x3139939425063c0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.888286:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b1aeea00/0x3139939425063c0c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.888292:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1aeea00/0x3139939425063c0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147218.888321:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310547712:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 6516us (6820us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147218.888326:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20486 00000100:00100000:0.0:1746147218.888353:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00010000:00010000:1.0:1746147218.888370:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147218.888372:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147218.888375:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425063be9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.888382:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425063be9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.888396:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147218.888413:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967310548224:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 587us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147218.888420:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9289 00000100:00100000:0.0:1746147218.888421:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147218.888430:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310548480 00000100:00100000:1.0:1746147218.888433:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310548480 00010000:00010000:1.0:1746147218.888442:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009400ba00/0x3139939425063b4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [4767744->18446744073709551615] (req 4886528->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f914 expref: 23 pid: 13695 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746147218.888442:0:7226:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310548992 00000100:00100000:0.0:1746147218.888445:0:7226:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310548992 00000100:00100000:1.0:1746147218.888457:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9292 00010000:00010000:0.0:1746147218.888457:0:7226:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063a92 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f896 expref: 24 pid: 1854 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746147218.888462:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2002:x1830967310548480:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147218.888468:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147218.888475:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009400ba00/0x3139939425063b4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4767744->18446744073709551615] (req 4886528->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f914 expref: 24 pid: 13695 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746147218.888476:0:7226:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9293 00000100:00100000:0.0:1746147218.888481:0:7226:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aa328450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2003:x1830967310548992:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147218.888482:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009400ba00/0x3139939425063b4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4767744->18446744073709551615] (req 4886528->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f914 expref: 24 pid: 13695 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746147218.888488:0:7226:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147218.888492:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009400ba00/0x3139939425063b4f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4767744->18446744073709551615] (req 4886528->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f914 expref: 24 pid: 13695 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746147218.888497:0:7226:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063a92 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f896 expref: 24 pid: 1854 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746147218.888498:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147218.888517:0:7226:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063a92 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f896 expref: 23 pid: 1854 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746147218.888527:0:7226:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063a92 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f896 expref: 23 pid: 1854 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746147218.888535:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147218.888537:0:7226:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147218.888539:0:7226:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425063bf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.888545:0:7226:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425063bf7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147218.888569:0:7226:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746147218.888584:0:7226:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aa328450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2003:x1830967310548992:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 103us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147218.888589:0:7226:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9293 00010000:00010000:1.0:1746147218.888641:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147218.888644:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425063c05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.888650:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425063c05 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.888664:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147218.888674:0:9584:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425063c05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.888680:0:9584:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425063c05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.888691:0:9584:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425063c05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.888702:0:12201:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425063bf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.888702:0:9584:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425063c05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.888710:0:12201:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425063bf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.888720:0:12201:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425063bf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.888726:0:12201:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425063bf7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.888732:0:12201:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425063bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.888737:0:12201:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095a2a000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147218.888739:0:12201:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425063bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.888745:0:12201:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425063bf7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.888753:0:12201:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425063bf7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.888754:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425063be9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.888759:0:12201:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095a2a000/0x3139939425063bf7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.888760:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425063be9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.888770:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425063be9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.888774:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425063be9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.888780:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425063be9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.888785:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958e1400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147218.888787:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425063be9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147218.888790:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310547840:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 7475us (7748us total) trans 0 rc 0/0 00010000:00010000:3.0:1746147218.888792:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425063be9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147218.888796:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20483 00010000:00010000:3.0:1746147218.888800:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425063be9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.888805:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e1400/0x3139939425063be9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.888836:0:9584:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425063c05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.888842:0:9584:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800993b1c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147218.888845:0:9584:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425063c05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.888850:0:9584:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425063c05 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.888857:0:9584:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425063c05 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.888862:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993b1c00/0x3139939425063c05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147218.888903:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+20:2001:x1830967310547968:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 7295us (7335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147218.888910:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20485 00000100:00100000:3.0:1746147218.889008:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ca10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967310548096:12345-192.168.204.25@tcp:1:lfs.0 Request processed in 7705us (7939us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147218.889014:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20482 00000100:00100000:1.0:1746147218.889124:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+19:2002:x1830967310548480:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 660us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147218.889129:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9292 00000100:00100000:0.0:1746147218.890902:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.890999:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310549248 00000100:00100000:2.0:1746147218.891007:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310549248 00000100:00100000:2.0:1746147218.891131:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16556 00000100:00100000:2.0:1746147218.891140:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+39:3078:x1830967310549248:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:2.0:1746147218.891194:0:7237:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746147218.891220:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098447e00/0x31399394250638f5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f746 expref: 39 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.891237:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958e0800/0x3139939425063bcd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f968 expref: 38 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.891247:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147218.891251:0:7237:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746147218.891279:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc200/0x3139939425063c13 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147218.891291:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc200/0x3139939425063c13 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147218.891299:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc200/0x3139939425063c13 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000040:00080000:2.0:1746147218.892668:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1363, 88 off127808 00000004:00080000:2.0:1746147218.892677:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756882587232ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147218.892711:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1351, 88 off126752 00000004:00080000:2.0:1746147218.892716:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756882626298ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147218.892733:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1352, 88 off126840 00000004:00080000:2.0:1746147218.892736:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756882646493ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147218.892742:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1364, 88 off127896 00000004:00080000:2.0:1746147218.892745:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756882655158ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147218.892750:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1365, 88 off127984 00000004:00080000:2.0:1746147218.892753:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756882663243ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147218.892778:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1353, 88 off126928 00000004:00080000:2.0:1746147218.892781:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756882691733ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147218.892882:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1354, 88 off127016 00000004:00080000:2.0:1746147218.892887:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756882797391ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147218.892912:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1355, 88 off127104 00000004:00080000:2.0:1746147218.892915:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756882825692ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147218.892924:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1366, 88 off128072 00000004:00080000:2.0:1746147218.892927:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756882837041ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147218.892947:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1356, 88 off127192 00000004:00080000:2.0:1746147218.892950:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756882860533ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147218.892959:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1367, 88 off128160 00000004:00080000:2.0:1746147218.892961:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756882871646ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147218.892967:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1357, 88 off127280 00000004:00080000:2.0:1746147218.892970:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756882880464ns, next at 694367916532ns, rc = 0 00000040:00080000:2.0:1746147218.892979:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1368, 88 off128248 00000004:00080000:2.0:1746147218.892981:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756882891958ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147218.892989:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1369, 88 off128336 00000004:00080000:2.0:1746147218.892991:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756882901751ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147218.893003:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1370, 88 off128424 00000004:00080000:2.0:1746147218.893005:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756882916168ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147218.893014:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1371, 88 off128512 00000004:00080000:2.0:1746147218.893017:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756882927786ns, next at 694367945074ns, rc = 0 00000040:00080000:2.0:1746147218.893027:0:7237:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1358, 88 off127368 00000004:00080000:2.0:1746147218.893030:0:7237:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756882940231ns, next at 694367916532ns, rc = 0 00000001:00080000:0.0:1746147218.897236:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937469 is committed 00000004:00080000:0.0:1746147218.897253:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1334 committed 00000004:00080000:0.0:1746147218.897278:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1350 committed 00000004:00080000:0.0:1746147218.897298:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1349 committed 00000004:00080000:0.0:1746147218.897301:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1348 committed 00000004:00080000:0.0:1746147218.897302:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1347 committed 00000004:00080000:0.0:1746147218.897304:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1333 committed 00000004:00080000:0.0:1746147218.897306:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1346 committed 00000004:00080000:0.0:1746147218.897307:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1332 committed 00000004:00080000:0.0:1746147218.897309:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1345 committed 00000004:00080000:0.0:1746147218.897311:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1331 committed 00000004:00080000:0.0:1746147218.897312:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1330 committed 00000004:00080000:0.0:1746147218.897314:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1329 committed 00000004:00080000:0.0:1746147218.897316:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1344 committed 00000004:00080000:0.0:1746147218.897318:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1343 committed 00000004:00080000:0.0:1746147218.897319:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1328 committed 00000004:00080000:0.0:1746147218.897320:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1327 committed 00000004:00080000:0.0:1746147218.897321:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1342 committed 00000001:00100000:0.0:1746147218.897337:0:8094:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4b43ad24-8860-49d9-a9ff-4a4a0414ff18 00000001:00080000:0.0:1746147218.897344:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937464 is committed 00000020:00000080:0.0:1746147218.897347:0:8094:0:(genops.c:904:class_export_put()) final put ffff8800b42a5800/4b43ad24-8860-49d9-a9ff-4a4a0414ff18 00000001:00100000:0.0:1746147218.897372:0:8094:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 27888ca4-3347-429c-8b24-1b5eba1f59cf 00000001:00080000:0.0:1746147218.897377:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937463 is committed 00000020:00000080:0.0:1746147218.897398:0:8094:0:(genops.c:904:class_export_put()) final put ffff880131081800/27888ca4-3347-429c-8b24-1b5eba1f59cf 00000100:00100000:0.0:1746147218.897425:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311556608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147218.897470:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311556864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147218.897494:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147218.897525:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311556608 00000100:00100000:1.0:1746147218.897531:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311556608 00000100:00100000:0.0:1746147218.897546:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311557120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147218.897563:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147218.897588:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311557120 00000100:00100000:1.0:1746147218.897590:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311557120 00000100:00100000:1.0:1746147218.897605:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20487 00000100:00100000:1.0:1746147218.897612:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3767:x1830967311556608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147218.897618:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311556992:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147218.897641:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147218.897658:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311557504:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147218.897674:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147218.897769:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311556992 00000100:00100000:3.0:1746147218.897772:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311556992 00000100:00100000:1.0:1746147218.897772:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3767:x1830967311556608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 160us (279us total) trans 21474842756 rc 0/0 00000100:00100000:1.0:1746147218.897778:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20487 00000100:00100000:3.0:1746147218.897789:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311557504 00000100:00100000:3.0:1746147218.897791:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311557504 00000100:00100000:1.0:1746147218.897792:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20488 00000100:00100000:1.0:1746147218.897796:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3767:x1830967311557120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147218.897803:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20489 00000100:00100000:3.0:1746147218.897809:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3766:x1830967311556992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147218.897845:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3767:x1830967311557120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (280us total) trans 21474842757 rc 0/0 00000100:00100000:1.0:1746147218.897850:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20488 00000100:00100000:1.0:1746147218.897858:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20490 00000100:00100000:1.0:1746147218.897862:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3766:x1830967311557504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147218.897876:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3766:x1830967311556992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (234us total) trans 21474842758 rc 0/0 00000100:00100000:3.0:1746147218.897882:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20489 00000100:00100000:3.0:1746147218.897898:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311558016:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147218.897915:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3766:x1830967311557504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (239us total) trans 21474842759 rc 0/0 00000100:00100000:3.0:1746147218.897920:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147218.897920:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20490 00000100:00100000:1.0:1746147218.897929:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311558016 00000100:00100000:3.0:1746147218.897931:0:3766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311558528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147218.897931:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311558016 00000100:00100000:3.0:1746147218.897946:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1746147218.898001:0:65:0:(genops.c:863:class_export_destroy()) destroying export ffff8800b42a5800/4b43ad24-8860-49d9-a9ff-4a4a0414ff18 for lustre-MDT0000 00000020:00000080:2.0:1746147218.898063:0:65:0:(genops.c:863:class_export_destroy()) destroying export ffff880131081800/27888ca4-3347-429c-8b24-1b5eba1f59cf for lustre-MDT0000 00000100:00100000:1.0:1746147218.898067:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311558528 00000100:00100000:1.0:1746147218.898070:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311558528 00000020:00000080:2.0:1746147218.898104:0:65:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8800b42a6800 for lustre-MDT0000 00000100:00100000:1.0:1746147218.898105:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20491 00000100:00100000:1.0:1746147218.898110:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3766:x1830967311558016:12345-0@lo:2:osp-syn-1-0.0 00000020:00000080:2.0:1746147218.898111:0:65:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff880131087800 for lustre-MDT0000 00000100:00100000:2.0:1746147218.898122:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311556736:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147218.898179:0:3766:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474842750 gen 2 00000004:00080000:3.0:1746147218.898184:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009514d500, transno 21474842724 00000100:00100000:2.0:1746147218.898216:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746147218.898369:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8b3100, transno 21474842725 00000004:00080000:3.0:1746147218.898373:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8b1f80, transno 21474842726 00000004:00080000:3.0:1746147218.898375:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8b1c00, transno 21474842727 00000004:00080000:3.0:1746147218.898378:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8b2680, transno 21474842728 00000004:00080000:3.0:1746147218.898381:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009455d880, transno 21474842733 00000004:00080000:3.0:1746147218.898383:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009455dc00, transno 21474842734 00000004:00080000:3.0:1746147218.898385:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009455c380, transno 21474842735 00000004:00080000:3.0:1746147218.898388:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258f100, transno 21474842736 00000004:00080000:3.0:1746147218.898390:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009455c000, transno 21474842737 00000004:00080000:3.0:1746147218.898392:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009455ca80, transno 21474842738 00000004:00080000:3.0:1746147218.898394:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009455f100, transno 21474842739 00000004:00080000:3.0:1746147218.898396:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4394380, transno 21474842740 00000004:00080000:3.0:1746147218.898399:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009455df80, transno 21474842741 00000004:00080000:3.0:1746147218.898401:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099150a80, transno 21474842742 00000004:00080000:3.0:1746147218.898404:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4397b80, transno 21474842743 00000004:00080000:3.0:1746147218.898406:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4397800, transno 21474842744 00000004:00080000:3.0:1746147218.898408:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099151500, transno 21474842745 00000004:00080000:3.0:1746147218.898411:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099150e00, transno 21474842746 00000004:00080000:3.0:1746147218.898413:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099151c00, transno 21474842747 00000100:00100000:1.0:1746147218.898413:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3766:x1830967311558016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 302us (491us total) trans 17179875359 rc 0/0 00000004:00080000:3.0:1746147218.898415:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5575180, transno 21474842748 00000004:00080000:3.0:1746147218.898418:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5577100, transno 21474842749 00000100:00100000:1.0:1746147218.898419:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20491 00000004:00080000:3.0:1746147218.898420:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132127b80, transno 21474842750 00000100:00100000:3.0:1746147218.898426:0:3766:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009258ce00 x1830967311556992/t21474842758(21474842758) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147234 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:3.0:1746147218.898436:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258ce00/2, rc 0, transno 21474842758 00000100:00100000:3.0:1746147218.898439:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311556992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147218.898458:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311557248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147218.898476:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147218.898488:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311557760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147218.898509:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147218.898518:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311558272:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147218.898532:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147218.898541:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746147218.898544:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311557888:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147218.898558:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147218.898564:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311558400:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147218.898576:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147218.898664:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311556736 00000100:00100000:1.0:1746147218.898667:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311556736 00000100:00100000:1.0:1746147218.898676:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311557248 00000100:00100000:1.0:1746147218.898678:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311557248 00000100:00100000:1.0:1746147218.898683:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311557760 00000100:00100000:1.0:1746147218.898685:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311557760 00000100:00100000:1.0:1746147218.898690:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311558272 00000100:00100000:1.0:1746147218.898691:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311558272 00000100:00100000:1.0:1746147218.898697:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311557888 00000100:00100000:1.0:1746147218.898698:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311557888 00000100:00100000:1.0:1746147218.898703:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311558400 00000100:00100000:1.0:1746147218.898704:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311558400 00000100:00100000:1.0:1746147218.898711:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20492 00000100:00100000:1.0:1746147218.898714:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3766:x1830967311558528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147218.898767:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3766:x1830967311558528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (820us total) trans 17179875360 rc 0/0 00000100:00100000:1.0:1746147218.898772:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20492 00000100:00100000:1.0:1746147218.898780:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20493 00000100:00100000:1.0:1746147218.898783:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3764:x1830967311556736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147218.898826:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3764:x1830967311556736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (610us total) trans 21474842760 rc 0/0 00000100:00100000:1.0:1746147218.898831:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20493 00000100:00100000:1.0:1746147218.898837:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20494 00000100:00100000:1.0:1746147218.898841:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3764:x1830967311557248:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147218.898866:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258ed80/2, rc 0, transno 21474842757 00000100:00100000:0.0:1746147218.898871:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311557120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147218.898877:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3764:x1830967311557248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 36us (401us total) trans 21474842761 rc 0/0 00000004:00080000:0.0:1746147218.898883:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258fb80/2, rc 0, transno 21474842756 00000100:00100000:1.0:1746147218.898884:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20494 00000100:00100000:0.0:1746147218.898886:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311556608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147218.898890:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20495 00000100:00100000:1.0:1746147218.898894:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3764:x1830967311557760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147218.898894:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311557632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147218.898913:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147218.898922:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800769d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311558144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147218.898931:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3764:x1830967311557760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 37us (421us total) trans 17179875361 rc 0/0 00000100:00100000:0.0:1746147218.898935:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147218.898936:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20495 00000100:00100000:1.0:1746147218.898942:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311557632 00000100:00100000:1.0:1746147218.898945:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311557632 00000100:00100000:1.0:1746147218.898952:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311558144 00000100:00100000:1.0:1746147218.898954:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311558144 00000100:00100000:1.0:1746147218.898959:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20496 00000100:00100000:1.0:1746147218.898963:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3764:x1830967311558272:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147218.898980:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258e300/2, rc 0, transno 21474842759 00000100:00100000:3.0:1746147218.898983:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311557504:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147218.898993:0:3766:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179875355 gen 2 00000004:00080000:3.0:1746147218.898996:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098c72300, transno 17179875283 00000004:00080000:3.0:1746147218.899002:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ee680, transno 17179875284 00000004:00080000:3.0:1746147218.899004:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312efb80, transno 17179875285 00000004:00080000:3.0:1746147218.899006:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312edf80, transno 17179875286 00000004:00080000:3.0:1746147218.899009:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312eca80, transno 17179875287 00000100:00100000:1.0:1746147218.899011:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3764:x1830967311558272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (478us total) trans 17179875362 rc 0/0 00000004:00080000:3.0:1746147218.899012:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ec380, transno 17179875288 00000004:00080000:3.0:1746147218.899014:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ec000, transno 17179875289 00000004:00080000:3.0:1746147218.899016:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312ed180, transno 17179875290 00000100:00100000:1.0:1746147218.899016:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20496 00000004:00080000:3.0:1746147218.899019:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5576680, transno 17179875293 00000004:00080000:3.0:1746147218.899021:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4396d80, transno 17179875294 00000004:00080000:3.0:1746147218.899023:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5575f80, transno 17179875295 00000004:00080000:3.0:1746147218.899025:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4396300, transno 17179875296 00000100:00100000:1.0:1746147218.899025:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20497 00000004:00080000:3.0:1746147218.899027:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098823800, transno 17179875297 00000004:00080000:3.0:1746147218.899030:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5576d80, transno 17179875298 00000100:00100000:1.0:1746147218.899030:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3764:x1830967311557888:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147218.899032:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4397100, transno 17179875299 00000004:00080000:3.0:1746147218.899035:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5576300, transno 17179875300 00000004:00080000:3.0:1746147218.899038:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099010e00, transno 17179875302 00000004:00080000:3.0:1746147218.899040:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099013b80, transno 17179875303 00000004:00080000:3.0:1746147218.899043:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099012d80, transno 17179875304 00000004:00080000:3.0:1746147218.899045:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5577480, transno 17179875305 00000004:00080000:3.0:1746147218.899048:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800933f7480, transno 17179875306 00000004:00080000:3.0:1746147218.899050:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5574a80, transno 17179875307 00000004:00080000:3.0:1746147218.899053:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800975a6300, transno 17179875308 00000004:00080000:3.0:1746147218.899055:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800769dbb80, transno 17179875309 00000004:00080000:3.0:1746147218.899058:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800947e7480, transno 17179875310 00000004:00080000:3.0:1746147218.899060:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f084a80, transno 17179875311 00000004:00080000:3.0:1746147218.899063:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095060a80, transno 17179875312 00000004:00080000:3.0:1746147218.899065:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095063800, transno 17179875313 00000004:00080000:3.0:1746147218.899067:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f56a00, transno 17179875314 00000004:00080000:3.0:1746147218.899070:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f57100, transno 17179875315 00000004:00080000:3.0:1746147218.899072:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009258e680, transno 17179875316 00000004:00080000:3.0:1746147218.899075:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3cc700, transno 17179875317 00000100:00100000:1.0:1746147218.899077:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3764:x1830967311557888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (517us total) trans 17179875363 rc 0/0 00000004:00080000:3.0:1746147218.899078:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097eb9180, transno 17179875328 00000004:00080000:3.0:1746147218.899080:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097eb8000, transno 17179875329 00000100:00100000:1.0:1746147218.899081:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20497 00000004:00080000:3.0:1746147218.899084:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097ebbb80, transno 17179875330 00000004:00080000:3.0:1746147218.899086:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009455fb80, transno 17179875331 00000004:00080000:3.0:1746147218.899103:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097eb9500, transno 17179875332 00000004:00080000:3.0:1746147218.899106:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097eb9f80, transno 17179875333 00000004:00080000:3.0:1746147218.899108:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097eb8e00, transno 17179875334 00000100:00100000:1.0:1746147218.899108:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20498 00000004:00080000:3.0:1746147218.899110:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097eb8700, transno 17179875335 00000100:00100000:1.0:1746147218.899112:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3764:x1830967311558400:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147218.899113:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099155f80, transno 17179875340 00000004:00080000:3.0:1746147218.899115:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095148e00, transno 17179875341 00000004:00080000:3.0:1746147218.899118:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099156d80, transno 17179875342 00000004:00080000:3.0:1746147218.899120:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099154000, transno 17179875343 00000004:00080000:3.0:1746147218.899123:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009514b100, transno 17179875344 00000004:00080000:3.0:1746147218.899125:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099157100, transno 17179875345 00000004:00080000:3.0:1746147218.899127:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099154e00, transno 17179875346 00000004:00080000:3.0:1746147218.899130:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099155500, transno 17179875347 00000004:00080000:3.0:1746147218.899132:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800968a0700, transno 17179875348 00000004:00080000:3.0:1746147218.899135:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800968a0000, transno 17179875349 00000004:00080000:3.0:1746147218.899137:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800968a1500, transno 17179875350 00000004:00080000:3.0:1746147218.899140:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800968a1f80, transno 17179875351 00000004:00080000:3.0:1746147218.899143:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800968a2a00, transno 17179875352 00000004:00080000:3.0:1746147218.899146:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800968a1180, transno 17179875353 00000004:00080000:3.0:1746147218.899148:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800968a1c00, transno 17179875354 00000004:00080000:3.0:1746147218.899150:0:3766:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800968a3800, transno 17179875355 00000100:00100000:1.0:1746147218.899152:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3764:x1830967311558400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (575us total) trans 17179875364 rc 0/0 00000100:00100000:3.0:1746147218.899154:0:3766:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800769daa00 x1830967311558016/t17179875359(17179875359) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746147234 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000100:00100000:1.0:1746147218.899157:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20498 00000004:00080000:3.0:1746147218.899161:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800769daa00/2, rc 0, transno 17179875359 00000100:00100000:3.0:1746147218.899164:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311558016:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147218.899164:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20499 00000100:00100000:1.0:1746147218.899167:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3767:x1830967311557632:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147218.899175:0:3766:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800769db800/2, rc 0, transno 17179875360 00000100:00100000:3.0:1746147218.899177:0:3766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3766:1830967311558528:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147218.899195:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20500 00000100:00100000:3.0:1746147218.899201:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3767:x1830967311558144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147218.899204:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3767:x1830967311557632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 36us (290us total) trans 17179875365 rc 0/0 00000100:00100000:1.0:1746147218.899209:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20499 00000100:00080000:1.0:1746147218.899222:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746147218.899225:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746147218.899233:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147218.899245:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311557376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147218.899259:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147218.899276:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3767:x1830967311558144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (338us total) trans 17179875366 rc 0/0 00000100:00100000:3.0:1746147218.899282:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20500 00000100:00100000:3.0:1746147218.899291:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311556864 00000100:00100000:3.0:1746147218.899294:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311556864 00000100:00100000:3.0:1746147218.899303:0:12225:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311557376 00000100:00100000:3.0:1746147218.899305:0:12225:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311557376 00000100:00100000:3.0:1746147218.899311:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20501 00000100:00100000:3.0:1746147218.899315:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3765:x1830967311556864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147218.899371:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3765:x1830967311556864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (136us total) trans 21474842762 rc 0/0 00000100:00100000:3.0:1746147218.899376:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20501 00000100:00100000:3.0:1746147218.899385:0:12225:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20502 00000100:00100000:3.0:1746147218.899389:0:12225:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3765:x1830967311557376:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147218.899404:0:8110:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 23 done 00000004:00080000:1.0:1746147218.899433:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258c700/2, rc 0, transno 21474842762 00000100:00100000:1.0:1746147218.899437:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311556864:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147218.899441:0:12225:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3765:x1830967311557376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (180us total) trans 21474842763 rc 0/0 00000004:00080000:1.0:1746147218.899443:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258ca80/2, rc 0, transno 21474842763 00000100:00100000:1.0:1746147218.899445:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311557376:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147218.899446:0:12225:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20502 00000004:00080000:3.0:1746147218.902322:0:8112:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 6 in flight, 56 done 00000004:00080000:2.0:1746147218.906184:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800769d9f80/2, rc 0, transno 17179875363 00000100:00100000:2.0:1746147218.906201:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311557888:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147218.906214:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800769d8e00/2, rc 0, transno 17179875364 00000100:00100000:2.0:1746147218.906217:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311558400:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147218.906231:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258d500/2, rc 0, transno 21474842760 00000100:00100000:2.0:1746147218.906235:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311556736:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147218.906244:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009258c380/2, rc 0, transno 21474842761 00000100:00100000:2.0:1746147218.906247:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311557248:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147218.906255:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009514ad80/2, rc 0, transno 17179875361 00000100:00100000:2.0:1746147218.906258:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311557760:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746147218.906265:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800769d8a80/2, rc 0, transno 17179875362 00000100:00100000:2.0:1746147218.906268:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311558272:0@lo:2:osp-syn-1-0.0 00000004:00010000:2.0:1746147218.906344:0:7237:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009514c700 reply state ffff8800998a1800 transno 8589937469 ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc200/0x3139939425063c13 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147218.906364:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc200/0x3139939425063c13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:2.0:1746147218.906373:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147218.906376:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746147218.906380:0:7237:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746147218.906490:0:7237:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746147218.906513:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:3078:x1830967310549248:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 15362us (15604us total) trans 8589937469 rc 0/0 00000100:00100000:2.0:1746147218.906523:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16556 00010000:00010000:1.0:1746147218.906529:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc200/0x3139939425063c13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147218.906537:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc200/0x3139939425063c13 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147218.906543:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc200/0x3139939425063c13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147218.906548:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800990cc200 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147218.906553:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc200/0x3139939425063c13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147218.906559:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc200/0x3139939425063c13 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147218.906570:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147218.906572:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746147218.906576:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc200/0x3139939425063c13 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147218.906581:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cc200/0x3139939425063c13 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00000100:00100000:1.0:1746147218.906670:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311558656:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147218.906719:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147218.907214:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311558656 00000100:00100000:0.0:1746147218.907221:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311558656 00000100:00100000:0.0:1746147218.907271:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20503 00000100:00100000:0.0:1746147218.907276:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3767:x1830967311558656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147218.907413:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3767:x1830967311558656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (694us total) trans 21474842764 rc 0/0 00000100:00100000:0.0:1746147218.907418:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20503 00000004:00080000:1.0:1746147218.907515:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4394380/2, rc 0, transno 21474842764 00000100:00100000:1.0:1746147218.907519:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311558656:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746147218.907530:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009514b480/2, rc 0, transno 17179875365 00000100:00100000:1.0:1746147218.907532:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009514b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311557632:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147218.907540:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800769d8000/2, rc 0, transno 17179875366 00000100:00100000:1.0:1746147218.907542:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800769d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311558144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147218.908779:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.908849:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310549376 00000100:00100000:2.0:1746147218.908855:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310549376 00000100:00100000:2.0:1746147218.909759:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16557 00000100:00100000:2.0:1746147218.909769:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009514d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:3078:x1830967310549376:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147218.909788:0:7237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147218.909809:0:7237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063c1a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f976 expref: -99 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.909865:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063c1a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f976 expref: 28 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.909878:0:7237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063c1a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f976 expref: 28 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.909897:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:2.0:1746147218.909901:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746147218.909905:0:7237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990cda00, rc 0) 00000100:00100000:2.0:1746147218.909947:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009514d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:3078:x1830967310549376:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 180us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147218.909953:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16557 00000100:00100000:0.0:1746147218.914687:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147218.914748:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310549504 00000100:00100000:3.0:1746147218.914758:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310549504 00000100:00100000:3.0:1746147218.914814:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16558 00000100:00100000:3.0:1746147218.914822:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:3078:x1830967310549504:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147218.914845:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147218.914868:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425063c21 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f97d expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.914964:0:9138:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425063c28 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.914982:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425063c28 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.914993:0:9138:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425063c28 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00000004:00200000:3.0:1746147218.915021:0:9138:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x30:0x0]: returning size 9080864 00000004:00200000:3.0:1746147218.915025:0:9138:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746147218.915041:0:9138:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425063c28 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9138 initiator: MDT0 00010000:00010000:3.0:1746147218.915066:0:9138:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011f212a00/0x3139939425063c21 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f97d expref: 30 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.915114:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425063c28 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f97d expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.915123:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147218.915126:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746147218.915129:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1aeea00, rc 0) 00000100:00100000:3.0:1746147218.915188:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:3078:x1830967310549504:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 366us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147218.915194:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16558 00000100:00100000:0.0:1746147218.917554:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.917589:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.917616:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.917637:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.917720:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310549632 00000100:00100000:2.0:1746147218.917730:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310549632 00000100:00100000:3.0:1746147218.917983:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310549760 00000100:00100000:3.0:1746147218.917988:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310549760 00000100:00100000:1.0:1746147218.918002:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310549888 00000100:00100000:1.0:1746147218.918006:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310549888 00000100:00100000:0.0:1746147218.918030:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.918358:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.918382:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310550016 00000100:00100000:0.0:1746147218.918384:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310550016 00000100:00100000:0.0:1746147218.918406:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310550144 00000100:00100000:0.0:1746147218.918408:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310550144 00000100:00100000:0.0:1746147218.918421:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310550272 00000100:00100000:1.0:1746147218.918510:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20504 00000100:00100000:1.0:1746147218.918519:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967310549760:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147218.918539:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147218.918561:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958e0800/0x3139939425063c2f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f98b expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147218.918587:0:9584:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x96:0x0] initial LVB size: 2097152, mtime: 0x6814178f, atime: 0x68141790, ctime: 0x68141790, blocks: 0x808 00010000:00010000:1.0:1746147218.918608:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147218.918610:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147218.918619:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e0800/0x3139939425063c2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f98b expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147218.918635:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958e0800/0x3139939425063c2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f98b expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147218.918644:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958e0800, rc 0) 00000100:00100000:1.0:1746147218.918687:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310549760:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 170us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147218.918693:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20504 00000100:00100000:1.0:1746147218.918711:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20505 00000100:00100000:1.0:1746147218.918716:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967310549888:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147218.918722:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147218.918730:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425063c36 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f992 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147218.918738:0:9584:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x97:0x0] initial LVB size: 2097152, mtime: 0x68141790, atime: 0x68141790, ctime: 0x68141790, blocks: 0x800 00010000:00010000:1.0:1746147218.918746:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147218.918747:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147218.918750:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425063c36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f992 expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147218.918759:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425063c36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f992 expref: 24 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147218.918765:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e572a00, rc 0) 00000100:00100000:1.0:1746147218.918782:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310549888:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 66us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147218.918787:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20505 00000100:00100000:1.0:1746147218.918797:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20506 00000100:00100000:1.0:1746147218.918801:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310550016:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147218.918807:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147218.918817:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063c3d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f999 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147218.918830:0:9584:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x68141790, atime: 0x68141790, ctime: 0x68141790, blocks: 0x808 00010000:00010000:1.0:1746147218.918838:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147218.918839:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147218.918842:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063c3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f999 expref: 22 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147218.918851:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063c3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f999 expref: 22 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147218.918858:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e573e00, rc 0) 00000100:00100000:1.0:1746147218.918871:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967310550016:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 70us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147218.918876:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20506 00000100:00100000:1.0:1746147218.918887:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20507 00000100:00100000:1.0:1746147218.918891:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310550144:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147218.918896:0:9584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147218.918904:0:9584:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425063c44 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f9a0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147218.918914:0:9584:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4886560, mtime: 0x68141791, atime: 0x68141791, ctime: 0x68141791, blocks: 0x1558 00010000:00010000:1.0:1746147218.918920:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147218.918921:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147218.918925:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425063c44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9a0 expref: 22 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147218.918933:0:9584:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425063c44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9a0 expref: 22 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147218.918939:0:9584:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e573600, rc 0) 00000100:00100000:1.0:1746147218.918952:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967310550144:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 60us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147218.918957:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20507 00000100:00100000:0.0:1746147218.919016:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310550272 00000100:00100000:0.0:1746147218.919033:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20508 00000100:00100000:0.0:1746147218.919037:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310550272:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:0.0:1746147218.919043:0:13712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746147218.919051:0:13712:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063c4b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f9a7 expref: -99 pid: 13712 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746147218.919062:0:13712:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x98:0x0] initial LVB size: 4194304, mtime: 0x68141791, atime: 0x68141791, ctime: 0x68141791, blocks: 0x1008 00010000:00010000:0.0:1746147218.919069:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147218.919070:0:13712:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746147218.919074:0:13712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063c4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9a7 expref: 25 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147218.919083:0:13712:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063c4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9a7 expref: 25 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746147218.919104:0:13712:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f588e00, rc 0) 00000100:00100000:0.0:1746147218.919119:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2001:x1830967310550272:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 81us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147218.919124:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20508 00000100:00100000:2.0:1746147218.919134:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20509 00000100:00100000:2.0:1746147218.919146:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+21:2001:x1830967310549632:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147218.919153:0:12201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147218.919162:0:12201:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990cc000/0x3139939425063c52 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f984 expref: -99 pid: 12201 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147218.919174:0:12201:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x93:0x0] initial LVB size: 1048576, mtime: 0x68141791, atime: 0x68141791, ctime: 0x68141790, blocks: 0x7e8 00010000:00010000:2.0:1746147218.919183:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147218.919184:0:12201:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147218.919188:0:12201:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990cc000/0x3139939425063c52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f984 expref: 22 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147218.919197:0:12201:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990cc000/0x3139939425063c52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f984 expref: 22 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746147218.919203:0:12201:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990cc000, rc 0) 00000100:00100000:2.0:1746147218.919229:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967310549632:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 84us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147218.919233:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20509 00000100:00100000:0.0:1746147218.921909:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.921934:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.921951:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.921968:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.921979:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147218.921986:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310550400 00000100:00100000:1.0:1746147218.921986:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310550656 00000100:00100000:0.0:1746147218.921991:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310550912 00000100:00100000:0.0:1746147218.921994:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310550912 00000100:00100000:3.0:1746147218.921995:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310550400 00000100:00100000:1.0:1746147218.921995:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310550656 00000100:00100000:0.0:1746147218.922021:0:10340:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310550528 00000100:00100000:0.0:1746147218.922022:0:10340:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310550528 00000100:00100000:2.0:1746147218.922059:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310550784 00000100:00100000:2.0:1746147218.922063:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310550784 00000100:00100000:1.0:1746147218.922131:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20510 00000100:00100000:1.0:1746147218.922139:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310550912:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147218.922147:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20511 00000100:00100000:0.0:1746147218.922151:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310550656:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147218.922157:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20512 00000100:00100000:3.0:1746147218.922163:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310550528:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147218.922224:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310550656:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 73us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147218.922226:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20513 00000100:00100000:0.0:1746147218.922229:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20511 00000100:00100000:2.0:1746147218.922232:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310550400:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147218.922239:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20514 00000100:00100000:0.0:1746147218.922242:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310550784:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147218.922368:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310550528:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 204us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147218.922374:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20512 00000100:00100000:0.0:1746147218.922374:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310550784:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 132us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147218.922376:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310550912:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 238us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147218.922378:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20514 00000100:00100000:1.0:1746147218.922382:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20510 00000100:00100000:2.0:1746147218.922440:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2000:x1830967310550400:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 209us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147218.922446:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20513 00000100:00100000:0.0:1746147218.922489:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.922706:0:12201:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310551040 00000100:00100000:2.0:1746147218.922709:0:12201:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310551040 00000100:00100000:2.0:1746147218.922736:0:12201:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20515 00000100:00100000:2.0:1746147218.922740:0:12201:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310551040:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147218.922795:0:12201:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310551040:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 53us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147218.922800:0:12201:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20515 00000100:00100000:0.0:1746147218.924542:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.924578:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.924609:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.924636:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.924889:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.924914:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147218.924932:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310551296 00000100:00100000:0.0:1746147218.924939:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310551296 00000100:00100000:0.0:1746147218.924969:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310551552 00000100:00100000:0.0:1746147218.924972:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310551552 00000100:00100000:0.0:1746147218.924985:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310551808 00000100:00100000:0.0:1746147218.924987:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310551808 00000100:00100000:1.0:1746147218.924991:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310551168 00000100:00100000:1.0:1746147218.924996:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310551168 00000100:00100000:0.0:1746147218.924996:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310551424 00000100:00100000:0.0:1746147218.924998:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310551424 00000100:00100000:0.0:1746147218.925007:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310551680 00000100:00100000:0.0:1746147218.925009:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310551680 00000100:00100000:1.0:1746147218.925020:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20516 00000100:00100000:1.0:1746147218.925027:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310551296:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147218.925031:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20517 00000100:00100000:0.0:1746147218.925037:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310551552:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:3.0:1746147218.925074:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20518 00000100:00100000:3.0:1746147218.925082:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310551808:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:0.0:1746147218.925129:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310551552:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 90us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147218.925135:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20517 00000100:00100000:0.0:1746147218.925149:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20519 00000100:00100000:0.0:1746147218.925153:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310551424:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:2.0:1746147218.925188:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20520 00000100:00100000:2.0:1746147218.925196:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967310551168:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147218.925353:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310551296:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 324us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147218.925360:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310551808:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 277us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147218.925360:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20516 00000100:00100000:0.0:1746147218.925360:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310551424:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 204us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147218.925365:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20519 00000100:00100000:3.0:1746147218.925371:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20518 00000100:00100000:1.0:1746147218.925378:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20521 00000100:00100000:1.0:1746147218.925383:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967310551680:12345-192.168.204.25@tcp:23:lfs.0 00000100:00100000:1.0:1746147218.925415:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967310551680:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 32us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147218.925420:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20521 00000100:00100000:2.0:1746147218.925428:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:2001:x1830967310551168:12345-192.168.204.25@tcp:23:lfs.0 Request processed in 232us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147218.925434:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20520 00000100:00100000:0.0:1746147218.927210:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147218.928293:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310551936 00000100:00100000:1.0:1746147218.928301:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310551936 00000100:00100000:1.0:1746147218.928347:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20522 00000100:00100000:1.0:1746147218.928354:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:3078:x1830967310551936:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147218.928391:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147218.928412:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x3139939425063c59 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f9ae expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746147218.928432:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6814176c, atime: 0x0, ctime: 0x6814176c, blocks: 0xfc0 00010000:00010000:1.0:1746147218.928453:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147218.928455:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147218.928463:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x3139939425063c59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9ae expref: 26 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.928477:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x3139939425063c59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9ae expref: 26 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.928487:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a0a00, rc 0) 00000100:00100000:1.0:1746147218.928540:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:3078:x1830967310551936:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 184us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147218.928550:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20522 00000100:00100000:0.0:1746147218.929846:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147218.929940:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310552064 00000100:00100000:1.0:1746147218.929945:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310552064 00000100:00100000:1.0:1746147218.929981:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20523 00000100:00100000:1.0:1746147218.929987:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310552064:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:1.0:1746147218.930175:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147218.930179:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147218.930182:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746147218.930183:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:1.0:1746147218.930185:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746147218.930213:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310552064:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 226us (371us total) trans 17179875367 rc 0/0 00000100:00100000:1.0:1746147218.930219:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20523 00000100:00100000:0.0:1746147218.933912:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.934198:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310552192 00000100:00100000:2.0:1746147218.934207:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310552192 00000100:00100000:2.0:1746147218.934269:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20524 00000100:00100000:2.0:1746147218.934278:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+22:3078:x1830967310552192:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:2.0:1746147218.934297:0:1136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746147218.934326:0:1136:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063c60 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f9b5 expref: -99 pid: 1136 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746147218.934487:0:1136:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x94:0x0] initial LVB size: 4194304, mtime: 0x6814176c, atime: 0x0, ctime: 0x6814176c, blocks: 0x1fc8 00010000:00010000:2.0:1746147218.934520:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147218.934522:0:1136:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147218.934530:0:1136:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063c60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9b5 expref: 23 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.934546:0:1136:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990cc600/0x3139939425063c60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9b5 expref: 23 pid: 1136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.934556:0:1136:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990cc600, rc 0) 00000100:00100000:2.0:1746147218.935121:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:3078:x1830967310552192:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 842us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147218.935128:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20524 00000100:00100000:0.0:1746147218.937775:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.937912:0:1136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310552320 00000100:00100000:2.0:1746147218.937921:0:1136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310552320 00000100:00100000:2.0:1746147218.937972:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20525 00000100:00100000:2.0:1746147218.937980:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+23:2001:x1830967310552320:12345-192.168.204.25@tcp:22:lfs.0 00002000:00010000:2.0:1746147218.938196:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746147218.938200:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147218.938202:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147218.938203:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147218.938205:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00000100:00100000:2.0:1746147218.938241:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310552320:12345-192.168.204.25@tcp:22:lfs.0 Request processed in 262us (474us total) trans 21474842765 rc 0/0 00000100:00100000:2.0:1746147218.938247:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20525 00000100:00100000:0.0:1746147218.944053:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147218.944199:0:13334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310552576 00000100:00100000:1.0:1746147218.944208:0:13334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310552576 00000100:00100000:1.0:1746147218.944283:0:13334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7507 00000100:00100000:1.0:1746147218.944291:0:13334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310552576:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147218.944328:0:13334:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063c67 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.944343:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147218.944346:0:13334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147218.944350:0:13334:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063c67 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.944364:0:13334:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063c67 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147218.950762:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.951186:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.951205:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.951227:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310552832 00000100:00100000:2.0:1746147218.951236:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310552832 00000100:00100000:2.0:1746147218.951289:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310552960 00000100:00100000:2.0:1746147218.951292:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310552960 00000100:00100000:2.0:1746147218.951306:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310553472 00000100:00100000:2.0:1746147218.951308:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310553472 00000100:00100000:2.0:1746147218.951324:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7508 00000100:00100000:2.0:1746147218.951332:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310552832:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147218.951369:0:29475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425063c6e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.951385:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147218.951387:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147218.951392:0:29475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425063c6e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.951407:0:29475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425063c6e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147218.952191:0:29477:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7509 00000100:00100000:2.0:1746147218.952198:0:29477:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310552960:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147218.952217:0:29477:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425063c75 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.952225:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147218.952226:0:29477:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147218.952229:0:29477:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425063c75 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.952238:0:29477:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425063c75 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147218.952587:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7510 00000100:00100000:3.0:1746147218.952596:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967310553472:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:3.0:1746147218.952613:0:9589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88011f213800/0x3139939425063c7c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.952620:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147218.952621:0:9589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147218.952624:0:9589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011f213800/0x3139939425063c7c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.952632:0:9589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011f213800/0x3139939425063c7c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147218.952900:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147218.952922:0:13302:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310553856 00000100:00100000:2.0:1746147218.952927:0:13302:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310553856 00000100:00100000:2.0:1746147218.952964:0:13302:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7511 00000100:00100000:2.0:1746147218.952968:0:13302:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310553856:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:2.0:1746147218.952985:0:13302:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094008800/0x3139939425063c83 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.952993:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147218.952994:0:13302:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147218.952997:0:13302:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094008800/0x3139939425063c83 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.953005:0:13302:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094008800/0x3139939425063c83 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746147218.955606:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147218.957052:0:29476:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310553728 00000100:00100000:1.0:1746147218.957064:0:29476:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310553728 00000100:00100000:1.0:1746147218.957151:0:29476:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 7512 00000100:00100000:1.0:1746147218.957570:0:29476:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310553728:12345-192.168.204.25@tcp:3:lfs.0 00010000:00010000:1.0:1746147218.957613:0:29476:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009371d200/0x3139939425063c8a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.957629:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147218.957631:0:29476:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147218.957637:0:29476:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371d200/0x3139939425063c8a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.957652:0:29476:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009371d200/0x3139939425063c8a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.969719:0:13334:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063c67 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.969737:0:13334:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063c67 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.969745:0:13334:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063c67 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.969752:0:13334:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a9a0e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147218.969757:0:13334:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063c67 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.969769:0:13334:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063c67 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.969791:0:13334:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063c67 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.969797:0:13334:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x3139939425063c67 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [16384->1048575] (req 16384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13334 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147218.969914:0:13334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310552576:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 25617us (25866us total) trans 0 rc 1032192/1032192 00000100:00100000:1.0:1746147218.969926:0:13334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7507 00010000:00010000:2.0:1746147218.974015:0:29475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425063c6e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.974035:0:29475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425063c6e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.974043:0:29475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425063c6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.974056:0:29475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094008a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147218.974060:0:29475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425063c6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.974069:0:29475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425063c6e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.974112:0:29475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425063c6e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147218.974118:0:29475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094008a00/0x3139939425063c6e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147218.974198:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967310552832:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 22860us (23442us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746147218.974208:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7508 00010000:00010000:3.0:1746147218.975147:0:29477:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425063c75 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.975162:0:29477:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425063c75 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.975168:0:29477:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425063c75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.975173:0:29477:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094009000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147218.975177:0:29477:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425063c75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.975183:0:29477:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425063c75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.975196:0:29477:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425063c75 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.975202:0:29477:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094009000/0x3139939425063c75 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29477 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147218.976139:0:29477:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310552960:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 23937us (24948us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746147218.976149:0:29477:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7509 00010000:00010000:3.0:1746147218.984363:0:9589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88011f213800/0x3139939425063c7c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.984382:0:9589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88011f213800/0x3139939425063c7c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.984395:0:9589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88011f213800/0x3139939425063c7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.984403:0:9589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011f213800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746147218.984407:0:9589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88011f213800/0x3139939425063c7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.984418:0:9589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88011f213800/0x3139939425063c7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.984438:0:9589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88011f213800/0x3139939425063c7c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147218.984445:0:9589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f213800/0x3139939425063c7c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147218.984549:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310553472:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 31948us (33336us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746147218.984561:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7510 00010000:00010000:1.0:1746147218.994171:0:29476:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009371d200/0x3139939425063c8a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.994193:0:29476:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009371d200/0x3139939425063c8a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.994202:0:29476:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009371d200/0x3139939425063c8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.994209:0:29476:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009371d200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746147218.994213:0:29476:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009371d200/0x3139939425063c8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.994220:0:29476:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009371d200/0x3139939425063c8a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.994246:0:29476:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009371d200/0x3139939425063c8a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147218.994252:0:29476:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009371d200/0x3139939425063c8a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29476 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147218.994366:0:29476:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310553728:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 37201us (38762us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746147218.994377:0:29476:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7512 00010000:00010000:2.0:1746147219.003269:0:13302:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094008800/0x3139939425063c83 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147219.003288:0:13302:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094008800/0x3139939425063c83 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147219.003295:0:13302:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094008800/0x3139939425063c83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147219.003302:0:13302:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094008800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746147219.003306:0:13302:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094008800/0x3139939425063c83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147219.003315:0:13302:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094008800/0x3139939425063c83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147219.003335:0:13302:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094008800/0x3139939425063c83 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147219.003341:0:13302:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094008800/0x3139939425063c83 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13302 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147219.003449:0:13302:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2001:x1830967310553856:12345-192.168.204.25@tcp:3:lfs.0 Request processed in 50473us (50542us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746147219.003461:0:13302:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 7511 00000100:00100000:2.0:1746147219.011873:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147219.011935:0:7237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310554240 00000100:00100000:0.0:1746147219.011946:0:7237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310554240 00000100:00100000:0.0:1746147219.012027:0:7237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16559 00000100:00100000:0.0:1746147219.012036:0:7237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:3078:x1830967310554240:12345-192.168.204.25@tcp:36:lfs.0 00010000:00010000:0.0:1746147219.012104:0:7237:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1746147219.012128:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1746147219.012138:0:7237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1aeea00/0x3139939425063c28 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f97d expref: 29 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746147219.012167:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147219.012173:0:7237:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746147219.012223:0:7237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b800/0x3139939425063c91 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147219.012236:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b800/0x3139939425063c91 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147219.012244:0:7237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b800/0x3139939425063c91 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00000004:00010000:0.0:1746147219.012348:0:7237:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880095127800 reply state ffff88009f1ea000 transno 8589937470 ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b800/0x3139939425063c91 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147219.012356:0:7237:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b800/0x3139939425063c91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:0.0:1746147219.012361:0:7237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147219.012363:0:7237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746147219.012365:0:7237:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746147219.012438:0:7237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:3078:x1830967310554240:12345-192.168.204.25@tcp:36:lfs.0 Request processed in 403us (575us total) trans 8589937470 rc 0/0 00000100:00100000:0.0:1746147219.012444:0:7237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16559 00000100:00100000:3.0:1746147219.016279:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147219.016391:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310554368 00000100:00100000:1.0:1746147219.016402:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310554368 00000100:00100000:1.0:1746147219.016458:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20526 00000100:00100000:1.0:1746147219.016466:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:3078:x1830967310554368:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147219.016484:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147219.016510:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0400/0x3139939425063c98 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f9bc expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.016540:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990cc000/0x3139939425063c52 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f984 expref: 25 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147219.016547:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147219.016549:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147219.016552:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0400/0x3139939425063c98 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9bc expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.016581:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800990cc000/0x3139939425063c52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f984 expref: 25 pid: 12201 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147219.016593:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800990cc000/0x3139939425063c52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f984 expref: 25 pid: 12201 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746147219.016604:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311558784:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147219.016695:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147219.017195:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967311558912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746147219.017232:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147219.017258:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311558912 00000100:00100000:0.0:1746147219.017263:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311558912 00000100:00080000:1.0:1746147219.017346:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746147219.017378:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1746147219.017385:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3764:x1830967311558912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746147219.017399:0:9587:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490726464 pending 598016 free 3905277952 avail 3672633344 00000100:00100000:0.0:1746147219.017448:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3764:x1830967311558912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746147219.017454:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1746147219.017749:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3764:1830967311558912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1746147219.018121:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311558784:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147219.018143:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0400/0x3139939425063c98 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9bc expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.018155:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57a0400, rc 0) 00000100:00100000:1.0:1746147219.018188:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:3078:x1830967310554368:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1723us (1921us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147219.018195:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20526 00000100:00100000:0.0:1746147219.018809:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147219.018887:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310554496 00000100:00100000:1.0:1746147219.018892:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310554496 00010000:00010000:1.0:1746147219.018913:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800990cc000/0x3139939425063c52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f984 expref: 25 pid: 12201 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746147219.018995:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9294 00000100:00100000:1.0:1746147219.019001:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310554496:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746147219.019012:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746147219.019031:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800990cc000/0x3139939425063c52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f984 expref: 25 pid: 12201 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746147219.019047:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800990cc000/0x3139939425063c52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f984 expref: 25 pid: 12201 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746147219.019069:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990cc000/0x3139939425063c52 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f984 expref: 25 pid: 12201 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746147219.019110:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147219.019111:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147219.019119:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0400/0x3139939425063c98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9bc expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.019127:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0400/0x3139939425063c98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9bc expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.019150:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57a0400/0x3139939425063c98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9bc expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147219.019160:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311559040:192.168.204.25@tcp:105: 00000100:00100000:1.0:1746147219.019205:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147219.021645:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311559040:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147219.021668:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746147219.021713:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310554496:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2711us (2905us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147219.021723:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9294 00000100:00100000:0.0:1746147219.026046:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147219.027873:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310554624 00000100:00100000:1.0:1746147219.027887:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310554624 00000100:00100000:1.0:1746147219.028546:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20527 00000100:00100000:1.0:1746147219.028557:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:3078:x1830967310554624:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147219.028580:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147219.028601:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009371c400/0x3139939425063c9f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f9c3 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.028639:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958e0800/0x3139939425063c2f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f98b expref: 28 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147219.028647:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147219.028649:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147219.028652:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009371c400/0x3139939425063c9f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9c3 expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.028684:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958e0800/0x3139939425063c2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f98b expref: 28 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147219.028696:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958e0800/0x3139939425063c2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f98b expref: 28 pid: 9584 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746147219.028708:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311559168:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147219.028798:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147219.030989:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147219.031053:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310554752 00000100:00100000:2.0:1746147219.031061:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310554752 00010000:00010000:2.0:1746147219.031123:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958e0800/0x3139939425063c2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f98b expref: 29 pid: 9584 timeout: 857 lvb_type: 1 00000100:00100000:2.0:1746147219.031163:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9295 00000100:00100000:2.0:1746147219.031171:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310554752:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746147219.031184:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746147219.031344:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311559168:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147219.031375:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009371c400/0x3139939425063c9f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9c3 expref: 29 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.031396:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371c400, rc 0) 00000100:00100000:1.0:1746147219.031440:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:3078:x1830967310554624:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2885us (5405us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147219.031447:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20527 00010000:00010000:2.0:1746147219.031811:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958e0800/0x3139939425063c2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f98b expref: 29 pid: 9584 timeout: 857 lvb_type: 1 00010000:00010000:2.0:1746147219.031831:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958e0800/0x3139939425063c2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f98b expref: 28 pid: 9584 timeout: 857 lvb_type: 1 00010000:00010000:2.0:1746147219.031855:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958e0800/0x3139939425063c2f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f98b expref: 28 pid: 9584 timeout: 857 lvb_type: 1 00010000:00010000:2.0:1746147219.031872:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147219.031874:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746147219.031881:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009371c400/0x3139939425063c9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9c3 expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147219.031888:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009371c400/0x3139939425063c9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9c3 expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147219.031914:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009371c400/0x3139939425063c9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9c3 expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746147219.031924:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095127100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311559296:192.168.204.25@tcp:105: 00000100:00100000:2.0:1746147219.031987:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147219.032987:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095127100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311559296:192.168.204.25@tcp:105: 00010000:00010000:2.0:1746147219.033002:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746147219.033025:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2001:x1830967310554752:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 1855us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147219.033032:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9295 00000100:00100000:0.0:1746147219.033191:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147219.033386:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310554880 00000100:00100000:1.0:1746147219.033392:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310554880 00000100:00100000:1.0:1746147219.033428:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20528 00000100:00100000:1.0:1746147219.033434:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:3078:x1830967310554880:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147219.033447:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147219.033462:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009371ca00/0x3139939425063ca6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f9ca expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.033481:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425063c36 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f992 expref: 28 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147219.033488:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147219.033489:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147219.033492:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009371ca00/0x3139939425063ca6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9ca expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.033522:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425063c36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f992 expref: 28 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147219.033532:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425063c36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f992 expref: 28 pid: 9584 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746147219.033546:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311559424:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147219.033593:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746147219.036084:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147219.036253:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310555008 00000100:00100000:3.0:1746147219.036259:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310555008 00010000:00010000:3.0:1746147219.036392:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425063c36 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f992 expref: 29 pid: 9584 timeout: 857 lvb_type: 1 00000100:00100000:3.0:1746147219.036532:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9296 00000100:00100000:3.0:1746147219.036538:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310555008:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147219.036549:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147219.036566:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425063c36 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f992 expref: 29 pid: 9584 timeout: 857 lvb_type: 1 00010000:00010000:3.0:1746147219.036575:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425063c36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f992 expref: 29 pid: 9584 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746147219.036577:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311559424:192.168.204.25@tcp:104: 00010000:00010000:3.0:1746147219.036595:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e572a00/0x3139939425063c36 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f992 expref: 29 pid: 9584 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746147219.036605:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009371ca00/0x3139939425063ca6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9ca expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.036616:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147219.036618:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147219.036624:0:9586:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009371ca00/0x3139939425063ca6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9ca expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.036631:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009371ca00/0x3139939425063ca6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9ca expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147219.036761:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746147219.036774:0:9586:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009371ca00/0x3139939425063ca6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9ca expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746147219.036784:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311559552:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147219.036802:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310555008:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 264us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147219.036807:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9296 00000100:00100000:1.0:1746147219.036925:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147219.038716:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311559552:192.168.204.25@tcp:105: 00010000:00010000:1.0:1746147219.038734:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371ca00, rc 0) 00000100:00100000:1.0:1746147219.038786:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:3078:x1830967310554880:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 5350us (5593us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147219.038794:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20528 00000100:00100000:0.0:1746147219.042356:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147219.042517:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310555136 00000100:00100000:1.0:1746147219.042527:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310555136 00000100:00100000:1.0:1746147219.042595:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20529 00000100:00100000:1.0:1746147219.042605:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:3078:x1830967310555136:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147219.042629:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147219.042651:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x3139939425063cad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f9d1 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.042685:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063c3d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f999 expref: 25 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147219.042693:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147219.042695:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147219.042698:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x3139939425063cad lrc: 4/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9d1 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.042729:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063c3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f999 expref: 25 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147219.042740:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063c3d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f999 expref: 25 pid: 9584 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746147219.042753:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311559680:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147219.043553:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147219.044278:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311559680:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147219.044306:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x3139939425063cad lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9d1 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.044325:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371de00, rc 0) 00000100:00100000:1.0:1746147219.044360:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:3078:x1830967310555136:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 1757us (2024us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147219.044367:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20529 00000100:00100000:0.0:1746147219.044665:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147219.044720:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310555264 00000100:00100000:3.0:1746147219.044726:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310555264 00010000:00010000:3.0:1746147219.044750:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063c3d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f999 expref: 25 pid: 9584 timeout: 857 lvb_type: 1 00000100:00100000:3.0:1746147219.044772:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9297 00000100:00100000:3.0:1746147219.044778:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310555264:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147219.044788:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147219.044811:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063c3d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f999 expref: 25 pid: 9584 timeout: 857 lvb_type: 1 00010000:00010000:3.0:1746147219.044822:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063c3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f999 expref: 25 pid: 9584 timeout: 857 lvb_type: 1 00010000:00010000:3.0:1746147219.044842:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e573e00/0x3139939425063c3d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f999 expref: 25 pid: 9584 timeout: 857 lvb_type: 1 00010000:00010000:3.0:1746147219.044869:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147219.044872:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147219.044878:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x3139939425063cad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9d1 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147219.044887:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x3139939425063cad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9d1 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147219.044913:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009371de00/0x3139939425063cad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9d1 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147219.044923:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311559808:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147219.044994:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962240 going to sleep for 11 seconds 00000100:00100000:0.0:1746147219.046581:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147219.046714:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311559808:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147219.046737:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147219.046781:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310555264:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2003us (2116us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147219.046789:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9297 00000100:00100000:1.0:1746147219.046984:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310555392 00000100:00100000:1.0:1746147219.046990:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310555392 00000100:00100000:1.0:1746147219.047022:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20530 00000100:00100000:1.0:1746147219.047029:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:3078:x1830967310555392:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147219.047045:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147219.047223:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009371c600/0x3139939425063cb4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f9d8 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.047251:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425063c44 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9a0 expref: 25 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147219.047258:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147219.047260:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147219.047263:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371c600/0x3139939425063cb4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9d8 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.047288:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425063c44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9a0 expref: 25 pid: 9584 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147219.047299:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425063c44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9a0 expref: 25 pid: 9584 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746147219.047314:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311559936:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147219.047360:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746147219.049577:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9586:1830967311559936:192.168.204.25@tcp:104: 00010000:00010000:1.0:1746147219.049701:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009371c600/0x3139939425063cb4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9d8 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.049723:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371c600, rc 0) 00000100:00100000:1.0:1746147219.049784:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:3078:x1830967310555392:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2754us (3207us total) trans 0 rc 0/0 00000100:00100000:1.0:1746147219.049794:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20530 00000100:00100000:0.0:1746147219.049918:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147219.050623:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310555520 00000100:00100000:3.0:1746147219.050632:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310555520 00010000:00010000:3.0:1746147219.050666:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425063c44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9a0 expref: 25 pid: 9584 timeout: 857 lvb_type: 1 00000100:00100000:3.0:1746147219.051107:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9298 00000100:00100000:3.0:1746147219.051116:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310555520:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147219.051129:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147219.051155:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425063c44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9a0 expref: 25 pid: 9584 timeout: 857 lvb_type: 1 00010000:00010000:3.0:1746147219.051166:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425063c44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9a0 expref: 25 pid: 9584 timeout: 857 lvb_type: 1 00010000:00010000:3.0:1746147219.051191:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e573600/0x3139939425063c44 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9a0 expref: 25 pid: 9584 timeout: 857 lvb_type: 1 00010000:00010000:3.0:1746147219.051392:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147219.051394:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147219.051405:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009371c600/0x3139939425063cb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9d8 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147219.051413:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009371c600/0x3139939425063cb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9d8 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147219.051452:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009371c600/0x3139939425063cb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9d8 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147219.051470:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311560064:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147219.051966:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147219.054519:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16749:1830967311560064:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147219.054554:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147219.054609:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+24:2000:x1830967310555520:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 3493us (4690us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147219.054623:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9298 00000100:00100000:0.0:1746147219.054645:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147219.054811:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310555648 00000100:00100000:1.0:1746147219.054822:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310555648 00000100:00100000:1.0:1746147219.054869:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20531 00000100:00100000:1.0:1746147219.054876:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:3078:x1830967310555648:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:1.0:1746147219.054896:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746147219.054916:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009371d800/0x3139939425063cbb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f9df expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.054946:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063c4b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9a7 expref: 28 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147219.054953:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147219.054955:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746147219.054958:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009371d800/0x3139939425063cbb lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9df expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746147219.054993:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063c4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9a7 expref: 28 pid: 13712 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746147219.055005:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063c4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9a7 expref: 28 pid: 13712 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746147219.055105:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311560192:192.168.204.25@tcp:104: 00000100:00100000:1.0:1746147219.055181:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c1d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746147219.057367:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4397800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9586:1830967311560192:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147219.057399:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009371d800/0x3139939425063cbb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9df expref: 28 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147219.057417:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009371d800, rc 0) 00000100:00100000:2.0:1746147219.057458:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:3078:x1830967310555648:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 2582us (2814us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147219.057467:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20531 00000100:00100000:0.0:1746147219.057604:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147219.057877:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310555776 00000100:00100000:3.0:1746147219.057884:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310555776 00010000:00010000:3.0:1746147219.057912:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063c4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9a7 expref: 28 pid: 13712 timeout: 857 lvb_type: 1 00000100:00100000:3.0:1746147219.057949:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9299 00000100:00100000:3.0:1746147219.057956:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310555776:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147219.057970:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147219.057991:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063c4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9a7 expref: 28 pid: 13712 timeout: 857 lvb_type: 1 00010000:00010000:3.0:1746147219.058004:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063c4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9a7 expref: 28 pid: 13712 timeout: 857 lvb_type: 1 00010000:00010000:3.0:1746147219.058030:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f588e00/0x3139939425063c4b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9a7 expref: 28 pid: 13712 timeout: 857 lvb_type: 1 00010000:00010000:3.0:1746147219.058298:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147219.058301:0:16749:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746147219.058309:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009371d800/0x3139939425063cbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9df expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147219.058317:0:16749:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009371d800/0x3139939425063cbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9df expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147219.058352:0:16749:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009371d800/0x3139939425063cbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9df expref: 27 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147219.058364:0:16749:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311560320:192.168.204.25@tcp:105: 00000100:00100000:3.0:1746147219.058696:0:16749:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a962240 going to sleep for 11 seconds 00000100:00100000:3.0:1746147219.060131:0:16749:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16749:1830967311560320:192.168.204.25@tcp:105: 00010000:00010000:3.0:1746147219.060165:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147219.060204:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310555776:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 2248us (2600us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147219.060216:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9299 00000100:00100000:2.0:1746147219.060821:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147219.060851:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147219.060864:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147219.060896:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:1.0:1746147219.061113:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310555904 00000100:00100000:1.0:1746147219.061120:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310555904 00000100:00100000:1.0:1746147219.061153:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310556160 00000100:00100000:1.0:1746147219.061155:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310556160 00000100:00100000:1.0:1746147219.061167:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310556416 00000100:00100000:1.0:1746147219.061168:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310556416 00000100:00100000:1.0:1746147219.061198:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310556032 00000100:00100000:1.0:1746147219.061200:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310556032 00000100:00100000:1.0:1746147219.061219:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20532 00000100:00100000:1.0:1746147219.061225:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+25:2000:x1830967310555904:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:0.0:1746147219.061246:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20533 00000100:00100000:0.0:1746147219.061252:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2001:x1830967310556160:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147219.061369:0:9584:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746147219.061369:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746147219.061372:0:9584:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147217 -> 1746147217 00002000:00010000:0.0:1746147219.061372:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147216 -> 1746147217 00002000:00010000:1.0:1746147219.061374:0:9584:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147217 -> 1746147217 00002000:00010000:0.0:1746147219.061374:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147216 -> 1746147217 00002000:00010000:1.0:1746147219.061376:0:9584:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147216 -> 1746147218 00002000:00010000:0.0:1746147219.061376:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147216 -> 1746147218 00002000:00010000:1.0:1746147219.061378:0:9584:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00002000:00010000:0.0:1746147219.061378:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746147219.061403:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2001:x1830967310556160:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 152us (551us total) trans 17179875368 rc 0/0 00000100:00100000:0.0:1746147219.061409:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20533 00000100:00100000:0.0:1746147219.061422:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20534 00000100:00100000:0.0:1746147219.061426:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310556416:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:2.0:1746147219.061444:0:1136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20535 00000100:00100000:2.0:1746147219.061451:0:1136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:2000:x1830967310556032:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:0.0:1746147219.061465:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:0.0:1746147219.061467:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147217 -> 1746147217 00002000:00010000:0.0:1746147219.061470:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147217 -> 1746147217 00002000:00010000:0.0:1746147219.061472:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147217 -> 1746147218 00002000:00010000:0.0:1746147219.061474:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00002000:00010000:2.0:1746147219.061588:0:1136:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147219.061590:0:1136:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147215 -> 1746147217 00002000:00010000:2.0:1746147219.061592:0:1136:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147216 -> 1746147217 00002000:00010000:2.0:1746147219.061594:0:1136:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147216 -> 1746147218 00002000:00010000:2.0:1746147219.061595:0:1136:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746147219.062197:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310555904:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 971us (1375us total) trans 21474842766 rc 0/0 00000100:00100000:1.0:1746147219.062203:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20532 00000100:00100000:0.0:1746147219.062263:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2001:x1830967310556416:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 836us (1397us total) trans 21474842767 rc 0/0 00000100:00100000:0.0:1746147219.062268:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20534 00000100:00100000:2.0:1746147219.062275:0:1136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310556032:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 825us (1378us total) trans 17179875369 rc 0/0 00000100:00100000:2.0:1746147219.062280:0:1136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20535 00000100:00100000:3.0:1746147219.062347:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147219.062383:0:3758:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:0.0:1746147219.062395:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310556288 00000100:00100000:0.0:1746147219.062399:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310556288 00000100:00100000:0.0:1746147219.062413:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310556544 00000100:00100000:0.0:1746147219.062415:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310556544 00000100:00100000:0.0:1746147219.062425:0:17600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20536 00000100:00100000:0.0:1746147219.062430:0:17600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:2000:x1830967310556288:12345-192.168.204.25@tcp:2:lfs.0 00000100:00100000:1.0:1746147219.062519:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 20537 00000100:00100000:1.0:1746147219.062525:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+29:2000:x1830967310556544:12345-192.168.204.25@tcp:2:lfs.0 00002000:00010000:1.0:1746147219.062576:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147219.062579:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147217 -> 1746147217 00002000:00010000:1.0:1746147219.062581:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147217 -> 1746147217 00002000:00010000:1.0:1746147219.062582:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147217 -> 1746147218 00002000:00010000:1.0:1746147219.062584:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746147219.062605:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2000:x1830967310556544:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 81us (221us total) trans 17179875370 rc 0/0 00000100:00100000:1.0:1746147219.062611:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20537 00002000:00010000:0.0:1746147219.062758:0:17600:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147219.062761:0:17600:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147216 -> 1746147217 00002000:00010000:0.0:1746147219.062763:0:17600:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147216 -> 1746147217 00002000:00010000:0.0:1746147219.062765:0:17600:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147216 -> 1746147218 00002000:00010000:0.0:1746147219.062766:0:17600:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746147219.062782:0:17600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:2000:x1830967310556288:12345-192.168.204.25@tcp:2:lfs.0 Request processed in 352us (434us total) trans 21474842768 rc 0/0 00000100:00100000:0.0:1746147219.062787:0:17600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 20536 00000100:00100000:0.0:1746147219.065468:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147219.065564:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310556800 00000100:00100000:2.0:1746147219.065572:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310556800 00000100:00100000:2.0:1746147219.065824:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6206 00000100:00100000:2.0:1746147219.065832:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:3078:x1830967310556800:12345-192.168.204.25@tcp:35:lfs.0 00000004:00010000:2.0:1746147219.065902:0:7241:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x30:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425063bdb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f96f expref: 30 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147219.065962:0:7241:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094009e00/0x3139939425063cc2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7241 initiator: MDT0 00010000:00010000:2.0:1746147219.065976:0:7241:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063c1a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f976 expref: 30 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147219.065984:0:7241:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094009e00/0x3139939425063cc2 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7241 initiator: MDT0 00010000:00010000:2.0:1746147219.066019:0:7241:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063c1a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f976 expref: 30 pid: 7237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746147219.066031:0:7241:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063c1a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f976 expref: 30 pid: 7237 timeout: 857 lvb_type: 0 00000100:00100000:2.0:1746147219.066048:0:7241:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095124a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7241:1830967311560448:192.168.204.25@tcp:104: 00000100:00100000:2.0:1746147219.066837:0:7241:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a796a480 going to sleep for 11 seconds 00000100:00100000:2.0:1746147219.068531:0:7241:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095124a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7241:1830967311560448:192.168.204.25@tcp:104: 00010000:00010000:2.0:1746147219.068558:0:7241:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094009e00/0x3139939425063cc2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7241 initiator: MDT0 00000100:00100000:0.0:1746147219.068774:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147219.068907:0:16749:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310556928 00000100:00100000:3.0:1746147219.068916:0:16749:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310556928 00010000:00010000:3.0:1746147219.068956:0:16749:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063c1a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f976 expref: 31 pid: 7237 timeout: 857 lvb_type: 0 00000100:00100000:3.0:1746147219.068987:0:16749:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 9300 00000100:00100000:3.0:1746147219.068996:0:16749:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aa328050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+31:2001:x1830967310556928:12345-192.168.204.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746147219.069011:0:16749:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746147219.069016:0:16749:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063c1a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f976 expref: 31 pid: 7237 timeout: 857 lvb_type: 0 00010000:00010000:3.0:1746147219.069026:0:16749:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063c1a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f976 expref: 31 pid: 7237 timeout: 857 lvb_type: 0 00010000:00010000:3.0:1746147219.069052:0:16749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800990cda00/0x3139939425063c1a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f976 expref: 31 pid: 7237 timeout: 857 lvb_type: 0 00010000:00010000:3.0:1746147219.069132:0:16749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147219.069138:0:16749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094009e00/0x3139939425063cc2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7241 initiator: MDT0 00010000:00010000:3.0:1746147219.069149:0:16749:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094009e00/0x3139939425063cc2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7241 initiator: MDT0 00010000:00010000:3.0:1746147219.069158:0:16749:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094009e00/0x3139939425063cc2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7241 initiator: MDT0 00010000:00010000:3.0:1746147219.069185:0:16749:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746147219.069237:0:16749:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aa328050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b52e0b40-fb04-4c4c-8912-aa690ee7230d+30:2001:x1830967310556928:12345-192.168.204.25@tcp:103:ldlm_bl.0 Request processed in 241us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147219.069244:0:16749:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 9300 00010000:00010000:0.0:1746147219.069325:0:7241:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094009e00/0x3139939425063cc2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7241 initiator: MDT0 00010000:00010000:0.0:1746147219.069331:0:7241:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094009e00/0x3139939425063cc2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7241 initiator: MDT0 00000040:00080000:0.0:1746147219.069760:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1372, 88 off128600 00000004:00080000:0.0:1746147219.069773:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757059682846ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147219.069816:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1359, 88 off127456 00000004:00080000:0.0:1746147219.069821:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757059731506ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147219.069842:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1360, 88 off127544 00000004:00080000:0.0:1746147219.069845:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757059755152ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147219.069853:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1373, 88 off128688 00000004:00080000:0.0:1746147219.069855:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757059765719ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147219.069861:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1374, 88 off128776 00000004:00080000:0.0:1746147219.069864:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757059774941ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147219.069871:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1361, 88 off127632 00000004:00080000:0.0:1746147219.069874:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757059784332ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147219.069880:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1362, 88 off127720 00000004:00080000:0.0:1746147219.069882:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757059793098ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147219.069889:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1363, 88 off127808 00000004:00080000:0.0:1746147219.069891:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757059801483ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147219.069898:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1375, 88 off128864 00000004:00080000:0.0:1746147219.069900:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757059810811ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147219.069907:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1364, 88 off127896 00000004:00080000:0.0:1746147219.069909:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757059819933ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147219.069916:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1376, 88 off128952 00000004:00080000:0.0:1746147219.069918:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757059828526ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147219.069925:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1365, 88 off127984 00000004:00080000:0.0:1746147219.069927:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757059837401ns, next at 694367916532ns, rc = 0 00000040:00080000:0.0:1746147219.069933:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1377, 88 off129040 00000004:00080000:0.0:1746147219.069936:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757059846236ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147219.069942:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1378, 88 off129128 00000004:00080000:0.0:1746147219.069945:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757059855134ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147219.069951:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1379, 88 off129216 00000004:00080000:0.0:1746147219.069955:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757059865223ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147219.069962:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1380, 88 off129304 00000004:00080000:0.0:1746147219.069964:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757059874636ns, next at 694367945074ns, rc = 0 00000040:00080000:0.0:1746147219.069971:0:7241:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1366, 88 off128072 00000004:00080000:0.0:1746147219.069973:0:7241:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757059883852ns, next at 694367916532ns, rc = 0 00000001:00080000:2.0:1746147219.071549:0:8094:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937471 is committed 00000004:00080000:2.0:1746147219.071556:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1342 committed 00000004:00080000:2.0:1746147219.071567:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1359 committed 00000004:00080000:2.0:1746147219.071571:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1358 committed 00000004:00080000:2.0:1746147219.071573:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1357 committed 00000004:00080000:2.0:1746147219.071574:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1356 committed 00000004:00080000:2.0:1746147219.071576:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1341 committed 00000004:00080000:2.0:1746147219.071577:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1355 committed 00000004:00080000:2.0:1746147219.071578:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1340 committed 00000004:00080000:2.0:1746147219.071580:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1354 committed 00000004:00080000:2.0:1746147219.071582:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1339 committed 00000004:00080000:2.0:1746147219.071583:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1338 committed 00000004:00080000:2.0:1746147219.071585:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1337 committed 00000004:00080000:2.0:1746147219.071586:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1353 committed 00000004:00080000:2.0:1746147219.071588:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1352 committed 00000004:00080000:2.0:1746147219.071589:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1336 committed 00000004:00080000:2.0:1746147219.071590:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1335 committed 00000004:00080000:2.0:1746147219.071592:0:8094:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1351 committed 00000100:00100000:3.0:1746147219.071683:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311560832:0@lo:2:osp-syn-0-0.0 00000004:00010000:0.0:1746147219.071705:0:7241:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800909fb480 reply state ffff880098cab400 transno 8589937471 ns: mdt-lustre-MDT0000_UUID lock: ffff880094009e00/0x3139939425063cc2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7241 initiator: MDT0 00010000:00010000:0.0:1746147219.071720:0:7241:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094009e00/0x3139939425063cc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7241 initiator: MDT0 00010000:00010000:0.0:1746147219.071729:0:7241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147219.071732:0:7241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746147219.071737:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147219.071737:0:7241:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746147219.071744:0:7241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:0.0:1746147219.071746:0:7241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746147219.071752:0:7241:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da0d800/0x3139939425063bdb lrc: 0/0,0 mode: --/PW res: [0x200000404:0x30:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f96f expref: 28 pid: 9138 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746147219.071764:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311561216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147219.071777:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147219.071790:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311561856:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147219.071806:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147219.071816:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311562368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147219.071828:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1746147219.071833:0:7241:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746147219.071844:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800909fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:3078:x1830967310556800:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 6012us (6385us total) trans 8589937471 rc 0/0 00000100:00100000:3.0:1746147219.071845:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1746147219.071849:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311560704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147219.071854:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6206 00000100:00100000:3.0:1746147219.071861:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746147219.071870:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311561344:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746147219.071878:0:3750:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880094009e00/0x3139939425063cc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7241 initiator: MDT0 00000100:00100000:3.0:1746147219.071882:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746147219.071886:0:3750:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094009e00/0x3139939425063cc2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7241 initiator: MDT0 00000100:00100000:3.0:1746147219.071891:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311561728:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746147219.071894:0:3750:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094009e00/0x3139939425063cc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7241 initiator: MDT0 00010000:00010000:0.0:1746147219.071904:0:3750:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094009e00 already unused, calling callback (ffffffffa0efd690) 00000100:00100000:3.0:1746147219.071906:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746147219.071909:0:3750:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094009e00/0x3139939425063cc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7241 initiator: MDT0 00000100:00100000:3.0:1746147219.071913:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311562240:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746147219.071917:0:3750:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094009e00/0x3139939425063cc2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7241 initiator: MDT0 00010000:00010000:0.0:1746147219.071925:0:3750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00000100:00100000:3.0:1746147219.071927:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746147219.071927:0:3750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746147219.071930:0:3750:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094009e00/0x3139939425063cc2 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7241 initiator: MDT0 00010000:00010000:0.0:1746147219.071935:0:3750:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094009e00/0x3139939425063cc2 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7241 initiator: MDT0 00000100:00100000:3.0:1746147219.071947:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311560832 00000100:00100000:0.0:1746147219.071950:0:17600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311561216 00000100:00100000:3.0:1746147219.071953:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311560832 00000100:00100000:0.0:1746147219.071953:0:17600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311561216 00000100:00100000:3.0:1746147219.071976:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311561856 00000100:00100000:3.0:1746147219.071978:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311561856 00010000:00010000:1.0:1746147219.072010:0:3751:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b800/0x3139939425063c91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147219.072018:0:3751:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b800/0x3139939425063c91 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147219.072023:0:3751:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b800/0x3139939425063c91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147219.072027:0:3751:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009400b800 already unused, calling callback (ffffffffa0efd690) 00010000:00010000:1.0:1746147219.072030:0:3751:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b800/0x3139939425063c91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147219.072033:0:3751:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b800/0x3139939425063c91 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147219.072040:0:3751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:1.0:1746147219.072041:0:3751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746147219.072043:0:3751:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b800/0x3139939425063c91 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00010000:00010000:1.0:1746147219.072051:0:3751:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009400b800/0x3139939425063c91 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7237 initiator: MDT0 00000100:00100000:1.0:1746147219.072070:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311560576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147219.072108:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147219.072147:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800909f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311560960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147219.072640:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311561088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147219.072656:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746147219.072669:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311562368 00000100:00100000:0.0:1746147219.072672:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311562368 00000100:00100000:0.0:1746147219.072690:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311560704 00000100:00100000:0.0:1746147219.072692:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311560704 00000100:00100000:0.0:1746147219.072699:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311561344 00000100:00100000:0.0:1746147219.072701:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311561344 00000100:00100000:0.0:1746147219.072707:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311561728 00000100:00100000:0.0:1746147219.072709:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311561728 00000100:00100000:0.0:1746147219.072716:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20538 00000100:00100000:0.0:1746147219.072722:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3767:x1830967311560832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746147219.072837:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:2.0:1746147219.072839:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311562240 00002000:00010000:0.0:1746147219.072840:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746147217 -> 1746147217 00000100:00100000:2.0:1746147219.072842:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311562240 00002000:00010000:0.0:1746147219.072842:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 1746147217 -> 1746147217 00002000:00010000:0.0:1746147219.072844:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746147218 -> 1746147218 00002000:00010000:0.0:1746147219.072847:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 2024 -> 2024 00000100:00100000:2.0:1746147219.072856:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311560576 00000100:00100000:2.0:1746147219.072858:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311560576 00000100:00100000:2.0:1746147219.072866:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20539 00000100:00100000:2.0:1746147219.072871:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3767:x1830967311561216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147219.072873:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3767:x1830967311560832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 151us (1136us total) trans 21474842769 rc 0/0 00000100:00100000:0.0:1746147219.072879:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20538 00000100:00100000:0.0:1746147219.072904:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20540 00000100:00100000:0.0:1746147219.072908:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3767:x1830967311561856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746147219.072915:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4886560 -> 4886560 00002000:00010000:2.0:1746147219.072917:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746147217 -> 1746147217 00002000:00010000:2.0:1746147219.072919:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746147217 -> 1746147217 00002000:00010000:2.0:1746147219.072920:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746147218 -> 1746147218 00002000:00010000:2.0:1746147219.072922:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 5464 -> 5464 00000100:00100000:2.0:1746147219.072943:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3767:x1830967311561216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (1165us total) trans 21474842770 rc 0/0 00000100:00100000:2.0:1746147219.072948:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20539 00000100:00100000:2.0:1746147219.072959:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20541 00000100:00100000:2.0:1746147219.072964:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800975a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3767:x1830967311562368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147219.072985:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3767:x1830967311561856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (1178us total) trans 17179875371 rc 0/0 00000100:00100000:0.0:1746147219.072990:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20540 00000100:00100000:0.0:1746147219.073000:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20542 00000100:00100000:0.0:1746147219.073004:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3767:x1830967311560704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147219.073009:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800975a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3767:x1830967311562368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (1180us total) trans 17179875372 rc 0/0 00000100:00100000:2.0:1746147219.073014:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20541 00000100:00100000:2.0:1746147219.073021:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20543 00000100:00100000:2.0:1746147219.073024:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800769dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:3767:x1830967311561344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746147219.073044:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147219.073046:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb mtime from disk: 1746147217 -> 1746147217 00002000:00010000:0.0:1746147219.073048:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb atime from disk: 1746147217 -> 1746147217 00002000:00010000:0.0:1746147219.073050:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb ctime from disk: 1746147218 -> 1746147218 00002000:00010000:2.0:1746147219.073052:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147219.073052:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x97:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:2.0:1746147219.073054:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147219.073056:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746147219.073058:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:2.0:1746147219.073060:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x95:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:2.0:1746147219.073073:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3767:x1830967311561344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (1189us total) trans 17179875374 rc 0/0 00000100:00100000:0.0:1746147219.073073:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800769d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3767:x1830967311560704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (1210us total) trans 17179875373 rc 0/0 00000100:00100000:0.0:1746147219.073078:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20542 00000100:00100000:3.0:1746147219.073108:0:13712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311561088 00000100:00100000:3.0:1746147219.073111:0:13712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311561088 00000100:00100000:1.0:1746147219.073116:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311561600:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147219.073135:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147219.073142:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311562112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147219.073155:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746147219.073174:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311561600 00000100:00100000:1.0:1746147219.073177:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311561600 00000100:00100000:0.0:1746147219.073635:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311562112 00000100:00100000:0.0:1746147219.073639:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311562112 00000100:00100000:2.0:1746147219.073830:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20543 00000100:00100000:2.0:1746147219.073842:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20544 00000100:00100000:2.0:1746147219.073848:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c4c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:3767:x1830967311561728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746147219.073864:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20545 00000100:00100000:3.0:1746147219.073872:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+17:3767:x1830967311562240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147219.073877:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20546 00000100:00100000:0.0:1746147219.073881:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3765:x1830967311560576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746147219.073931:0:13712:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746147219.073931:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746147219.073933:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb mtime from disk: 1746147217 -> 1746147217 00002000:00010000:3.0:1746147219.073934:0:13712:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147219.073935:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb atime from disk: 1746147217 -> 1746147217 00002000:00010000:3.0:1746147219.073936:0:13712:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746147219.073937:0:13712:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746147180 -> 1746147180 00002000:00010000:0.0:1746147219.073938:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb ctime from disk: 1746147218 -> 1746147218 00002000:00010000:3.0:1746147219.073939:0:13712:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 8136 -> 8136 00002000:00010000:0.0:1746147219.073939:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x96:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746147219.073966:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+18:3767:x1830967311562240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (2037us total) trans 21474842771 rc 0/0 00000100:00100000:0.0:1746147219.073967:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3765:x1830967311560576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (1858us total) trans 17179875375 rc 0/0 00000100:00100000:3.0:1746147219.073971:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20545 00000100:00100000:0.0:1746147219.073974:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20546 00000100:00100000:0.0:1746147219.073980:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20547 00000100:00100000:3.0:1746147219.073983:0:13712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20548 00000100:00100000:0.0:1746147219.073984:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3765:x1830967311561088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147219.073986:0:13712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+20:3765:x1830967311561600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147219.074021:0:10340:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20549 00000100:00100000:0.0:1746147219.074026:0:10340:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3765:x1830967311562112:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147219.074077:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5576300/2, rc 0, transno 17179875375 00000100:00100000:2.0:1746147219.074078:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c4c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3767:x1830967311561728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 231us (2171us total) trans 21474842772 rc 0/0 00000100:00100000:2.0:1746147219.074083:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20544 00000100:00100000:1.0:1746147219.074083:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311560576:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746147219.074311:0:13712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+22:3765:x1830967311561600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 324us (1175us total) trans 17179875376 rc 0/0 00000100:00100000:3.0:1746147219.074317:0:13712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20548 00000004:00080000:3.0:1746147219.074340:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5577480/2, rc 0, transno 17179875373 00000100:00100000:0.0:1746147219.074341:0:10340:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3765:x1830967311562112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 315us (1185us total) trans 17179875378 rc 0/0 00000100:00100000:3.0:1746147219.074343:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311560704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746147219.074346:0:10340:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20549 00000004:00080000:3.0:1746147219.074351:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5576a00/2, rc 0, transno 17179875374 00000100:00100000:3.0:1746147219.074353:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311561344:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147219.074362:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbc0700/2, rc 0, transno 21474842772 00000100:00100000:3.0:1746147219.074376:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311561728:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147219.074382:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bab6300/2, rc 0, transno 21474842771 00000100:00100000:3.0:1746147219.074385:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311562240:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147219.074391:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909fbb80/2, rc 0, transno 21474842769 00000100:00100000:3.0:1746147219.074393:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311560832:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147219.074400:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbc0e00/2, rc 0, transno 21474842770 00000100:00100000:3.0:1746147219.074402:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311561216:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746147219.074409:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5577100/2, rc 0, transno 17179875371 00000100:00100000:3.0:1746147219.074411:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311561856:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746147219.074416:0:3767:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ed180/2, rc 0, transno 17179875372 00000100:00100000:3.0:1746147219.074418:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3767:1830967311562368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746147219.074489:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311562624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147219.074517:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746147219.074534:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5575180/2, rc 0, transno 17179875376 00000100:00100000:1.0:1746147219.074537:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311561600:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746147219.074542:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312ec380/2, rc 0, transno 17179875378 00000100:00100000:1.0:1746147219.074544:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311562112:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746147219.074573:0:1398:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746147219.074575:0:1398:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb mtime from disk: 1746147217 -> 1746147217 00002000:00010000:1.0:1746147219.074577:0:1398:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb atime from disk: 1746147217 -> 1746147217 00002000:00010000:1.0:1746147219.074580:0:1398:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb ctime from disk: 1746147218 -> 1746147218 00002000:00010000:1.0:1746147219.074581:0:1398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x98:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746147219.074609:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3765:x1830967311561088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 624us (1952us total) trans 17179875377 rc 0/0 00000100:00100000:1.0:1746147219.074613:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20547 00000100:00100000:1.0:1746147219.074623:0:1398:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311562624 00000100:00100000:1.0:1746147219.074625:0:1398:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311562624 00000100:00100000:1.0:1746147219.074638:0:1398:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20550 00000100:00100000:1.0:1746147219.074641:0:1398:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3765:x1830967311562624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746147219.074693:0:1398:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3765:x1830967311562624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (175us total) trans 21474842773 rc 0/0 00000100:00100000:1.0:1746147219.074698:0:1398:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20550 00000004:00080000:0.0:1746147219.074754:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bab7800/2, rc 0, transno 21474842773 00000100:00100000:0.0:1746147219.074758:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311562624:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746147219.074765:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5574a80/2, rc 0, transno 17179875377 00000100:00100000:0.0:1746147219.074767:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3765:1830967311561088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746147219.075306:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147219.075326:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311561472:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147219.075341:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147219.075352:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311561984:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147219.075364:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147219.075374:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311562496:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147219.075388:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147219.075406:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311560960 00000100:00100000:2.0:1746147219.075409:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311560960 00000100:00100000:2.0:1746147219.075424:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311561472 00000100:00100000:2.0:1746147219.075426:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311561472 00000100:00100000:2.0:1746147219.075433:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311561984 00000100:00100000:2.0:1746147219.075435:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311561984 00000100:00100000:2.0:1746147219.075443:0:13695:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311562496 00000100:00100000:2.0:1746147219.075445:0:13695:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311562496 00000100:00100000:2.0:1746147219.075454:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20551 00000100:00100000:2.0:1746147219.075459:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3764:x1830967311560960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746147219.075514:0:13695:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746147219.075516:0:13695:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746147217 -> 1746147217 00002000:00010000:2.0:1746147219.075518:0:13695:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746147217 -> 1746147217 00002000:00010000:2.0:1746147219.075520:0:13695:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746147218 -> 1746147218 00002000:00010000:2.0:1746147219.075522:0:13695:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746147219.075544:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3764:x1830967311560960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (238us total) trans 21474842774 rc 0/0 00000100:00100000:2.0:1746147219.075549:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20551 00000100:00100000:2.0:1746147219.075558:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20552 00000100:00100000:0.0:1746147219.075561:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20553 00000100:00100000:2.0:1746147219.075562:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3764:x1830967311561472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147219.075566:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3764:x1830967311561984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147219.075610:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:3764:x1830967311561472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (267us total) trans 21474842775 rc 0/0 00000100:00100000:0.0:1746147219.075614:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3764:x1830967311561984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (250us total) trans 21474842776 rc 0/0 00000100:00100000:2.0:1746147219.075615:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20552 00000100:00100000:0.0:1746147219.075619:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20553 00000100:00100000:2.0:1746147219.075622:0:13695:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20554 00000100:00100000:2.0:1746147219.075626:0:13695:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3764:x1830967311562496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746147219.076125:0:13695:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3764:x1830967311562496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 497us (735us total) trans 21474842777 rc 0/0 00000100:00100000:2.0:1746147219.076131:0:13695:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20554 00000004:00080000:2.0:1746147219.076156:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800909f8380/2, rc 0, transno 21474842774 00000100:00100000:2.0:1746147219.076160:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800909f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311560960:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147219.076166:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbc2680/2, rc 0, transno 21474842775 00000100:00100000:2.0:1746147219.076169:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311561472:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147219.076174:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbc1880/2, rc 0, transno 21474842776 00000100:00100000:2.0:1746147219.076177:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311561984:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746147219.076196:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bab6680/2, rc 0, transno 21474842777 00000100:00100000:2.0:1746147219.076199:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3764:1830967311562496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746147219.076342:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:3.0:1746147219.076381:0:9138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310557056 00000100:00100000:3.0:1746147219.076385:0:9138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310557056 00000100:00100000:3.0:1746147219.076432:0:9138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 16560 00000100:00100000:3.0:1746147219.076438:0:9138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+26:3078:x1830967310557056:12345-192.168.204.25@tcp:101:lfs.0 00010000:00010000:3.0:1746147219.076455:0:9138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746147219.076474:0:9138:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4c00/0x3139939425063cc9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd1162dc568e7f9e6 expref: -99 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147219.076537:0:9138:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4c00/0x3139939425063cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9e6 expref: 27 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147219.076552:0:9138:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9b4c00/0x3139939425063cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.25@tcp remote: 0xd1162dc568e7f9e6 expref: 27 pid: 9138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746147219.076565:0:9138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x30:0x0].0x0 (ffff880098006f00) 00010000:00010000:3.0:1746147219.076568:0:9138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746147219.076571:0:9138:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9b4c00, rc 0) 00000100:00100000:3.0:1746147219.076612:0:9138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:3078:x1830967310557056:12345-192.168.204.25@tcp:101:lfs.0 Request processed in 174us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1746147219.076617:0:9138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 16560 00000100:00100000:0.0:1746147219.078021:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.25@tcp (source: 12345-192.168.204.25@tcp) 00000100:00100000:2.0:1746147219.078151:0:7241:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967310557312 00000100:00100000:2.0:1746147219.078156:0:7241:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967310557312 00000100:00100000:2.0:1746147219.078200:0:7241:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.25@tcp, seq: 6207 00000100:00100000:2.0:1746147219.078208:0:7241:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bab5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+27:3078:x1830967310557312:12345-192.168.204.25@tcp:35:lfs.0 00000100:00100000:2.0:1746147219.078461:0:7241:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bab5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b52e0b40-fb04-4c4c-8912-aa690ee7230d+28:3078:x1830967310557312:12345-192.168.204.25@tcp:35:lfs.0 Request processed in 253us (443us total) trans 8589937472 rc 0/0 00000100:00100000:2.0:1746147219.078467:0:7241:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.25@tcp, seq: 6207 00000001:02000400:1.0:1746147219.820523:0:13768:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200b: @@@@@@ FAIL: final resync failed 00010000:00010000:0.0:1746147219.829236:0:10927:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746147220.473371:0:3767:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746147220.473395:0:3767:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311562752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1746147220.473466:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746147220.473659:0:12153:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830967311562752 00000100:00100000:2.0:1746147220.473668:0:12153:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830967311562752 00000100:00100000:2.0:1746147220.473718:0:12153:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1746147220.473726:0:12153:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311562752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1746147220.473758:0:12153:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490128448 pending 0 free 3911233536 avail 3679711232 00000100:00100000:2.0:1746147220.473798:0:12153:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3767:x1830967311562752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1746147220.473803:0:12153:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:3.0:1746147220.474199:0:3767:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3767:1830967311562752:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1746147220.474299:0:7235:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 Debug log: 70651 lines, 70651 kept, 0 dropped, 0 bad.